Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve retry mechanism for IPsec certificate signing requests #2527

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

pperiyasamy
Copy link
Member

When CSR is not signed within a minute, ipsec pod is crashlooping and keeps creating CSR at a minute interval until it succeeds. This is not a scalable solution on 500 node setup because signer takes a while to sign the CSR. Hence this commit implements a linear backoff mechanism with initial delay of 5 minutes and maximum of 3 attempts. So this would avoid storming API server with lots of CSR requests.

@openshift-ci openshift-ci bot requested review from danwinship and jcaamano October 10, 2024 08:57
@pperiyasamy pperiyasamy force-pushed the ipsec-csr-improve-retry branch from 3a65910 to 2c82759 Compare October 10, 2024 09:48
@pperiyasamy
Copy link
Member Author

/retest

@pperiyasamy
Copy link
Member Author

/assign @trozet @yuvalk @tssurya @jcaamano

When CSR is not signed within a minute, ipsec pod is crashlooping and keeps
creating CSR at a minute interval until it succeeds. This is not a scalable
solution on 500 node setup because signer takes a while to sign the CSR.
Hence this commit implements a linear backoff mechanism with initial delay of
5 minutes and maximum of 3 attempts. So this would avoid storming API server
with lots of CSR requests.

Signed-off-by: Periyasamy Palanisamy <pepalani@redhat.com>
@pperiyasamy pperiyasamy force-pushed the ipsec-csr-improve-retry branch from 2c82759 to ea934aa Compare November 28, 2024 18:09
Copy link
Contributor

openshift-ci bot commented Nov 28, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: pperiyasamy
Once this PR has been reviewed and has the lgtm label, please ask for approval from jcaamano. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Copy link
Contributor

openshift-ci bot commented Nov 28, 2024

@pperiyasamy: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/security ea934aa link false /test security
ci/prow/e2e-ovn-ipsec-step-registry ea934aa link false /test e2e-ovn-ipsec-step-registry
ci/prow/e2e-network-mtu-migration-ovn-ipv6 ea934aa link false /test e2e-network-mtu-migration-ovn-ipv6
ci/prow/e2e-metal-ipi-ovn-ipv6-ipsec ea934aa link false /test e2e-metal-ipi-ovn-ipv6-ipsec
ci/prow/e2e-azure-ovn ea934aa link false /test e2e-azure-ovn
ci/prow/e2e-metal-ipi-ovn-ipv6 ea934aa link true /test e2e-metal-ipi-ovn-ipv6
ci/prow/e2e-gcp-ovn-upgrade ea934aa link true /test e2e-gcp-ovn-upgrade
ci/prow/e2e-aws-hypershift-ovn-kubevirt ea934aa link false /test e2e-aws-hypershift-ovn-kubevirt
ci/prow/e2e-openstack-ovn ea934aa link false /test e2e-openstack-ovn
ci/prow/e2e-azure-ovn-upgrade ea934aa link true /test e2e-azure-ovn-upgrade
ci/prow/e2e-aws-ovn-single-node ea934aa link false /test e2e-aws-ovn-single-node
ci/prow/e2e-gcp-ovn-techpreview ea934aa link true /test e2e-gcp-ovn-techpreview
ci/prow/e2e-aws-ovn-windows ea934aa link true /test e2e-aws-ovn-windows
ci/prow/e2e-aws-ovn-upgrade ea934aa link true /test e2e-aws-ovn-upgrade
ci/prow/4.18-upgrade-from-stable-4.17-e2e-aws-ovn-upgrade ea934aa link false /test 4.18-upgrade-from-stable-4.17-e2e-aws-ovn-upgrade
ci/prow/e2e-vsphere-ovn-dualstack-primaryv6 ea934aa link false /test e2e-vsphere-ovn-dualstack-primaryv6
ci/prow/4.18-upgrade-from-stable-4.17-e2e-azure-ovn-upgrade ea934aa link false /test 4.18-upgrade-from-stable-4.17-e2e-azure-ovn-upgrade
ci/prow/e2e-aws-ovn-serial ea934aa link false /test e2e-aws-ovn-serial
ci/prow/e2e-network-mtu-migration-ovn-ipv4 ea934aa link false /test e2e-network-mtu-migration-ovn-ipv4

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants