Unable to setup jenkins operator in Kubernetes 1.19 EKs

Hi Team,

I am trying to setup Jenkins on Kubernetes.

It works with the helm chart but we prefer the operator approach. The operator is not able to spawn the Jenkins pod.

Errors & details as below.

❯ helm repo list 
NAME      URL                                                                         
jenkins   https://charts.jenkins.io


❯ helm search repo jenkins
NAME                        CHART VERSION APP VERSION DESCRIPTION                                       
jenkins/jenkins             4.1.17        2.346.3     Jenkins - Build great things at any scale! The ...
jenkinsci/jenkins-operator  0.6.2         0.7.1       Kubernetes native operator which fully manages ...
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:03.096Z  DEBUG controller-jenkins  Reconciling Jenkins {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:03.104Z  DEBUG controller-jenkins  Operator credentials secret is present  {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:03.144Z  DEBUG controller-jenkins  Scripts config map is present {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:03.169Z  DEBUG controller-jenkins  Init configuration config map is present  {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:03.209Z  DEBUG controller-jenkins  Base configuration config map is present  {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:03.209Z  DEBUG controller-jenkins  GroovyScripts Secret and ConfigMap added watched labels {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:03.209Z  DEBUG controller-jenkins  ConfigurationAsCode Secret and ConfigMap added watched labels {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:03.209Z  DEBUG controller-jenkins  createServiceAccount with annotations map[] {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:03.372Z  DEBUG controller-jenkins  Service account, role and role binding are present  {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:03.373Z  DEBUG controller-jenkins  Extra role bindings are present {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:03.383Z  DEBUG controller-jenkins  Jenkins HTTP Service is present {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:03.394Z  DEBUG controller-jenkins  Jenkins slave Service is present  {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:03.394Z  DEBUG controller-jenkins  Kubernetes resources are present  {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:03.394Z  DEBUG controller-jenkins  Jenkins master pod is present {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:03.394Z  DEBUG controller-jenkins  Jenkins master pod is terminating {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:08.395Z  DEBUG controller-jenkins  Reconciling Jenkins {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:08.395Z  DEBUG controller-jenkins  Operator credentials secret is present  {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:08.418Z  DEBUG controller-jenkins  Scripts config map is present {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:08.434Z  DEBUG controller-jenkins  Init configuration config map is present  {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:08.461Z  DEBUG controller-jenkins  Base configuration config map is present  {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:08.461Z  DEBUG controller-jenkins  GroovyScripts Secret and ConfigMap added watched labels {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:08.461Z  DEBUG controller-jenkins  ConfigurationAsCode Secret and ConfigMap added watched labels {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:08.461Z  DEBUG controller-jenkins  createServiceAccount with annotations map[] {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:08.607Z  DEBUG controller-jenkins  Service account, role and role binding are present  {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:08.607Z  DEBUG controller-jenkins  Extra role bindings are present {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:08.624Z  DEBUG controller-jenkins  Jenkins HTTP Service is present {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:08.636Z  DEBUG controller-jenkins  Jenkins slave Service is present  {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:08.636Z  DEBUG controller-jenkins  Kubernetes resources are present  {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:08.636Z  DEBUG controller-jenkins  Jenkins master pod is present {"cr": "jenkins"}
jenkins-jenkins-operator-6fb5db4c7-llv6h jenkins-operator 2022-09-02T11:30:08.636Z  DEBUG controller-jenkins  Jenkins master pod is terminating {"cr": "jenkins"}

Jenkins Master container logs.

jenkins-jenkins jenkins-master + echo 'Installing plugins required by Operator - end'
jenkins-jenkins jenkins-master Installing plugins required by Operator - end
jenkins-jenkins jenkins-master + echo 'Installing plugins required by user - begin'
jenkins-jenkins jenkins-master Installing plugins required by user - begin
jenkins-jenkins jenkins-master WARN: install-plugins.sh is deprecated, please switch to jenkins-plugin-cli
jenkins-jenkins jenkins-master + cat
jenkins-jenkins jenkins-master + [[ -z '' ]]
jenkins-jenkins jenkins-master + install-plugins.sh
jenkins-jenkins jenkins-master Creating initial locks...
jenkins-jenkins jenkins-master Analyzing war /usr/share/jenkins/jenkins.war...
jenkins-jenkins jenkins-master Registering preinstalled plugins...
jenkins-jenkins jenkins-master Using version-specific update center: https://updates.jenkins.io/dynamic-2.319/...
jenkins-jenkins jenkins-master Downloading plugins...
jenkins-jenkins jenkins-master 
jenkins-jenkins jenkins-master WAR bundled plugins:
jenkins-jenkins jenkins-master 
jenkins-jenkins jenkins-master 
jenkins-jenkins jenkins-master Installed plugins:
jenkins-jenkins jenkins-master ace-editor:1.1
jenkins-jenkins jenkins-master apache-httpcomponents-client-4-api:4.5.13-1.0
jenkins-jenkins jenkins-master authentication-tokens:1.4
jenkins-jenkins jenkins-master bootstrap5-api:5.1.3-6
jenkins-jenkins jenkins-master bouncycastle-api:2.25
jenkins-jenkins jenkins-master branch-api:2.1046.v0ca_37783ecc5
jenkins-jenkins jenkins-master caffeine-api:2.9.3-65.v6a_47d0f4d1fe
jenkins-jenkins jenkins-master checks-api:1.7.4
jenkins-jenkins jenkins-master cloudbees-folder:6.722.v8165b_a_cf25e9
jenkins-jenkins jenkins-master configuration-as-code:1346.ve8cfa_3473c94
jenkins-jenkins jenkins-master credentials-binding:1.27.1
jenkins-jenkins jenkins-master credentials:1074.1076.v39c30cecb_0e2
jenkins-jenkins jenkins-master display-url-api:2.3.5
jenkins-jenkins jenkins-master durable-task:500.v8927d9fd99d8
jenkins-jenkins jenkins-master echarts-api:5.3.2-1
jenkins-jenkins jenkins-master font-awesome-api:6.0.0-1
jenkins-jenkins jenkins-master git-client:3.11.2
jenkins-jenkins jenkins-master git-server:1.11
jenkins-jenkins jenkins-master git:4.11.3
jenkins-jenkins jenkins-master handlebars:3.0.8
jenkins-jenkins jenkins-master jackson2-api:2.13.3-285.vc03c0256d517
jenkins-jenkins jenkins-master javax-activation-api:1.2.0-3
jenkins-jenkins jenkins-master javax-mail-api:1.6.2-6
jenkins-jenkins jenkins-master jaxb:2.3.6-1
jenkins-jenkins jenkins-master job-dsl:1.78.1
jenkins-jenkins jenkins-master jquery3-api:3.6.0-3
jenkins-jenkins jenkins-master jsch:0.1.55.2
jenkins-jenkins jenkins-master junit:1.54.3
jenkins-jenkins jenkins-master kubernetes-client-api:5.12.2-193.v26a_6078f65a_9
jenkins-jenkins jenkins-master kubernetes-credentials-provider:0.20
jenkins-jenkins jenkins-master kubernetes-credentials:0.9.0
jenkins-jenkins jenkins-master kubernetes:1.31.3
jenkins-jenkins jenkins-master lockable-resources:2.16
jenkins-jenkins jenkins-master mailer:414.vcc4c33714601
jenkins-jenkins jenkins-master matrix-project:772.v494f19991984
jenkins-jenkins jenkins-master metrics:4.0.2.8.1
jenkins-jenkins jenkins-master mina-sshd-api-common:2.8.0-30.vf9df64641cb_d
jenkins-jenkins jenkins-master mina-sshd-api-core:2.8.0-30.vf9df64641cb_d
jenkins-jenkins jenkins-master momentjs:1.1.1
jenkins-jenkins jenkins-master pipeline-build-step:2.18
jenkins-jenkins jenkins-master pipeline-graph-analysis:195.v5812d95a_a_2f9
jenkins-jenkins jenkins-master pipeline-groovy-lib:612.v84da_9c54906d
jenkins-jenkins jenkins-master pipeline-input-step:449.v77f0e8b_845c4
jenkins-jenkins jenkins-master pipeline-milestone-step:101.vd572fef9d926
jenkins-jenkins jenkins-master pipeline-model-api:1.9.3
jenkins-jenkins jenkins-master pipeline-model-definition:1.9.3
jenkins-jenkins jenkins-master pipeline-model-extensions:1.9.3
jenkins-jenkins jenkins-master pipeline-rest-api:2.24
jenkins-jenkins jenkins-master pipeline-stage-step:293.v200037eefcd5
jenkins-jenkins jenkins-master pipeline-stage-tags-metadata:1.9.3
jenkins-jenkins jenkins-master pipeline-stage-view:2.24
jenkins-jenkins jenkins-master plain-credentials:1.8
jenkins-jenkins jenkins-master plugin-util-api:2.16.0
jenkins-jenkins jenkins-master popper2-api:2.11.5-1
jenkins-jenkins jenkins-master scm-api:608.vfa_f971c5a_a_e9
jenkins-jenkins jenkins-master script-security:1138.v8e727069a_025
jenkins-jenkins jenkins-master snakeyaml-api:1.31-84.ve43da_fb_49d0b
jenkins-jenkins jenkins-master ssh-credentials:277.v95c2fec1c047
jenkins-jenkins jenkins-master sshd:3.242.va_db_9da_b_26a_c3
jenkins-jenkins jenkins-master structs:324.va_f5d6774f3a_d
jenkins-jenkins jenkins-master trilead-api:1.67.vc3938a_35172f
jenkins-jenkins jenkins-master variant:1.4
jenkins-jenkins jenkins-master workflow-aggregator:2.6
jenkins-jenkins jenkins-master workflow-api:1153.vb_912c0e47fb_a_
jenkins-jenkins jenkins-master workflow-basic-steps:2.24
jenkins-jenkins jenkins-master workflow-cps-global-lib:588.v576c103a_ff86
jenkins-jenkins jenkins-master workflow-cps:2660.2664.v4c114e93f4c1
jenkins-jenkins jenkins-master workflow-durable-task-step:1139.v252a_e12e8463
jenkins-jenkins jenkins-master workflow-job:1145.v7f2433caa07f
jenkins-jenkins jenkins-master workflow-multibranch:716.vc692a_e52371b_
jenkins-jenkins jenkins-master workflow-scm-step:400.v6b_89a_1317c9a_
jenkins-jenkins jenkins-master workflow-step-api:639.v6eca_cd8c04a_a_
jenkins-jenkins jenkins-master + echo 'Installing plugins required by user - end'
jenkins-jenkins jenkins-master workflow-support:813.vb_d7c3d2984a_0
jenkins-jenkins jenkins-master Cleaning up locks
jenkins-jenkins jenkins-master Installing plugins required by user - end
jenkins-jenkins jenkins-master Running from: /usr/share/jenkins/jenkins.war
jenkins-jenkins jenkins-master webroot: EnvVars.masterEnvVars.get("JENKINS_HOME")
jenkins-jenkins jenkins-master 2022-09-05 11:20:14.005+0000 [id=1]	INFO	org.eclipse.jetty.util.log.Log#initialized: Logging initialized @1573ms to org.eclipse.jetty.util.log.JavaUtilLog
jenkins-jenkins jenkins-master 2022-09-05 11:20:14.166+0000 [id=1]	INFO	winstone.Logger#logInternal: Beginning extraction from war file
jenkins-jenkins jenkins-master 2022-09-05 11:20:15.594+0000 [id=1]	WARNING	o.e.j.s.handler.ContextHandler#setContextPath: Empty contextPath
jenkins-jenkins jenkins-master 2022-09-05 11:20:15.721+0000 [id=1]	INFO	org.eclipse.jetty.server.Server#doStart: jetty-9.4.43.v20210629; built: 2021-06-30T11:07:22.254Z; git: 526006ecfa3af7f1a27ef3a288e2bef7ea9dd7e8; jvm 11.0.14+9
jenkins-jenkins jenkins-master 2022-09-05 11:20:16.363+0000 [id=1]	INFO	o.e.j.w.StandardDescriptorProcessor#visitServlet: NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet
jenkins-jenkins jenkins-master 2022-09-05 11:20:16.535+0000 [id=1]	INFO	o.e.j.s.s.DefaultSessionIdManager#doStart: DefaultSessionIdManager workerName=node0
jenkins-jenkins jenkins-master 2022-09-05 11:20:16.535+0000 [id=1]	INFO	o.e.j.s.s.DefaultSessionIdManager#doStart: No SessionScavenger set, using defaults
jenkins-jenkins jenkins-master 2022-09-05 11:20:16.537+0000 [id=1]	INFO	o.e.j.server.session.HouseKeeper#startScavenging: node0 Scavenging every 660000ms
jenkins-jenkins jenkins-master 2022-09-05 11:20:17.779+0000 [id=1]	INFO	hudson.WebAppMain#contextInitialized: Jenkins home directory: /var/lib/jenkins found at: EnvVars.masterEnvVars.get("JENKINS_HOME")
jenkins-jenkins jenkins-master 2022-09-05 11:20:18.166+0000 [id=1]	INFO	o.e.j.s.handler.ContextHandler#doStart: Started w.@3901f6af{Jenkins v2.319.3,/,file:///var/lib/jenkins/war/,AVAILABLE}{/var/lib/jenkins/war}
jenkins-jenkins jenkins-master 2022-09-05 11:20:18.239+0000 [id=1]	INFO	o.e.j.server.AbstractConnector#doStart: Started ServerConnector@18230356{HTTP/1.1, (http/1.1)}{0.0.0.0:8080}
jenkins-jenkins jenkins-master 2022-09-05 11:20:18.245+0000 [id=1]	INFO	org.eclipse.jetty.server.Server#doStart: Started @5816ms
jenkins-jenkins jenkins-master 2022-09-05 11:20:18.253+0000 [id=23]	INFO	winstone.Logger#logInternal: Winstone Servlet Engine running: controlPort=disabled
jenkins-jenkins jenkins-master 2022-09-05 11:20:18.911+0000 [id=30]	INFO	jenkins.InitReactorRunner$1#onAttained: Started initialization
jenkins-jenkins jenkins-master 2022-09-05 11:20:22.026+0000 [id=29]	INFO	hudson.PluginManager#considerDetachedPlugin: Loading a detached plugin as a dependency: /var/lib/jenkins/plugins/command-launcher.jpi
jenkins-jenkins jenkins-master 2022-09-05 11:20:22.058+0000 [id=29]	INFO	hudson.PluginManager#considerDetachedPlugin: Loading a detached plugin as a dependency: /var/lib/jenkins/plugins/jdk-tool.jpi
jenkins-jenkins jenkins-master 2022-09-05 11:20:24.290+0000 [id=30]	INFO	jenkins.InitReactorRunner$1#onAttained: Listed all plugins
- jenkins-jenkins