After I upgrade Jenkins from Jenkins 2.401.1 → Jenkins 2.401.2
My job not run, like its stuck and waiting, job rotate and shows
Still waiting to schedule task Waiting for next available executor
Jenkins use cloud agents on k8s, when i test with built-In node agent, test Hello script works fine, where is problem caused, why not works my job, is there is problem with plugins? Also checked or Jenkins is connected to my k8s, yes it is connected to Kubernetes v1.25.6
[Pipeline] // node
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] echo
This will always run
[Pipeline] echo
One way or another, I have finished
[Pipeline] echo
Only run the steps in post if the current Pipeline’s or stage’s run has an "aborted" status, usually due to the Pipeline being manually aborted.
Error when executing aborted post condition:
groovy.lang.MissingPropertyException: No such property: EMAIL_TO for class: groovy.lang.Binding
at groovy.lang.Binding.getVariable(Binding.java:63)
at org.jenkinsci.plugins.scriptsecurity.sandbox.groovy.SandboxInterceptor.onGetProperty(SandboxInterceptor.java:285)
at org.kohsuke.groovy.sandbox.impl.Checker$7.call(Checker.java:375)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedGetProperty(Checker.java:379)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedGetProperty(Checker.java:355)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedGetProperty(Checker.java:355)
at com.cloudbees.groovy.cps.sandbox.SandboxInvoker.getProperty(SandboxInvoker.java:29)
at org.jenkinsci.plugins.workflow.cps.LoggingInvoker.getProperty(LoggingInvoker.java:121)
at com.cloudbees.groovy.cps.impl.PropertyAccessBlock.rawGet(PropertyAccessBlock.java:20)
at WorkflowScript.run(WorkflowScript:226)
at org.jenkinsci.plugins.pipeline.modeldefinition.ModelInterpreter.delegateAndExecute(ModelInterpreter.groovy:137)
at org.jenkinsci.plugins.pipeline.modeldefinition.ModelInterpreter.runPostConditions(ModelInterpreter.groovy:761)
at org.jenkinsci.plugins.pipeline.modeldefinition.ModelInterpreter.catchRequiredContextForNode(ModelInterpreter.groovy:395)
at org.jenkinsci.plugins.pipeline.modeldefinition.ModelInterpreter.catchRequiredContextForNode(ModelInterpreter.groovy:393)
at org.jenkinsci.plugins.pipeline.modeldefinition.ModelInterpreter.runPostConditions(ModelInterpreter.groovy:760)
at com.cloudbees.groovy.cps.CpsDefaultGroovyMethods.each(CpsDefaultGroovyMethods:2125)
at com.cloudbees.groovy.cps.CpsDefaultGroovyMethods.each(CpsDefaultGroovyMethods:2110)
at com.cloudbees.groovy.cps.CpsDefaultGroovyMethods.each(CpsDefaultGroovyMethods:2151)
at org.jenkinsci.plugins.pipeline.modeldefinition.ModelInterpreter.runPostConditions(ModelInterpreter.groovy:750)
at org.jenkinsci.plugins.pipeline.modeldefinition.ModelInterpreter.runPostConditions(ModelInterpreter.groovy)
at org.jenkinsci.plugins.pipeline.modeldefinition.ModelInterpreter.executePostBuild(ModelInterpreter.groovy:728)
at ___cps.transform___(Native Method)
at com.cloudbees.groovy.cps.impl.PropertyishBlock$ContinuationImpl.get(PropertyishBlock.java:73)
at com.cloudbees.groovy.cps.LValueBlock$GetAdapter.receive(LValueBlock.java:30)
at com.cloudbees.groovy.cps.impl.PropertyishBlock$ContinuationImpl.fixName(PropertyishBlock.java:65)
at jdk.internal.reflect.GeneratedMethodAccessor113.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.cloudbees.groovy.cps.impl.ContinuationPtr$ContinuationImpl.receive(ContinuationPtr.java:72)
at com.cloudbees.groovy.cps.impl.ConstantBlock.eval(ConstantBlock.java:21)
at com.cloudbees.groovy.cps.Next.step(Next.java:83)
at com.cloudbees.groovy.cps.Continuable$1.call(Continuable.java:152)
at com.cloudbees.groovy.cps.Continuable$1.call(Continuable.java:146)
at org.codehaus.groovy.runtime.GroovyCategorySupport$ThreadCategoryInfo.use(GroovyCategorySupport.java:136)
at org.codehaus.groovy.runtime.GroovyCategorySupport.use(GroovyCategorySupport.java:275)
at com.cloudbees.groovy.cps.Continuable.run0(Continuable.java:146)
at org.jenkinsci.plugins.workflow.cps.SandboxContinuable.access$001(SandboxContinuable.java:18)
at org.jenkinsci.plugins.workflow.cps.SandboxContinuable.run0(SandboxContinuable.java:51)
at org.jenkinsci.plugins.workflow.cps.CpsThread.runNextChunk(CpsThread.java:187)
at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.run(CpsThreadGroup.java:423)
at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:331)
at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:295)
at org.jenkinsci.plugins.workflow.cps.CpsVmExecutorService$2.call(CpsVmExecutorService.java:97)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:139)
at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:68)
at jenkins.util.ErrorLoggingExecutorService.lambda$wrap$0(ErrorLoggingExecutorService.java:51)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
[Pipeline] }
[Pipeline] // stage
[Pipeline] End of Pipeline
org.jenkinsci.plugins.workflow.actions.ErrorAction$ErrorId: 721041c2-ec19-4c98-bc42-6a987d0493a6
Finished: ABORTED
Jenkins setup
Jenkins 2.401.2 + Kubernetes (v1.25.6) + Gitlab
k exec -it jenkins-0 -- /bin/bash
Defaulted container "jenkins" out of: jenkins, config-reload, init (init)
jenkins@jenkins-0:/$ java --version
openjdk 11.0.19 2023-04-18
OpenJDK Runtime Environment Temurin-11.0.19+7 (build 11.0.19+7)
OpenJDK 64-Bit Server VM Temurin-11.0.19+7 (build 11.0.19+7, mixed mode)
Slack Notification Plugin (slack): 664.vc9a_90f8b_c24a_
Pipeline: Job (workflow-job): 1326.ve643e00e9220
JavaScript GUI Lib: ACE Editor bundle plugin (ace-editor): 1.1
JSch dependency plugin (jsch): 0.1.55.61.va_e9ee26616e7
Kubernetes CLI Plugin (kubernetes-cli): 1.12.0
Credentials Binding Plugin (credentials-binding): 642.v737c34dea_6c2
JQuery3 API Plugin (jquery3-api): 3.7.1-1
bouncycastle API Plugin (bouncycastle-api): 2.30.1.77-225.v26ea_c9455fd9
Pipeline: Groovy Libraries (pipeline-groovy-lib): 689.veec561a_dee13
Matrix Authorization Strategy Plugin (matrix-auth): 3.2.2
Token Macro Plugin (token-macro): 384.vf35b_f26814ec
Pipeline: API (workflow-api): 1291.v51fd2a_625da_7
JAXB plugin (jaxb): 2.3.8-1
Apache HttpComponents Client 4.x API Plugin (apache-httpcomponents-client-4-api): 4.5.14-208.v438351942757
Authentication Tokens API Plugin (authentication-tokens): 1.53.v1c90fd9191a_b_
JavaScript GUI Lib: Moment.js bundle plugin (momentjs): 1.1.1
Credentials Plugin (credentials): 1319.v7eb_51b_3a_c97b_
Pipeline: Basic Steps (workflow-basic-steps): 1049.v257a_e6b_30fb_d
Durable Task Plugin (durable-task): 550.v0930093c4b_a_6
SCM API Plugin (scm-api): 676.v886669a_199a_a_
Bootstrap 4 API Plugin (bootstrap4-api): 4.6.0-3
Display URL API (display-url-api): 2.200.vb_9327d658781
SSH Build Agents plugin (ssh-slaves): 1.31.2
PAM Authentication plugin (pam-auth): 1.6
Pipeline: Supporting APIs (workflow-support): 881.v7663695646cf
Pipeline: Nodes and Processes (workflow-durable-task-step): 1331.vc8c2fed35334
Resource Disposer Plugin (resource-disposer): 0.14
Kubernetes Credentials Plugin (kubernetes-credentials): 0.11
Oracle Java SE Development Kit Installer Plugin (jdk-tool): 63.v62d2fd4b_4793
Plain Credentials Plugin (plain-credentials): 179.vc5cb_98f6db_38
Build Timeout (build-timeout): 1.20
Calendar View Plugin (calendar-view): 0.3.3
Commons HttpClient 3.x API (commons-httpclient3-api): 3.1-3
Configuration as Code Plugin (configuration-as-code): 1670.v564dc8b_982d0
Jakarta Activation API (jakarta-activation-api): 2.1.3-1
Email Extension Plugin (email-ext): 2.97
Mina SSHD API :: Common (mina-sshd-api-common): 2.12.0-99.vdb_f07841c2db_
Authorize Project (authorize-project): 1.7.1
JavaScript GUI Lib: Handlebars bundle plugin (handlebars): 3.0.8
jQuery plugin (jquery): 1.12.4-1
Git plugin (git): 5.2.1
Workspace Cleanup Plugin (ws-cleanup): 0.38
GIT server Plugin (git-server): 1.10
Timestamper (timestamper): 1.11.5
Active Directory plugin (active-directory): 2.16
Bootstrap 5 API Plugin (bootstrap5-api): 5.3.2-3
Popper.js 2 API Plugin (popper2-api): 2.11.6-2
JUnit Plugin (junit): 1265.v65b_14fa_f12f0
Command Agent Launcher Plugin (command-launcher): 90.v669d7ccb_7c31
ECharts API Plugin (echarts-api): 5.4.0-7
Dark Theme (dark-theme): 315.va_22e7d692ea_a
Pipeline: Build Step (pipeline-build-step): 540.vb_e8849e1a_b_d8
Font Awesome API Plugin (font-awesome-api): 6.5.1-2
Matrix Project Plugin (matrix-project): 818.v7eb_e657db_924
Git client plugin (git-client): 4.6.0
JavaMail API (javax-mail-api): 1.6.2-8
Pipeline: REST API Plugin (pipeline-rest-api): 2.19
Pipeline: Input Step (pipeline-input-step): 477.v339683a_8d55e
Pipeline: Groovy (workflow-cps): 3837.v305192405b_c0
Pipeline: Milestone Step (pipeline-milestone-step): 111.v449306f708b_7
Pipeline: Step API (workflow-step-api): 639.v6eca_cd8c04a_a_
OWASP Markup Formatter Plugin (antisamy-markup-formatter): 162.v0e6ec0fcfcf6
Ionicons API (ionicons-api): 56.v1b_1c8c49374e
Pipeline: Stage Step (pipeline-stage-step): 305.ve96d0205c1c6
Mailer Plugin (mailer): 463.vedf8358e006b_
SnakeYAML API Plugin (snakeyaml-api): 2.2-111.vc6598e30cc65
Jakarta Mail API (jakarta-mail-api): 2.1.3-1
Material Theme (material-theme): 0.5.2-rc100.6121925fe229
Caffeine API Plugin (caffeine-api): 3.1.8-133.v17b_1ff2e0599
Pipeline: Model API (pipeline-model-api): 2.2150.v4cfd8916915c
SSH Credentials Plugin (ssh-credentials): 334.v7732563deee1
Theme Manager (theme-manager): 193.vcef22f6c5f2b_
Pipeline: Stage Tags Metadata (pipeline-stage-tags-metadata): 2.2150.v4cfd8916915c
Solarized Theme Plugin (solarized-theme): 0.1
OkHttp Plugin (okhttp-api): 4.11.0-172.vda_da_1feeb_c6e
commons-text API Plugin (commons-text-api): 1.11.0-94.v3e1f4a_926e49
Instance Identity (instance-identity): 185.v303dc7c645f9
Mina SSHD API :: Core (mina-sshd-api-core): 2.12.0-99.vdb_f07841c2db_
Pipeline Graph Analysis Plugin (pipeline-graph-analysis): 1.12
Lockable Resources plugin (lockable-resources): 2.14
SSH server (sshd): 3.249.v2dc2ea_416e33
Pipeline: Declarative (pipeline-model-definition): 2.2150.v4cfd8916915c
Popper.js API Plugin (popper-api): 1.16.1-2
Pipeline (workflow-aggregator): 596.v8c21c963d92d
JavaScript GUI Lib: jQuery bundles (jQuery and jQuery UI) plugin (jquery-detached): 1.2.1
Script Security Plugin (script-security): 1326.vdb_c154de8669
Trilead API Plugin (trilead-api): 2.84.v72119de229b_7
Office 365 Connector (Office-365-Connector): 4.20.0
Kubernetes Client API Plugin (kubernetes-client-api): 6.8.1-224.vd388fca_4db_3b_
Pipeline: SCM Step (workflow-scm-step): 427.v4ca_6512e7df1
Jackson 2 API Plugin (jackson2-api): 2.15.3-363.v82c51b_de9f60
JavaBeans Activation Framework (JAF) API (javax-activation-api): 1.2.0-6
Kubernetes plugin (kubernetes): 3937.vd7b_82db_e347b_
Checks API plugin (checks-api): 2.0.2
Folders Plugin (cloudbees-folder): 6.858.v898218f3609d
Plugin Utilities API Plugin (plugin-util-api): 3.8.0
Pipeline: Declarative Extension Points API (pipeline-model-extensions): 2.2150.v4cfd8916915c
commons-lang3 v3.x Jenkins API Plugin (commons-lang3-api): 3.13.0-62.v7d18e55f51e2
Branch API Plugin (branch-api): 2.1128.v717130d4f816
LDAP Plugin (ldap): 682.v7b_544c9d1512
Pipeline: Shared Groovy Libraries (workflow-cps-global-lib): 564.ve62a_4eb_b_e039
Structs Plugin (structs): 325.vcb_307d2a_2782
Pipeline: Stage View Plugin (pipeline-stage-view): 2.19
Variant Plugin (variant): 60.v7290fc0eb_b_cd
Metrics Plugin (metrics): 4.2.21-449.v6960d7c54c69
Pipeline: Multibranch (workflow-multibranch): 770.v1a_d0708dd1f6
System logs from Jenkins UI:
Apr 03, 2024 8:26:04 AM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Disconnected computer cronjobs-podName-65491-wlv4v-j-8rncv
Apr 03, 2024 8:26:04 AM INFO hudson.slaves.NodeProvisioner update
cronjobs-podName-65491-wlv4v-j-8rncv provisioning successfully completed. We have now 1 computer(s)
Apr 03, 2024 8:26:05 AM WARNING org.csanchez.jenkins.plugins.kubernetes.KubernetesLauncher launch
Error in provisioning; agent=KubernetesSlave name: cronjobs-podName-65491-wlv4v-j-kq7z6, template=PodTemplate{id='2903b865-4a75-498f-a9bf-252871fad7a8', name='CRONJOBS_JUPYTER_jupyter-trip-planning-data_65491-wlv4v-jzph1', namespace='jenkins', label='CRONJOBS_JUPYTER_jupyter-trip-planning-data_65491-wlv4v', annotations=[PodAnnotation{key='buildUrl', value='http://jenkins.jenkins.svc.cluster.local:8080/job/CRONJOBS/job/JUPYTER/job/jupyter-trip-planning-data/65491/'}, PodAnnotation{key='runUrl', value='job/CRONJOBS/job/JUPYTER/job/jupyter-trip-planning-data/65491/'}]}
java.lang.IncompatibleClassChangeError: Found class io.fabric8.kubernetes.api.model.VolumeFluent$EmptyDirNested, but interface was expected
at org.csanchez.jenkins.plugins.kubernetes.volumes.workspace.EmptyDirWorkspaceVolume.buildVolume(EmptyDirWorkspaceVolume.java:63)
at org.csanchez.jenkins.plugins.kubernetes.PodTemplateBuilder.build(PodTemplateBuilder.java:211)
at org.csanchez.jenkins.plugins.kubernetes.PodTemplate.build(PodTemplate.java:902)
at org.csanchez.jenkins.plugins.kubernetes.KubernetesLauncher.launch(KubernetesLauncher.java:119)
at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:298)
at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:80)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Apr 03, 2024 8:26:05 AM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Terminating Kubernetes instance for agent cronjobs-podName-65491-wlv4v-j-kq7z6
Apr 03, 2024 8:26:05 AM WARNING org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave deleteSlavePod
Failed to delete pod for agent null/cronjobs-podName-65491-wlv4v-j-kq7z6: namespace cannot be null
io.fabric8.kubernetes.client.KubernetesClientException: namespace cannot be null
at io.fabric8.kubernetes.client.dsl.internal.BaseOperation.inNamespace(BaseOperation.java:245)
at io.fabric8.kubernetes.client.dsl.internal.BaseOperation.inNamespace(BaseOperation.java:92)
at org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave.deleteSlavePod(KubernetesSlave.java:357)
at org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave._terminate(KubernetesSlave.java:343)
at hudson.slaves.AbstractCloudSlave.terminate(AbstractCloudSlave.java:88)
at org.csanchez.jenkins.plugins.kubernetes.KubernetesLauncher.launch(KubernetesLauncher.java:259)
at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:298)
at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:80)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Apr 03, 2024 8:26:05 AM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Disconnected computer cronjobs-podName-65491-wlv4v-j-kq7z6
Apr 03, 2024 8:26:05 AM INFO hudson.slaves.NodeProvisioner update
cronjobs-podName-65491-wlv4v-j-kq7z6 provisioning successfully completed. We have now 1 computer(s)
Before Upgrade a job works fine