Jenkins agents randomly stopping

Using Jenkins Ask a question
1

Jenkins setup: Jenkins: 2.387.3
OS: Windows Server 2019 - 10.0
Java: 11.0.18 - Oracle Corporation (Java HotSpot™ 64-Bit Server VM)

We are seeing this in our windows event logs of jenkins agents going down randomly and coming backup. They are running as a service under windows and are set to restart if stopped. The only error I can find is the following:
Child process [15992 - D:\Program Files\Java\jdk-20\bin\java.exe -Xrs -Xmx1048m -jar D:\Jenkins\agent.jar -jnlpUrl “https://win011-jnkn001:8443/manage/computer/win011-jnkn002/jenkins-agent.jnlp” -secret c10dcdd59f87e24f9153c478726addeccdb89e20f6e218f78d1552b87ce711ff -workDir “D:\Jenkins” ] terminated with -1073741510

I also see this error message in remoting log:

INFO: Failed to synchronize IO streams on the channel hudson.remoting.Channel@28cad2c4:JNLP4-connect connection to win011-jnkn001/10.10.44.44:53194
hudson.remoting.ChannelClosedException: Channel “hudson.remoting.Channel@28cad2c4:JNLP4-connect connection to pwi011-jnkn001.corp.medica.com/10.10.44.44:53194”: Remote call on JNLP4-connect connection to win011-jnkn001/10.10.44.44:53194 failed. The channel is closing down or has closed down

There is nothing else to see either in event log or in error logs in remoting directory…in the event log the agent goes down and then comes back up again.

As in this image you can see it goes down and then come back up very quickly.

image
image1278×123 24 KB

Has anyone had this happen? It seems to drop at anytime and as in this case was in the middle of a run and the users see this error:

18:46:07 Build analytics-mart-CLAIM_DETL_FACT #21 completed: FAILURE
18:46:07 Build analytics-mart-claim_hdr-other #36 completed: FAILURE
18:46:07 Build analytics-mart-MBR #150 completed: FAILURE
18:46:07 Build analytics-mart #56 completed: FAILURE
18:46:07 Build analytics-mart-CLAIM_DETL_DIM #13 completed: FAILURE
18:46:07 Build analytics-mart-pbm #46 completed: FAILURE

2

Jenkins does not support Java 20. Agents should run the same version of Java as the controller. Running an unsupported Java version might cause issues.

That Jenkins version has multiple critical security vulnerabilities. You should plan your upgrade to a current version as soon as you can.

Java 11.0.24 is the most recent Java 11 release. You should upgrade to the most recent Java release.

None of those are guaranteed to solve the issue, but they may help.