Attendees 
- @dduportal (Damien Duportal)
- @lemeurherve (Hervé Le Meur)
- @MarkEWaite (Mark Waite)
Announcements 
-
Jenkins Weekly Releases
- 2 weeks ago: 2.568 (security release)
- No issues except on Docker image: DockerHub thrown HTTP/429 errors (too many API requests at the same time from trusted.ci IPs)
- Last Week: 2.569
- No issues with credential-less Vault
- Still the Docker image: Docker Windows stalled many times
- This Week: 2.570
- No issues with release/packaging
- But Docker Windows image failure requiring retries (2025 with
hcs::CreateComputeSystem 73b820e80f2446fe63fcd287a565cc0968eaca683800a120aacb256a8a537eca: Incorrect function.during OpenJDK MSI installation)- Removed docker-compose parallel behavior => should remove the error from last week (Docker Engine stuck at the end of the build) but unrelated to the ‘hcs::CreateComputeSystem’
- add a “retry” with (shorter) timeout to help us?
- Move OpenDJK installation to ZIP instead of MSI?
- Short term: Herve built JDK by JDK to unblock publication
- 2 weeks ago: 2.568 (security release)
-
Announcements:
- Team meeting last week (2026-06-16) was cancelled due to a production outage requiring our focus
- Team capacity:
- Jay is out today
- Priorities:
- Infra Roadmap: Jenkins Roadmap
- Current EPICs (by priority): GitHub · Where software is built
Upcoming Calendar 
- Next infra meeting: next week on 2026-06-30
- Next Weekly: 2.571 on next week on 2026-06-30
- Next LTS: 2026-07-08 - 2.568.1 - Release lead is Kris Stern
- RC 2 weeks before (tomorrow)
- Next Security Release as per jenkinsci-advisories:
- 2026-06-24 (tomorrow): plugins advisory https://groups.google.com/g/jenkinsci-advisories/c/Lr8OpmrFCcM/m/2rkodrcMCgAJ
- Status.jenkins.io + ci.jenkins.io banner announcement today => Hervé
- Plugins/packages updates prior (less moving pieces for JenSec during advisory) => Damien (later today)
- 2026-06-24 (tomorrow): plugins advisory https://groups.google.com/g/jenkinsci-advisories/c/Lr8OpmrFCcM/m/2rkodrcMCgAJ
- Upcoming credentials expirations (~3 weeks):
- Renew ci.jenkins.io API token for incremental-publisher: 2026-07-07
- Expiration of the Digital Oceans PATs: 2026-07-19
- Next major event: N.A.
Cloud Budgets
-
Azure (CDF paid)
- April: $3.553 (invoice)
- May: $2800 (invoice)
- June: $1,575 (invoice, forecasted at $2,130)
We will meet our threshold of $2.5k monthly- With last week publick8s incident, we’ve added a new permanent nodepool. Impact is ~$150-200 monthly increase.
- Note: publick8s should move to sponsored subscription ($634 for June, forecasted at $830)
-
Azure Sponsored subscription (Microsoft Credits): ~$86347 credits on June 2d 2026 - until 20 Oct. 2027
- April: $5,902 (invoice)
- May: $5,734 (invoice)
- June: $4,182 (invoice, forecasted at $5,711 )
At current rate, we shall deplete credits on September 2027 (unless we have to move ci.jenkins.io here)- bigger variation seen on “dev-packer-builds” (between $2 and $110 daily, $541 for June). We’ve contained the impact of our PRs, should improve situation
-
DigitalOcean - Remaining $6,822.47 until January 02, 2027
- April: $841,69 (invoice)
- May: $1186.97 (invoice)
- June: $579.91 (forecasted at $760)
- Bandwidth limit applied on archives.jenkins.io: -23% compared to last month.
At current rate, we shall deplete credits on February 2027
-
AWS:
- Sponsored account, credits left: $43.6k until 01/31/2028 (1st June)
- April: $15.4k
- May: $14.9k
- June: ~$6,269.44 (forecasted at ~8.0k - 8.4 last week)
- -46% compared to last month (+42% last week)
At current rate ($8.0k monthly, expecting $35.5k left on 1st July 2026), we shall deplete credits on 31 October 2026 (~10 days as margin in November 2026)- WiP: The return of Spot instances hoping to gain some $$ (implies Maven side caching)
- EC2 Fleet plugin instead of EC2? The maintainer is actively responding now (wasn’t the case in 2025)

- EC2 Fleet plugin instead of EC2? The maintainer is actively responding now (wasn’t the case in 2025)
- Todo: BOM improvements (to consume less) with
- SplitTest plugin to have less parallel workloads
- Maybe (Spot + retries) for short PCT branches only in BOM PRs (while keeping on demand for controller branch)
- Can we ask for more sponsoring at AWS?
- At CDCon, Mila Zhou was still our contact at AWS
- Lets’ contact their open source program to ask
- Sponsored account, credits left: $43.6k until 01/31/2028 (1st June)
-
JFrog Artifactory Usage
Storage: 1.85 Tb (same as last week)- Bandwidth:
- April: 43.85 Tb
- May: 29.98 Tb
June: 17.82 TB (forecasted at 23 Tb)
-
Algolia API usage
- plugins.jenkins.io:
June: 112k search requests, 28% of our 400K monthly
- Less request than last month: 2k to 5k daily
- plugins.jenkins.io:
Notes 
Last Week (2026-06-16)
Cancelled meeting but milestone were updated as usual: GitHub · Where software is built
-
support
- need to change ownership of the openshift-sync-plugin, openshift-client-plugin, and openshift-login-plugin Jira components
- Need to recover my ‘Gabe Montero’ login
- spot builds are not reliable for long builds
- Request for an Entra Application & Exchange Online Mailbox Access for OAuth2 SMTP Testing - Gsoc2026
-
keep-infra-up-to-date
-
keep-infra-sane-and-maintainable
- [release.ci.jenkins.io] Azure Credentials for Core Release (Vault access) expires on 2026-06-27
- Block common LLM/scraper user agents on archives.jenkins.io to decrease DigitalOcean costs
- [plugins.jenkins.io] Watch Algolia search usage for June 2026
- Remove ASDF from website repositories and rely on packer-image NodeJS
- [Uplink,Rating,PHS,Keycloak] Postgres version
13will lose standard Azure support on March 31, 2026. Upgrade now to avoid extended support charges starting August 1, 2026.
This Week (2026-06-23)
-
Done:
-
support
- [ci.jenkins.io] Warning: JENKINS_HOME disk usage is > 80%
- Junit results and attachment: RFE to have it on cold storage?
- Grant admin access to appcircle plugin repositories
- Issue with the s390x agent on ci.jenkins.io
- Email last week regarding power outage: that was the cause of agent not available
- Regarding the DNS issue, it could have been but need to double check
- GSoC 2026 - Plugin Modernizer stats visualization - New repo on jenkins-infra
plugin-modernizer-stats
- [ci.jenkins.io] Warning: JENKINS_HOME disk usage is > 80%
-
keep-infra-sane-and-maintainable
- [ci.jenkins.io] Set up maven caching for all container agents
- [ci.jenkins.io] Enable Spot for Windows EC2 agents
- [packer/AWS] Decrease AWS costs related to packer
- [ci.jenkins.io/infra.ci.jenkins.io][agents] Fix and improve Playwright installation (webbrowser cache, Windows, etc.)
- Possible regression on a plugin owned by Mark (incoming helpdesk issue)
- [infra.ci.jenkins.io] Website production deployment jobs not already monitored
- Optimization for AWS costs (ci.jenkinbs.io only): do not build daily OR even better: build daily but only in container agents (cheaper on AWS)
- [infra.ci] Monitor all “Report” jobs
-
-
- support
- Slow response from https://issues.jenkins.io
- GitLab Plugin latest two releases not available from https://plugins.jenkins.io/gitlab-plugin/
- Jenkins Update Service Is Unavailable ( 503 )
- Post mortem to finish by @dduportal
- [ci.jenkins.io] Windows instance failure not retried - Core build
- Stucked, back to backlog unless we move to EC2 fleet manager
- keep-infra-sane-and-maintainable
- [ci.jenkins.io] generalize the Maven-side client caching
- [ci.jenkins.io] Set up maven caching for all VM agents
- Herve is going to take care of the Linux VM
- Damien works on the Windows (pipeline library side) one
- [ci.jenkins.io] Set up maven caching for all VM agents
- Make update-center2 generation more resilient against GH instability
- Need to check with Daniel about status
- [updates.jenkins.io] provide a mirror for Jenkins Russian users
- Still better than before, but we’ll have to plan to host or manage mirror ourselves in the future
- On hold, back to backlog
- [ci.jenkins.io] generalize the Maven-side client caching
- keep-infra-up-to-date
- [ci.jenkins.io] Ensure the Maven cache is up to date with latest BOM branches
- Damien keep working on cache content (already updated)
- BOM lines changed: good test for an eventual updatecli automation here
- Upgrade jq to 1.8 on packer-images and ensure compatibility across all jenkins-infra projects
- Jay did the identification of targets, will work on Puppet jq installation
- Drop Windows 2019 support
- Weekly does not provide 2019 Docker anymore (since 2.569)
- Suggestion about an administrative monitor. But would require delaying to next LTS line (after 2.568) => decision to be made by release officer and maybe platform SIG officer
- [ci.jenkins.io] Ensure the Maven cache is up to date with latest BOM branches
- support
-
Issues added to the next milestone:
- Add mirror
- TODO: publick8s-sponsored issue
-
Issues staying in backlog/triage:
- Upgrade to Kubernetes 1.35
- Debian upgrade campaign:
bookworm(12.x) totrixie(13.x) - Bump Helm from
3.xto4.x - [cert.ci.jenkins.io] Monitor the
acceptance-tests-check-agent-availabilityjob and alert us when failing 3 consecutive times - Tombstone
plugin-site-apiservice (in favor of a static report file) - [cert.ci.jenkins.io] migrate controller VM from Azure CDF to Azure sponsored subscription
- [Terraform azure/aws/shared-tools] Migrate Kubernetes provider resources (
kubernetes_*) to versioned resources (kubernetes_*_v1) - See if we can get OIDC enabled on our artifactory
- main branch Jenkins build status is in progress but not build was triggered
- msbuild not available on ci.jenkins.io Windows agent for winp build process
- Sporadic HTTP 503 First byte timeout errors on jenkins.io
- Provide Maven 4 pre-release templates on ci.jenkins.io
- Enable Jenkins CLI
- Prepare for post-Jira account management
- Inform of Ingress NGINX Retirement in March 2026
- [Azure Deprecation] Convert your OS disks to Standard SSD or Premium SSD before 8 September 2028
- [Azure] Merge webservices data storage accounts into a single one with NFS v4.1
- private docker image registry for staging core security releases
- [ci.jenkins.io] diagnose and eventually fix the EC2 Windows VM performances and build failures/retries
- [PHS/Datadog] improve monitoring using application logs
- Chinese jenkins site incorrect site redirection
- Add a real-world job to weekly.ci.jenkins.io
- [ci.jenkins.io] Monitor and Garbage collect data volume of the DockerHub registry mirror and EC pull through cache
- Move collection of stats out from Kohsuke’s home
- Support [skip ci] on default branch
- Create build for jenkinsci/winp on release ci server
- [Update Center] HTTP/404 on
/current/updates/*.json*links - Add monitoring for CD secrets updates
- Nobody noticed that the last successful extension-indexer run was in August 2023
- [INFRA-3046] Monitor Jenkins mirrors Age
- [INFRA-2352] Add monitoring for age of crawler files
- Move docker controller images publication job from trusted.ci.jenkins.io to release.ci.jenkins.io
- [(status|contributors|stats|docs|stories|cn|jenkins-io-components).jenkins.io, Websites PR previews] Netlify billing plan changed: evaluate and act