Attendees 
- @dduportal (Damien Duportal)
- @lemeurherve (Hervé Le Meur)
- @jayfranco999(Jay Reddy)
Announcements 
- Jenkins Weekly Releases
- Last Week: 2.570
- No issues with release/packaging
- But Docker Windows image failure requiring retries (2025 with
hcs::CreateComputeSystem 73b820e80f2446fe63fcd287a565cc0968eaca683800a120aacb256a8a537eca: Incorrect function.during OpenJDK MSI installation)- Short term: Herve built JDK by JDK to unblock publication
- Long term: analysis in progress
- This Week: 2.571
- No issues at all
- Last Week: 2.570
- Announcements:
- Team capacity: N.A. this week, everyone is there
- Priorities:
- Infra Roadmap: Jenkins Roadmap
- Current EPICs (by priority): GitHub · Where software is built
- Docker renewed our DSOS plan (open source program) for one year, and added 2 seats, up to 15 new, many thanks!
Upcoming Calendar 
- Next infra meeting: next week on 2026-07-07
- Next Weekly: 2.572 on next week on 2026-07-07
- Next LTS: 2026-07-08 - 2.568.1 - Release lead is Kris Stern
- RC 1 weeks before (last week)
- Damien off: Herve and Jay lead on infra side
- Upcoming credentials expirations (~3 weeks):
- Renew ci.jenkins.io API token for incremental-publisher: 2026-07-07
- issue to create => @7JoquqrvQFu6FDlR14JVhg (Jay)
- Expiration of the Digital Oceans PATs: 2026-07-19
- issue to create => @7JoquqrvQFu6FDlR14JVhg (Jay)
- Renew ci.jenkins.io API token for incremental-publisher: 2026-07-07
- Report Cloud Costs to Jenkins Infra Spreadsheet: 2026-07-10 => @dduportal
- Next major event: N.A.
Cloud Budgets
-
Azure (CDF paid)
- April: $3.553 (invoice)
- May: $2800 (invoice)
- June: $1,977 (invoice, forecasted at $2,112)
We will meet our threshold of $2.5k monthly- With last week publick8s incident, we’ve added a new permanent nodepool. Impact is ~$150-200 monthly increase.
- Note: publick8s should move to sponsored subscription ($634 for June, forecasted at $830)
-
Azure Sponsored subscription (Microsoft Credits): ~$86347 credits on June 2d 2026 - until 20 Oct. 2027
- April: $5,902 (invoice)
- May: $5,734 (invoice)
- June: $5,246 (invoice, forecasted at $5,632)
At current rate, we shall deplete credits on September 2027 (unless we have to move ci.jenkins.io here)- bigger variation seen on “dev-packer-builds” (between $2 and $110 daily, $541 for June). We’ve contained the impact of our PRs, should improve situation
-
DigitalOcean - Remaining $6,574.45 until January 02, 2027
- April: $841,69 (invoice)
- May: $1186.97 (invoice)
- June: $716.89 (forecasted at $760)
- Bandwidth limit applied on archives.jenkins.io: -23% compared to last month.
At current rate, we shall deplete credits on February 2027
-
AWS:
- Sponsored account, credits left: $43.6k until 01/31/2028 (1st June)
- April: $15.4k
- May: $14.9k
- June: ~$7,496.16 (forecasted at ~7.9k - 8.4 last week)
- -46% compared to last month (+42% last week)
At current rate ($8.0k monthly, expecting $35.5k left on 1st July 2026), we shall deplete credits on 31 October 2026 (~10 days as margin in November 2026)- Done: Maven caching is there (only a few nitpick fallbacks in case of error)
- WiP: Spot instances on “short” builds: ok for windows.
- Moving to EC2 Fleet plugin instead of EC2
- Todo: BOM improvements (to consume less) with
- SplitTest plugin to have less parallel workloads
- Maybe (Spot + retries) for short PCT branches only in BOM PRs (while keeping on demand for controller branch)
- => @hervelemeur to open the helpdesk
- Can we ask for more sponsoring at AWS?
- At CDCon, Mila Zhou was still our contact at AWS
- Lets’ contact their open source program to ask => @dduportal with @en3hD3iMRx6_6IXLNY0Rag
- Sponsored account, credits left: $43.6k until 01/31/2028 (1st June)
-
JFrog Artifactory Usage
Storage: 1.85 Tb (same as last week)- Bandwidth:
- April: 43.85 Tb
- May: 29.98 Tb
June: 22.85 TB (forecasted at 23 Tb)
-
Algolia API usage
- Context: [plugins.jenkins.io] Watch Algolia search usage for June 2026
- plugins.jenkins.io:
- (Month): 153.16K search requests for the period 1st (month) => (today) (max. 400K monthly)
Notes 
-
Done:
-
support
-
keep-infra-up-to-date
-
keep-infra-sane-and-maintainable
-
-
-
support
- CD fail with 403 on
https://github.com/jenkins-infra/plugin-modernizer-tool- Tokens are updated by RPU => it’s a permission issue
- WiP: checking RPU code for changes around GH orgs
- ci.jenkins.io is not allocating Windows agents
- Kept open until we move to EC2 Fleet plugin
- [Maven Dependency] could not be resolve
org.eclipse.m2e:lifecycle-mapping:jar:1.0.0Maven plugin- James answered, need to be handled with jenkinsci maintainers
- Jenkins Update Service Is Unavailable ( 503 )
- Still need to write post-mortem
- CD fail with 403 on
-
keep-infra-sane-and-maintainable
- [ci.jenkins.io] Set up maven caching for all VM agents
- It works very well!
- Left-overs: optimization of cloud init + archive name
- [ci.jenkins.io] Set up maven caching for all container agents
- It works very well!
- Left over: nice to have fail without breaking pipeline in library code
- [ci.jenkins.io] Enable Spot for Windows EC2 agents
- PoC was really promising
- WIP: moving from EC2 plugin EC2 Fleet plugin. AWS/Terraform part done, Puppet in progress
- Make update-center2 generation more resilient against GH instability
- Back to backlog: it’s on Daniel’s side
- [ci.jenkins.io] Set up maven caching for all VM agents
-
keep-infra-up-to-date
- Upgrade jq to 1.8 on packer-images and ensure compatibility across all jenkins-infra projects
- JQ 1.8.2 delivered on agents
- WiP on GPG verification of jq download
- WiP on installing jq on agent.trusted (+GPG)
- Drop Windows 2019 support
- Dropped from weekly last week
- Confirmed we drop it for incoming 2.568.1 LTS
- Next step start discussion / communication plan for dropping it on agent images
- Upgrade jq to 1.8 on packer-images and ensure compatibility across all jenkins-infra projects
-
-
Issues added to the next milestone:
-
Issues staying in backlog/triage:
- Upgrade to Kubernetes 1.35
- Debian upgrade campaign:
bookworm(12.x) totrixie(13.x) - Bump Helm from
3.xto4.x - [cert.ci.jenkins.io] Monitor the
acceptance-tests-check-agent-availabilityjob and alert us when failing 3 consecutive times - Tombstone
plugin-site-apiservice (in favor of a static report file) - [cert.ci.jenkins.io] migrate controller VM from Azure CDF to Azure sponsored subscription
- [Terraform azure/aws/shared-tools] Migrate Kubernetes provider resources (
kubernetes_*) to versioned resources (kubernetes_*_v1) - See if we can get OIDC enabled on our artifactory
- main branch Jenkins build status is in progress but not build was triggered
- msbuild not available on ci.jenkins.io Windows agent for winp build process
- Sporadic HTTP 503 First byte timeout errors on jenkins.io
- Provide Maven 4 pre-release templates on ci.jenkins.io
- Enable Jenkins CLI
- Prepare for post-Jira account management
- Inform of Ingress NGINX Retirement in March 2026
- [Azure Deprecation] Convert your OS disks to Standard SSD or Premium SSD before 8 September 2028
- [Azure] Merge webservices data storage accounts into a single one with NFS v4.1
- private docker image registry for staging core security releases
- [ci.jenkins.io] diagnose and eventually fix the EC2 Windows VM performances and build failures/retries
- [PHS/Datadog] improve monitoring using application logs
- Chinese jenkins site incorrect site redirection
- Add a real-world job to weekly.ci.jenkins.io
- [ci.jenkins.io] Monitor and Garbage collect data volume of the DockerHub registry mirror and EC pull through cache
- Move collection of stats out from Kohsuke’s home
- Support [skip ci] on default branch
- Create build for jenkinsci/winp on release ci server
- [Update Center] HTTP/404 on
/current/updates/*.json*links - Add monitoring for CD secrets updates
- Nobody noticed that the last successful extension-indexer run was in August 2023
- [INFRA-3046] Monitor Jenkins mirrors Age
- [INFRA-2352] Add monitoring for age of crawler files
- Move docker controller images publication job from trusted.ci.jenkins.io to release.ci.jenkins.io
- [(status|contributors|stats|docs|stories|cn|jenkins-io-components).jenkins.io, Websites PR previews] Netlify billing plan changed: evaluate and act