Attendees 
- @lemeurherve (Hervé Le Meur)
- @jayfranco999 (Jay Reddy)
- @MarkEWaite (Mark Waite)
- @dduportal (Damien Duportal)
Announcements 
- Jenkins Weekly Releases
- Last Week: 2.558
- This Week: 2.559
- Announcements:
- Jenkins Digicert Code Signing Certificate expires in May: [pkg.jenkins.io/release.jenkins.io] Certificate signing the MSI Jenkins package expires on 16 May 2026 · Issue #4923 · jenkins-infra/helpdesk · GitHub
- Team capacity:
- Damien is back \o/
- Priorities:
- Infra Roadmap: Jenkins Roadmap
- Damien to update for Feb/March/April (incoming PR \o/)
- Current topics:
- MSI signing renewal
- Absolute top priority
- Azure Sponsored Subscription 2026: utilizes the 100k$ credits for the Jenkins Infrastructure
- Windows 2025/2022/2019
- Maven 4 RC/GA
- (add to roadmap): weekly.ci.jenkins.io as public live demo
- Proposed priorities:
- stats.jenkins.io stale data
- Get rid of puppet
- MSI signing renewal
- Infra Roadmap: Jenkins Roadmap
Upcoming Calendar 
- Next infra meeting: next week
- Next Weekly: 2.560
- Next LTS: 2.555.1 on 15th April - Shalini Sudarsan release lead
- Next Security Release as per jenkinsci-advisories: N/A
- Upcoming credentials expirations (~3 weeks):
- [trusted.ci] Artifactory Admin Token for RPU: 2026-04-21
- For Damien
- Expiration of the Digital Oceans PATs: 2026-04-26
- For Jay in pair with Damien
- Azure Credential used by Packer Image builds: 2026-05-01
- For Damien, issue to be created
- [trusted.ci] Artifactory Admin Token for RPU: 2026-04-21
- Next major event:
- cdCon May 18-20 in Minesota, Mark will be controller of ceremonies!
Cloud Budgets
-
Azure (CDF paid)
- October: $5.5k (invoice)
- November: $5.7k (invoice)
- December: $5.4k (invoice)
- January: $5.6k (previously forecasted at $5.8k, Hervé has no access to invoice)
- February: $6.4k (previously forecasted at $6.8k, Hervé has no access to invoice)
- March: $5.6k (invoice, previously forecasted at $5.8k)
- April: $1.6k (forecasted at $4.1k)
- Additional cost reduction options are also available after we use new sponsored subscription
-
Azure Sponsored subscription (Microsoft Credits): $96,537 credits left
- Epic: Azure Sponsored Subscription 2026: utilizes the 100k$ credits for the Jenkins Infrastructure
- March: $1847 (invoice)
- April: $1606 (forecasted at $3.3k)
-
DigitalOcean - Remaining $8,985.82 (April 2026) until January 02, 2027 (~11 months left at current rate)
- October: $788.81 (invoice)
- November: $831.38 (invoice)
- December: $454.60 (invoice, previously forecasted at $585)
- January: $385.30 (invoice, previously forecasted at $407)
- February: $565.03 (invoice, previously forecasted at $609)
- March: $423.63 (invoice, previously forecasted at $358)
- April: $334.18 (forecasted at $716)
-
AWS:
- Sponsored account, credits left: $13,880.67 until 05/31/2027, and $60k until 01/31/2028
- AWS sponsoring renewed \o/
- $60k new credit line expiring on 2028-01-31
- $87,907 left on the two $60k credit lines
- October: $6.9k
- November: $5.9k
- December: $10.7 (previously forecasted at $9.5k way higher than usual)
- Huge increase due to EC2 plugin bug
- January: $15.5k (invoice, previously forecasted at $15.3k)
- Still really high, ci.jenkins.io is once again at risk if we don’t decrease the consumption or if we don’t move it somewhere else before end of April 2026
- Need an issue ASAP for the EC2 agents GC (Damien)
- Need an issue for packer image various resources cleanup
- Mark opened an issue on the EC2 plugin: ci.jenkins.io EC2 agents sometimes hang and fail to connect with SSH key not found · Issue #1990 · jenkinsci/ec2-plugin · GitHub
- February: $11.1k (invoice, previously forecasted at $10.3)
- Forecast lowered but still quite high
- March: $14.0k (invoice, previously forecasted at $13.8k)
- April: $6.3k (forecasted at $14.1k)
- We need to resume the work on the cleanups
- Sponsored account, credits left: $13,880.67 until 05/31/2027, and $60k until 01/31/2028
-
JFrog Artifactory Usage
- Storage: 1.65 Tb (was 1.77 Tb two weeks ago)
- Bandwidth:
- October: 16.67 Tb
- November: 15.9 Tb
- December: 30.34Tb
- A single IP address consumed 12Tb in December
- JFrog didn’t block this address until this month (unless this consumer changed its IP?)
- January: 16.67 Tb (previously forecasted at 15.9 Tb)
- Sounds like the abuser stopped abusing
- February: 17.46 Tb (previously forecast at 18.3 Tb)
- March: 27.24 Tb (previously forecasted at 24.8 Tb)
- April: 21.13 Tb (forecasted at 45.28 Tb)
- Mark needs to warn JFrog about the heavy use in March and April
- Mark needs to review the recent log analysis
Notes 
-
Done (Milestone ID)
-
Keep infrastructure sane and maintainable
- [ci.jenkins.io] Data disk passed the 90% usage threshold: need cleanup
- Renew
ci.jenkins.ioAPI token forincremental-publisherservice before 10 April 2026 - Increase TTL of our DNS records from 60 to 300 to reduce costs
- Internal Server Error when trying to log in to Uplink
- Azure Sponsored subscription
- [infra.ci.jenkins.io] Run packer VMs in Jenkins Sponsored subscription
- [infra.ci.jenkins.io] Run Kubernetes agents in Jenkins Sponsored subscription
- [infra.ci.jenkins.io] Run ephemeral agents in Jenkins Sponsored subscription
- [trusted.ci.jenkins.io] Run ephemeral VM agents in the sponsored subscription
-
Support
-
-
Work in Progress (Milestone ID)
- Keep infrastructure sane and maintainable
- Azure Sponsored Subscription 2026: utilizes the 100k$ credits for the Jenkins Infrastructure
- Monitor builds on our private instances (trusted.ci.jenkins.io / infra.ci.jenkins.io / release.ci.jenkins.io)
- Add Datadog tags to our instance agents and controllers to improve alerting
- [Uplink,Rating,PHS,Keycloak] Postgres version
13will lose standard Azure support on March 31, 2026. Upgrade now to avoid extended support charges starting August 1, 2026. - Pending bandwith
- [release.ci.jenkins.io] Avoid filling the JENKINS_HOME
- Move docker controller images publication job from trusted.ci.jenkins.io to release.ci.jenkins.io
- [ci.jenkins.io] Require authentication for read access
- [(status|contributors|stats|docs|stories|cn|jenkins-io-components).jenkins.io, Websites PR previews] Netlify billing plan changed: evaluate and act
- Optimise cost and maintainance by merging Windows 2022 and Windows 2025 templates
- [staging.pkg.origin.jenkins.io/staging.get.jenkins.io] Garbage collect the inactive branches
- [get.jenkins.io,mirrors.updates.jenkins.io] Resume GeoIP database weekly update
- Ensure the BOM cache filler runs successfully and is easier to use and monitor
- Setup a job/set of jobs to allow performing maintenance operations (cron, GCs of resources, etc.)
- [stats.jenkins.io/infra-statistics] Move “data for the usage stats site” generation (from anonymized data) out from Andrew machine
- Support
- Keep infrastructure up to date
- Keep infrastructure sane and maintainable
-
New items:
- msbuild not available on ci.jenkins.io Windows agent for winp build process
- Sporadic HTTP 503 First byte timeout errors on jenkins.io
- [infra.ci.jenkins.io] DigitalOcean PAT used by terraform expires on the 2026-04-26
- [trusted.ci.jenkins.io] RPU Artifactory API token expires on the
2026-04-21 - Search fails on the plugins site
- Update Jira LTS from 10.3.x to 11.3.x
- Checks pending for gatsby-plugin-jenkins-layout