Attendees 
- @jayfranco999 (Jay Reddy)
- @dduportal (Damien Duportal)
Announcements 
- Jenkins Weekly Releases
- Last Week: 2.582, completed
- The “recalculate metadata” step of the release build failed, Damien completed the remaining steps manually
- This Week: 2.583, completed
- Same metadata issue, same fix as last week.
- Following up on the issue Artifactory responds HTTP/403 to requests for metadata recalculation
- Deployment later today for weekly.ci and infra.ci
- Last Week: 2.582, completed
- Announcements:
- Team capacity: Damien will be off this Friday, Hervé today
- Priorities:
- Infra Roadmap: Jenkins Roadmap
- Current EPICs (by priority): GitHub · Where software is built
- Topic worth mentioning (timeframe of the upcoming 2 months)
- Nginx ingress retirement - Inform of Ingress NGINX Retirement in March 2026 · Issue #4869 · jenkins-infra/helpdesk · GitHub
- Kubernetes 1.35 upgrade - Upgrade to Kubernetes 1.35 · Issue #5168 · jenkins-infra/helpdesk · GitHub
- Blocked by publick8s migration to Sponsored Subscription
- Sponsoring: NodeOPS
- WiP on hosting their plugin: Hosting request for createos-sandbox-plugin · Issue #5304 · jenkins-infra/repository-permissions-updater · GitHub
Upcoming Calendar 
- Next infra meeting: 2026-09-29
- New timing proposal: 08:30am UTC, 14:00 Bangalore and 10:30am Paris
- Since too early for US, the week after would be 14:00 UTC (too late for Bangalore - 19:30) and 16:00 Paris
- We’ll alternate each week
- @dduportal to ask in jenkins-infra and update calendar once validated
- Next Weekly: 2026-09-29 - 2.584
- Next LTS: 2026-09-30 - 2.580.1 (release lead?)
- Next Security Release as per jenkinsci-advisories: N/A
- Upcoming credentials expirations (~3 weeks):
- 2026-10-07: Renew ci.jenkins.io API token for incremental-publisher (issue to create => @dduportal)
- 2026-10-14: Azure Credential used by Packer Image builds expires (issue to create => @7JoquqrvQFu6FDlR14JVhg)
- Next major event: N/A
Cloud Budgets
-
Azure (CDF paid)
- May: ~$2,800
- June: ~$2,108
- July: $2,182.84
- August: $2,179,52
- September: $1,486.58 (forecast at $2,113.08)
Max. threshold of $2.5k monthly met- Note: publick8s should move to sponsored subscription (~$990 monthly)
-
Azure Sponsored subscription (Microsoft Credits): $68,797 credits on September 01 2026 (expires on Nov. 2027)
- June: ~$5,542
- July: $5,518.05
- August: $6,652.23
- Septemper: ~$3,804.04 (forecasted at $5,475.57, previously at at $5287)
At current rate, we shall have a bit more than 12 months (at 5.5k/monthly), depleting credits on October 2027 (unless we have to move ci.jenkins.io here)
-
DigitalOcean - Remaining $5,295.56 until January 02, 2027 (on September 15)
- May: $1186.97
- June: $740.32
- July: $496.88
- August: $382.55
- September: $373.47 (forecast at $533) increase in cost is attributed to increase disk and VM size in census.jio
At current rate, we have ~12 months left
-
AWS:
- Sponsored account, credits left: $24,424.79 until 01/31/2028 (on 22nd September)
- May: $14.9k
- June: ~$7,893
- July: $5,891.74
- August: $5,398.51 -19% compared to last month
- September: $3,097.39 (-28% than same period last month) (forecasted at $4,237.28)
At current rate ($4.3k monthly), we shall deplete credits on mid-February 2027- No more cost reduction effort: from now we focus on either getting more credits or moving to Azure (or somewhere else) - [Autumn/2026] Determine and set up the future Cloud location of `ci.jenkins.io` before EoY 2026 · Issue #5283 · jenkins-infra/helpdesk · GitHub
- Sponsored account, credits left: $24,424.79 until 01/31/2028 (on 22nd September)
-
JFrog Artifactory Usage
- Storage: 1.97 TB (was 1.84Tb last week)
- No more Darin Pope’s cron GC on incrementals
- Bandwidth:
- May: 29.98 TB
- June: 23.24 TB
- July: 31.3 TB
- August: 36.53 TB
- September: 31.98 TB (forecast: 45.68 TB, previously 41 TB)
- Storage: 1.97 TB (was 1.84Tb last week)
Notes 
-
Done:
-
support
- [trusted.ci.jenkins.io] Crawler build is failing
- Possible pagerduty threshold improvement: only alert us after 2/3 days consecutives build failures
- 403 releasing plugin
- Required an update of RPU to use v2 API on artifacotry on a few endpoints (there are still some)
- [trusted.ci.jenkins.io] Crawler build is failing
-
keep-infra-up-to-date
- Backport docker, packaging, and release changes for LTS 2.580.1
- No backports on packaging/release. Only the usual Docker base images (out of scope of the infra).
- Keep track of NodeJS version provided by our agents in the projects using it
- A few cleanup of
updateclimanifests + pipelines not needed anymore in the website projects - We removed some
updateclijobs on infra.ci.jenkins.io’s configuration as code. Need manual removal though.
- A few cleanup of
- Backport docker, packaging, and release changes for LTS 2.580.1
-
keep-infra-sane-and-maintainable
- Use a common
buildWebsitepipeline library function for websites- We now have a central pipeline library for every website built and deployed in the Jenkins infrastructure (e.g. any NPM project)
- [packer-images] Migrate install_jq from shell to an Ansible role
- Was a good bootstrap related to ansible user/permissions along with cleanup of Packer code (explicit SSH user, etc.)
- Merged, need to be released though
- A few comments to add along with an updatecli tracking
- Next step: define a list of
install_*shell functions into Ansible into another issue
- Use a common
-
-
-
keep-infra-sane-and-maintainable
- Optimise costs and maintainance by merging Windows 2022 and Windows 2025 templates
- WiP by Herve (all Docker images on jenkinsci shall be using 2025 hosts)
- Next step report last tasks (cleanup packer-images and Azure galleries at least)
- [stats.jenkins.io/infra-statistics] Move “data for the usage stats site” generation (from anonymized data) out from Andrew machine
- First end to end pipeline run successfully ran: need to check result on stats.jenkins.io for September 2025
- KK did not answer regarding missing anonymized logs after March 2026
- Next steps: without issue on the first successful run
- PR to review by the team for the pipeline
- Then, integrate data from Oct. 2025 up to March 2026 in stats.jenkins.io
- Finally: set the pipeline to run weekly
- [packer-images] Migrate the self-contained install functions of ubuntu-provision.sh to Ansible roles
- Complexity Tiers defined: @dduportal to review them before proceeding
- Next step: define another function, deliver it standalone to validate the process inherited from install_jq.
- Then: batching changes by Tiers.
- Optimise costs and maintainance by merging Windows 2022 and Windows 2025 templates
-
keep-infra-up-to-date
- [Plugin Health Score] Monitor outcomes of the scores computation routines and alert us when failing for too long
- PHS engines are now monitored in Datadog (4 new monitors: 2 staleness and 2 for failures). No pagerduty alerting yet (retained see below)
- Next step: sync with Adrien to validate these monitors. if ok, then we’ll enable pager duty (and close)
- Migrate
publick8sAKS cluster to the Azure 2026 Sponsored subscription- Stale: @dduportal need to write down plan and test migrating an existing publicIP
- Prepare update-center root CA rotation
- No more action required for now: back to backlog
- [get.jenkins.io,mirrors.updates.jenkins.io] Resume GeoIP database weekly update
- Plan written with all requirement. Was blocked by the work on stats. We can resume this week.
- Next step: implement plan.
- [Plugin Health Score] Monitor outcomes of the scores computation routines and alert us when failing for too long
-
support
- [ci.jenkins.io] DockerHub transparent mirror/proxy seems to be down, resulting in HTTP/429 from DockerHub
- Stale. Back to backlog, need work on the jenkinsci Docker repositories, no infra things yet.
- Create sonarcloud-token
- @dduportal to create credentials (as admin)
- [get.jenkins.io] Ensure TUNA (China-based) mirror is reliable for Chinese users (original title: Support Mirror Selection in Update Center)
- Waiting for end of September before taking any actions.
- No one complained yet.
- TUNA mirror admin never answered.
- [ci.jenkins.io] DockerHub transparent mirror/proxy seems to be down, resulting in HTTP/429 from DockerHub
-
-
Issues added to the next milestone:
* Request to add new member as maintainer forjenkins-infra/plugin-modernizer-stats -
Issues staying in backlog/triage:
- Harmonise spot and nonspot agent template labels on ci.jenkins.io
- [updates.jenkins.io] Get rid of Cloudflare R2 buckets for UC mirrors in favor of plain old VMs
- Switch ci.jenkins.io git implementation from JGit to command line git
- [ci.jenkins.io] optimize Maven Cache loading during EC2 Agent startup
- [Maven Dependency] could not be resolve
org.eclipse.m2e:lifecycle-mapping:jar:1.0.0Maven plugin - [packer-images] Bump Ubuntu base image from 22.04 to 26.04
- Upgrade to Kubernetes 1.35
- Debian upgrade campaign:
bookworm(12.x) totrixie(13.x) - Tombstone
plugin-site-apiservice (in favor of a static report file) - See if we can get OIDC enabled on our artifactory
- main branch Jenkins build status is in progress but not build was triggered
- Sporadic HTTP 503 First byte timeout errors on jenkins.io
- Provide Maven 4 pre-release templates on ci.jenkins.io
- Move docker controller images publication job from trusted.ci.jenkins.io to release.ci.jenkins.io
- Enable Jenkins CLI
- [(status|contributors|stats|docs|stories|cn|jenkins-io-components).jenkins.io, Websites PR previews] Netlify billing plan changed: evaluate and act
- Prepare for post-Jira account management
- Inform of Ingress NGINX Retirement in March 2026
- [Azure Deprecation] Convert your OS disks to Standard SSD or Premium SSD before 8 September 2028
- [Azure] Merge webservices data storage accounts into a single one with NFS v4.1
- private docker image registry for staging core security releases
- [ci.jenkins.io] diagnose and eventually fix the EC2 Windows VM performances and build failures/retries
- [PHS/Datadog] improve monitoring using application logs
- Add a real-world job to weekly.ci.jenkins.io
- [ci.jenkins.io] Monitor and Garbage collect data volume of the DockerHub registry mirror and EC pull through cache
- Move collection of stats out from Kohsuke’s home
- Support [skip ci] on default branch
- Create build for jenkinsci/winp on release ci server
- [Update Center] HTTP/404 on
/current/updates/*.json*links - Add monitoring for CD secrets updates
- Support CD workflow on Windows
- Matomo github/docker repos
- Add reminder about Jira notification email address
- [INFRA-3167] Move security settings to configuration-as-code for puppet managed instances
- [INFRA-3046] Monitor Jenkins mirrors Age
- [INFRA-2352] Add monitoring for age of crawler files