Infrastructure Team Meeting - July 08, 2025

Name: 2025 07 08 Jenkins Infra Meeting
Uploaded: 2025-07-29T10:19:28Z
Description: [2025 07 08 Jenkins Infra Meeting] Attendees :busts_in_silhouette: @dduportal (Damien Duportal) @jayfranco999 (Jay Reddy) @smerle33 (Stéphane Merle) @poddingue (Bruno Verachten) @biru-c...

dduportal · July 29, 2025, 10:19am

Attendees

@dduportal (Damien Duportal)
@jayfranco999 (Jay Reddy)
@smerle33 (Stéphane Merle)
@poddingue (Bruno Verachten)
@biru-codeastromer (Birajit)
@zhan9san (Jack Z)

Announcements

Jenkins Weekly Releases
- Last Week: 2.517 - went well, except OSUOSL slowness - You're invited to talk on Matrix
- This Week: 2.518 - started on time - (link)
  - Retrying with Git 2.50.0 Windows 2
Announcements:
- Little milestone: 14 July is off for Bruno, Damien and Stephane, Damien is off 10 and 15 additionnaly
  - Damien off next Tuesday (15 July): someone takes over or shall we cancel?
    - Let’s cancel next meeting!
- Java Patch Day the 15 July
  - Let’s wait for automatic PRs: no rush!
- Infra roadmap
  - Proposed update in feat(roadmap) update jenkins-infra tasks for June 2025 by dduportal · Pull Request #8209 · jenkins-infra/jenkins.io · GitHub
  - Preview: Jenkins Roadmap
- New meeting time to discuss to cover Asia?
  - Birajit and Jack are ok with current meeting time: do we keep it as it?
    - Anwser is : yes. But we are open to change

Upcoming Calendar

Next Weekly: 2025-07-15 - 2.519
Next LTS: (?)
Next Security Release as per jenkinsci-advisories: this Wednesday 9 July (https://groups.google.com/g/jenkinsci-advisories/c/doaM4i0Qf6o/m/TUfGhCOKBgAJ?utm_medium=email&utm_source=footer)
Upcoming credentials expirations (~3 weeks):
- 2025-07-23: (trusted.ci.jenkins.io) RPU Artifactory API token expires - [trusted.ci.jenkins.io] RPU Artifactory API token expires the `2025-07-23` · Issue #4725 · jenkins-infra/helpdesk · GitHub

Cloud Budgets

Azure CDF:
- April: $3.9k (invoice)
- May: $3.5k (invoice)
- June: 3,474 (+100) - waiting for invoice of $3,5k
- July: $925 (forecast at ~4k)
Azure Sponsorship (Microsoft Credits) - Remaining: $3813 until 31 August 2025
- April: $12.1k
- May: $14.6k
- June: $10.5k
- July: $2,312
  - Too soon to view the effect of ci.jenkins.io move to AWS
DigitalOcean - Remaining $13,543.93 until January 02, 2026
- April: $349 (invoice)
- May: $310 (invoice)
- June: $252 (invoice)
- July: $47 (forecast at $208)
AWS:
- CloudBees:
  - April: $532
  - May: $548
  - June: $598
  - July: $135 (forecast at $601)
- Sponsored account ($94,370 credits lefts until 2027)
  - April: $1,977
  - May: $2,96
  - June: $367.25
  - July: $468 (forecast at $2,5k)
    - Too soon to view the real effect of ci.jenkins.io move to AWS
Jfrog Artifactory Usage
- Storage: 1.19TB
- Bandwidth:
  - April: 26.34 TB (22.25 Tb for ‘releases’ repository)
  - May: 23.93 TB (22.21 Tb for ‘releases’ repository)
  - June: 22.94 TB (21.44 Tb for ‘releases’ repository)
  - July: 8.52 Tb (8.16 Tb for ‘releases’ repository)

Notes

Done:
- Keep platform sane and maintainable:
  - Renew Docker Open Source Program sponsorship for 2025-2026
  - jgit in Artifactory proxies all of Eclipse and jgit-cache contains 200GB
- Support:
  - Renew NotMyFault’s VPN cert
- Keep platform up to date:
  - [azure] renewal of differents Service Principal Passwords
Closed as not planned:
- Requesting for jfrog access
Work in Progress:
- 2025 Cloud Usage: ensure that we can run until end of year
  - [ci.jenkins.io] migrate from Azure (sponsored) subscription to AWS (sponsored) account
    - Migration performed with success yesterday
    - WiP: Cleanup (of old Azure resources) started
    - Performance issues on Windows VM agents => need a separate issue for smoother tracking
      - Windows 2022 by default?
      - Temp dir ?
      - Inbound agent?
    - Spot instances are often reclaimed => need a separate issue for smoother tracking
      - Re-evaluate instance types based on current spot rate reclaim
      - Re-evaluate disabling the “fallback to ondemand”
      - Inbound agent?
- Stats
  - [stats.jenkins.io/infra-statistics] Move “data for the usage stats site” generation (from anonymized data) out from Andrew machine)
    - Delayed: focused on AWS migration. Resuming after the 15 July (moving off milestones)
    - Note: there also gaps in the last months stats: need diagnose
    - Still no June stats
- Monitor builds on our private instances (trusted.ci.jenkins.io / infra.ci.jenkins.io / release.ci.jenkins.io)
  - Create a “private report” web service for monitoring
    - Last step: release.ci container agents. WiP by @smerle
  - Jay’s PoC on the pipeline library is succesful. Code cleanup in progress.
  - Next step: Jay will investigate the datadog HTTP monitor
- Support:
  - Admin access for Jenkins GSoC org admins to GSoC SiG Gitter channel
    - need to contact Element for takeover. Jenkins Board?
    - Delayed: focused on AWS migration. Resuming after the 15 July (moving off milestones)
  - Github Copilot organisation space
    - jenkinsci admin hands. No infra task related.
    - No news from GitHub (yet?) as per Tim answer
- Keep platform up to date:
  - Update Jira LTS from 9.12.x to 10.3.x
    - LF is building a staging VM to test the migration.
      - We provided them a DNS, and ensured LDAP allowed it.
      - Note: the staging instance is restricted through our VPN (better safe than sorry)
  - JDK25 integration
    - PR for Jenkins tool jdk25
      - Required a “custom URL” override per tool in our Puppet configuration
      - Targets 25+30 EA version
    - After knowledge sharing pairing session, we agreed that we should update the “tool” to reuse the locally installed JDK (in the all in on)
      - Avoid download on each build (faster build, better user experience, less failure, less bandwitdh for Adoptium)
      - Less updates and config for us: all is defined in all in one.
      - potential edge case: webbuilder. Easy to switch to all in one though.
- Keep platform sane and maintainable:
  - OSUOSL: decrease mirror dependency
    - Delayed: focused on AWS migration. Resuming after the 15 July (moving off milestones)
    - OSSPlanet mirror answered and fix their reference. They also contributed (Mirrors and infra-reports)
    - We can now apply archives.jenkins.io
Issues staying in backlog/triage:
Issues added to the next milestone:
- [trusted.ci.jenkins.io] RPU Artifactory API token expires the 2025-07-23
- Latest htmlpublisher release is not recognized as such
- New Mirror in Germany
- Tombstone Puppet (and replace it by something else)
  - Jack started a draft PR, with archives.jenkins.io
  - We should meet after 22 July for demo by Jack
  - Learning curve for Stephane and Jay => thinking about Packer
    - Damien to explain in the issue
  - Jack suggests to have a separate repo with GHA publication of Ansible roles.
    - He writes down requirements so we can make it autonomous
    - Ansible Galaxy requires an account
- [privatek8s] migrate cluster privatek8s from Azure (sponsored) subscription to Azure (CDF) subscription

Topic	Replies	Views
Infrastructure Team Meeting - July 01, 2025 Infrastructure meeting , sig-infra	26	July 8, 2025
Infrastructure Team Meeting - June 24, 2025 Infrastructure meeting , sig-infra	23	June 26, 2025
Infrastructure Team Meeting - July 22, 2025 Infrastructure meeting , sig-infra	21	July 29, 2025
Infrastructure Team Meeting - June 17, 2025 Infrastructure meeting , sig-infra	17	June 19, 2025
Infrastructure Team Meeting - August 12, 2025 Infrastructure meeting , sig-infra	18	August 19, 2025