Infrastructure Team Meeting - June 23, 2026

Attendees :busts_in_silhouette:

Announcements :loudspeaker:

  1. Jenkins Weekly Releases

    • 2 weeks ago: 2.568 (security release)
      • No issues except on Docker image: DockerHub thrown HTTP/429 errors (too many API requests at the same time from trusted.ci IPs)
    • Last Week: 2.569
      • No issues with credential-less Vault
      • Still the Docker image: Docker Windows stalled many times
    • This Week: 2.570
      • No issues with release/packaging
      • But Docker Windows image failure requiring retries (2025 with hcs::CreateComputeSystem 73b820e80f2446fe63fcd287a565cc0968eaca683800a120aacb256a8a537eca: Incorrect function. during OpenJDK MSI installation)
        • Removed docker-compose parallel behavior => should remove the error from last week (Docker Engine stuck at the end of the build) but unrelated to the ‘hcs::CreateComputeSystem’
        • add a “retry” with (shorter) timeout to help us?
        • Move OpenDJK installation to ZIP instead of MSI?
        • Short term: Herve built JDK by JDK to unblock publication
  2. Announcements:

Upcoming Calendar :tear_off_calendar:

  • Next infra meeting: next week on 2026-06-30
  • Next Weekly: 2.571 on next week on 2026-06-30
  • Next LTS: 2026-07-08 - 2.568.1 - Release lead is Kris Stern
    • RC 2 weeks before (tomorrow)
  • Next Security Release as per jenkinsci-advisories:
  • Upcoming credentials expirations (~3 weeks):
    • Renew ci.jenkins.io API token for incremental-publisher: 2026-07-07
    • Expiration of the Digital Oceans PATs: 2026-07-19
  • Next major event: N.A.

Cloud Budgets

  • Azure (CDF paid)

    • April: $3.553 (invoice)
    • May: $2800 (invoice)
    • June: $1,575 (invoice, forecasted at $2,130)
      • :white_check_mark: We will meet our threshold of $2.5k monthly
      • With last week publick8s incident, we’ve added a new permanent nodepool. Impact is ~$150-200 monthly increase.
        • Note: publick8s should move to sponsored subscription ($634 for June, forecasted at $830)
  • Azure Sponsored subscription (Microsoft Credits): ~$86347 credits on June 2d 2026 - until 20 Oct. 2027

    • April: $5,902 (invoice)
    • May: $5,734 (invoice)
    • June: $4,182 (invoice, forecasted at $5,711 )
      • :white_check_mark: At current rate, we shall deplete credits on September 2027 (unless we have to move ci.jenkins.io here)
      • bigger variation seen on “dev-packer-builds” (between $2 and $110 daily, $541 for June). We’ve contained the impact of our PRs, should improve situation
  • DigitalOcean - Remaining $6,822.47 until January 02, 2027

    • April: $841,69 (invoice)
    • May: $1186.97 (invoice)
    • June: $579.91 (forecasted at $760)
      • Bandwidth limit applied on archives.jenkins.io: -23% compared to last month.
      • :white_check_mark: At current rate, we shall deplete credits on February 2027
  • AWS:

    • Sponsored account, credits left: $43.6k until 01/31/2028 (1st June)
      • April: $15.4k
      • May: $14.9k
      • June: ~$6,269.44 (forecasted at ~8.0k - 8.4 last week)
        • -46% compared to last month (+42% last week)
        • :warning: At current rate ($8.0k monthly, expecting $35.5k left on 1st July 2026), we shall deplete credits on 31 October 2026 (~10 days as margin in November 2026)
        • WiP: The return of Spot instances hoping to gain some $$ (implies Maven side caching)
          • EC2 Fleet plugin instead of EC2? The maintainer is actively responding now (wasn’t the case in 2025) :partying_face:
        • Todo: BOM improvements (to consume less) with
          • SplitTest plugin to have less parallel workloads
          • Maybe (Spot + retries) for short PCT branches only in BOM PRs (while keeping on demand for controller branch)
        • Can we ask for more sponsoring at AWS?
          • At CDCon, Mila Zhou was still our contact at AWS
          • Lets’ contact their open source program to ask
  • JFrog Artifactory Usage

    • :white_check_mark: Storage: 1.85 Tb (same as last week)
    • Bandwidth:
      • April: 43.85 Tb
      • May: 29.98 Tb
      • :warning: June: 17.82 TB (forecasted at 23 Tb)
  • Algolia API usage

    • plugins.jenkins.io:
      • :white_check_mark: June: 112k search requests, 28% of our 400K monthly
        • Less request than last month: 2k to 5k daily

Notes :book:

Last Week (2026-06-16)

Cancelled meeting but milestone were updated as usual: GitHub · Where software is built

This Week (2026-06-23)