Infrastructure Team Meeting - June 30, 2026

Attendees :busts_in_silhouette:

Announcements :loudspeaker:

  1. Jenkins Weekly Releases
    • Last Week: 2.570
      • No issues with release/packaging
      • But Docker Windows image failure requiring retries (2025 with hcs::CreateComputeSystem 73b820e80f2446fe63fcd287a565cc0968eaca683800a120aacb256a8a537eca: Incorrect function. during OpenJDK MSI installation)
        • Short term: Herve built JDK by JDK to unblock publication
        • Long term: analysis in progress
    • This Week: 2.571
      • No issues at all
  2. Announcements:
    • Team capacity: N.A. this week, everyone is there
    • Priorities:
    • Docker renewed our DSOS plan (open source program) for one year, and added 2 seats, up to 15 new, many thanks!

Upcoming Calendar :tear_off_calendar:

  • Next infra meeting: next week on 2026-07-07
  • Next Weekly: 2.572 on next week on 2026-07-07
  • Next LTS: 2026-07-08 - 2.568.1 - Release lead is Kris Stern
    • RC 1 weeks before (last week)
    • Damien off: Herve and Jay lead on infra side
  • Upcoming credentials expirations (~3 weeks):
    • Renew ci.jenkins.io API token for incremental-publisher: 2026-07-07
      • issue to create => @7JoquqrvQFu6FDlR14JVhg (Jay)
    • Expiration of the Digital Oceans PATs: 2026-07-19
      • issue to create => @7JoquqrvQFu6FDlR14JVhg (Jay)
  • Report Cloud Costs to Jenkins Infra Spreadsheet: 2026-07-10 => @dduportal
  • Next major event: N.A.

Cloud Budgets

  • Azure (CDF paid)

    • April: $3.553 (invoice)
    • May: $2800 (invoice)
    • June: $1,977 (invoice, forecasted at $2,112)
      • :white_check_mark: We will meet our threshold of $2.5k monthly
      • With last week publick8s incident, we’ve added a new permanent nodepool. Impact is ~$150-200 monthly increase.
        • Note: publick8s should move to sponsored subscription ($634 for June, forecasted at $830)
  • Azure Sponsored subscription (Microsoft Credits): ~$86347 credits on June 2d 2026 - until 20 Oct. 2027

    • April: $5,902 (invoice)
    • May: $5,734 (invoice)
    • June: $5,246 (invoice, forecasted at $5,632)
      • :white_check_mark: At current rate, we shall deplete credits on September 2027 (unless we have to move ci.jenkins.io here)
      • bigger variation seen on “dev-packer-builds” (between $2 and $110 daily, $541 for June). We’ve contained the impact of our PRs, should improve situation
  • DigitalOcean - Remaining $6,574.45 until January 02, 2027

    • April: $841,69 (invoice)
    • May: $1186.97 (invoice)
    • June: $716.89 (forecasted at $760)
      • Bandwidth limit applied on archives.jenkins.io: -23% compared to last month.
      • :white_check_mark: At current rate, we shall deplete credits on February 2027
  • AWS:

    • Sponsored account, credits left: $43.6k until 01/31/2028 (1st June)
      • April: $15.4k
      • May: $14.9k
      • June: ~$7,496.16 (forecasted at ~7.9k - 8.4 last week)
        • -46% compared to last month (+42% last week)
        • :warning: At current rate ($8.0k monthly, expecting $35.5k left on 1st July 2026), we shall deplete credits on 31 October 2026 (~10 days as margin in November 2026)
        • Done: Maven caching is there (only a few nitpick fallbacks in case of error)
        • WiP: Spot instances on “short” builds: ok for windows.
          • Moving to EC2 Fleet plugin instead of EC2
        • Todo: BOM improvements (to consume less) with
          • SplitTest plugin to have less parallel workloads
          • Maybe (Spot + retries) for short PCT branches only in BOM PRs (while keeping on demand for controller branch)
          • => @hervelemeur to open the helpdesk
        • Can we ask for more sponsoring at AWS?
          • At CDCon, Mila Zhou was still our contact at AWS
          • Lets’ contact their open source program to ask => @dduportal with @en3hD3iMRx6_6IXLNY0Rag
  • JFrog Artifactory Usage

    • :white_check_mark: Storage: 1.85 Tb (same as last week)
    • Bandwidth:
      • April: 43.85 Tb
      • May: 29.98 Tb
      • :warning: June: 22.85 TB (forecasted at 23 Tb)
  • Algolia API usage

Notes :book: