Infrastructure Team Meeting - July 28, 2026

[dduportal (Damien Duportal)]

2026 07 28 Jenkins Infra Meeting

Attendees

• @dduportal (Damien Duportal)
• @jayfranco999 (Jay Reddy)
• @MarkEWaite (Mark Waite)

Announcements

1. Jenkins Weekly Releases
   • Last Week: 2.574, no issues
   • This Week: 2.575, minor issue on Docker image publication, fixed by chore(ci/publish) ensure all docker bake build calls uses the same set of `--file` flags by dduportal · Pull Request #2422 · jenkinsci/docker · GitHub
2. Announcements:
   • Last week meeting cancelled by Damien (21 July 2026) but notes/milestone still published
   • Team capacity:
     • Herve is off until Monday August 3rd with limited availability on 3/4/5 Aug.
     • Wednesday 29 July, low availability for both Jay and Damien
   • Priorities:
     • Infra Roadmap: Jenkins Roadmap
     • Current EPICs (by priority): GitHub · Where software is built

Upcoming Calendar

• Next infra meeting: 2026-08-04
• Next Weekly: 2.576 on 2026-08-05 (incoming advisory)
• Next LTS: 2.568.2 - 2026-08-05
• Next Security Release as per jenkinsci-advisories: 2026-08-05 (incoming advisory)
• Upcoming credentials expirations (~3 weeks):
  • 2026-08-03: Netlify token used on infra.ci to deploy websites (preview/CD) expires
    • [infra.ci.jenkins.io] Netlify token expires on 2026-08-03 · Issue #5236 · jenkins-infra/helpdesk · GitHub
  • 2026-08-09: [infra.ci] contributors|stats|plugins FileShare service principal credentials
    • [infra.ci.jenkins.io] Azure Credentials for stats.jenkins.io, plugins.jenkins.io, and contributors.jenkins.io expires on 2026-08-09 · Issue #5237 · jenkins-infra/helpdesk · GitHub
  • 2026-08-19: [infra.ci] NPM token expires
    • Issue to create => @7JoquqrvQFu6FDlR14JVhg
  • 2026-08-22: [trusted.ci] Artifactory Admin Token for RPU expires
    • Issue to create => @dduportal
• Next major event: N.A.

Cloud Budgets

• Azure (CDF paid)

  • April: ~$3,553 (invoice)
  • May: ~$2,800 (invoice)
  • June: ~$2,108 (invoice)
  • July: ~$1,918 (forecasted at $2,2k)
    • We will meet our threshold of $2.5k monthly
    • Note: publick8s should move to sponsored subscription ($880 for June, forecasted at $960 for July)

• Azure Sponsored subscription (Microsoft Credits): $80967 credits on July 1st 2026 - until 20 Oct. 2027

  • April: ~$5,902 (invoice)
  • May: ~$5,734 (invoice)
  • June: ~$5,542 (invoice)
  • July: ~$4,522 (forecasted at $5.1k)
    • At current rate, we shall deplete credits on October 2027 (unless we have to move ci.jenkins.io here)

• DigitalOcean - Remaining $6,472.29 until January 02, 2027

  • April: $841,69 (invoice)
  • May: $1186.97 (invoice)
  • June: $740.32 (invoince)
  • July: $450(forecasted at ~$516)
    • At current rate, we shall deplete credits on January 2027

• AWS:

  • Sponsored account, credits left: $35.7k until 01/31/2028 (on 1st July)
    • April: $15.4k
    • May: $14.9k
    • June: ~$7,893
    • July: ~$5.1k (forecasted at ~5.8k)
      • -25% compared to June
      • At current rate ($5.6k monthly), we shall deplete credits on January 2027

• JFrog Artifactory Usage

  • Storage: 1.87 Tb (steady)
  • Bandwidth:
    • April: 43.85 Tb
    • May: 29.98 Tb
    • June: 23.24 Tb
    • July: 26.71 TB (forecasted at ~29 Tb)

• Algolia API usage

  • Context: [plugins.jenkins.io] Watch Algolia search usage for June 2026
  • plugins.jenkins.io:
    • (July): ~86.4K (21%) search requests(max. 400K monthly)

Notes

• Done:

  • support

    • Request GH Pages for AI Chatbot to Guide User Workflow Project
    • Removing mirrors.de.sahilister.net Jenkins mirror
    • [IMP] : Accidental incrementals release on qmetry-test-management — how to return to a clean semantic (1.x) version line?
    • CD release of finite-state-analysis-plugin fails with 401 deploying to repo.jenkins-ci.org
    • Infra build failing for plugin-site

  • keep-infra-up-to-date

    • [infra.ci.jenkins.io] Azure Credential used by Packer Image builds expires on 2026-07-26
    • [infra.ci.jenkins.io] Renew Algolia write API token used for plugins.jenkins.io before 2026-07-29

  • keep-infra-sane-and-maintainable

    • [cert.ci.jenkins.io] Monitor the acceptance-tests-check-agent-availability job and alert us when failing 3 consecutive times

• Closed as not planned:

  • Issues Upgrading

• Work in Progress:

  • keep-infra-sane-and-maintainable

    • standardize docker updatecli pipelines on a single properties() call
      • Problem identified while working on the issue below: conflict between pipeline properties and used pipeline library leading to unexpected properties (discarder/etc.)
      • Waiting for issue below as pre-requisites
    • updatecli daily cron isn’t actually firing on a bunch of repos (terraform + docker)
      • Problem: conflict between pipeline properties and used pipeline library leading to missing daily triggers
      • Almost finished (all PRs being merged)
    • [pipeline-library] define a common nodeWithTimeoutAndRetry() function for website builds
      • Not started yet, but all prerequisites met. For next milestone.
    • [Jfrog Artifactory/MyJfrog portal] Allow access (billing and support) to the whole team on MyJfrog
      • Support: adding Herve and Jay is still not answered. Gotta ping them again.
      • We still need to add Jay in MyJfrog
    • Migrate publick8s AKS cluster to the Azure 2026 Sponsored subscription
      • Issue to fill (@dduportal) now that we have fixed the Sweden ↔ US East service endpoint challenge within Azure
      • Blocked by cert.ci controller migration to sponsored subscription
    • [AWS] Activate user-defined cost allocation tags
      • We have more tags tracked, but need more to really have a real trend

  • keep-infra-up-to-date

    • [infra.ci.jenkins.io] Azure Credentials for stats.jenkins.io, plugins.jenkins.io, and contributors.jenkins.io expires on 2026-08-09
    • [infra.ci.jenkins.io] Netlify token expires on 2026-08-03
    • Prepare update-center root CA rotation
    • Drop Windows 2019 support
      • SIG later to bring the topic officially

  • support

    • CD release fails with 403 Forbidden deploying testingbot plugin to repo.jenkins-ci.org/releases
    • build-pipeline plugin tests now fail with ‘cannot find Chrome binary’
      • Plugin need update of Selenium setup (or move to another UI test tool such as Playwright or kill the UI test stuff)

• Issues added to the next milestone:

  • Enable previews for the plugin-modernizer-stats repo PRs
  • [cert.ci.jenkins.io] migrate controller VM from Azure CDF to Azure sponsored subscription

• Issues staying in backlog/triage:

  • Decrease BOM costs by splitting tests more efficiently
  • [ci.jenkins.io] optimize Maven Cache loading during EC2 Agent startup
  • [Maven Dependency] could not be resolve org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 Maven plugin
  • Upgrade to Kubernetes 1.35
  • Debian upgrade campaign: bookworm (12.x) to trixie (13.x)
  • Tombstone plugin-site-api service (in favor of a static report file)
  • [Terraform azure/aws/shared-tools] Migrate Kubernetes provider resources (kubernetes_*) to versioned resources ( kubernetes_*_v1)
  • See if we can get OIDC enabled on our artifactory
  • main branch Jenkins build status is in progress but not build was triggered
  • msbuild not available on ci.jenkins.io Windows agent for winp build process
  • Sporadic HTTP 503 First byte timeout errors on jenkins.io
  • Provide Maven 4 pre-release templates on ci.jenkins.io
  • Move docker controller images publication job from trusted.ci.jenkins.io to release.ci.jenkins.io
  • Enable Jenkins CLI
  • [(status|contributors|stats|docs|stories|cn|jenkins-io-components).jenkins.io, Websites PR previews] Netlify billing plan changed: evaluate and act
  • Prepare for post-Jira account management
  • Inform of Ingress NGINX Retirement in March 2026
  • [Azure Deprecation] Convert your OS disks to Standard SSD or Premium SSD before 8 September 2028
  • [Azure] Merge webservices data storage accounts into a single one with NFS v4.1
  • private docker image registry for staging core security releases
  • [ci.jenkins.io] diagnose and eventually fix the EC2 Windows VM performances and build failures/retries
  • [PHS/Datadog] improve monitoring using application logs
  • Chinese jenkins site incorrect site redirection
  • Add a real-world job to weekly.ci.jenkins.io
  • [ci.jenkins.io] Monitor and Garbage collect data volume of the DockerHub registry mirror and EC pull through cache
  • Move collection of stats out from Kohsuke’s home
  • Support [skip ci] on default branch
  • Create build for jenkinsci/winp on release ci server
  • [Update Center] HTTP/404 on /current/updates/*.json* links
  • Add monitoring for CD secrets updates
  • Add reminder about Jira notification email address
  • [INFRA-3046] Monitor Jenkins mirrors Age
  • [INFRA-2352] Add monitoring for age of crawler files