Attendees
- @dduportal (Damien Duportal)
- @MarkEWaite (Mark Waite)
- @smerle33 (Stéphane Merle)
- @poddingue (Bruno Verachten)
- @kmartens27 (Kevin Martens)
- @Stewi
Announcements
- Jenkins Weekly Releases
- Last Week: 2.488 was released succesfully the 3rd December
- Hiccup during the Windows packaging due to a PR merged in jenkinsci/packaging not working with the release Windows container image
- Change rollbacked, root cause found and explained by @slide
- Note: @slide is helping by trying to add the required Windows packaging tools (Wik setup) into our packer template so we could start using the same image on both ci.jio and release.ci.jio
- This Week: 2.489 started on time should be finished later today
- Last Week: 2.488 was released succesfully the 3rd December
Upcoming Calendar
- Next Weekly: 2.490, 17 Dec. 2024
- Next LTS: 2.479.3, 8 Jan. 2025
- Next Security Release as per jenkinsci-advisories: N.A.
- Upcoming credentials expirations (~3 weeks):
- We missed the NPM API token expiration. Fixed and added calendar event for next time (see finished issues)
- Terraform Azure:
- 18 Dec. - stats.jenkins.io Azure SP for production deployment
- 18 Dec. - contributors.jio Azure SP for production deployment
- 18 Dec. - infra.ci.jio Azure SP for production deployment
- 26 Dec. - All Terraform State Azure SP are expiring (8 projects, 8 credentials, automated PRs from https://github.com/jenkins-infra/terraform-states/pull/38 up to https://github.com/jenkins-infra/terraform-states/pull/45)
- Next major event:
- 2 week “release break” end of year
- Weekly break or not hasn’t been decided yet (see Jenkins developers conversation )
- Contributor Summit and FOSDEM, in Brussels, 31 Jan. and 1/2 Feb. 2025
- Mark has proposed prioritized list of attendees to Jenkins Board, more details end of this week
- 2 week “release break” end of year
Cloud Budgets
- Azure CDF:
- September: $3,810 (invoice)
- October: $4.0k (invoice)
- November: $4.3k (invoice)
- Update Center (DNS requests increase) + Azure outage
- December: $1.3k (forecast at $4.5k)
- Azure Sponsorship (Microsoft Credits) - Remaining: $40952 ($79048 consumed) until May 2025
- September: $10.4k consumed
- October: $12.9k consumed
- November: $13k
- December: $2.9k (forecast at $9k)
- DigitalOcean - Remaining $15,478 ($4k consumed) until 02 January 2025
- September: $158 (invoice)
- October: $195.67 (invoice)
- November: $146 (invoice)
- December: $57 (forecast at $176)
- Requesting extension this month!
- AWS:
- CloudBees:
- August: $6.3k
- September: $6.1k
- October: $6.4k
- November: $3.9k
- December: $157 (forecast at $552)
- Sponsored account
- October: $178
- November: $482
- December: $129 (forecast at $355, but we hope for more :))
- CloudBees:
Notes
-
Done:
-
-
[INFRA-3100] Migrate updates.jenkins.io to another Cloud
- Ready to decommission the old system, confirmed that update center was the primary bandwidth consumer
- [Update Center] Add archives.jenkins.io as a mirror fallback for JSON metadatas
- Communicates to Cloudflare (numbers and blog post)
-
[AWS] Move ci.jenkins.io from Azure (sponsorship) to AWS (sponsorship)
-
GeoIP Updated (we had to rollback last week delivery)
- [get.jenkins.io/updates.jenkins.io] mirrors system keep losing ability to evaluate client IP locations
- Problem contained but wee need a long term fix (see below)
- cleaning and changing the cron for geoip updater cronjob
- WiP on new entrypoint (only update if needed) + helm chart (RBAC for rollout restart)
- [get.jenkins.io/updates.jenkins.io] mirrors system keep losing ability to evaluate client IP locations
-
Artifactory permission issue since
plugin-modernizer-tool
was moved tojenkins-infra
- Looks like it’s fixed (required work on RPU)
-
Add monitoring for CD secrets updates
- Smart Idea by Tim we could implement easily with datadog and GH API
-
- Jay is learning and working on shared library
-
Platform Support:
- ACP:
- build failure with useArtifactCachingProxy=true and dependency with version range
- Instability of artifact-caching-proxy
- WDYT about a bom-preheat stage (maven resolving all dependencies and populating ACP) at the beginning (and/or manual job)
- dnf5 update fails with gpgcheck=1
- External user struggling to submit story to stories.jenkins.io
- Infra stats missing October 2024 data for stats.jenkins.io Plugin Installation Trend feature
- Have not heard from KK. Mark and Damien will push forward as we need stats on 2.479.x adoption
- Maven Central artifacts are being downloaded from repo.jenkins-ci.org
- ACP:
-
Keep Platform Up to date:
- Refine updatecli to not propose www.bing.com version updates
- Switching to azcopy Ubuntu Package
- change the stage view to pipeline graph view on infra.ci and then ci.jio
- Bring back the duration trend!
- Stay on infra.ci for the upcoming month
- Refine updatecli to not propose www.bing.com version updates
-
-
New Issues/issues to triage:
-
Kept in triage:
- [Update Center] HTTP/404 on
/current/updates/*.json*
links - (packer-images): Add Win-19, Win-22 (AMD64 and ARM64) AMIs For EC2 agents
- [ci.jenkins.io] Set up an ECR pull through cache
- [ci.jenkins.io] Move ACI agents to ephemeral Windows containers to AWS
- [ci.jenkins.io] Move ephemeral Linux containers to AWS
- Switch agent (java home) to JDK21 default
- Switch default JDK to 21 for pipeline libraries
- Switch default JDK to 21 for build tools
- Move controllers to JDK21 (runtime)
- Move agents to JDK21 (runtime)
- [INFRA-2651] Replace accountapp with (keycloak? Go-authentik? Something Else?)
- [Update Center] HTTP/404 on
-
ToDo (next milestone) (infra-team-sync-2024-12-17 Milestone · GitHub)