Infrastructure Team Meeting - November 07, 2023

[dduportal (Damien Duportal)]

2023 11 07 Jenkins Infra Meeting

Attendees

• @dduportal (Damien Duportal)
• @hlemeur (Hervé Le Meur)
• @smerle33 (Stéphane Merle)
• @kmartens27 (Kevin Martens)

Announcements

1. Weekly: 2.431 is out

• WAR, Packages and Docker image
• Changelog also
• Windows Container Image are using JDK17 by default (aligned with Linux)

2. Public AKS upgrade later today (impact on get.jenkins.io, etc.)

Upcoming Calendar

• Next Weekly: 2.432 the 14 of November
• Next LTS: 2.426.1 Nov 15, 2023
  • Mark Waite is the release lead, see the checklist
• Next Security Release as per jenkinsci-advisories: N.A.
• Next major events:
  • DevOps World London is coming (5 December 2023)
  • Jenkins contributor summit prior to FOSDEM (Feb 2024)

Notes

• Done:

  • Add Bruno Verachten to the GSoC team
  • ftp.belnet.be should be removed from mirrors or a fall-back offered
  • track the new jdk21 version from adoptium
  • Ensure removed jenkins.io pages aren’t accessible and indexed anymore
    • Minor hiccup during first attempt: HTTP/403 on some (removed or moved) pages due to empty directory (forbidden directory listing)
      • Removing the empty dirs. changed to HTTP/404 which is better
    • Added redirections on a lot of moved pages to ensure users aren’t blocked from permalinks or old Google results
  • Planning for supported JDK versions in Jenkins Infrastructure

• Closed as not planned:

  • I’m trying to login in my account but giving me password error

• Work In Progress:

  • [INFRA-3100] Migrate updates.jenkins.io to another Cloud
    • Finished and validate the update-center2 script for the (parallel copies + mirrorbits scan)
      • Timing is 1 min20 to 1 min50
    • Fix the HTTP/500 Apache errors
    • TODO:
      • jenkins-infra/crawler to copy files to UC mirrors
      • Full end to end test to update mirrors regularly for UC
      • Run a Jenkins to new UC test
      • JEP to describe the changes, with the PoC as a proof
  • Proposal for application in publick8s to migrate to arm64
    • Done: datadog cluster-agent and cert-manager are running on arm64 now \o/
    • TODO:
      • plugin-site-api
      • plugin-site-frontend
      • weekly.ci.jenkins.io
      • plugin-site-issues?
      • infra.ci arm64 agents as “bonus step” (node pool, and then jenkinsciinfra/docker-*)
    • mirrorbits: PR will be sent by Herve to upstream to have arm64 release
    • Falco to arm64: still need falco version bump
  • Upgrade to Kubernetes 1.26
    • Done: EKS
    • Done: privatek8s
    • TODO: publick8s
      • We need to move public IP to another RG and move the lock, to avoid blocking RG MC_*. To be tested on the privatek8s cluster
      • Falco upgrade
      • Then publick8s. Later today or tomorrow (depends on the time)
  • [ci.jenkins.io] Cannot spawn Linux arm64 VM agents

    • 100 Gb ephemeral disk is not allowed with this instance size

    • TODO find a solution
      • Compare with infra.ci where these VM works
      • Check datadog disk usage for epehemeral agents on ci.j (do we need 150 Gb disk?)
      • increase instance size
      • other?
  • Merging core PRs doesn’t cancel PR builds
    • Waiting for NotMyFault feedback, he is looking for a Core PR with a running build to merge
  • “Mirror Status” link from get.jenkins.io returns a 404 error
    • Still todo:
      • Check if status.html update fixes the issue (file age making it not retained by OSUOSL?)
      • Check if using archives.jenkins.io as mirror fallabck does not fix the issue either
  • Packer: GOSS version tracking and moving sanity check to goss
    • WiP: Migrating the linux tests to goss (full)
    • Then updatecli

• ToDo (next milestone) (infra-team-sync-2023-11-14 Milestone · GitHub)

  • Start a new repo under jenkins-infra for the Jenkins Contributor Spotlight feature on jenkins.io