Infrastructure Team Meeting - December 19, 2023

[dduportal (Damien Duportal)]

2023 12 19 Jenkins Infra Meeting

Attendees

• @dduportal (Damien Duportal)
• @hlemeur (Hervé Le Meur)
• @MarkEWaite (Mark Waite)
• @smerle33 (Stéphane Merle)
• @poddingue (Bruno Verachten)
• @kmartens27 (Kevin Martens)

Announcements

1. Weekly: 2.437 in progress (WAR, packages and Docker image)
2. Billing Status
   • Azure:
     • Nov. was at $7.3k.
     • Dec. goal between $6.5k to $7k.
     • Current Dec.: $4.5k, forecast at $7.5k
   • Azure Sponsorship:
     • Nov. consumed around 80$ from credits.
     • Dec. current consumption: $587
   • AWS:
     • Nov. was $9.8k
     • Currently Dec. consumption: $5.5k, forecast at $9.7k
   • DigitalOcean:
     • ~$750 credits left the 1st of Dec. 2023
     • Dec. current consumption: $536
   • Others: N.A.
3. End of year, no infra meeting next week

Upcoming Calendar

• Next Weekly: 2.438 next week (26 Dec. 2023)
• Next LTS: January 24th (2.426.3)
• Next Security Release as per jenkinsci-advisories: N.A.
• Next major event: FOSDEM Brussels (3-4 Feb) with a Jenkins Contributor summit the 2nd of Feb.

Notes

• Done:

  • Archive repo database-drizzle-plugin
  • plugin-site doesn’t build on infra.ci due to missing ‘docker’ agent
  • Update ci.jenkins.io, trusted.ci, cert.ci and release.ci to latest LTS version 2.426.2
  • Write access to a new user for ci-with-toad-edge-plugin
  • s390 agent availability checks are failing
  • Remove Pipeline Agent Build History plugin from infra.ci.jenkins.io
  • SSL certificate for repo.jenkins-ci.org expires Dec 20, 2023 (9 days)
  • JIRA database restored after spam attack - status and more, needs retro

• Closed as not planned:

  • Did not receive email regarding the password
  • Plugin not showing up on the plugin-site
  • CD release for the for the google-oauth-plugin is not working properly
  • repo.jenkins-ci.org does not support IPv6

• Work In Progress:

  • declarative-pipeline-migration-assistant-plugin no longer compiles
    • Should be closeable, waiting for basil to confirm
  • Remove jcenter, and oss.sonatype.org-releases repositories from public virtual repository; reconfigure Atlassian remote repositories
    • Set up jcenter and atlassian as private to be sure
    • Proposal: ACP cleanup in January (to keep good bandwidth in Dec. but control when plugin fails due to missing dependencies which where in jcenter)
  • [INFRA-3100] Migrate updates.jenkins.io to another Cloud
    • WiP on Azcopy authentication (from SAS to Azure SP)
    • WiP on the JEP (need review by others than the writer
    • todo: review by the JenSec
    • todo: stress test to run
  • Check if we could replace blobxfer by an az-cli command
    • done: plan (fine grain \o/)
    • WiP on Azcopy authentication with Azure SP to ensure rotation/revokation can be done
  • [Sponsorships] Renew DigitalOcean sponsorship for 2024
    • Confirmed with Oliver from DO that we can wait for the 1st week of January and then renew immediatly
  • jgit cloning not converting line ends on windows?
    • Assigned to @en3hD3iMRx6_6IXLNY0Rag (ongoing git / jgit issue)
  • Symbolic link for “latest” for windows-stable in get.jenkins.io points to older release
    • Blocked by Check if we could replace `blobxfer` by an `az-cli` command · Issue #3414 · jenkins-infra/helpdesk · GitHub
    • Moving to backlog
  • DNS domain name jenkins.io expires 2024-01-27 (45 days)
    • To check in January
    • Added reminder in the team calendar
  • Migration left over from publicK8s to arm64
    • No work done
    • To be continued
  • Export download mirrors list to a textual representation
    • Repo jenkins-infra/reports used for new script
    • Job added with pipeline
    • Script added an working on local machine, it produces a txt file with the mirror list (URLs)
    • Next step: xq installation (to be deployed)
    • WiP: JSON file? versioned?
  • [get.jenkins.io] migrate from mirrorbits to mirrorbits-parent chart
    • To be scheduled between Christmas and New Years Eve
  • [publick8s] Tune node pool size
    • to be done (resource decrease, but no limit changes on the remaining x86_64 services as they don’t consume that much)
  • infra.ci.jenkins.io on arm64 (controller and agents)
    • Successfully set up a linux-arm64 pod template using the “all in one” Docker image (jenkins-infra/packer-images) which works
    • WiP migrating kubernetes-management to this one (image docker-helmfile to be migrated to packer-images “all in on”)
      • doctl and xq done (not published)
    • Next steps: terraform projects (docker-hashicorp-tools)
  • [Sponsorships] Setup the secondary Azure subscription to consume the sponsor credits
    • All controllers are using the new subscription for VMs (except release which does not use azure-vms)
    • Network overlap fixed
    • WiP: packer builds in this subscription
    • No spot instance (yet?) but we can try running bom with VMs
  • Packer: GOSS version tracking and moving sanity check to goss
    • goss windows is used and updated by updatecli (along with linux)
    • Blocked by the sponsored subscription migration (network rules)
    • Next step (nit) factorizing
  • Redirect Chinese pages to English pages and shutdown the Chinese site
    • Delayed to January
  • [sponsors] [INFRA-3122] Check for Scaleway sponsorship
    • No answer: let’s close and search other sponsors

• ToDo (next milestone) (infra-team-sync-2024-01-02 Milestone · GitHub)