Infrastructure Team Meeting - June 27, 2023

dduportal · July 27, 2023, 9:54am

Attendees

@dduportal (Damien Duportal)
@hlemeur (Hervé Le Meur)
@MarkEWaite (Mark Waite)
@smerle33 (Stéphane Merle)
@poddingue (Bruno Verachten)
@kmartens27 (Kevin Martens)

Announcements

Weekly: 2.412 is out (core, package and Docker image, changelog)
LTS release tomorrow
Maven 3.9.3: let’s wait after the LTS
Meeting next week cancelled: we’ll see each other the 11 July.

Upcoming Calendar

Next Weekly: 2.143, 04 July
Next LTS: tomorrow (28 June) \o/
Next Security Release as per jenkinsci-advisories: N.A.
Next major event: N.A.

Notes

Done:
Closed as not planned:
- cpc1
- cpc1
- Account linked to old inaccessible email account
- Remote repository for repo.karuslabs.com
  - Removed corresponding exception in ACP
- Account issue
Work In Progress:
- Upgrade to Kubernetes 1.25
  - DigitalOcean upgraded + set HA
  - Next step: EKS clusters, but no BOM build, after the LTS, need announcement. Friday 30 (review Thursday?)
  - AKS in 2 weeks for Ubuntu 22.04
- AKS: add cluster publick8s and migrate prodpublick8s public services on it
  - Cleanup (a lot!) and follow ups. Additional task to be tracked separately (discovered during operations)
  - Blog post published last week to announce get.jenkins.io Ip change
  - Deletion to be done today
- IPv6 problem with “get.jenkins.io”
- Artifact caching proxy is unreliable
  - Ready to be retried: ci.jenkins.io agents are now in the same network as ACP
  - Let’s evaluate ourselves first
  - Datadog key exposed and rotated (sorry)
- [ci.jenkins.io] Use a new VM instance type
  - Ready to bootstrap
- The mirrors.jenkins-ci.org is missing some necessary metadata files, which prevents it from being added as an apt/yum repo
  - pkg.jenkins.io in Fastly
  - It’s hard for our China users to download
  - New mirrors in china already there?
  - This topic need to be raised outside the jenkins infra team, and we need sponsor
  - No direct action for Jenkins Infra for now?
  - Cloudflare
- Install and configure Datadog plugin on ci.jenkins.io
  - Datadog plugin is connected to the agent and send metrics, logs and traces
  - It works \o/
  - Working on deduplication of logs (between Docker container logs and Datadog plugin agent)
- Matomo github/docker repos
  - Lets go: MySQL instance + Docker image
- Ubuntu 22.04 upgrade campaign
  - vpn.jenkins.io migrated
  - s390x.jenkins migrated
  - ci.jenkins.io: VM migration
  - AKS: 1.25 Kube
  - updates.jenkins.io (pkg.origin VM)
    - For the updates.jenkins.io part: CloudFlare R2 is an AWS S3-compliant object store with no egress fees. (tracked in another issue (TBD add link).
      - HTTP update center on update.jenkins-ci.org
      - Work on better understanding trusted.ci update center update
    - pkg => work to do for ubuntu upgrade
- Proposal for application in publick8s to migrate to arm64
  - reports.jenkins.io looks a good candidate
  - javadoc.jenkins.io as well
  - Work on the taints/tolerations
- Remove IP restriction on bounce or migrate to VPN
  - Back to backlog
  - Might need to be done with cert.ci.jenkins.io
- Assess Artifactory bandwidth reduction options
  - We’ll have to make mirrors private as per last meeting with JFrog
  - PR to prepare on POM parents to start experiment
  - Jfrog: Need to create testing zone with private mirrors to test with the PR in parents
  - Need sync with other core maintainers
  - Document to review before adding to the issue
New issues
- Windows 2022: ready to start working, but nothing to do on infra (except support)
ToDo (next milestone) (infra-team-sync-2023-06-27 Milestone · GitHub)