Infrastructure Team Meeting - July 26, 2022

[dduportal (Damien Duportal)]

2022 07 26 Jenkins Infra Meeting

Announcements

1. Weekly 2.361
   • 2.361 complete, checklist not yet complete
   • Custom image will be available soon
2. Announcement
   • Summer season, many on holiday
     • Damien out tomorrow for 8 days
     • Herve out next week
     • Stephane holiday also from 8th to 21st of august
     • Mark has a conference end of week (ScaleX 19)
     • Bandwidth limited while team members offline

Upcoming Calendar

• Next Weekly: 2.362 next tuesday handled by @smerle
• Next LTS: Jenkins LTS-RC release candidate scheduled tomorrow
  • Release in 2 weeks
  • LTS baseline selection for baseline is scheduled for tomorrow
• Next Security Release:
• Next major event:

Notes

• Done:

  • Install github-comment-ops
    • Installed on all jenkinsci initially, then restricted on core and jenkins-infra-test-plugin
    • Let’s disable for jenkins-infra and list use cases for infra
  • JFrog repo.j.o does not let me in
  • Add a synthetic monitoring on Artifactory login
  • [INFRA-3162] Disable all anti-spam protection on cert.ci
  • Meta ticket to remove jenkins-wiki-exporter
  • [INFRA-1601] Datadog doesn’t detect when the accountapp is down

• Work In Progress:

  • Permission issue on plugin release with CD workflow
    • RPU builds are ok on trusted.ci (note: token are valids for 5 hours)
    • Seems like Artifactory is not working well today
    • Adrien to check with Daniel
  • ci.jenkins.io permissions for contributor
    • Redirected to mailing list
  • Want containerized Java 17 Windows agents
    • Put on hold
  • Access to npm namespace
    • Herve to follow up
  • [minor] infra.ci logs are mentioning an expired datadog API key
    • WiP, to be diagnosed
  • Puppet Upgrade Campaign to latest 6.x
    • On hold for holidays, but changelog sounds good
  • Downloads /latest directory out of date
    • On hold, requires more thoughts/work
    • Do we still have a use case for the “/latest” links? Let’s check on code and access log
    • Cleanup up mirrors? We never did, so we won’t start this time
  • enable Development integration in JIra
    • Delaying discussions and actions until september
    • JIRA is going forced to cloud in long term: wider discussion about Atlassian (do we fit? sponsoring? etc.)
    • Let’s avoid putting too much effort on this given this context
  • Replace s390x Ubuntu 18.04 agent with s390x Ubuntu 20.04 agent
  • [INFRA-3100] Migrate updates.jenkins.io to another Cloud
    • Puppet WiP
    • Next step: JSON

• New/Important:

  • Cleanup proposal of communication channels
    • Ask in the IRC channel (+ mailing list)
    • Should we keep the jenkins-infra@googlegroups.com ?
      *
  • [ci.jenkins.io][Infra-as-code] Define Core and plugins as code in a custom built Docker Image
  • [ci.jenkins.io][Infra-as-code] Define Job Configuration as code
  • [infra.ci.jenkins.io] Start using JDK17
  • Alert fatigue: Datadog + Pagerduty are too verbose
  • [INFRA-2754] Realign repo.jenkins-ci.org mission
  • (Re) Introduce an artifact caching proxy for ci.jenkins.io
  • Puppet Upgrade Campaign to latest 7.x
  • [INFRA-3080] Migrate Windows Server from 2019 to 2022
  • Upgrade to Kubernetes 1.23
  • [pkg.jenkins.io,releases] Finish cleanup of mirrorbrain
  • Ubuntu 22.04 upgrade campaign
  • temp-privatek8s cluster backup
  • [terraform:AWS] manage EKS modules as code
  • AKS: add cluster privatek8s
  • [INFRA-3135] Terraform 2021 Winter (/ 2022 Summer )
  • [Azure Teraform] Import existing resources
  • Add observability for the build agents
  • [ci.jenkins.io] collect datadog metrics for ephemeral VMs
  • [INFRA-3137] Terraform: Import unmanaged Oracle Cloud resources
  • Migrate Blue Ocean remaining jobs from ci.blueocean.io to the OSS Infra
  • [Documentation] add a public page with the “add a jenkins mirror” procedure
  • Keycloak performance horrific when looking up / modifying users
  • Weekly release build does not resume
  • GC AWS Old Images (from packer)
  • Monitor builds on our private instances (trusted.ci.jenkins.io / infra.ci.jenkins.io / release.ci.jenkins.io)
  • Updatecli: Use separated pipelines + organization scanning for all updatecli processes in jenkins-infra
  • Separate terraform backends & repositories: “Azure Net” and “Azure”
  • [INFRA-3125] Migrate jenkins-infra repositories from branch “master” to “main”

• ToDo (next milestone) (https://github.com/jenkins-infra/helpdesk/milestone/27)