Infrastructure Team Meeting - January 02, 2024

[dduportal (Damien Duportal)]

- YouTube

Attendees

• @dduportal (Damien Duportal)
• @smerle33 (Stéphane Merle)
• @poddingue (Bruno Verachten)
• @MarkEWaite (Mark Waite)

Announcements

1. Weekly: 2.438 done last week with no problem
2. Weekly: 2.439 WAR, packages and Docker image OK
3. Billing Status
   • Azure:
     • Dec. was at $7.35k
     • Current Jan.: $0.3k, forecast at $6.7k
   • Azure Sponsorship:
     • Current consumption: $987 (on the $40k)
   • AWS:
     • Dec. was $8.9k
     • Currently Jan. consumption: $0.3k, forecast at $8.2k
   • DigitalOcean:
     • ~$450 credits left the 2nd of Jan. 2024
     • Current: 38$ consumption
   • Others: N.A.

Upcoming Calendar

• Next Weekly: 2.440 next Tuesday
• Next LTS (Events):
  • Next RC - 10 Jan 2024
  • Next LTS baseline selection - 10 Jan 2024
  • Next LTS (2.426.3) - 24 Jan 2024
• Next Security Release as per jenkinsci-advisories: N.A.
• Next major event:
  • FOSDEM (Brussels): 2-4 Feb 2024

Notes

• Done:

  • [Sponsorships] Setup the secondary Azure subscription to consume the sponsor credits
  • Apply for docker-openvpn VPN access for release.ci.jenkins.io
  • declarative-pipeline-migration-assistant-plugin no longer compiles
  • Jira upgraded to most recent release by Linux Foundation (status and developer list)

• Closed as not planned:

  • i couldn’t remember
  • Login issue

• Work In Progress:

  • Replace code-coverage-api with coverage
    • Done on ci.j, trusted and cert, need to do it for infra.ci and release => @smerle
  • crawler build fails because azcopy sync returns a 403
    • Azcopy fixed (expiry date of the SAS token)
    • Todo: fix AWS S3 => @dduportal
    • Todo: add updatecli to remind us (and update) => @dduportal and @smerle
  • Intermittent out of memory for Java 21 builds of Jenkins core on ci.jenkins.io
    • We are not sure what is the issue here (need specific Maven/Java/jenkins skills) => we need help to diagnose
    • At first sight, low priority. Let’s keep it on current milestone at low priority (unless arguments added to make it more important)
  • jgit cloning not converting line ends on windows?
    • A second contributor confirms seeing differences between Windows Container agents and Windows VM agents
    • Could be related to the (infra) agent setup, or plugin (setting up the agent) or jgit itself
    • Moving to next milestone, still assigned to @en3hD3iMRx6_6IXLNY0Rag
  • Remove jcenter, and oss.sonatype.org-releases repositories from public virtual repository; reconfigure Atlassian remote repositories
    • @en3hD3iMRx6_6IXLNY0Rag confirmed we see a bandwidth decrease (as shown around Christmas and shared with JFrog)
    • One last item for @dduportal: removing sonatype cache from public access
    • Good side effect: we saw several plugins upgrading their core dependency to move dependencies from ours to a maven central \o/
  • Migration left over from publicK8s to arm64
    • Nothing to report
    • Workload to be spread across team members along the way
  • Export download mirrors list to a textual representation
    • We have a textual representation
    • Need to convert to JSON
    • Low priority
  • [get.jenkins.io] migrate from mirrorbits to mirrorbits-parent chart
    • Nothing to report
    • Proposal to do it Thursday morning (4 Jan. 2024) => @dduportal
  • [publick8s] Tune node pool size
    • Nothing to report
    • To do tomorrow (Wednesday 3 Jan.)
  • infra.ci.jenkins.io on arm64 (controller and agents)
    • Docker Helmfile ready to be replaced by all in one
    • kubernetes-management is the next target for arm64 agents
    • Then all terraform agents (involves a shared library change)
  • [Sponsorships] Renew DigitalOcean sponsorship for 2024
    • Digital Ocean renewed our sponsorship for 2024
    • $20k credits should be applied today or tomorrow to our account (we have 2 weeks of credits left until then)
  • Packer: GOSS version tracking and moving sanity check to goss
    • Windows and Linux are done since last month
    • Next step: factorize common tests + check all updatecli dependencies
    • Low priority
  • Check if we could replace blobxfer by azcopy
    • Nothing to report (holidays)
    • Moving to 2 milestones (holidays for @lemeurherve)
    • Currently focusing on fixing and restricting SAS tokens so knowledge can be cherry-picked in this topic
  • [INFRA-3100] Migrate updates.jenkins.io to another Cloud
    • Nothing to report (holidays) except a minor credential cleanup
    • Moving to 2 milestones (holidays for @lemeurherve)
    • Currently focusing on fixing and restricting SAS tokens so knowledge can be cherry-picked in this topic
  • ci.jenkins.io install coverage-badges-extension-plugin
    • Let’s install it to ci.jenkins.io
    • @dduportal to comment the “balance” (risk vs. benefits)
    • Still pining async (low priority) the JenSec team for the sake of sharing

• ToDo (next milestone) (infra-team-sync-2024-01-09 Milestone · GitHub)