Attendees 
- @dduportal (Damien Duportal)
- @smerle33 (Stéphane Merle)
- @poddingue (Bruno Verachten)
- @kmartens27 (Kevin Martens)
- @hlemeur (Hervé Le Meur)
- @MarkEWaite (Mark Waite)
Announcements 
- Weekly: 2.436 is out (WAR, packages and Docker image). Changelog: merged and live \o/
- Ready to roll for the infra!
- Billing Status
- Azure: Nov. was at $7.3k. Dec. goal between $6.5k to $7k.
- Azure Sponsorship: Nov. consumed around 80$ from credits. Let’s go for using it as much as posible ($0.5k for Dec. 2023?)
- AWS: 9.8k (below the 10k goal but far from the expected 5k)
- DigitalOcean: ~960$ left for Dec. 2023, we consumed 766$ in November. Renewal for January.
- Others: N.A.
repo.jenkins-ci.orgcertificate expires SOON (20 Dec.)
Upcoming Calendar 
- Next Weekly: 2.437 next week (19 Dec. 2023)
- Next LTS: January 24th (2.426.3)
- Next Security Release as per jenkinsci-advisories: N.A.
- Next major event: FOSDEM Brussels (3-4 Feb) with a Jenkins Contributor summit the 2nd of Feb.
Notes 
-
Done in the 2023-12-05 milestone:
- Archive foj repository
- Jira component archive
- Add Pipeline agent build history plugin to weekly.ci.jenkins.io
- TODO: open helpdesk issue mentioning perf. problems as we will need to remove it from infra.ci (+weekly.ci does not have any agent)
- Add basil to the board team
- ftp.belnet.be mirror is preventing plugin downloads
- Moving to alumni in jenkins-infra
- Grant markewaite access to the infrastructure VPN
- Start a new repo under jenkins-infra for the Jenkins Contributor Spotlight feature on jenkins.io
- https://contributors.jenkins.io/ is running in production \o/
-
Done:
- Delete jenkins.io-account
- Fix broken ci.jenkins.io job for controller container on Windows
- Windows Docker image: replaced
curl.exe(TLS errors since a few day) by the native Powershell HTTP client => fixed the issue - Weekly 2.436 was successfully delivered with this fix
- Windows Docker image: replaced
- Expiration of the Digital Oceans PATs [December 2023]
- Jenkins.io does not seem to be loading new content
- A build was stuck for 5 days. Killed it and next one passed
- Suspend Confluence Publisher plugin due to closed source dependency
- Suspension is merged to update center, not yet visible on plugin site
-
-
SSL certificate for repo.jenkins-ci.org expires Dec 20, 2023 (9 days)
- Let’s Encrypt 90-days for now to avoid breakage right before Christmas
- We’ll decide for 1 year (paying) or keep using LE (free but every 90 days) in January 2024
-
[INFRA-3100] Migrate updates.jenkins.io to another Cloud
- Waiting for PR review on update-center2 from JenSec team
- JEP is in draft, need more work before reviews
- get.jenkins.io/updates seems to have UC content
-
Symbolic link for “latest” for windows-stable in get.jenkins.io points to older release
- Mark recommends not working on this since it has been that way for a very long time
- Proposal to switch from blobxfer to azcopy would support symlink dereference
- Might be fixed as a happy side effect of other changes related to azcopy
- Link exists for some cases and not for other cases
- Consider placing the azcopy task into the new milestone: Check if we could replace `blobxfer` by an `az-cli` command · Issue #3414 · jenkins-infra/helpdesk · GitHub
-
Did not receive email regarding the password
- Greylisted: they need to contact their email provider as it is not clear what condition triggered the “greylisting”
- Issue on their side (or they can change their email)
-
Issues are modified by a spammer
- Account suspended and blocked
- Bulk Update feature disabled to avoid same problem later
- Board Meeting proposal to restore backup from 6th December and accept loosing data since then (one of the changes severed EPIC links which is quite an issue)
- Next steps in private discussion with board and officers
- LF contacted by Mark last Sunday (10th). We want them to send us the oldest dump (to a secure location or people!)
-
- Log files show that Maven central is cached
- Remove those caches in a brownout, good results
- Proposed this Friday, is Damien available on Friday. If not, is Daniel Beck available on Friday.
- Damien OK. He need to check with Daniel about the “to do list”.
- Mark prepare announcements for the 1:00 PM UTC Friday implementation time
-
[ci.jenkins.io / BOM] Diagnose slowness when >200 parallel pipeline steps are running
- Wait for later, OK to suspend work
-
Migration left over from publicK8s to arm64
- Stephane forgot a few services that remained on publick8s
- Services not as easy to migrate, will need more testing
- Keycloak and LDAP are storing persistent data, so would need the volume migration technique used previously
- That migration requires a stop of the service, would need planning
- Intentionally postponing
- Mirrorbits does not have an ARM64 image yet
- Proposed an ARM64 image, not yet ready
- OK to pause, return to it
-
Export download mirrors list to a textual representation
- Want a list of mirrors used by get.jenkins.io as a report from infra.ci.jenkins.io
- Started with a pull request skeleton with a bash script that parses the page to a text file
- Not good enough, need to provide a json file will all IP addresses of the mirrors
- Not specific to mirrorbits, be more generic by using a JSON format (more extensible)
- Want a list of mirrors used by get.jenkins.io as a report from infra.ci.jenkins.io
-
[get.jenkins.io] migrate from
mirrorbitstomirrorbits-parentchart- No work yet, will use the new helm charts from Damien and Herve
-
[publick8s] Tune node pool size
- Created a new smaller, less expensive Intel node pool and migrated services to the lower cost nodes
- Using 5 nodes when we were expecting 3 nodes
- Investigated on CPU consumption and think we may even be able to reduce limits to pack more effectively
- Savings expected from those changes
-
infra.ci.jenkins.io on
arm64(controller and agents)- ARM64 agents added on infra.ci.jenkins.io
- Small node pool, similar to what we did elsewhere
- Plan migration of infra.ci.jenkins.io to ARM64, will switch to a zone friendly volume
-
[Sponsorships] Setup the secondary Azure subscription to consume the sponsor credits
- Are now consuming from the secondary subscription,
- Under budget for Nov 2023 as well (even without secondary)
-
[Sponsorships] Renew DigitalOcean sponsorship for 2024
- DigitalOcean has agreed to renew the sponsorship
- Wait until current sponsorship is complete in January 2024
- Thanks to DigitalOcean
-
Packer: GOSS version tracking and moving sanity check to goss
- Stephane is working on the Windows portion of GOSS, ongoing effort to match updatecli and GOSS
- Need a pause before launching GOSS, unclear why a pause is needed or why it helps
- Passing tests tell us the system is well configured
- Stephane is working on the Windows portion of GOSS, ongoing effort to match updatecli and GOSS
-
Redirect Chinese pages to English pages and shutdown the Chinese site
- Kevin has installed minikube and other parts, stuck with some operations
- Looking at the rewrite to do the redirect
- Mark has not done his part, not yet ready for a session with Damien
- Kevin has installed minikube and other parts, stuck with some operations
-
[sponsors] [INFRA-3122] Check for Scaleway sponsorship
- Their form is gone, no way to contact them
- Let’s wait for another week and then switch to OVH sponsorship
-
-
ToDo (next milestone) (infra-team-sync-2023-12-19 Milestone · GitHub)