Infrastructure Team Meeting - January 21, 2025

Attendees :busts_in_silhouette:

Announcements :loudspeaker:

  1. Jenkins Weekly Releases
    • Last week: 2.493 released with no issues.
    • This Week: 2.494 started on time today
  2. Azure Outages impacting Container Instances
    • Reminder:
    • Issues to create:
      • Write down procedure to switch labels to VM (without breaking JDK selection) => @dduportal
      • Monitoring should alert us when agent allocations starts to fail => @dduportal
        • Increase build retention for jenkins-infra-plugin and the Infra/acceptance-tests
        • Datadog monitor (for both builds): status? build time?
        • See if pattern emerges to trigger alerts
    • New impact detected by @en3hD3iMRx6_6IXLNY0Rag on Jenkins Core Tests which times out around 6h. Short term: if no immediate solution disable test until we’ve migrated to AWS anbd then re-analysis.
  3. No team meeting the 4 February 2025 (post-FOSDEM)

Upcoming Calendar :calendar:

Cloud Budgets

  • Azure CDF:
    • October: $4,0k (invoice)
    • November: $4,3k (invoice)
    • December: $4,4k
    • :warning: January: $2,905 (forecast at $4.5k) :warning:
      • Increase in DNS billing in our zones
      • Increase on trusted.ci (not sure why: crawler failures?) agent
  • Azure Sponsorship (Microsoft Credits) - Remaining: $24,714 until May 2025
    • October: $12,9k consumed
    • November: $13k
    • December: $9,5k
    • January: $7.4k (forecast at $10,8k) :warning:
  • DigitalOcean - Remaining ~$15k until January 02, 2026
    • October: $195.67 (invoice)
    • November: $146 (invoice)
    • December: $192 (invoice)
    • January: $146 (forecast at $216)
  • AWS:
    • CloudBees:
      • October: $6,4k
      • November: $3,9k
      • December: $540
      • January: $344 (forecast at $530)
    • Sponsored account (~$58k credits lefts)
      • October: $178
      • November: $482
      • December: $595
      • January: $578 (forecast at $890)

Notes :book: