GSoC Office Hour - June 11, 2025

Hi,

This meeting will begin in 45 minutes. Agenda and Zoom info are at Jenkins GSoC 2025 Office Hours Meeting Agenda and Notes - Google Docs.

Thanks,
alyssa

1 Like

Meeting Notes:

Attendees: Alyssa, Bruno, Kevin, Valentin, Kris Stern, Giovanni Vaccarino, Chirag Gupta, Phillipp Glanz, Birajit Saikia, Maeve Ho

Agenda:

Status Update

  • Jenkins Domain Specific LLM - Chirag Gupta

    • Architecture for the agent confirmed.
    • Tools finalized for the agent.
    • Done with exploration of various architectures for making the agent.
    • Started the work on the prototype.
  • AI-Powered Chatbot for Quick Access to Jenkins Resources - Giovanni Vaccarino

    • Logistics:
      • Blog post went online last week
      • Community mail sent last week
    • Technical:
      • More PRs have been merged
      • Working on the evaluation
        • Done some research on how to better approach the process
          • Splitting the evaluation into two parts
            • Quality of the retrieval
            • Quality of the generation
        • Created a benchmark dataset of ~ 300 QAs, giving priority to official data sources
          • 100 QAs from Jenkins Docs
          • 100 QAs from Jenkins Plugin Docs
          • 50 QAs from Discourse/community.jenkins.io questions
          • 50 QAs from StackOverflow threads
        • The dataset was created using an LLM(Mistral 7B Instruct), providing him the content(e.g. A plugin’s docs or a page from the documentation) and asking him to generate a QA on that content
        • Prepared an evaluation pipeline
        • Ready to evaluate and tune
        • First results show that as expected the retrieval have to be optimized using a hybrid approach
        • Working with Notebooks to exploit Colab/Kaggle
  • Improving Tekton Client Plugin for Jenkins - Maeve Ho

  • Improving Plugin Modernizer - Raunak Madan

    • Blog post up and running, and mail sent to the dev mailing list last week.

    • Push the metadata to a public repo each time the CLI tool runs. (#1047). PR will be ready today after a bit of cleanup.

    • Now we are able to store the metadata as plugin-name/modernization-metadata/timestamp.json.

    • We will open a repo under jenkins-infra later on. Currently working with a test repo.

    • Now will focus on extracting the metadata (PR link etc).

  • Complete Build Retooling of Jenkins.io - Birajit Saikia

    • Antora (docs.jenkins.io) Work
      • Continued syncing content from jenkins.io:
        • Part 8 – PR #310
        • Part 9 – PR #311
        • Part 10 – PR #314
        • Part 11 – PR #315
        • These marked the end of full updates to latest state of jenkins.io in docs.jenkins.io repo . Although this is just part 1 of our Antora work . We will come back to the antora part like migration of pages and division again from July 1.
        • Also previously part 7 and 8 were in draft mode since some more changes were needed . Now part 8 is ready and part 7 will be completely ready for review by tonight.
      • Top navbar links fixed via:
      • Resolved Issue #200 by reformatting and restoring full authors data — useful for migration to Gatsby later → PR #319
    • Gatsby Site Migration Kickoff
      • Officially started the Gatsby part of the project on June 10
      • Decided on a weekly page-by-page migration plan (2–5 pages per week)
      • Opened two tracking issues for this week’s pages in the new Gatsby repo:
        • #1 – Migrate Download Page
          • I will create some sub-issues inside this main issue for some of the sub pages inside download folder that needs to be migrated as well as decided in our yesterday project meet.
        • #2 – Migrate Roadmap Page
  • Other updates

    • Held 3rd weekly GSoC project meeting on June 10
    • Updated the Notion tracker with all tasks and milestones
    • Added a direct LinkedIn button to blog post via PR #8177 in jenkins.io (live at all blog posts)
  • Daily progress updates-

1 Like