GSoC Office Hour June 18, 2025

Will begin in 1 hour.

Agenda and call in info are at Jenkins GSoC 2025 Office Hours Meeting Agenda and Notes - Google Docs.

Meeting notes and recording will be shared below after the meeting.

thanks,
alyssa

Meeting Notes:

Attendees: Alyssa, Raunak Madan, Giovanni Vaccarino, Kris Stern, Bruno, Valentin, Maeve Ho , Birajit Saikia, Chirag, Sridhar, Vutukuri

Agenda:

Status Update

  • AI-Powered Chatbot for Quick Access to Jenkins Resources - Giovanni Vaccarino

  • More research have been done to understand which keyword-based method to use to improve the research

  • Extracted first evaluation on the benchmark with only semantic research

    • Quality between 45-55/100
    • Have to tune RAG hyperparams, that could lead to
  • First experiments implementing search with BM25

    • Using a two stage approach, searching before on the titles and then on the chunks of the titles found
      • Worse results having a quality ~35/100
    • Searching directly on all the chunks
      • A bit more computationally expensive but lead to better results
      • Better results than the two stage approach, leading to a quality of ~45/100
      • However very homogeneous w.r.t. Data sources
  • Next experiments will include

    • Mixing the 2 search approaches
    • Tuning params on semantic research
  • Worked on the UI to match the multi-chat functionality already offered by the backend

    • PR #13
    • With this PR and some future fixes, we should be at a good point for the UI
  • While continuing the work on optimizing the retrieval performance, I’ll continue working on other tasks

  • Week of university exams

  • Improving Tekton Client Plugin for Jenkins - Maeve Ho

    • Got the modernization task PR merged: #391, Tekton plugin can now run on Java 17 with the latest Jenkins version
    • Update all Github Actions workflows to match with the new version
    • WIP: Documenting existing features, analyzing current architecture for refactor, writing pros/cons analysis.
    • KS: Update to Java 21
  • Improving Plugin Modernizer - Raunak Madan

    • We are able to collect the pull request URL, pull request status, and check run information, if any PR is made via our CLI tool for the plugin modernization. #1062
    • The check (success or failure) and the status (open, closed, or merged) of the PR are updated dynamically via the GitHub Actions workflow on the metadata repository.
    • Extract the diff stats, i.e, (no. of additions, deletions, and changed files) after the plugin modernization. #1069
    • Fix bug to set the remote origin correctly to SSH of the forked repo when forking metadata #1063
    • Will now focus on the vetting process and validating the metadata changes so we merge only valid PRs.
  • Complete Build Retooling of Jenkins.io - Birajit Saikia

    • PR merged for new share button addition in jenkins.io #8180
    • PR’s for updates in Antora are in review; some of them and working on feedbacks
    • Gatsby work has begun -
      • Roadmap page migration completed
      • Download page migration completed
      • Changelog pages migration completed
      • Main content completed only the styling to match like jenkins.io is left
    • Continuing to raise PRs in jenkins.io to keep things up-to-date
    • Had our last project meet yesterday -
      • Discussed this week’s targeted pages goals
    • Daily progress updates-
  • Jenkins Domain Specific LLM - Chirag Gupta

    • Finalised the agent architecture and documented it.
    • Updated the repo with the final architecture Puml code and the image.
    • A basic working prototype is ready.
    • Self-study on MCP.
    • Working on the LightRag tool to be used by the agent.
  • Projects are on schedule according to lead mentors.

Upcoming deadline:

  • July 14 - Mentors and GSoC contributors can begin submitting midterm evaluations (for standard 12 week coding projects)
  • July 18 - Midterm evaluation deadline (standard coding period)

Action item: