Getting statistics on flaky tests / Monitoring tool

I have test runs in my project with hundreds of tests. Some of the tests are flickering - they fail from time to time. I want to keep an eye on them and know how they behave over time. Is there any useful plugin for that? We are using the “Test Results Analyzer”, but you can’t configure a list of tests to observe there… I have to type subsequently, from time to time all my test names in the search field to see their trend. I would prefer a simple dashboard with a configurable list of tests I want to observe.

I think @timja has done some work on https://plugins.jenkins.io/junit-sql-storage/

I’ve never looked into it, but it might give you a database you can do some querying on.

Are you building with maven? Then you can extract those tests using https://github.com/zeebe-io/flaky-test-extractor-maven-plugin. The output can then be parsed by the junit-plugin.