Coverage fails in a Merge Request build.
I have configure it not to fail for threshold, but fail only if the coverage decreases.
I also have installed the Git Forensics Plugin, so that it can use the master branch as the reference build.
In the built Merge Request, the Coverage fails. So how can coverage drop when Jenkins says coverage hasn’t changed?
publishCoverage(adapters: [
jacocoAdapter(path: 'build/reports/jacoco/test/jacocoTestReport.xml', thresholds:
[thresholdTarget: 'Group', unhealthyThreshold: 100.0],
[thresholdTarget: 'Package', unhealthyThreshold: 100.0],
[thresholdTarget: 'File', unhealthyThreshold: 85.0],
[thresholdTarget: 'Class', unhealthyThreshold: 85.0],
[thresholdTarget: 'Method', unhealthyThreshold: 85.0],
[thresholdTarget: 'Instruction', unhealthyThreshold: 85.0],
[thresholdTarget: 'Line', unhealthyThreshold: 85.0],
[thresholdTarget: 'Conditional', unhealthyThreshold: 85.0]
])
], calculateDiffForChangeRequests: true, failBuildIfCoverageDecreasedInChangeRequest: true,
sourceFileResolver: sourceFiles('STORE_LAST_BUILD'), tag: 'JaCoCo')
This is what Jenkins has to say about the coverage of the merge request build:
Coverage Reports
Code coverage hasn't changed in comparison with the target branch build
Report: 100% Group: 100% Package: 85% File: 51% Class: 51% Method: 46% Instruction: 43% Line: 42% Conditional: 38%
This is what Jenkins has to say about coverage on the reference build. The Target Branch Build (master)
Coverage Report
Line: 42.43%
Branch: 38.87%
09:27:09 Report coverage diff: 0.0%. Add to CoverageResult.
09:27:09 Group coverage diff: 0.0%. Add to CoverageResult.
09:27:09 Package coverage diff: 0.0%. Add to CoverageResult.
09:27:09 File coverage diff: -0.059009552%. Add to CoverageResult.
09:27:09 Class coverage diff: -0.047649384%. Add to CoverageResult.
09:27:09 Method coverage diff: -0.014305115%. Add to CoverageResult.
09:27:09 Instruction coverage diff: -0.018161774%. Add to CoverageResult.
09:27:09 Line coverage diff: -0.020206451%. Add to CoverageResult.
09:27:09 Conditional coverage diff: 0.0%. Add to CoverageResult.
09:27:09 [Coverage] Computing coverage delta report
09:27:09 [Coverage] Obtaining reference build from reference recorder
09:27:09 [Coverage] -> Found 'Packages » my-gui-application » master #1'
09:27:09 [Coverage] -> Using reference build 'packages/my-gui-application/master #1'
09:27:09 [Coverage] -> Found reference result 'io.jenkins.plugins.coverage.CoverageAction@5f11d158'
09:27:10 Code coverage enforcement failed: Package coverage in Report level 'my-gui-application: jacocoTestReport.xml' is lower than 100.00 healthy threshold
09:27:10 Code coverage enforcement failed: File coverage in Report level 'my-gui-application: jacocoTestReport.xml' is lower than 85.00 healthy threshold
09:27:10 Code coverage enforcement failed: Class coverage in Report level 'my-gui-application: jacocoTestReport.xml' is lower than 85.00 healthy threshold
09:27:10 Code coverage enforcement failed: Method coverage in Report level 'my-gui-application: jacocoTestReport.xml' is lower than 85.00 healthy threshold
09:27:10 Code coverage enforcement failed: Instruction coverage in Report level 'my-gui-application: jacocoTestReport.xml' is lower than 85.00 healthy threshold
09:27:10 Code coverage enforcement failed: Line coverage in Report level 'my-gui-application: jacocoTestReport.xml' is lower than 85.00 healthy threshold
09:27:10 Code coverage enforcement failed: Conditional coverage in Report level 'my-gui-application: jacocoTestReport.xml' is lower than 85.00 healthy threshold
09:27:10 io.jenkins.plugins.coverage.exception.CoverageException: Fail build because this change request decreases line coverage by -0.020206451
09:27:10 at io.jenkins.plugins.coverage.CoverageProcessor.failBuildIfChangeRequestDecreasedCoverage(CoverageProcessor.java:279)
09:27:10 at io.jenkins.plugins.coverage.CoverageProcessor.performCoverageReport(CoverageProcessor.java:146)
09:27:10 at io.jenkins.plugins.coverage.CoveragePublisher.perform(CoveragePublisher.java:99)
09:27:10 at jenkins.tasks.SimpleBuildStep.perform(SimpleBuildStep.java:123)
09:27:10 at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:101)
09:27:10 at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:71)
09:27:10 at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
09:27:10 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
09:27:10 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
09:27:10 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
09:27:10 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
09:27:10 at java.base/java.lang.Thread.run(Thread.java:829)
09:27:10
09:27:10 [Checks API] No suitable checks publisher found.