Scan multibranch pipeline takes a long time to complete

Hello everybody,

In my current Jenkins I have a multi-branch jenkins pipeline setup. That is also webhooked to my bitbucket repo.

Every time a developer pushes code, it triggers a scan on all branches. There are currently about 53 branches. Sometimes a scan takes a few minutes to complete and sometimes it can take up to 20 - 30 minutes. I can also reproduce it by manually clicking the “scan multibranch pipeline”.

How can there such a big difference in the amount of minutes of the scan and how can I improve or troubleshoot this issue?

I can provide some more screenshots of my setup if needed.

Hope you can help.

Best,

Jordy


Jenkins setup:
Jenkins: 2.542
OS: Linux - 6.8.0-79-generic
Java: 21.0.9 - Eclipse Adoptium (OpenJDK 64-Bit Server VM)

Office-365-Connector:5.2.0
Parameterized-Remote-Trigger:3.2.2
PrioritySorter:905.v35c21f62f980
allure-jenkins-plugin:2.34.0
ansicolor:1.0.6
ant:520.vd082ecfb_16a_9
antisamy-markup-formatter:173.v680e3a_b_69ff3
apache-httpcomponents-client-4-api:4.5.14-269.vfa_2321039a_83
apache-httpcomponents-client-5-api:5.5-170.v023de017ccd7
asm-api:9.9.1-189.vb_5ef2964da_91
atlassian-jira-software-cloud:2.0.15
authentication-tokens:1.144.v5ff4a_5ec5c33
azure-credentials:404.vd0fb_33a_8a_14e
azure-sdk:259.vf079c96088a_f
badge:2.562.vc3c0b_6925377
beer:104.v3c4e67fa_1b_f5
bootstrap5-api:5.3.8-895.v4d0d8e47fea_d
bouncycastle-api:2.30.1.82-277.v70ca_0b_877184
branch-api:2.1268.v044a_87612da_8
build-timeout:1.38
build-user-vars-plugin:212.vd6b_e9f6d0cdb\_
caffeine-api:3.2.3-194.v31a_b_f7a_b_5a_81
checks-api:373.vfe7645102093
cloud-stats:377.vd8a_6c953e98e
cloudbees-bitbucket-branch-source:937.2.2
cloudbees-disk-usage-simple:256.v20ec4eb_884f1
cloudbees-folder:6.1073.va_7888eb_dd514
command-launcher:123.v37cfdc92ef67
commons-collections4-api:4.5.0-8.va_d5448ef9011
commons-compress-api:1.28.0-2
commons-httpclient3-api:3.1-3
commons-lang3-api:3.20.0-109.ve43756e2d2b_4
commons-text-api:1.15.0-210.v7480a_da_70b_9e
config-file-provider:1006.vc7366c201f57
credentials:1453.v9b_a_29777a_b_fd
credentials-binding:702.vfe613e537e88
dark-theme:574.va_19f05d54df5
display-url-api:2.217.va_6b_de84cc74b\_
docker-commons:457.v0f62a_94f11a_3
docker-java-api:3.7.0-133.v93b_8fb_c17a_77
docker-plugin:1308.vff6e33248305
docker-workflow:634.vedc7242b_eda_7
durable-task:639.vefb_3d8372f6d
echarts-api:6.0.0-1165.vd1283a_3e37d4
eddsa-api:0.3.0.1-19.vc432d923e5ee
email-ext:1933.v45cec755423f
embeddable-build-status:637.vd878e68178f8
emoji-symbols-api:17.0-57.v8d44b_9a_b_d5ea\_
envinject:2.926.v69c9b_3896a_96
envinject-api:1.236.v35fd4d7eb_515
flaky-test-handler:1.3.168.v9b_0b_fd020db_8
font-awesome-api:7.1.0-882.v1dfb_771e3278
git:5.8.1
git-client:6.4.2
github:1.45.0
github-api:1.330-492.v3941a_032db_2a\_
github-branch-source:1925.v62fb_7ffb_08ce
gradle:2.16.1149.v711b_998b_0532
groovy-postbuild:272.v52a_03efb_8653
gson-api:2.13.2-173.va_a_092315913c
h2-api:11.1.4.199-36.vb_ee07e965744
handy-uri-templates-2-api:2.1.8-38.vcea_5d521d5f3
htmlpublisher:427
instance-identity:203.v15e81a_1b_7a_38
ionicons-api:94.vcc3065403257
jackson2-api:2.20.1-423.v13951f6b_6532
jakarta-activation-api:2.1.4-1
jakarta-mail-api:2.1.5-1
jakarta-xml-bind-api:4.0.6-10.v9b_7e1d1fc40b\_
javadoc:354.vee1a_660b_4990
javax-activation-api:1.2.0-8
javax-mail-api:1.6.2-11
jaxb:2.3.9-133.vb_ec76a_73f706
jdk-tool:83.v417146707a_3d
jersey2-api:2.47-165.ve7809a_3e87e0
jira:3.20
jjwt-api:0.11.5-120.v0268cf544b_89
joda-time-api:2.14.0-149.v1c3ce991d1b_9
jquery3-api:3.7.1-619.vdb_10e002501a\_
jsch:0.2.16-95.v3eecb_55fa_b_78
json-api:20250517-173.v596efb_962a_31
json-path-api:2.10.0-202.va_9cc16c1e476
jsoup:1.21.2-66.v6ea_38164b_8a_2
junit:1380.v491ff054cd35
junit-attachments:330.v25180b_263160
ldap:793.v754d6b_41b_ea_4
locale:614.va_6a_5a_1a_f2b_38
login-theme:284.v95044396a_484
mailer:525.v2458b_d8a_1a_71
matrix-auth:3.2.9
matrix-project:870.v9db_fcfc2f45b\_
maven-plugin:3.27
mercurial:1323.ve69d2a_db_8a_b_d
metrics:4.2.37-489.vb_6db_69b_ce753
mina-sshd-api-common:2.16.0-167.va_269f38cc024
mina-sshd-api-core:2.16.0-167.va_269f38cc024
multibranch-scan-webhook-trigger:1.0.11
nested-view:241.v178f0b_a_cd76a\_
netty-api:4.1.128.Final-14.v3a_f80ce4b_522
nodejs:1.6.6
nodelabelparameter:759.vb_b_e95db_f3251
okhttp-api:4.12.0-195.vc02552c04ffd
oss-symbols-api:424.ved751e062911
pam-auth:1.12
pipeline-build-step:571.v08a_fffd4b_0ce
pipeline-github-lib:65.v203688e7727e
pipeline-graph-analysis:245.v88f03631a_b_21
pipeline-groovy-lib:787.ve2fef0efdca_6
pipeline-input-step:540.v14b_100d754dd
pipeline-maven:1567.vb_2c3a_2116860
pipeline-maven-api:1567.vb_2c3a_2116860
pipeline-milestone-step:138.v78ca_76831a_43
pipeline-model-api:2.2277.v00573e73ddf1
pipeline-model-definition:2.2277.v00573e73ddf1
pipeline-model-extensions:2.2277.v00573e73ddf1
pipeline-rest-api:2.38
pipeline-stage-step:322.vecffa_99f371c
pipeline-stage-tags-metadata:2.2277.v00573e73ddf1
pipeline-stage-view:2.38
pipeline-utility-steps:2.20.0
plain-credentials:199.v9f8e1f741799
plugin-util-api:6.1192.v30fe6e2837ff
powershell:2.3
prism-api:1.30.0-630.va_e19d17f83b_0
prometheus:819.v50953a_c560dd
publish-over:0.22
publish-over-ssh:390.vb_f56e7405751
resource-disposer:0.25
scm-api:724.v7d839074eb_5c
script-security:1385.v7d2d9ec4d909
snakeyaml-api:2.5-143.v93b_c004f89de
sonar:2.18.2
ssh-agent:386.v36cc0c7582f0
ssh-credentials:361.vb_f6760818e8c
ssh-slaves:3.1085.vc64d040efa_85
sshd:3.374.v19b_d59ce6610
structs:362.va_b_695ef4fdf9
theme-manager:327.v780d7096ec29
thinBackup:2.1.3
timestamper:1.30
token-macro:477.vd4f0dc3cb_cf1
trilead-api:2.284.v1974ea_324382
variant:70.va_d9f17f859e0
workflow-aggregator:608.v67378e9d3db_1
workflow-api:1398.v67030756d3fb\_
workflow-basic-steps:1098.v808b_fd7f8cf4
workflow-cps:4238.va_6fb_65c1f699
workflow-durable-task-step:1464.v2d3f5c68f84c
workflow-job:1559.va_a_533730b_ea_d
workflow-multibranch:821.vc3b_4ea_780798
workflow-scm-step:466.va_d69e602552b\_
workflow-step-api:710.v3e456cc85233
workflow-support:1010.vb_b_39488a_9841
ws-cleanup:0.49

Can you post a finer log during a scan?

What is and who do you mean with function log?

Can you extract system log part, increase the log level to finer?

When the branch is already discovered, the new push should not scan anything. What bit bucket integration are you using?