[fix][client] Exclude io.prometheus:simpleclient_caffeine from client-side dependencies

[lhotari]

Fixes #24755

Motivation

• Pulsar 4.0.6 breaks with Gradle Java 8 build, see [Bug] Pulsar client 4.0.6 fails with Java 8 #24755. The problem was introduced by [improve] Enable metrics for all broker caches #24365 which added the io.prometheus:simpleclient_caffeine dependency to pulsar-common module.
• pulsar-common is also shared on client side so the io.prometheus:simpleclient_caffeine dependency should be excluded from client side dependencies

Modifications

• add exclusions to pulsar-common when applicable, so that io.prometheus:simpleclient_caffeine dependency is excluded from client side dependencies
• improve the way how Prometheus dependency management in pom.xml is handle, start using the BOM

Documentation

• doc
• doc-required
• doc-not-needed
• doc-complete

[merlimat]

@lhotari there seems to be a class issue in a test:

  Error:  Failures: 
  Error:  org.apache.pulsar.websocket.WebSocketHttpServletRequestWrapperTest.mockRequestTest
  [INFO]   Run 1: PASS
  Error:    Run 2: WebSocketHttpServletRequestWrapperTest.mockRequestTest:76 » NoClassDefFound Could not initialize class org.apache.pulsar.common.stats.CacheMetricsCollector

[codecov-commenter]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 74.19%. Comparing base (8879b3b) to head (295f33e).
⚠️ Report is 2 commits behind head on master.

Additional details and impacted files

@@              Coverage Diff              @@
##             master   #24761       +/-   ##
=============================================
+ Coverage     38.31%   74.19%   +35.88%     
- Complexity    13047    33243    +20196     
=============================================
  Files          1844     1901       +57     
  Lines        144274   148403     +4129     
  Branches      16726    17204      +478     
=============================================
+ Hits          55279   110109    +54830     
+ Misses        81481    29516    -51965     
- Partials       7514     8778     +1264     

Flag	Coverage Δ
inttests	26.37% <ø> (-0.12%)	⬇️
systests	22.73% <ø> (+<0.01%)	⬆️
unittests	73.72% <ø> (+39.25%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.
see 1407 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.