[improve][broker] PIP-380: Support-setting-up-specific-namespaces-to-skipping-the-load-shedding

[Demogorgon314]

PIP: PIP-380 #23304

Motivation

#23304

Modifications

Add a new configuration loadBalancerSheddingExcludedNamespaces to allow disabling the load balancer shedding for specific namespaces.

Documentation

• doc
• doc-required
• doc-not-needed
• doc-complete

[heesung-sohn]

Left minor comments. otherwise LGTM.

[heesung-sohn]

btw, we probably want to add this bundle load data filtering logic here as well,

https://github.com/apache/pulsar/blob/master/pulsar-broker/src/main/java/org/apache/pulsar/broker/loadbalance/impl/ModularLoadManagerImpl.java#L1125

[Demogorgon314]

@heesung-sn Updated. PTAL again.

[heesung-sohn]

LGTM

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 66.66667% with 16 lines in your changes missing coverage. Please review.

Project coverage is 74.28%. Comparing base (bbc6224) to head (ca29336).
Report is 1137 commits behind head on master.

Files with missing lines	Patch %	Lines
...roker/loadbalance/impl/ModularLoadManagerImpl.java	47.82%	9 Missing and 3 partials ⚠️
...ker/loadbalance/extensions/models/TopKBundles.java	71.42%	1 Missing and 1 partial ⚠️
...dbalance/extensions/ExtensibleLoadManagerImpl.java	88.88%	0 Missing and 1 partial ⚠️
...dbalance/extensions/scheduler/TransferShedder.java	80.00%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##             master   #23549      +/-   ##
============================================
+ Coverage     73.57%   74.28%   +0.70%     
+ Complexity    32624    32324     -300     
============================================
  Files          1877     1868       -9     
  Lines        139502   145319    +5817     
  Branches      15299    16623    +1324     
============================================
+ Hits         102638   107943    +5305     
+ Misses        28908    28833      -75     
- Partials       7956     8543     +587     

Flag	Coverage Δ
inttests	26.84% <41.66%> (+2.26%)	⬆️
systests	23.26% <25.00%> (-1.06%)	⬇️
unittests	73.78% <66.66%> (+0.93%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines	Coverage Δ
...org/apache/pulsar/broker/ServiceConfiguration.java	98.16% <100.00%> (-1.23%)	⬇️
...ns/strategy/RoundRobinBrokerSelectionStrategy.java	100.00% <100.00%> (ø)
...dbalance/extensions/ExtensibleLoadManagerImpl.java	79.57% <88.88%> (-0.52%)	⬇️
...dbalance/extensions/scheduler/TransferShedder.java	82.51% <80.00%> (-0.41%)	⬇️
...ker/loadbalance/extensions/models/TopKBundles.java	93.75% <71.42%> (+2.96%)	⬆️
...roker/loadbalance/impl/ModularLoadManagerImpl.java	83.25% <47.82%> (-1.73%)	⬇️

... and 1079 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.