Add retry logic in pulsar consumer unsubscribe

[congqixia]

Add retry logic in pulsar consumer Unsubscribe.
Tested with until fail script, works find in tens of minutes without failure with current retry setting.

Also remove panic logic when unsubscribe fails since the cost is too huge.

/cc @bigsheeper @xiaofan-luan
/kind bug

Fix #15280

Signed-off-by: Congqi Xia [email protected]

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[xiaofan-luan]

/lgtm

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: congqixia

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• internal/datanode/OWNERS [congqixia]
• internal/util/OWNERS [congqixia]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[bigsheeper]

/lgtm

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[yanliang567]

/run-checks

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[yanliang567]

/run-checks

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[mergify]

@congqixia E2e jenkins job failed, comment /run-checks can trigger the job again.

[codecov]

Codecov Report

Merging #15284 (9116ca1) into master (bbb672c) will increase coverage by 0.08%.
The diff coverage is 80.00%.

@@            Coverage Diff             @@
##           master   #15284      +/-   ##
==========================================
+ Coverage   79.63%   79.71%   +0.08%     
==========================================
  Files         450      450              
  Lines       61441    61445       +4     
==========================================
+ Hits        48928    48982      +54     
+ Misses      10168    10121      -47     
+ Partials     2345     2342       -3     

Impacted Files	Coverage Δ
internal/util/mqclient/pulsar_consumer.go	90.78% <80.00%> (-0.88%)	⬇️
internal/util/flowgraph/node.go	72.26% <0.00%> (-0.85%)	⬇️
internal/rootcoord/root_coord.go	79.38% <0.00%> (+0.12%)	⬆️
internal/querycoord/task.go	80.20% <0.00%> (+0.19%)	⬆️
internal/querycoord/task_scheduler.go	75.38% <0.00%> (+0.35%)	⬆️
internal/proxy/impl.go	84.48% <0.00%> (+0.49%)	⬆️
internal/msgstream/mq_msgstream.go	75.54% <0.00%> (+0.77%)	⬆️
internal/datacoord/segment_manager.go	82.81% <0.00%> (+1.03%)	⬆️
internal/distributed/querycoord/client/client.go	72.13% <0.00%> (+2.18%)	⬆️
internal/indexnode/indexnode_mock.go	87.87% <0.00%> (+3.03%)	⬆️
... and 1 more