Fixing org.opensearch.repositories.azure.AzureBlobContainerRetriesTests and org.opensearch.action.admin.cluster.node.stats.NodeStatsTests

[reta]

Description

Fixing org.opensearch.repositories.azure.AzureBlobContainerRetriesTests and org.opensearch.action.admin.cluster.node.stats.NodeStatsTests

Issues Resolved

Closes #1389 and #1388

Check List

• New functionality includes testing.
  • All tests pass
• New functionality has been documented.
  • New functionality has javadoc added
• Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[opensearch-ci-bot]

Can one of the admins verify this patch?

[opensearch-ci-bot]

✅   DCO Check Passed d7d571438102f6178c1d59824d498f94f4ef8909

[reta]

Aligning with netty 4.1.69.Final

[opensearch-ci-bot]

✅   Gradle Wrapper Validation success d7d571438102f6178c1d59824d498f94f4ef8909

[reta]

When CI node gets really busy, 1s may not be enough (this is total operation timeout, not network one)

[opensearch-ci-bot]

❌   Gradle Precommit failure d7d571438102f6178c1d59824d498f94f4ef8909
Log 1351

[opensearch-ci-bot]

✅   Gradle Wrapper Validation success d6b9bbc

[opensearch-ci-bot]

✅   DCO Check Passed d6b9bbc

[opensearch-ci-bot]

✅   Gradle Precommit success d6b9bbc

[dblock]

start gradle check

[opensearch-ci-bot]

❌   Gradle Check failure d6b9bbc
Log 736

Reports 736

[reta]

❌ Gradle Check failure d6b9bbc Log 736

Reports 736

@dblock another flaky one? First time I see it, have you seen it before?

REPRODUCE WITH: ./gradlew ':server:internalClusterTest' --tests "org.opensearch.snapshots.SharedClusterSnapshotRestoreIT.testSnapshotCanceledOnRemovedShard" -Dtests.seed=9350EB7A8335C1F9 -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1" -Dtests.locale=sl -Dtests.timezone=SystemV/PST8 -Druntime.java=17

org.opensearch.snapshots.SharedClusterSnapshotRestoreIT > testSnapshotCanceledOnRemovedShard FAILED
    SnapshotMissingException[[test-repo:test-snap] is missing]
        at org.opensearch.action.admin.cluster.snapshots.get.TransportGetSnapshotsAction.masterOperation(TransportGetSnapshotsAction.java:160)
        at org.opensearch.action.admin.cluster.snapshots.get.TransportGetSnapshotsAction.masterOperation(TransportGetSnapshotsAction.java:80)
        at org.opensearch.action.support.master.TransportMasterNodeAction.masterOperation(TransportMasterNodeAction.java:124)
        at org.opensearch.action.support.master.TransportMasterNodeAction$AsyncSingleAction.lambda$doStart$3(TransportMasterNodeAction.java:197)
        at org.opensearch.action.ActionRunnable$2.doRun(ActionRunnable.java:86)
        at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:792)
        at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.lang.Thread.run(Thread.java:833)

[nknize]

another flaky one? First time I see it...

I've seen this failure before. It's sporadic and needs deeper investigation so I opened #1396

Rerunning gradle check here...

[nknize]

start gradle check

[opensearch-ci-bot]

✅   Gradle Check success d6b9bbc
Log 747

Reports 747