[BUG] Flaky org.opensearch.cluster.allocation.ClusterRerouteIT.testDelayWithALargeAmountOfShards

[ashking94]

Describe the bug
org.opensearch.cluster.allocation.ClusterRerouteIT.testDelayWithALargeAmountOfShards test is flaky.

To Reproduce
CI - https://build.ci.opensearch.org/job/gradle-check/27604/testReport/junit/org.opensearch.cluster.allocation/ClusterRerouteIT/testDelayWithALargeAmountOfShards/

Expected behavior
Test should always pass

Plugins
Please list all plugins currently enabled.

Screenshots
If applicable, add screenshots to help explain your problem.

Host/Environment (please complete the following information):

• OS: [e.g. iOS]
• Version [e.g. 22]

Additional context
Add any other context about the problem here.

[peternied]

+1 #10800 (comment)

[amkhar]

#10904 (comment)