[AUTOCUT] Gradle Check Flaky Test Report for RemoteStoreKafkaIT

[opensearch-ci-bot]

Flaky Test Report for RemoteStoreKafkaIT

Noticed the RemoteStoreKafkaIT has some flaky, failing tests that failed during post-merge actions and timer trigerred run on main branch.

Details

Git Reference	Merged Pull Request	Build Details	Test Name
main	null	58898 60364 62476 62597 63248 63612 68699 68751 71394 71626 71731	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testBatchStartPointerOnReplicaPromotion org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testDefaultGetIngestionState org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testErrorStrategy org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testExternalVersioningWithDisabledGCDeletes org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testOffsetUpdateOnBlockErrorPolicy org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testRemoteSnapshotRestore org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testSegmentReplicationWithRemoteStore
2b6d266	20140	68145	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testExternalVersioning
82ebf3b	19074	62412	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testSegmentReplicationWithRemoteStore
2f416d3	19032	62279	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion
5fd0a36	18808	61327	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion
a8b1734	18087	57282	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion
4c76c1d	18027	57085	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion
ddb4354	17893	56370	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testErrorStrategy
e8b975d	17750	55870	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testSegmentReplicationWithRemoteStore
6b976ea	17836	55861	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testSegmentReplicationWithRemoteStore
17289b7	17663	54990	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testSegmentReplicationWithRemoteStore

The other pull requests, besides those involved in post-merge actions, that contain failing tests with the RemoteStoreKafkaIT class are:

• 20192
• 17631
• 18333
• 18405
• 18944
• 18693
• 17752
• 17764
• 20526
• 17273
• 17712
• 17771
• 17815
• 17941
• 19046
• 17336
• 17495
• 17575
• 17612
• 17615
• 17619
• 17679
• 17699
• 17729
• 17733
• 17757
• 17791
• 17843
• 17912
• 18054
• 18063
• 18153
• 18161
• 18169
• 18195
• 18197
• 18229
• 18254
• 18288
• 18312
• 18331
• 18504
• 18602
• 18649
• 18702
• 18748
• 18877
• 18879
• 18889
• 19199
• 19320
• 19958
• 20065
• 20530
• 20874

For more details on the failed tests refer to OpenSearch Gradle Check Metrics dashboard.

[krisfreedain]

Catch all triage - 1

[andrross]

@yupeng9 @varunbharadwaj Can one of you take a look here? These tests have been pretty flaky. Here's an example:

https://build.ci.opensearch.org/job/gradle-check/57507/consoleText

REPRODUCE WITH: ./gradlew ':plugins:ingestion-kafka:internalClusterTest' --tests "org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion" -Dtests.seed=99C705639E2EC4B4 -Dtests.security.manager=false -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=bem-ZM -Dtests.timezone=SystemV/AST4ADT -Druntime.java=21

RemoteStoreKafkaIT > testPauseAndResumeIngestion FAILED
    java.lang.AssertionError: expected:<2> but was:<4>
        at __randomizedtesting.SeedInfo.seed([99C705639E2EC4B4:473224DAFADE6AA]:0)
        at org.junit.Assert.fail(Assert.java:89)
        at org.junit.Assert.failNotEquals(Assert.java:835)
        at org.junit.Assert.assertEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:633)
        at org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion(RemoteStoreKafkaIT.java:216)

[yupeng9]

ack, will take a look