[AUTO] [main] Added bwc version 2.4.2.

[opensearch-trigger-bot]

I've noticed that a new tag 2.4.1 was pushed, and added a bwc version 2.4.2.

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: SUCCESS ✅
• URL: https://build.ci.opensearch.org/job/gradle-check/8053/
• CommitID: b41a5c6

[reta]

@dblock seems like changes in Version.java are missed?

[dblock]

@reta We're doing funky things here on main. See if this is OK? Are those comments useful?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/8068/
• CommitID: 52f7715
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[reta]

@reta We're doing funky things here on main. See if this is OK? Are those comments useful?

@dblock unfortunately they still are:

/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:86: error: cannot find symbol

    public static final Version V_2_4_1 = new Version(2040199, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
> Task :server:compileJava
  location: class Version
/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:89: error: cannot find symbol
    public static final Version V_2_4_2 = new Version(2040299, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
  location: class Version
/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:90: error: cannot find symbol
    public static final Version V_2_5_0 = new Version(2050099, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
  location: class Version

The issue here is that we (OpenSearch) build our own Apache Lucene snapshots and publish them, I sadly don't know the details how often we do that, but we have not done that in a while, and hence we have pretty old 9.5.0 snapshots without 9.4.2 reference :(

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.indices.stats.IndexStatsIT.testFilterCacheStats
      1 org.opensearch.cluster.allocation.AwarenessAllocationIT.testThreeZoneOneReplicaWithForceZoneValueAndLoadAwareness

• URL: https://build.ci.opensearch.org/job/gradle-check/8066/
• CommitID: b621228
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[dreamer-89]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.indices.stats.IndexStatsIT.testFilterCacheStats
      1 org.opensearch.cluster.allocation.AwarenessAllocationIT.testThreeZoneOneReplicaWithForceZoneValueAndLoadAwareness

• URL: https://build.ci.opensearch.org/job/gradle-check/8066/
• CommitID: b621228
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

#2501

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/8074/
• CommitID: 52f7715
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[dreamer-89]

@reta We're doing funky things here on main. See if this is OK? Are those comments useful?

@dblock unfortunately they still are:

/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:86: error: cannot find symbol

    public static final Version V_2_4_1 = new Version(2040199, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
> Task :server:compileJava
  location: class Version
/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:89: error: cannot find symbol
    public static final Version V_2_4_2 = new Version(2040299, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
  location: class Version
/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:90: error: cannot find symbol
    public static final Version V_2_5_0 = new Version(2050099, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
  location: class Version

The issue here is that we (OpenSearch) build our own Apache Lucene snapshots and publish them, I sadly don't know the details how often we do that, but we have not done that in a while, and hence we have pretty old 9.5.0 snapshots without 9.4.2 reference :(

@reta: Thanks for sharing this. I see

@reta We're doing funky things here on main. See if this is OK? Are those comments useful?

@dblock unfortunately they still are:

/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:86: error: cannot find symbol

    public static final Version V_2_4_1 = new Version(2040199, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
> Task :server:compileJava
  location: class Version
/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:89: error: cannot find symbol
    public static final Version V_2_4_2 = new Version(2040299, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
  location: class Version
/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:90: error: cannot find symbol
    public static final Version V_2_5_0 = new Version(2050099, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
  location: class Version

The issue here is that we (OpenSearch) build our own Apache Lucene snapshots and publish them, I sadly don't know the details how often we do that, but we have not done that in a while, and hence we have pretty old 9.5.0 snapshots without 9.4.2 reference :(

There seems to be lucene snapshot workflow which generates the snapshots but needs aws account creds. @dblock @nknize : Any idea how do we trigger this job ?

[reta]

There seems to be lucene snapshot workflow which generates the snapshots but needs aws account creds.

Exactly :(

[nknize]

We shouldn't bump Lucene versions without triggering a snapshot build or updating the versions file with the next release (and updating shas). This should happen in a dedicated PR. I went ahead and triggered the next snapshot build.

https://github.com/opensearch-project/OpenSearch/actions/runs/3690669028

[dreamer-89]

We shouldn't bump Lucene versions without triggering a snapshot build or updating the versions file with the next release (and updating shas). This should happen in a dedicated PR. I went ahead and triggered the next snapshot build.

https://github.com/opensearch-project/OpenSearch/actions/runs/3690669028

The publish-snapshots step is failing @nknize

publish-snapshots
OpenIDConnect provider's HTTPS certificate doesn't match configured thumbprint

[nknize]

/cc @mch2 can you take a look when you get a chance?

[mch2]

/cc @mch2 can you take a look when you get a chance?

Seems like flaky behavior with OIDC, I've added the most current GH thumbprint manually and kicked off a run of lucene branch_9_4 - created version 9.4.3-snapshot-bb7785b and branch_9x - created version 9.5.0-snapshot-d5cef1c . For more info on the thumbprints - aws-actions/configure-aws-credentials#395.

There seems to be lucene snapshot workflow which generates the snapshots but needs aws account creds.

Exactly :(

Yep my fault sorry about this, I never pushed the cdk code used. I reused this cdk project from data-prepper to use an s3 bucket as our maven repo. Will move all this cdk config to a folder in core.

[dreamer-89]

Closing this in favour of #5570