Failing ES Promotion: apis management index management Data streams Get "before all" hook in "Get"" 13:42:45 │

[tylersmalley]

This failure is preventing the promotion of the current Elasticsearch nightly snapshot.

master/8.0: https://kibana-ci.elastic.co/job/elasticsearch+snapshots+verify/894/execution/node/407/log/?consoleFull
7.x/7.9: https://kibana-ci.elastic.co/job/elasticsearch+snapshots+verify/897/execution/node/442/log/

For more information on the Elasticsearch snapshot promotion process: https://www.elastic.co/guide/en/kibana/master/development-es-snapshots.html

Caused by elastic/elasticsearch#57701

13:42:45    1) apis
13:42:45         management
13:42:45           index management
13:42:45             Data streams
13:42:45               Get
13:42:45                 "before all" hook in "Get":
13:42:45       Error: [illegal_argument_exception] composable template [test-data-stream] template after composition is invalid
13:42:45        at respond (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:349:15)
13:42:45        at checkRespForFailure (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:306:7)
13:42:45        at HttpConnector.<anonymous> (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
13:42:45        at IncomingMessage.wrapper (/dev/shm/workspace/kibana/node_modules/elasticsearch/node_modules/lodash/lodash.js:4929:19)
13:42:45        at endReadableNT (_stream_readable.js:1145:12)
13:42:45        at process._tickCallback (internal/process/next_tick.js:63:19)
13:42:45  
13:42:45                     └- ✖ fail: "apis management index management Data streams Get "before all" hook in "Get""
13:42:45                     │
13:42:45                     └-> "after all" hook
13:42:45  
13:42:45    1) apis
13:42:45         management
13:42:45           index management
13:42:45             Data streams
13:42:45               Get
13:42:45                 "after all" hook in "Get":
13:42:45       Error: [index_template_missing_exception] index_template [test-data-stream] missing
13:42:45        at respond (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:349:15)
13:42:45        at checkRespForFailure (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/transport.js:306:7)
13:42:45        at HttpConnector.<anonymous> (/dev/shm/workspace/kibana/node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
13:42:45        at IncomingMessage.wrapper (/dev/shm/workspace/kibana/node_modules/elasticsearch/node_modules/lodash/lodash.js:4929:19)
13:42:45        at endReadableNT (_stream_readable.js:1145:12)
13:42:45        at process._tickCallback (internal/process/next_tick.js:63:19)
13:42:45  
13:42:45                       └- ✖ fail: "apis management index management Data streams Get "after all" hook in "Get""
13:42:45                       │
13:42:45                     └-> "after all" hook
13:42:45                   └-> "after all" hook
13:42:45                 └-> "after all" hook
13:42:45               └-> "after all" hook

[elasticmachine]

Pinging @elastic/es-ui (Team:Elasticsearch UI)

[jloleysens]

Hey @tylersmalley ! I am guessing this is a flaky failure?

I was thinking the cause could be related to how the index template is setup in the index management API integration test, but was not able to reproduce locally.

I have opened a PR #69138 that attempts to address this.

[jloleysens]

Or, actually, I did not test building ES from source. I am guessing that change was not released yet, my bad.

[jloleysens]

Tested against source, the PR should fix the test from blocking snapshot promotion.

[jbudz]

build history at https://kibana-ci.elastic.co/job/elasticsearch+snapshots+verify/ - i'll see if this happening locally.

[jloleysens]

@jbudz This looks like it is being caused by a different change to the data streams endpoint. This time the timestamp_field response is no longer returning a string, but an object. Causing the test assertion to fail. This will also cause issues for our UI. I will make a PR to fix the affected areas.

[jloleysens]

And there is another issue that is still lingering from the original PR creating a stricter check on creating of composable index templates. Will also address that. The newer issue seems to be coming from elastic/elasticsearch#58400