Skip to content

Add support for append only indices#17039

Merged
shwetathareja merged 1 commit intoopensearch-project:mainfrom
RS146BIJAY:append-only-indices
Jan 28, 2025
Merged

Add support for append only indices#17039
shwetathareja merged 1 commit intoopensearch-project:mainfrom
RS146BIJAY:append-only-indices

Conversation

@RS146BIJAY
Copy link
Copy Markdown
Contributor

@RS146BIJAY RS146BIJAY commented Jan 16, 2025

Description

Adding support for Append only indices where we are disabling any form of updates and deletes on the index. We are also preventing passing a custom doc id for bulk indexing requests. Append only indices will be supported through a configurable setting. If this setting is enabled, all update and delete operations on the index (UPDATE, DELETE, UPSERT, UPDATE BY QUERY, DELETE BY QUERY, etc,) will be blocked.

Related Issues

#12886

Check List

  • Functionality includes testing.
  • API changes companion pull request created, if applicable.
  • Public documentation issue/PR created, if applicable.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@github-actions
Copy link
Copy Markdown
Contributor

❌ Gradle check result for 38061f7: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@RS146BIJAY RS146BIJAY marked this pull request as ready for review January 17, 2025 10:31
@RS146BIJAY RS146BIJAY changed the title Adding support for append only indices Add support for append only indices Jan 17, 2025
@github-actions
Copy link
Copy Markdown
Contributor

❌ Gradle check result for 7af2713: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Copy link
Copy Markdown
Member

@mgodwan mgodwan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If indexing into lucene ever causes the version to be greater than 1, should we fail the shard?

@RS146BIJAY RS146BIJAY added backport 2.x Backport to 2.x branch v2.19.0 Issues and PRs related to version 2.19.0 labels Jan 28, 2025
@github-actions
Copy link
Copy Markdown
Contributor

✅ Gradle check result for 331fc41: SUCCESS

@RS146BIJAY RS146BIJAY force-pushed the append-only-indices branch 2 times, most recently from e5cef6d to 9051853 Compare January 28, 2025 11:03
Signed-off-by: RS146BIJAY <rishavsagar4b1@gmail.com>
@github-actions
Copy link
Copy Markdown
Contributor

✅ Gradle check result for 1acf39b: SUCCESS

@RS146BIJAY
Copy link
Copy Markdown
Contributor Author

Code coverage is taken care by Integ test cases

@shwetathareja shwetathareja merged commit 5e12737 into opensearch-project:main Jan 28, 2025
@shwetathareja
Copy link
Copy Markdown
Member

@RS146BIJAY we will need documentation PR for the new setting

opensearch-trigger-bot bot pushed a commit that referenced this pull request Jan 28, 2025
Signed-off-by: RS146BIJAY <rishavsagar4b1@gmail.com>
(cherry picked from commit 5e12737)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
@RS146BIJAY
Copy link
Copy Markdown
Contributor Author

@RS146BIJAY we will need documentation PR for the new setting

Ack. Will raise a separate documentation PR.

linuxpi pushed a commit that referenced this pull request Jan 28, 2025
(cherry picked from commit 5e12737)

Signed-off-by: RS146BIJAY <rishavsagar4b1@gmail.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
etolbakov pushed a commit to etolbakov/OpenSearch that referenced this pull request Jan 29, 2025
Signed-off-by: RS146BIJAY <rishavsagar4b1@gmail.com>
Signed-off-by: Eugene Tolbakov <ev.tolbakov@gmail.com>
@kkewwei kkewwei mentioned this pull request May 15, 2025
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport 2.x Backport to 2.x branch v2.19.0 Issues and PRs related to version 2.19.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants