Introduce mapping transformer to allow transform mappings during index create/update or index template create/update#17635
Merged
saratvemulapalli merged 1 commit intoopensearch-project:mainfrom Apr 15, 2025
Conversation
bzhangam
requested review from
Bukhtawar,
CEHENKLE,
Rishikesh1159,
VachaShah,
anasalkouz,
andrross,
ashking94,
bugmakerrrrrr,
cwperks,
dblock,
dbwiddis,
gbbafna,
jainankitk,
jed326,
kotwanikunal,
linuxpi,
mch2,
msfroh,
nknize,
owaiskazi19,
reta,
sachinpkale,
saratvemulapalli,
shwetathareja and
sohami
as code owners
github-actions
bot
added
Cluster Manager
enhancement
bzhangam
force-pushed
the
introduceMappingTransformer
branch
from
37b530b to
7d47df7
Compare
github-project-automation
bot
moved this from 🏗 In progress
to ✅ Done
in Cluster Manager Project Board
github-project-automation
bot
moved this from ✅ Done
to 🏗 In progress
in Cluster Manager Project Board
Contributor
|
❌ Gradle check result for c88378f: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
Contributor
|
❌ Gradle check result for 70be6d0: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
bzhangam
force-pushed
the
introduceMappingTransformer
branch
from
70be6d0 to
7eeb323
Compare
github-project-automation
bot
moved this from 🏗 In progress
to ✅ Done
in Cluster Manager Project Board
github-project-automation
bot
moved this from ✅ Done
to 🏗 In progress
in Cluster Manager Project Board
bzhangam
force-pushed
the
introduceMappingTransformer
branch
from
8a64e2c to
afcad68
Compare
Signed-off-by: Bo Zhang <bzhangam@amazon.com>
bzhangam
force-pushed
the
introduceMappingTransformer
branch
from
afcad68 to
c57fbf4
Compare
Contributor
|
❕ Gradle check result for c57fbf4: UNSTABLE Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure. |
saratvemulapalli
approved these changes
Apr 15, 2025
Member
saratvemulapalli
left a comment
saratvemulapalli
left a comment
There was a problem hiding this comment.
Thanks for taking care of the feedback @bzhangam !
github-project-automation
bot
moved this from 🏗 In progress
to 👀 In review
in Cluster Manager Project Board
github-project-automation
bot
moved this from 👀 In review
to ✅ Done
in Cluster Manager Project Board
x-INFiN1TY-x
pushed a commit
to x-INFiN1TY-x/OpenSearch_Local
that referenced
this pull request
Apr 24, 2025
Signed-off-by: Bo Zhang <bzhangam@amazon.com> Signed-off-by: Tanishq Ranjan <tqranjan@amazon.com>
Harsh-87
pushed a commit
to Harsh-87/OpenSearch
that referenced
this pull request
May 7, 2025
Signed-off-by: Bo Zhang <bzhangam@amazon.com> Signed-off-by: Harsh Kothari <techarsh@amazon.com>
Harsh-87
pushed a commit
to Harsh-87/OpenSearch
that referenced
this pull request
May 7, 2025
Signed-off-by: Bo Zhang <bzhangam@amazon.com> Signed-off-by: Harsh Kothari <techarsh@amazon.com>
This was referenced Jan 8, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
In this PR we introduce the mapping transformer to the core to allow transforming the mapping during index create/update and index template create/update. We want to do this because we have a use case in neural search plugin where we want to auto generate the semantic fields(e.g. knn_vector or rank_feature) in the mappings based on the model id defined in the semantic field(A new field type introduced by neural search plugin). In this way we can simplify the neural search set up.
Potentially in future this feature can be leveraged by other plugins to auto transform the mapping based on the certain config defined by users.
Related Issues
Resolves #[17500] - Proposal to introduce the mapping transformer into core.
#[803] - Proposal to support semantic field in neural search.
#[1211] - HLD of the semantic field.
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.