Skip to content

Add foreach processor documentation#5981

Merged
vagimeli merged 12 commits into
mainfrom
foreach-processor
May 28, 2024
Merged

Add foreach processor documentation#5981
vagimeli merged 12 commits into
mainfrom
foreach-processor

Conversation

@vagimeli
Copy link
Copy Markdown
Contributor

Description

Closes content gap

Issues Resolved

#4647

Checklist

  • By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and subject to the Developers Certificate of Origin.
    For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
@vagimeli
Copy link
Copy Markdown
Contributor Author

@hdhalter We need a dev to take the first pass at drafting this content. I can support them in refining the content and getting it through the documentation process. The ingest processor template is provided with this PR, so it should help the dev get started. Thanks!

@vagimeli vagimeli marked this pull request as draft February 15, 2024 21:14
@vagimeli vagimeli marked this pull request as ready for review May 22, 2024 15:55
@vagimeli vagimeli changed the title [DOC] Add foreach processor documentation Add foreach processor documentation May 22, 2024
Comment thread _ingest-pipelines/processors/foreach.md
vagimeli added 2 commits May 22, 2024 12:21
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Comment thread _ingest-pipelines/processors/foreach.md
@vagimeli vagimeli added the backport 2.14 PR: Backport label for 2.14 label May 22, 2024
Comment thread _ingest-pipelines/processors/foreach.md
Comment thread _ingest-pipelines/processors/foreach.md Outdated
Comment thread _ingest-pipelines/processors/foreach.md Outdated
Comment thread _ingest-pipelines/processors/foreach.md Outdated
Comment thread _ingest-pipelines/processors/foreach.md Outdated
Comment thread _ingest-pipelines/processors/foreach.md Outdated
Comment thread _ingest-pipelines/processors/foreach.md Outdated
Comment thread _ingest-pipelines/processors/foreach.md Outdated
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Copy link
Copy Markdown
Contributor

@natebower natebower left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@vagimeli LGTM with the noted comments and changes. Thanks!

Comment thread _ingest-pipelines/processors/foreach.md Outdated
Comment thread _ingest-pipelines/processors/foreach.md Outdated
|-----------|-----------|-----------|
`field` | Required | The array field to iterate over.
`processor` | Required | The processor to execute against each field.
`ignore_missing` | Optional | If `true` and the specified field does not exist or is null, the processor will quietly exit without modifying the document.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is "quietly" necessary here? If it's a technical term and adds context, then fine as is.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's a technical expression that means hat the processor will terminate or exit its execution without performing any further actions or modifications to the document and without producing any errors or notifications.

Comment thread _ingest-pipelines/processors/foreach.md Outdated
Comment thread _ingest-pipelines/processors/foreach.md Outdated

#### Response

The following example response confirms that the pipeline is working as expected, showing the four elements have been lowercased:
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"that" should precede either "the four" or "have been", depending on the meaning.

Comment thread _ingest-pipelines/processors/foreach.md Outdated
]
}
}
gaobinlong1 day ago
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove?

vagimeli and others added 4 commits May 28, 2024 12:40
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
@vagimeli vagimeli merged commit fe979d5 into main May 28, 2024
@github-actions github-actions Bot deleted the foreach-processor branch May 28, 2024 18:51
opensearch-trigger-bot Bot pushed a commit that referenced this pull request May 28, 2024
* Add foreach processor documentation

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Add pipeline example requests and responses

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Add pipeline examples

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Address tech review comments

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Update _ingest-pipelines/processors/foreach.md

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Update _ingest-pipelines/processors/foreach.md

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Address editorial review comments

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

---------

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
(cherry picked from commit fe979d5)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport 2.14 PR: Backport label for 2.14 Content gap

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants