Skip to content

Add setting to configure the source mode of a data stream#419

Merged
jsoriano merged 4 commits intoelastic:mainfrom
jsoriano:synthetic-source-toggle
Sep 21, 2022
Merged

Add setting to configure the source mode of a data stream#419
jsoriano merged 4 commits intoelastic:mainfrom
jsoriano:synthetic-source-toggle

Conversation

@jsoriano
Copy link
Copy Markdown
Member

@jsoriano jsoriano commented Sep 15, 2022

What does this PR do?

Add setting to configure the source mode of a data stream.

Why is it important?

Depending on the use case, deciding how to store the source may bring important disk space savings or perfomance improvements.

This allows to enable _synthetic source for a data stream.

We may want to decide on a general default for the source mode depending on the results of the technical review implemented in elastic/kibana#140095, but we will still need a toggle in the package for exceptions (#340 (comment)).

Checklist

Related issues

@jsoriano jsoriano requested review from kpollich and ruflin September 15, 2022 08:04
@jsoriano jsoriano self-assigned this Sep 15, 2022
@jsoriano jsoriano requested a review from a team as a code owner September 15, 2022 08:04
@jsoriano
Copy link
Copy Markdown
Member Author

@kpollich depending on the outcome of this PR we may need a follow up on elastic/kibana#140095.

@ruflin
Copy link
Copy Markdown
Collaborator

ruflin commented Sep 15, 2022

Overall LGTM, left 2 minor questions.

@elasticmachine
Copy link
Copy Markdown

elasticmachine commented Sep 15, 2022

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2022-09-21T13:59:54.370+0000

  • Duration: 8 min 12 sec

Test stats 🧪

Test Results
Failed 0
Passed 640
Skipped 0
Total 640

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.

@elasticmachine
Copy link
Copy Markdown

🌐 Coverage report

Name Metrics % (covered/total) Diff
Packages 100.0% (7/7) 💚
Files 68.0% (17/25) 👍
Classes 76.471% (26/34) 👍
Methods 56.075% (60/107) 👍
Lines 42.184% (537/1273) 👍
Conditionals 100.0% (0/0) 💚

mrodm
mrodm previously approved these changes Sep 15, 2022
Copy link
Copy Markdown
Contributor

@mrodm mrodm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

kpollich
kpollich previously approved these changes Sep 21, 2022
Copy link
Copy Markdown
Member

@kpollich kpollich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 🚀

I created elastic/kibana#141211 to capture Fleet support for this.

@jsoriano
Copy link
Copy Markdown
Member Author

I created elastic/kibana#141211 to capture Fleet support for this.

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Change Proposal] Add support for synthetic source

5 participants