[Doc]Add section for conceptual info#11715
Conversation
|
@colinsurprenant FYI. From discussions in #11175. I believe that we have a good structure for moving forward. I'm ready to sync about new content for event ordering guaranties with multiple worker versus single worker. This one replaces #11581 |
|
Great! We could start with something around the lines of:
|
4c828f6 to
43e9083
Compare
43e9083 to
2daba10
Compare
|
@colinsurprenant, your comments on event ordering were very helpful! I used some of them in this PR, and all of them in the release notes. Thanks for taking time to add them. We also discussed that new section might be a good place to talk about Java pipeline initialization time. If somebody noticed a slowdown and googled "Java pipeline initialization time", what kind of guidance can we offer them? (Carried over from discussion in #logstash). Note: I'm leaving this PR in DRAFT status until we flesh out a few more details. Your comments are always welcomed and appreciated. |
|
PENDING: What should we advise people to do if they notice a slowdown? |
|
@colinsurprenant Please let me know what you think. |
|
Thanks @karenzone! I left a few comments for what I thought was not clear to me, but I trust you to figure the best phrasing! |
|
@elasticmachine, run elasticsearch-ci/docs |
|
@colinsurprenant Will you please take a look to see if I captured your comments correctly? Thanks! |
|
|
||
| When maintaining event order is important, use a single worker. | ||
| This approach ensures that batches are computed one-after-the-other, and | ||
| that events maintain their order within the batch. |
There was a problem hiding this comment.
I think this might be slightly misleading to think that "When maintaining event order is important, use a single worker" and using a single worker is all you need.
Maybe something like:
"When maintaining event order is important, use a single worker and set 'pipeline.ordered => true'.
I think this will allow the this doc to live longer if we ever change the "auto" setting behaviour... WDYT?
There was a problem hiding this comment.
Nice clarification! Thank you for suggesting it.
|
Thanks @karenzone, looking good, left a minor comment! |
Backport of #11715 to 7.8
Backport of #11715 to 7.8
Backport of #11715 to 7.8
Backport of #11715 to 7.8
Backport of #11715 to 7.8
Backport of #11715 to 7.7
Backport of #11715 to 7.7
Backport of #11715 to 7.7
Backport of #11715 to 7.7
Backport of #11715 to 7.7
Backport of #11715 to 7.x
Backport of #11715 to 7.x
Backport of #11715 to 7.x
Backport of #11715 to 7.x
Backport of #11715 to 7.x
Important info that customers need can be buried way down in the details. This PR adds a section for bubbling up and curating that information.
Replaces #11581
PREVIEW: http://logstash_11715.docs-preview.app.elstc.co/guide/en/logstash/master/processing.html