Skip to content

[Feature Request] Partitioned stream support in Stream framework #17493

@rishabhmaurya

Description

@rishabhmaurya

Is your feature request related to a problem? Please describe

A StreamProducer introduced in #16691 could produce multiple streams as part of one job.

Describe the solution you'd like

we can create something like PartitionedStreamTicket, which will internally contain list of tickets.
Its StreamProducer implementation in java can have a parallel execution of streams when getStream() is called on it.
For getFlightInfo() it can just return List of endpoints, as your POC code.

Related component

Search:Performance

Describe alternatives you've considered

No response

Additional context

No response

Metadata

Metadata

Labels

Type

No type

Projects

Status

🆕 New

Status

Todo

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions