Getting/Setting consumer state #815
Unanswered
Matan Rosenberg (matan129)
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi,
One of my apps uses Parallel Consumer 0.5.2.8.
It consumes messages from Kafka with consumer group A, and maintains some data structure on-disk.
This data structure (well - a collection of files) is periodically backed up to remote storage.
I have a use case in which a different service (with consumer group B), needs to download the backup and start ingesting from the point that service A left it.
Q: Is there a way to get (and set?) the current position & state of the consumer?
Currently, I get the committed offsets per partition and use it as an approximation, but it's not granular enough.
Thanks!
Beta Was this translation helpful? Give feedback.
All reactions