You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There has been a need to query certain Kafka topics with relative offsets, for example last offset, or last offset minus 100, or last offset minus 10 minutes.
Currently it is possible to do this by using metadata API to query for offsets and manually deriving an offset for which a source should be created. This could be made simpler by abstracting such logic in a user-friendly consumer source factory.
The text was updated successfully, but these errors were encountered:
I would be very happy if I could take care of it. It will be my first contribution to alpakka-kafka, so maybe could you give me some more suggestion or could you explain me what do you exactly expect from user-friendly consumer source factory? Otherwise I could suggest implementation.
ennru
changed the title
Consumer Source with relative offset defitions
Consumer Source with relative offset definitions
Aug 5, 2019
I believe this would be best implemented as something that retrieves the current offset and creates subscriptions from those offsets.
This would benefit from implementing #765 first, I guess.
There has been a need to query certain Kafka topics with relative offsets, for example last offset, or last offset minus 100, or last offset minus 10 minutes.
Currently it is possible to do this by using metadata API to query for offsets and manually deriving an offset for which a source should be created. This could be made simpler by abstracting such logic in a user-friendly consumer source factory.
The text was updated successfully, but these errors were encountered: