kafka-python read from last produced message after a consumer restart -


i using kafka-python consume messages kafka queue (kafka version 0.10.2.0). in particular using kafkaconsumer type. if consumer stops , after while restarted restart latest produced message, drop messages produced during time consumer down. how can achieve this?

thanks

you not seektoend() end of log.

keep in mind, first need subscribe topic before can seek. also, subscribing lazy. thus, need add "dummy poll" before can seek, too.

consumer.subscribe(...) consumer.poll() // dummy poll consumer.seektoend()  // enter regular poll-loop 

Comments