Re: Structured streaming from Kafka by timestamp

2019-02-05 Thread Cody Koeninger
To be more explicit, the easiest thing to do in the short term is use your own instance of KafkaConsumer to get the offsets for the timestamps you're interested in, using offsetsForTimes, and use those for the start / end offsets. See

Re: Structured streaming from Kafka by timestamp

2019-02-01 Thread Tomas Bartalos
Hello, sorry for my late answer. You're right, what I'm doing is a one time query, not a structured streaming. Probably it will be best to describe my use case: I'd like to expose live data (via jdbc/odbc) residing in Kafka with the power of spark's distributed sql engine. As jdbc server I use