e progress status with kafka stream displays the "startOffset" and
> "endOffset" values per batch. This is listed topic-partition wise the start
> to end offsets per trigger batch of streaming query.
>
>
> Akshay Bhardwaj
> +91-97111-33849
>
>
> On Tue,
Hey Spark Experts,
After listening to some of you, and the presentations at Spark Summit in
SF, I am transitioning from d-streams to structured streaming however I am
seeing some weird results.
My use case is as follows: I am reading in a stream from a kafka topic,
transforming a message, and
ote:
> Hi Austin,
>
> Are you using Spark Streaming or Structured Streaming?
>
> For better understanding, could you also provide sample code/config params
> for your spark-kafka connector for the said streaming job?
>
>
> Akshay Bhardwaj
> +91-97111-33849
>
>
>
)?
It seems to be contradicting itself w a) the actual offset it says its on
and the one it attempts to read and b) saying no configured reset policy
--
Austin Weaver
Software Engineer
FLYR, Inc. www.flyrlabs.com
