Thanks T.D! And sorry for the typo. It's very helpful to know that whatever
I was achieving with DStreams I can also achieve the same with Structured
streaming.
It seems like there is some other error in my code which I fixed it and it
seem to be working fine now!
Thanks again!
On Thu, Sep 14,
Are you sure the code is correct? A Dataset does not have a method
"trigger". Rather I believe the correct code should be
StreamingQuery query = resultDataSet*.writeStream.*trigger(
ProcesingTime(1000)).format("kafka").start();
You can do all the same things you can do with Structured Streaming
Hi All,
I am trying to read data from kafka, insert into Mongo and read from mongo
and insert back into Kafka. I went with structured stream approach first
however I believe I am making some naiver error because my map operations
are not getting invoked.
The pseudo code looks like this
DataSet
