Hi,
join between streaming and batch/static Datasets is supported for sure -->
http://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#join-operations
I'm not sure about union, but that's just easy to check (and am leaving it
as your home exercise).
You cannot have datase
Hi All,
I have messages in a queue that might be coming in with few different
schemas like
msg 1 schema 1, msg2 schema2, msg3 schema3, msg 4 schema1
I want to put all of this in one data frame. is it possible with structured
streaming?
I am using Spark 2.2.0
Thanks!
