I have written this simple code to try streaming aggregation in spark 2.4.
Somehow, job keeps running but not returning any result. It returns me 3
columns JobType, Timestamp and TS if I remove groupby and count aggregation
function.
Would really appreciate any help.
val edgeDF = spark
Hello,
I am using Apache Spark 2.2.1 with Scala. I am trying to load below JSON from
Kafka and trying to extract "JOBTYPE" and "LOADID" from the nested JSON object.
Need help with extraction logic.
Code
val workRequests = new StructType().add("after", new StructType()
