Hi, 1. Can we use Spark Structured Streaming for stateless transformations just like we would do with DStreams or Spark Structured Streaming is only meant for stateful computations?
2. When we use groupBy and Window operations for event time processing and specify a watermark does this mean the timestamp field in each message is compared to the processing time of that machine/node and discard that events that are late than the specified threshold? If we don't specify a watermark I am assuming the processing time wont come into the picture. is that right? Just trying to understand the interplay between processing time and even time when we do even time processing. Thanks!
