[Spark Streaming] support of non-timebased windows and lag function

Hi, I have a question regarding Spark structured streaming: will non-timebased window operations like the lag function be supported at some point, or is this not on the table due to technical difficulties? I.e. will something like this be possible in the future: w =

[Spark Core] Why no spark.read.delta / df.write.delta?

Hi there, I'm just wondering if there is any incentive to implement read/write methods in the DataFrameReader/DataFrameWriter for delta similar to e.g. parquet? For example, using PySpark, "spark.read.parquet" is available, but "spark.read.delta" is not (same for write). In my opinion,