Re: Does partition by and order by works only in stateful case?

Hi, My sincere apologies for adding my question to this chain. For some reason, I am unable to see the messages which I write to the group ever appear back in it and I think that this might be related in a way that shows a few differences between traditional operations and Spark Streaming

Re: Does partition by and order by works only in stateful case?

got it! Thanks. On Thu, Apr 12, 2018 at 7:53 PM, Tathagata Das wrote: > The traditional SQL windows with `over` is not supported in streaming. > Only time-based windows, that is, `window("timestamp", "10 minutes")` is > supported in streaming. > > On Thu, Apr 12,

Re: Does partition by and order by works only in stateful case?

The traditional SQL windows with `over` is not supported in streaming. Only time-based windows, that is, `window("timestamp", "10 minutes")` is supported in streaming. On Thu, Apr 12, 2018 at 7:34 PM, kant kodali wrote: > Hi All, > > Does partition by and order by works only

Does partition by and order by works only in stateful case?

Hi All, Does partition by and order by works only in stateful case? For example: select row_number() over (partition by id order by timestamp) from table gives me *SEVERE: Exception occured while submitting the query: java.lang.RuntimeException: org.apache.spark.sql.AnalysisException: