got it! Thanks.
On Thu, Apr 12, 2018 at 7:53 PM, Tathagata Das <tathagata.das1...@gmail.com>
wrote:
> The traditional SQL windows with `over` is not supported in streaming.
> Only time-based windows, that is, `window("timestamp", "10 minutes")` is
> supported in streaming.
>
> On Thu, Apr 12, 2018 at 7:34 PM, kant kodali <kanth...@gmail.com> wrote:
>
>> Hi All,
>>
>> Does partition by and order by works only in stateful case?
>>
>> For example:
>>
>> select row_number() over (partition by id order by timestamp) from table
>>
>> gives me
>>
>> *SEVERE: Exception occured while submitting the query:
>> java.lang.RuntimeException: org.apache.spark.sql.AnalysisException:
>> Non-time-based windows are not supported on streaming DataFrames/Datasets;;*
>>
>> I wonder what time based window means? is it not the window from over()
>> clause or does it mean group by(window('timestamp'), '10 minutes') like the
>> stateful case?
>>
>> Thanks
>>
>
>
