Re: PySpark order-only window function issue

2015-08-12 Thread Davies Liu
This should be a bug, go ahead to open a JIRA for it, thanks! On Tue, Aug 11, 2015 at 6:41 AM, Maciej Szymkiewicz mszymkiew...@gmail.com wrote: Hello everyone, I am trying to use PySpark API with window functions without specifying partition clause. I mean something equivalent to this

PySpark order-only window function issue

2015-08-11 Thread Maciej Szymkiewicz
Hello everyone, I am trying to use PySpark API with window functions without specifying partition clause. I mean something equivalent to this SELECT v, row_number() OVER (ORDER BY v) AS rn FROM df in SQL. I am not sure if I am doing something wrong or it is a bug but results are far from what I