Re: Window Functions importing issue in Spark 1.4.0

2016-01-20 Thread satish chandra j
Hi Ted, Thanks for sharing the link on rowNumber example on usage Could you please let me know if I could use rowNumber window function in my currenct Spark 1.4.0 version If yes, than why am I getting error in "import org.apache.spark.sql. expressions.Window" and "import

Window Functions importing issue in Spark 1.4.0

2016-01-07 Thread satish chandra j
HI All, Currently using Spark 1.4.0 version, I have a requirement to add a column having Sequential Numbering to an existing DataFrame I understand Window Function "rowNumber" serves my purpose hence I have below import statements to include the same import org.apache.spark.sql.expressions.Window

Re: Window Functions importing issue in Spark 1.4.0

2016-01-07 Thread Jacek Laskowski
Ok, enuf! :) Leaving the room for now as I'm like a copycat :) https://en.wiktionary.org/wiki/enuf Pozdrawiam, Jacek Jacek Laskowski | https://medium.com/@jaceklaskowski/ Mastering Apache Spark ==> https://jaceklaskowski.gitbooks.io/mastering-apache-spark/ Follow me at

Re: Window Functions importing issue in Spark 1.4.0

2016-01-07 Thread Ted Yu
Please take a look at the following for sample on how rowNumber is used: https://github.com/apache/spark/pull/9050 BTW 1.4.0 was an old release. Please consider upgrading. On Thu, Jan 7, 2016 at 3:04 AM, satish chandra j wrote: > HI All, > Currently using Spark 1.4.0