Re: Window Functions importing issue in Spark 1.4.0
Hi Ted, Thanks for sharing the link on rowNumber example on usage Could you please let me know if I could use rowNumber window function in my currenct Spark 1.4.0 version If yes, than why am I getting error in "import org.apache.spark.sql. expressions.Window" and "import org.apache.spark.sql.functions.rowNumber" Thanks for providing your valuable inputs Regards, Satish Chandra J On Thu, Jan 7, 2016 at 4:41 PM, Ted Yu wrote: > Please take a look at the following for sample on how rowNumber is used: > https://github.com/apache/spark/pull/9050 > > BTW 1.4.0 was an old release. > > Please consider upgrading. > > On Thu, Jan 7, 2016 at 3:04 AM, satish chandra j > wrote: > >> HI All, >> Currently using Spark 1.4.0 version, I have a requirement to add a column >> having Sequential Numbering to an existing DataFrame >> I understand Window Function "rowNumber" serves my purpose >> hence I have below import statements to include the same >> >> import org.apache.spark.sql.expressions.Window >> import org.apache.spark.sql.functions.rowNumber >> >> But I am getting an error at the import statement itself such as >> "object expressions is not a member of package org.apache.spark.sql" >> >> "value rowNumber is not a member of object org.apache.spark.sql.functions" >> >> Could anybody throw some light if any to fix the issue >> >> Regards, >> Satish Chandra >> > >
Re: Window Functions importing issue in Spark 1.4.0
Ok, enuf! :) Leaving the room for now as I'm like a copycat :) https://en.wiktionary.org/wiki/enuf Pozdrawiam, Jacek Jacek Laskowski | https://medium.com/@jaceklaskowski/ Mastering Apache Spark ==> https://jaceklaskowski.gitbooks.io/mastering-apache-spark/ Follow me at https://twitter.com/jaceklaskowski On Thu, Jan 7, 2016 at 12:11 PM, Ted Yu wrote: > Please take a look at the following for sample on how rowNumber is used: > https://github.com/apache/spark/pull/9050 > > BTW 1.4.0 was an old release. > > Please consider upgrading. > > On Thu, Jan 7, 2016 at 3:04 AM, satish chandra j > wrote: >> >> HI All, >> Currently using Spark 1.4.0 version, I have a requirement to add a column >> having Sequential Numbering to an existing DataFrame >> I understand Window Function "rowNumber" serves my purpose >> hence I have below import statements to include the same >> >> import org.apache.spark.sql.expressions.Window >> import org.apache.spark.sql.functions.rowNumber >> >> But I am getting an error at the import statement itself such as >> "object expressions is not a member of package org.apache.spark.sql" >> >> "value rowNumber is not a member of object org.apache.spark.sql.functions" >> >> Could anybody throw some light if any to fix the issue >> >> Regards, >> Satish Chandra > > - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: Window Functions importing issue in Spark 1.4.0
Please take a look at the following for sample on how rowNumber is used: https://github.com/apache/spark/pull/9050 BTW 1.4.0 was an old release. Please consider upgrading. On Thu, Jan 7, 2016 at 3:04 AM, satish chandra j wrote: > HI All, > Currently using Spark 1.4.0 version, I have a requirement to add a column > having Sequential Numbering to an existing DataFrame > I understand Window Function "rowNumber" serves my purpose > hence I have below import statements to include the same > > import org.apache.spark.sql.expressions.Window > import org.apache.spark.sql.functions.rowNumber > > But I am getting an error at the import statement itself such as > "object expressions is not a member of package org.apache.spark.sql" > > "value rowNumber is not a member of object org.apache.spark.sql.functions" > > Could anybody throw some light if any to fix the issue > > Regards, > Satish Chandra >
Window Functions importing issue in Spark 1.4.0
HI All, Currently using Spark 1.4.0 version, I have a requirement to add a column having Sequential Numbering to an existing DataFrame I understand Window Function "rowNumber" serves my purpose hence I have below import statements to include the same import org.apache.spark.sql.expressions.Window import org.apache.spark.sql.functions.rowNumber But I am getting an error at the import statement itself such as "object expressions is not a member of package org.apache.spark.sql" "value rowNumber is not a member of object org.apache.spark.sql.functions" Could anybody throw some light if any to fix the issue Regards, Satish Chandra
