Re: Another issue with using lag and lead with data frames

2015-08-14 Thread Salih Oztop
Window part for Order By clause. Kind Regards Salih Oztop From: Jerry jerry.c...@gmail.com To: user user@spark.apache.org Sent: Friday, August 14, 2015 5:50 PM Subject: Another issue with using lag and lead with data frames So it seems like dataframes aren't going give me a break and just

Re: Spark Dataframe 1.4 (GroupBy partial match)

2015-07-02 Thread Salih Oztop
-resolution-using-spark  Kind Regards Salih Oztop 07856128843 http://www.linkedin.com/in/salihoztop From: Suraj Shetiya surajshet...@gmail.com To: Michael Armbrust mich...@databricks.com Cc: Salih Oztop soz...@yahoo.com; user@spark.apache.org user@spark.apache.org; megha.sridh...@cynepia.com

Re: Spark Dataframe 1.4 (GroupBy partial match)

2015-06-30 Thread Salih Oztop
Hi SurajWhat will be your output after group by? Since GroupBy is for aggregations like sum, count etc. If you want to count the 2015 records than it is possible. Kind Regards Salih Oztop From: Suraj Shetiya surajshet...@gmail.com To: user@spark.apache.org Sent: Tuesday, June 30, 2015

Re: SparkSQL built in functions

2015-06-29 Thread Salih Oztop
() TypeError: unsupported operand type(s) for ** or pow(): 'Column' and 'int' Moreover testing the functions individually they are working fine.pow(2,4) 162**4 16 Kind Regards Salih Oztop From: Bob Corsaro rcors...@gmail.com To: user user@spark.apache.org Sent: Monday, June 29, 2015 7:27 PM Subject

Re: SparkSQL built in functions

2015-06-29 Thread Salih Oztop
Cc: Salih Oztop soz...@yahoo.com; user user@spark.apache.org Sent: Monday, June 29, 2015 9:52 PM Subject: Re: SparkSQL built in functions Interesting. Looking at the definitions, sql.functions.pow is defined only for (col,col). Just as an experiment, create a column with value 2 and see