Re: DataFrame First method is resulting different results in each iteration

2016-02-04 Thread Ali Tajeldin EDU
Hi Satish, Take a look at the smvTopNRecs() function in the SMV package. It does exactly what you are looking for. It might be overkill to bring in all of SMV for just one function but you will also get a lot more than just DF helper functions (modular views, higher level graphs, dynamic

Re: DataFrame First method is resulting different results in each iteration

2016-02-03 Thread satish chandra j
Hi Hemant, My dataframe "ordrd_emd_df" consist data in order as I have applied oderBy in the first step And also tried having "orderBy" method before "groupBy" than also getting different results in each iteration Regards, Satish Chandra On Wed, Feb 3, 2016 at 4:28 PM, Hemant Bhanawat

DataFrame First method is resulting different results in each iteration

2016-02-03 Thread satish chandra j
HI All, I have data in a emp_df (DataFrame) as mentioned below: EmpId Sal DeptNo 001 100 10 002 120 20 003 130 10 004 140 20 005 150 10 ordrd_emp_df = emp_df.orderBy($"DeptNo",$"Sal".desc) which results as below: DeptNo Sal EmpId 10 150

Re: DataFrame First method is resulting different results in each iteration

2016-02-03 Thread Hemant Bhanawat
Missing order by? Hemant Bhanawat SnappyData (http://snappydata.io/) On Wed, Feb 3, 2016 at 3:45 PM, satish chandra j wrote: > HI All, > I have data in a emp_df (DataFrame) as mentioned below: > > EmpId Sal DeptNo > 001 100 10 > 002 120 20 > 003

Re: DataFrame First method is resulting different results in each iteration

2016-02-03 Thread Hemant Bhanawat
Ahh.. missed that. I see that you have used "first" function. 'first' returns the first row it has found. On a single executor it may return the right results. But, on multiple executors, it will return the first row of any of the executor which may not be the first row when the results are