Re: GroupBy on DataFrame taking too much time

2016-01-11 Thread Xingchi Wang
Error happend at the "Lost task 0.0 in stage 0.0", I think it is not the "groupBy" problem, it's the sql read the "customer" table issue, please check the jdbc link and the data is loaded successfully?? Thanks Xingchi 2016-01-11 15:43 GMT+08:00 Gaini Rajeshwar : > Hi All, > > I have a table name

Re: Struggling time by data

2015-12-25 Thread Xingchi Wang
map{case(x, y) => s = x.split("_"), (s(0), (s(1), y)))}.groupByKey().filter{case (_, (a, b)) => abs(a._1, a._1) < 30min} does it work for you ? 2015-12-25 16:53 GMT+08:00 Yasemin Kaya : > hi, > > I have struggled this data couple of days, i cant find solution. Could you > help me? > > *DATA:* >