Perhaps, its just me but "lag" function isnt familiar to me .. But have you tried configuring the spark appropriately http://spark.apache.org/docs/latest/configuration.html
On Tue, Oct 14, 2014 at 5:37 PM, Manas Kar <manasdebashis...@gmail.com> wrote: > Hi, > I have an RDD containing Vehicle Number , timestamp, Position. > I want to get the "lag" function equivalent to my RDD to be able to > create track segment of each Vehicle. > > Any help? > > PS: I have tried reduceByKey and then splitting the List of position in > tuples. For me it runs out of memory every time because of the volume of > data. > > ...Manas > > *For some reason I have never got any reply to my emails to the user > group. I am hoping to break that trend this time. :)* > -- Mohit "When you want success as badly as you want the air, then you will get it. There is no other secret of success." -Socrates
