I am reading about combinebyKey and going through below example from one of
the blog post but i cant understand how it works step by step , Can some one
please explain
Case class Fruit ( kind : String , weight : Int ) {
def makeJuice : Juice = Juice ( weight * 100 )
}
Case
Hi ,
I am not able to understand how aggregate function works, Can some one
please explain how below result came
I am running spark using cloudera VM
The result in below is 17 but i am not able to find out how it is
calculating 17
val data = sc.parallelize(List(2,3,4))
data.aggregate(0)((x,y)
I am trying to understand about mapPartitions but i am still not sure how it
works
in the below example it create three partition
val parallel = sc.parallelize(1 to 10, 3)
and when we do below
parallel.mapPartitions( x = List(x.next).iterator).collect
it prints value
Array[Int] = Array(1, 4,