You can't use an RDD inside an operation on an RDD. Here you have filerdd in your map function. It sort of looks like you want a cartesian product of the RDD with itself, so look at the cartesian() method. It may not be a good idea to compute such a thing.
On Wed, Sep 10, 2014 at 1:57 PM, Pavlos Katsogridakis <[email protected]> wrote: > Hi , > > I have a question on spark > this programm on spark-shell > > val filerdd = sc.textFile("NOTICE",2) > val maprdd = filerdd.map( word => filerdd.map( word2 => (word2+word) ) ) > maprdd.collect() > > throws NULL pointer exception , > can somebody explain why i cannot have a nested rdd operation ? > > --pavlos > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
