Re: 'nested' RDD problem, advise needed

2015-03-22 Thread Victor Tso-Guillen
Something like this? (2 to alphabetLength toList).map(shift = Object.myFunction(inputRDD, shift).map(v = shift - v).foldLeft(Object.myFunction(inputRDD, 1).map(v = 1 - v))(_ union _) which is an RDD[(Int, Char)] Problem is that you can't play with RDDs inside of RDDs. The recursive structure

'nested' RDD problem, advise needed

2015-03-21 Thread Michael Lewis
Hi, I wonder if someone can help suggest a solution to my problem, I had a simple process working using Strings and now want to convert to RDD[Char], the problem is when I end up with a nested call as follow: 1) Load a text file into an RDD[Char] val inputRDD =