Re: JavaRDDListTuple2 flatMap Lexicographical Permutations - Java Heap Error

at 11:58 AM, Dan DeCapria, CivicScience dan.decap...@civicscience.com wrote: I am trying to generate all (N-1)(N)/2 lexicographical 2-tuples from a glom() JavaPairRDDListTuple2. The construction of these initial Tuple2's JavaPairRDDAQ,Integer space is well formed from case classes I provide

JavaRDDListTuple2 flatMap Lexicographical Permutations - Java Heap Error

I am trying to generate all (N-1)(N)/2 lexicographical 2-tuples from a glom() JavaPairRDDListTuple2. The construction of these initial Tuple2's JavaPairRDDAQ,Integer space is well formed from case classes I provide it (AQ, AQV, AQQ, CT) and is performant; minimized code: SparkConf conf = new

ChiSquared Test from user response flat files to RDD[Vector]?

Hi Spark community, I'm very new to the Apache Spark community; but if this (very active) group is anything like the other Apache project user groups I've worked with, I'm going to enjoy discussions here very much. Thanks in advance! Use Case: I am trying to go from flat files of user response