unsubscribe

2018-12-01 Thread Kappaganthu, Sivaram (CORP)
-- This message and any attachments are intended only for the use of the addressee and may contain information that is privileged and confidential. If the reader of the message is not the intended recipient or an authorized

Re: Convert RDD[Iterrable[MyCaseClass]] to RDD[MyCaseClass]

2018-12-01 Thread Chris Teoh
Hi James, Try flatMap (_.toList). See below example:- scala> case class MyClass(i:Int) defined class MyClass scala> val r = 1 to 100 r: scala.collection.immutable.Range.Inclusive = Range(1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29,

Re: Convert RDD[Iterrable[MyCaseClass]] to RDD[MyCaseClass]

2018-12-01 Thread Chris Teoh
Do you have the full code example? I think this would be similar to the mapPartitions code flow, something like flatMap( _ => _.toList ) I haven't yet tested this out but this is how I'd first try. On Sat, 1 Dec 2018 at 01:02, James Starks wrote: > When processing data, I create an instance