Hi I need the ability to be able to create RDDs programatically inside my program (e.g. based on varaible number of input files).
Can this be done? I need this as I want to run the following statement inside an iteration: JavaRDD<String> rdd1 = jsc.textFile("/file1.txt"); Thanks Amit