Re: How to add multiple sequence files from HDFS to a Spark Context to do Batch processing?

file can be a directory (look at all children) or even a glob (/path/*.ext, for example). On Fri, Jul 31, 2015 at 11:35 AM, swetha swethakasire...@gmail.com wrote: Hi, How to add multiple sequence files from HDFS to a Spark Context to do Batch processing? I have something like the following

How to add multiple sequence files from HDFS to a Spark Context to do Batch processing?

Hi, How to add multiple sequence files from HDFS to a Spark Context to do Batch processing? I have something like the following in my code. Do I have to add Comma separated list of Sequence file paths to the Spark Context. val data = if(args.length0 args(0)!=null) sc.sequenceFile(file,