Re: Different input format based on files names in driver code

2017-06-23 Thread Ankit Singhal
You can create a list of files for each type and use MultipleInputs[1]. https://hadoop.apache.org/docs/r2.6.3/api/org/apache/hadoop/mapreduce/lib/input/MultipleInputs.html On Thu, Jun 22, 2017 at 10:30 PM, vivek wrote: > Thanks! > > > On Jun 22, 2017 20:15, "Erik

Re: Different input format based on files names in driver code

2017-06-22 Thread vivek
Thanks! On Jun 22, 2017 20:15, "Erik Krogen" wrote: > You would need to write a custom InputFormat which would return an > appropriate RecordReader based on the file format involved in each > InputSplit. You can have InputFormat#getSplits load InputSplits for both > file

Different input format based on files names in driver code

2017-06-21 Thread vivek
Hi, I have two different files having different names.I want to input files depending upon the name of the file and use different input format for both the files. Eg If i have two files abc_file1 and bcd_file2 In the same input folder And i want to use textinputformat for file1 and someother