Re: Getting filename in case of MultipleInputs

2012-05-06 Thread Kasi Subrahmanyam
Yeah Jim, I have gone through the comments in that JIRA ticket and am able to solve my problem On Sat, May 5, 2012 at 11:25 PM, Jim Donofrio donofrio...@gmail.com wrote: There is already a JIRA for this: MAPREDUCE-1743 On 05/03/2012 09:06 AM, Harsh J wrote: Subbu, The only way I can

Re: Getting filename in case of MultipleInputs

2012-05-03 Thread Harsh J
Subbu, The only way I can think of, is to use an overridden InputFormat/RecordReader pair that sets the map.input.file config value during its initialization, using the received FileSplit object. This should be considered as a bug, however, and even 2.x is affected. Can you please file a JIRA on

RE: Getting filename in case of MultipleInputs

2012-05-03 Thread Devaraj k
Hi Subbu, I am not sure which input format you are using. If you are using FileInputFormat, you can get the file name this way in map function.. import org.apache.hadoop.mapred.FileSplit; import org.apache.hadoop.mapreduce.InputSplit; import org.apache.hadoop.mapreduce.Mapper; public

Re: Getting filename in case of MultipleInputs

2012-05-03 Thread Bejoy Ks
Hi Subbu, The file/split processed by a mapper could be obtained from WebUI as soon as the job is executed. However this detail can't be obtained once the job is moved to JT history. Regards Bejoy On Thu, May 3, 2012 at 6:25 PM, Kasi Subrahmanyam kasisubbu...@gmail.com wrote: Hi,