hi By setting isSplitable false, we prevent the files from splitting. we can check that from the no. of map tasks.. but how do we check, if the records are proper..
Chandravadana S Enis Soztutar wrote: > > Nope, not right now. But this has came up before. Perhaps you will > contribute one? > > > chandravadana wrote: >> thanks >> >> is there any built in record reader which performs this function.. >> >> >> >> Enis Soztutar wrote: >> >>> Yes, you can use MultiFileInputFormat. >>> >>> You can extend the MultiFileInputFormat to return a RecordReader, which >>> reads a record for each file in the MultiFileSplit. >>> >>> Enis >>> >>> chandra wrote: >>> >>>> hi.. >>>> >>>> By setting isSplitable false, we can set 1 file with n records 1 >>>> mapper. >>>> >>>> Is there any way to set 1 complete file per record.. >>>> >>>> Thanks in advance >>>> Chandravadana S >>>> >>>> >>>> >>>> >>>> This e-mail and any files transmitted with it are for the sole use of >>>> the >>>> intended recipient(s) and may contain confidential and privileged >>>> information. >>>> If you are not the intended recipient, please contact the sender by >>>> reply >>>> e-mail and destroy all copies of the original message. >>>> Any unauthorized review, use, disclosure, dissemination, forwarding, >>>> printing or copying of this email or any action taken in reliance on >>>> this >>>> e-mail is strictly >>>> prohibited and may be unlawful. >>>> >>>> >>>> >>> >>> >> >> > > -- View this message in context: http://www.nabble.com/1-file-per-record-tp19644985p19667750.html Sent from the Hadoop core-user mailing list archive at Nabble.com.
