Re: custom FileInputFormat class

2012-05-18 Thread John Hancock
Devaraj, Thanks for the pointer. I ended up extending FileInputFormat. I made some notes about the program I wrote to use the custom FileInputFormat here: https://cakephp.rootser.com/posts/view/64 I think it may be because I'm using 1.0.1, but I did not need to write a getSplits() method. How

RE: custom FileInputFormat class

2012-05-17 Thread Devaraj k
Hi John, You can extend FileInputFormat(or implement InputFormat) and then you need to implement below methods. 1. InputSplit[] getSplits(JobConf job, int numSplits) : For splitting the input files logically for the job. If FileInputFormat.getSplits(JobConf job, int numSplits) suits for

Re: custom FileInputFormat class

2012-05-17 Thread Harsh J
Hello John, I covered two resources you can use to read up on these custom extensions previously at http://search-hadoop.com/m/98TH8MPsTK. Hope this helps you get started. Let us know if you have specific issues/questions once you do :) On Thu, May 17, 2012 at 3:40 PM, John Hancock wrote: > All,