Re: Setting number of mappers in Teragen

2012-12-26 Thread anil gupta
Hi Harsh, Fixed it. I was putting the -Dmapred.map.tasks=20 after specifying the input directory. I completely forgot about this trick of genericOptionParser of Hadoop. Thanks a lot. :) On Wed, Dec 26, 2012 at 10:33 AM, Harsh J wrote: > The MR1 teragen's mappers # depends on the total number of

Re: Setting number of mappers in Teragen

2012-12-26 Thread Harsh J
The MR1 teragen's mappers # depends on the total number of rows and demanded # of maps. How are you passing -Dmapred.map.tasks=20 (no spaces) exactly? All generic options must go in before any other options do, so it should appear right after the word "teragen" in your command. On Wed, Dec 26, 20