Re: Num map task?

2009-04-24 Thread jason hadoop
Unless the argument (args[0]) to your job is a comma separated set of paths, you are only adding a single input path. It may be you want to pass args and not args[0]. FileInputFormat.setInputPaths(c, args[0]); On Thu, Apr 23, 2009 at 7:10 PM, nguyenhuynh.mr nguyenhuynh...@gmail.comwrote:

Re: Num map task?

2009-04-23 Thread Edward J. Yoon
How do you to add input paths? On Wed, Apr 22, 2009 at 5:09 PM, nguyenhuynh.mr nguyenhuynh...@gmail.com wrote: Edward J. Yoon wrote: Hi, In that case, The atomic unit of split is a file. So, you need to increase the number of files. or Use the TextInputFormat as below.

Re: Num map task?

2009-04-23 Thread nguyenhuynh.mr
Edward J. Yoon wrote: How do you to add input paths? On Wed, Apr 22, 2009 at 5:09 PM, nguyenhuynh.mr nguyenhuynh...@gmail.com wrote: Edward J. Yoon wrote: Hi, In that case, The atomic unit of split is a file. So, you need to increase the number of files. or Use the

Re: Num map task?

2009-04-23 Thread Edward J. Yoon
As far as I know, FileInputFormat.getSplits() will returns the number of splits automatically computed by the number of files, blocks. BTW, What version of Hadoop/Hbase? I tried to test that code (http://wiki.apache.org/hadoop/Hbase/MapReduce) on my cluster (Hadoop 0.19.1 and Hbase 0.19.0). The

Re: Num map task?

2009-04-23 Thread nguyenhuynh.mr
Edward J. Yoon wrote: As far as I know, FileInputFormat.getSplits() will returns the number of splits automatically computed by the number of files, blocks. BTW, What version of Hadoop/Hbase? I tried to test that code (http://wiki.apache.org/hadoop/Hbase/MapReduce) on my cluster (Hadoop

Re: Num map task?

2009-04-22 Thread Edward J. Yoon
Hi, In that case, The atomic unit of split is a file. So, you need to increase the number of files. or Use the TextInputFormat as below. jobConf.setInputFormat(TextInputFormat.class); On Wed, Apr 22, 2009 at 4:35 PM, nguyenhuynh.mr nguyenhuynh...@gmail.com wrote: Hi all! I have a MR job use

Re: Num map task?

2009-04-22 Thread nguyenhuynh.mr
Edward J. Yoon wrote: Hi, In that case, The atomic unit of split is a file. So, you need to increase the number of files. or Use the TextInputFormat as below. jobConf.setInputFormat(TextInputFormat.class); On Wed, Apr 22, 2009 at 4:35 PM, nguyenhuynh.mr nguyenhuynh...@gmail.com wrote: