Re: GenericOptionsParser warning

2009-02-20 Thread Steve Loughran 

Rasit OZDAS wrote:

Hi,
There is a JIRA issue about this problem, if I understand it correctly:
https://issues.apache.org/jira/browse/HADOOP-3743

Strange, that I searched all source code, but there exists only this control
in 2 places:

if (!(job.getBoolean(mapred.used.genericoptionsparser, false))) {
  LOG.warn(Use GenericOptionsParser for parsing the arguments.  +
   Applications should implement Tool for the same.);
}

Just an if block for logging, no extra controls.
Am I missing something?

If your class implements Tool, than there shouldn't be a warning.


OK, for my automated submission code I'll just set that switch and I 
won't get told off.

GenericOptionsParser warning

2009-02-18 Thread Sandhya E 
Hi All

I prepare my JobConf object in a java class, by calling various set
apis in JobConf object. When I submit the jobconf object using
JobClient.runJob(conf), I'm seeing the warning:
Use GenericOptionsParser for parsing the arguments. Applications
should implement Tool for the same. From hadoop sources it looks like
setting mapred.used.genericoptionsparser will prevent this warning.
But if I set this flag to true, will it have some other side effects.

Thanks
Sandhya

Re: GenericOptionsParser warning

2009-02-18 Thread Steve Loughran 

Sandhya E wrote:

Hi All

I prepare my JobConf object in a java class, by calling various set
apis in JobConf object. When I submit the jobconf object using
JobClient.runJob(conf), I'm seeing the warning:
Use GenericOptionsParser for parsing the arguments. Applications
should implement Tool for the same. From hadoop sources it looks like
setting mapred.used.genericoptionsparser will prevent this warning.
But if I set this flag to true, will it have some other side effects.

Thanks
Sandhya


Seen this message too -and it annoys me; not tracked it down

Re: GenericOptionsParser warning

2009-02-18 Thread Rasit OZDAS 
Hi,
There is a JIRA issue about this problem, if I understand it correctly:
https://issues.apache.org/jira/browse/HADOOP-3743

Strange, that I searched all source code, but there exists only this control
in 2 places:

if (!(job.getBoolean(mapred.used.genericoptionsparser, false))) {
  LOG.warn(Use GenericOptionsParser for parsing the arguments.  +
   Applications should implement Tool for the same.);
}

Just an if block for logging, no extra controls.
Am I missing something?

If your class implements Tool, than there shouldn't be a warning.

Cheers,
Rasit

2009/2/18 Steve Loughran ste...@apache.org

 Sandhya E wrote:

 Hi All

 I prepare my JobConf object in a java class, by calling various set
 apis in JobConf object. When I submit the jobconf object using
 JobClient.runJob(conf), I'm seeing the warning:
 Use GenericOptionsParser for parsing the arguments. Applications
 should implement Tool for the same. From hadoop sources it looks like
 setting mapred.used.genericoptionsparser will prevent this warning.
 But if I set this flag to true, will it have some other side effects.

 Thanks
 Sandhya


 Seen this message too -and it annoys me; not tracked it down




-- 
M. Raşit ÖZDAŞ

Re: GenericOptionsParser warning

2009-02-18 Thread Aaron Kimball 
You should put this stub code in your program as the means to start your
MapReduce job:

public class Foo extends Configured implements Tool {

  public int run(String [] args) throws IOException {
JobConf conf = new JobConf(getConf(), Foo.class);
// run the job here.
return 0;
  }

  public static void main(String [] args) throws Exception {
int ret = ToolRunner.run(new Foo(), args); // calls your run() method.
System.exit(ret);
  }
}


On Wed, Feb 18, 2009 at 7:09 AM, Rasit OZDAS rasitoz...@gmail.com wrote:

 Hi,
 There is a JIRA issue about this problem, if I understand it correctly:
 https://issues.apache.org/jira/browse/HADOOP-3743

 Strange, that I searched all source code, but there exists only this
 control
 in 2 places:

 if (!(job.getBoolean(mapred.used.genericoptionsparser, false))) {
  LOG.warn(Use GenericOptionsParser for parsing the arguments.  +
   Applications should implement Tool for the same.);
}

 Just an if block for logging, no extra controls.
 Am I missing something?

 If your class implements Tool, than there shouldn't be a warning.

 Cheers,
 Rasit

 2009/2/18 Steve Loughran ste...@apache.org

  Sandhya E wrote:
 
  Hi All
 
  I prepare my JobConf object in a java class, by calling various set
  apis in JobConf object. When I submit the jobconf object using
  JobClient.runJob(conf), I'm seeing the warning:
  Use GenericOptionsParser for parsing the arguments. Applications
  should implement Tool for the same. From hadoop sources it looks like
  setting mapred.used.genericoptionsparser will prevent this warning.
  But if I set this flag to true, will it have some other side effects.
 
  Thanks
  Sandhya
 
 
  Seen this message too -and it annoys me; not tracked it down
 



 --
 M. Raşit ÖZDAŞ