Re: hadoop rumen question

2013-08-19 Thread Thomas Graves
The usage of Tracebuilder has 3 parameters. I believe you are only putting in 2 and its expecting the second parameter to be a file not a directory. java org.apache.hadoop.tools.rumen.TraceBuilder [options] jobtrace-output topology-output inputs See

Re: Queues in hadoop 2.0.4

2013-05-30 Thread Thomas Graves
The Resourcemanager manages the queues in hadoop 2.0.4. As far as the specifics it depends on the scheduler you use. If you use the capacity scheduler or fair scheduler you can have multiple queues. Take a look at the documentation here for capacity scheduler:

Re: MapReduce with ResourceManager

2012-04-12 Thread Thomas Graves
If you have a 23 or 2.0 cluster all setup, yes it comes with mapreduce application master and you run mapreduce very similar to how you did before on 1.X. Have you run mapreduce before on older versions of Hadoop? The queue can be specified the same way with -Dmapred.job.queue.name=default.

Re: Not able to start the NodeManager

2012-01-09 Thread Thomas Graves
Are you setting HADOOP_CONF_DIR in hadoop-env.sh? Do you have YARN_HOME set in hadoop-env.sh? Is your yarn-env.sh just the standard one from ./hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh? Tom On 1/9/12 6:16 AM, Praveen Sripati praveensrip...@gmail.com wrote: Hi, I am trying to

Re: [ANNOUNCEMENT] Apache Hadoop 0.22.0 release

2011-12-14 Thread Thomas Graves
Perhaps I missed it in another thread but does this become 2.0 then? Tom On 12/12/11 2:33 PM, Konstantin Shvachko shv.had...@gmail.com wrote: On December 10, 2011 Hadoop PMC voted to release Hadoop 0.22.0 See http://s.apache.org/COC The release have been brewing for one year. It

Re: Running example application with capacity scheduler ?

2011-09-14 Thread Thomas Graves
I believe it defaults to submit a job to the default queue if you don't specify it. You don't have the default queue defined in your list of mapred.queue.names. So add -Dmapred.job.queue.name=myqueue1 (or another queue you have defined) to the wordcount command like: bin/hadoop jar

Re: Running example application with capacity scheduler ?

2011-09-14 Thread Thomas Graves
I believe it defaults to submit a job to the default queue if you don't specify it. You don't have the default queue defined in your list of mapred.queue.names. So add -Dmapred.job.queue.name=myqueue1 (or another queue you have defined) to the wordcount command like: bin/hadoop jar

Re: next gen map reduce

2011-08-01 Thread Thomas Graves
The jira has more details and an architecture doc attached. https://issues.apache.org/jira/browse/MAPREDUCE-279 Tom On 8/1/11 2:12 AM, Dieter Plaetinck dieter.plaeti...@intec.ugent.be wrote: On Thu, 28 Jul 2011 06:13:01 -0700 Thomas Graves tgra...@yahoo-inc.com wrote: Its currently still

Re: next gen map reduce

2011-07-28 Thread Thomas Graves
Its currently still on the MR279 branch - http://svn.apache.org/viewvc/hadoop/common/branches/MR-279/. It is planned to be merged to trunk soon. Tom On 7/28/11 7:31 AM, real great.. greatness.hardn...@gmail.com wrote: In which Hadoop version is next gen introduced?

Re: Development enviroment problems - eclipse, hadoop 0.20.203

2011-07-22 Thread Thomas Graves
You can try the branch 0.20.204 (branch-0.20-security-204) as I fixed a JIRA to automatically update eclipse classpath file (https://issues.apache.org/jira/browse/HADOOP-7248). I haven't had any problems with the eclipse classpath file since. Tom On 7/21/11 8:26 PM, mertoz masmer...@gmail.com