Hi,
I continuously run a series of batch job using Hadoop Map Reduce. I also
have a managing daemon that moves data around on the hdfs making way for
more jobs to be run.
I use capacity scheduler to schedule many jobs in parallel.
I see an issue on the Hadoop web monitoring UI at port 50030 which
Martin,
Can you give more information about how you compiled and ran your job?
It probably makes sense to open a JIRA
(https://issues.apache.org/jira/browse/MAPREDUCE) to track this.
Cheers
Tom
On Wed, Sep 22, 2010 at 9:59 AM, Martin Becker <_martinbec...@web.de> wrote:
> Hello Tom,
> But could
David,
This was discussed here:
http://www.mail-archive.com/mapreduce-...@hadoop.apache.org/msg01833.html.
The reason is basically to give users more time to move to the new
API. The old API will be marked as deprecated in 0.22.0.
Cheers,
Tom
On Wed, Sep 22, 2010 at 10:53 AM, David Rosenstrauch
Hmmm. Any idea as to why the undeprecation? I thought the intention
was to try to move everybody to the new API. Why the reversal?
Thanks,
DR
On 09/22/2010 12:29 PM, Tom White wrote:
Note that JobClient, along with the rest of the "old" API in
org.apache.hadoop.mapred, has been undeprecate
Hello Tom,
But could I also use the new API by doing this?:
Configuration configuration = new Configuration();
Cluster cluster = new Cluster(configuration);
Job job = Job.getInstance(cluster);
...
System.exit(job.waitForCompletion(true) ? 0 : 1);
If I do this I get the most p
Hi Tom,
I see. Thanks.
Martin
On 22.09.2010 18:27, Tom White wrote:
Hi Martin,
This is a known bug, see https://issues.apache.org/jira/browse/HADOOP-6953.
Cheers
Tom
On Wed, Sep 22, 2010 at 8:17 AM, Martin Becker<_martinbec...@web.de> wrote:
Hi,
I am using Hadoop MapReduce 0.21.0. The
Note that JobClient, along with the rest of the "old" API in
org.apache.hadoop.mapred, has been undeprecated in Hadoop 0.21.0 so
you can continue to use it without warnings.
Tom
On Wed, Sep 22, 2010 at 2:43 AM, Amareshwari Sri Ramadasu
wrote:
> In 0.21, JobClient methods are available in org.apa
Hi Martin,
This is a known bug, see https://issues.apache.org/jira/browse/HADOOP-6953.
Cheers
Tom
On Wed, Sep 22, 2010 at 8:17 AM, Martin Becker <_martinbec...@web.de> wrote:
> Hi,
>
> I am using Hadoop MapReduce 0.21.0. The usual process of starting
> Hadoop/HDFS/MapReduce was to use the "star
Hi Martin,
I think this is because the whole package is deprecated on the
MapReduce side (in package-info.java). I've opened
https://issues.apache.org/jira/browse/MAPREDUCE-2084 to address this.
In the meantime, it is safe to use Tool and ToolRunner.
Thanks,
Tom
On Wed, Sep 22, 2010 at 8:52 AM,
Hi,
so the same package in both jars is not the problem. Should have known that.
I do not know why this happens. Any ideas?
Regards,
Martin
On 22.09.2010 17:45, Martin Becker wrote:
Hi,
Tom, thanks for your answer.
OK, so the problem is, that when I add both hadoop-common-0.21.0.jar
AND had
Hi,
Tom, thanks for your answer.
OK, so the problem is, that when I add both hadoop-common-0.21.0.jar AND
hadoop-mapred-0.21.0.jar to the class path, the Tool interface is marked
deprecated by Eclipse. This seems odd. Only having
hadoop-common-0.21.0.jar in the class path works fine. Both jar
Hi,
I am using Hadoop MapReduce 0.21.0. The usual process of starting
Hadoop/HDFS/MapReduce was to use the "start-all.sh" script. Now when
calling that script, it tell me that its usage is deprecated and I was
to use "start-{dfs,mapred}.sh". But when I do so the error message
"Hadoop common
Thanks Tom,
well now that is strange. I will look into that again. I suspect some
classpath/eclipse problems here.
Martin
On 22.09.2010 16:08, Tom White wrote:
Hi Martin,
Neither Tool nor ToolRunner is deprecated in 0.21.0. I don't think
they have ever been deprecated. You should be able to
Hi Martin,
Neither Tool nor ToolRunner is deprecated in 0.21.0. I don't think
they have ever been deprecated. You should be able to use them without
problems.
Tom
On Wed, Sep 22, 2010 at 6:52 AM, Martin Becker <_martinbec...@web.de> wrote:
> Hello,
> I am trying to move to Hadoop MapReduce 0.21.
Hello,
I am trying to move to Hadoop MapReduce 0.21.0.
The corresponding tutorial still uses Tool and ToolRunner.
Yet both are deprecated. What would be the correct way to implement,
configure and submit a Job now? I was thinking in terms of:
Configuration configuration = new Configura
Chris / All,
Any idea why this is error-ing out?
From: Bhaskar Ghosh
To: mapreduce-user@hadoop.apache.org
Sent: Tue, 21 September, 2010 12:08:21 AM
Subject: Re: How to create a composite value object for output from Map method
Hello All,
Thanks Chris for you
In 0.21, JobClient methods are available in org.apache.hadoop.mapreduce.Job and
org.apache.hadoop.mapreduce.Cluster classes.
On 9/22/10 3:07 PM, "Martin Becker" <_martinbec...@web.de> wrote:
Hello,
I am using the Hadoop MapReduce version 0.20.2 and soon 0.21.
I wanted to use the JobClient clas
Hello,
I am using the Hadoop MapReduce version 0.20.2 and soon 0.21.
I wanted to use the JobClient class to circumvent the use of the command
line interface.
I am noticed that JobClient still uses the deprecated JobConf class for
jib submissions.
Are there any alternatives to JobClient not using
18 matches
Mail list logo
