In streaming contents of the file will be streamed to mapper through
STDIN, not the file names.
Fix the perl script accordingly.
Thanks, Subir
On 8/3/12, Devi Kumarappan wrote:
>
>
> After specifying NLineInputFormat option, streaming job fails with
>
> Error from attempt_201205171448_0092_m_00
On Fri, Aug 3, 2012 at 4:19 PM, Arun C Murthy wrote:
> Just do -javaagent:./profiler.jar?
>
Yep, that should work. Thanks!
Just do -javaagent:./profiler.jar?
On Aug 3, 2012, at 9:32 AM, Stan Rosenberg wrote:
> Arun,
>
> I don't believe the symlink is of help. The symlink is created in the
> task's current working directory (cwd), but I don't know what cwd is
> when I launch with 'hadoop jar ...'.
>
> Thanks,
>
>
Thanks for the alternatives, but I'd ideally like to do all this inside the MR
job itself as I want to be able to programmatically run it regularly, and any
additional steps just add complexity.
Looking through sample code on Google, I never see anybody using the
Progressable passed in to the o
On Fri, Aug 3, 2012 at 1:31 PM, Harsh J wrote:
>
> What this would do is merely take your passed -files jar (client-common) and
> symlink it into the JVM's working directory (the task's working directory)
> _before_ the JVM is begun, as "foo.jar". So if I pass additionally, JVM opts
> that refer t
Hi,
The latest release package available is 2.0.0 (with 2.0.1 expected to be
out with some minor fixes and a security fix soon). Its API docs are here:
http://hadoop.apache.org/common/docs/current/api/
On Fri, Aug 3, 2012 at 9:34 PM, wrote:
> What is the newest API for Hadoop and MapReduce? Wh
Stan,
What Arun says would surely work.
For instance, read this command:
hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.0.0.jar pi
-files
"share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.0.0.jar#foo.jar"
-Dmapred.child.java.opts="-javaagent:./foo.jar" 1 1
What this would
Arun,
I don't believe the symlink is of help. The symlink is created in the
task's current working directory (cwd), but I don't know what cwd is
when I launch with 'hadoop jar ...'.
Thanks,
stan
On Fri, Aug 3, 2012 at 2:39 AM, Arun C Murthy wrote:
> Stan,
>
> You can ask TT to create a symli
What is the newest API for Hadoop and MapReduce? What number version is
it?
Andrew Botelho
EMC Corporation
55 Constitution Blvd., Franklin, MA
andrew.bote...@emc.com
Mobile: 508-813-2026
Ok Got it now. That is a good piece of information.
Thank You :)
Regards
Bejoy KS
Sent from handheld, please excuse typos.
-Original Message-
From: Harsh J
Date: Fri, 3 Aug 2012 16:28:27
To: ;
Cc: Mohammad Tariq
Subject: Re: Reading fields from a Text line
Bejoy,
In the new API, th
Bejoy,
In the new API, the default map() function, if not properly
overridden, is the identity map function. There is no IdentityMapper
class in the new API, the Mapper class itself is identity by default.
On Fri, Aug 3, 2012 at 1:07 PM, Bejoy KS wrote:
> That is a good pointer Harsh.
> Thanks a
That is a good pointer Harsh.
Thanks a lot.
But if IdentityMapper is being used shouldn't the job.xml reflect that? But
Job.xml always shows mapper as our CustomMapper.
Regards
Bejoy KS
Sent from handheld, please excuse typos.
-Original Message-
From: Harsh J
Date: Fri, 3 Aug 2012 13:
That is not really a bug. Only if you use @Override will you be really
asserting that you've overriden the right method (since new API uses
inheritance instead of interfaces). Without that kinda check, its easy
to make mistakes and add in methods that won't get considered by the
framework (and henc
13 matches
Mail list logo
