See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/18/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 19023 lines...]
[INFO] Executing tasks
main:
[IN
See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/17/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 19029 lines...]
[INFO]
[INFO] --- maven-install-
Good tip.
Can you please add it to the FAQ Chris started on
http://wiki.apache.org/hadoop/WritingYarnApps? (Oh, thanks Chris!)
Arun
On Sep 20, 2011, at 7:29 PM, Hitesh Shah wrote:
> Chris,
>
> Another small note in case you have not already figured it out.
>
> It should likely be possible
[
https://issues.apache.org/jira/browse/MAPREDUCE-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod Kumar Vavilapalli reopened MAPREDUCE-3053:
Assignee: Vinod Kumar Vavilapalli
I think it makes sense to f
Chris,
Another small note in case you have not already figured it out.
It should likely be possible to debug the application master by running it
directly ( instead of the multi-step client job submission approach). The only
thing to note is you will need to comment out the code that does the
See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/16/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 17990 lines...]
[INFO]
See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/15/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 18284 lines...]
at hudson.remoting.PipeWi
See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/14/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 18113 lines...]
at hudson.remoting.PipeWi
Simplify parameter passing to Application Master from Client. SImplify approach
to pass info such appId, ClusterTimestamp and failcount required by App Master.
-
On Sep 20, 2011, at 5:32 PM, Hitesh Shah wrote:
> Hi Chris
>
> You are right. At the moment, you do need to pass all of them in to your app
> master for it to register. I will file a jira to simplify this to end up with
> something along the lines where the RM implicitly passes such informatio
See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/13/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 3735 lines...]
A
hadoop-mapreduce-projec
Hi Chris
You are right. At the moment, you do need to pass all of them in to your app
master for it to register. I will file a jira to simplify this to end up with
something along the lines where the RM implicitly passes such information to
the app master without the client explicitly setting i
Unable to kill submitted jobs
-
Key: MAPREDUCE-3054
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3054
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0
[
https://issues.apache.org/jira/browse/MAPREDUCE-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Riccomini resolved MAPREDUCE-3053.
Resolution: Fixed
Fixed with:
val rmAddress =
NetUtils.createSocketAddr(con
YARN Protobuf RPC Failures in RM
Key: MAPREDUCE-3053
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3053
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: resourcemanager
Affects Vers
Feel free to use http://wiki.apache.org/hadoop/WritingYarnApps.
thanks,
Arun
On Sep 20, 2011, at 2:35 PM, Chris Riccomini wrote:
> Hey Arun,
>
> For sure. Any preferred location?
>
> Cheers,
> Chris
>
> From: Arun C Murthy [a...@hortonworks.com]
> Sent:
Hey Arun,
For sure. Any preferred location?
Cheers,
Chris
From: Arun C Murthy [a...@hortonworks.com]
Sent: Tuesday, September 20, 2011 2:32 PM
To: mapreduce-dev@hadoop.apache.org
Subject: Re: YARN, LocalResource, and Classpaths
Thanks Chris! We'd love to
Thanks Chris! We'd love to have you put up a README wiki to log your adventures
for posterity... interested?
On Sep 20, 2011, at 2:20 PM, Chris Riccomini wrote:
> Hey Guys,
>
> Thanks for the help. For the record, this solved the problem:
>
>new ApplicationMasterExecutor(packagePath)
>
Hey Guys,
Sorry to bug again, but I think it's best to get this stuff into the mail
archives.
I want to confirm that I'm starting my ApplicationMaster in the "proper" way.
Right now, my client is setCommand'ing this:
"java -cp './package/*' kafka.yarn.ApplicationMaster " + streamerClass + " "
Hey Guys,
Thanks for the help. For the record, this solved the problem:
new ApplicationMasterExecutor(packagePath)
.addCommand("java -cp './package/*' kafka.yarn.ApplicationMaster " +
streamerClass + " " + tasks + " "
+ "1>" + ApplicationConstants.LOG_DIR_EXPANSION_VAR + "/stdo
Hey Vinod,
Interesting follow up.
find ./package/*
Shows:
package/activation-1.1.jar
package/aopalliance-1.0.jar
package/asm-3.2.jar
package/aspectjrt-1.6.5.jar
package/avro-1.5.3.jar
package/avro-ipc-1.5.3.jar
...
Appears it's unzipped, after all. I think the :./package/*: syntax is busted
f
[
https://issues.apache.org/jira/browse/MAPREDUCE-2763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramya Sunil resolved MAPREDUCE-2763.
Resolution: Fixed
I see this issue being fixed in the latest code base. Hence resolving
Hey Vinod,
Yea, I considered that.
find .
.
./.task.sh.crc
./.container_tokens.crc
./container_tokens
./task.sh
./package
ls -l package
lrwxrwxrwx 1 criccomi eng 125 Sep 20 12:47 package ->
/tmp/nm-local-dir/usercache/criccomi/appcache/application_1316468926404_0016/filecache/2573972455544981
Maintain consistency in naming appIDs, jobIDs and attemptIDs
Key: MAPREDUCE-3052
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3052
Project: Hadoop Map/Reduce
Issue Type: Bu
As Vinod mentioned, package your dirs so that they untar into the CWD.
If you have a directory structure in your .tgz (e.g. lib.tgz -> lib/foo.jar)
you'll need to set your classpath to be ./foo/*.
hth,
Arun
On Sep 20, 2011, at 10:26 AM, Chris Riccomini wrote:
> Hey All,
>
> I'm trying to us
The .tgz archives are untarred and symlinked to in the working directory. In
your code, you mentioned the key to be "package" in the resource
description. I'd suggest you try to add files under the "package" dir
(actually a symlink). Also, it really depends on how you package really is
built.
For
HADOOP_CONF_DIR exported twice in the classpath
---
Key: MAPREDUCE-3051
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3051
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mr
Hey All,
I'm trying to use YARN's LocalResource stuff to ship a tgz file that has all
the jars that I need on my Classpath (for my ApplicationMaster and my container
tasks). I'm having trouble figuring out what my client should put in the
ApplicationMaster exec command that it sends to the Reso
YarnScheduler needs to expose Resource Usage Information
Key: MAPREDUCE-3050
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3050
Project: Hadoop Map/Reduce
Issue Type: Bug
[
https://issues.apache.org/jira/browse/MAPREDUCE-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod Kumar Vavilapalli resolved MAPREDUCE-2755.
Resolution: Duplicate
Same as MAPREDUCE-2754.
> MR-279: AM wri
Improvements in the RM, NM, HS UI pages
---
Key: MAPREDUCE-3049
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3049
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: mrv2
A
Fix test-patch to run tests via "mvn clean install test"
Key: MAPREDUCE-3048
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3048
Project: Hadoop Map/Reduce
Issue Type: Bug
FileOutputCommitter throws wrong type of exception when calling abortTask() to
handle a directory without permission
Key: MAPREDUCE-3047
URL: http
33 matches
Mail list logo
