[jira] [Commented] (YARN-871) Failed to run MR example against latest trunk
[
https://issues.apache.org/jira/browse/YARN-871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13969693#comment-13969693
]
maruscia commented on YARN-871:
---
The reported user os appears to be OSX, then the issue may be related to to
this SO question:
http://stackoverflow.com/questions/20390217/mapreduce-job-in-headless-environment-fails-n-times-due-to-am-container-exceptio
(check out Answer 1)
The hadoop-env.sh file hardcodes the java executable file path as /bin/java
while on MacOs it defaults to /usr/bin/java.
Would it be better to avoid the hardcoding and rely on $PATH?
Failed to run MR example against latest trunk
-
Key: YARN-871
URL: https://issues.apache.org/jira/browse/YARN-871
Project: Hadoop YARN
Issue Type: Bug
Reporter: Zhijie Shen
Attachments: yarn-zshen-resourcemanager-ZShens-MacBook-Pro.local.log
Built the latest trunk, deployed a single node cluster and ran examples, such
as
{code}
hadoop jar
hadoop-3.0.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-SNAPSHOT.jar
teragen 10 out1
{code}
The job failed with the following console message:
{code}
13/06/21 12:51:25 INFO mapreduce.Job: Running job: job_1371844267731_0001
13/06/21 12:51:31 INFO mapreduce.Job: Job job_1371844267731_0001 running in
uber mode : false
13/06/21 12:51:31 INFO mapreduce.Job: map 0% reduce 0%
13/06/21 12:51:31 INFO mapreduce.Job: Job job_1371844267731_0001 failed with
state FAILED due to: Application application_1371844267731_0001 failed 2
times due to AM Container for appattempt_1371844267731_0001_02 exited
with exitCode: 127 due to:
.Failing this attempt.. Failing the application.
13/06/21 12:51:31 INFO mapreduce.Job: Counters: 0
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-871) Failed to run MR example against latest trunk
[
https://issues.apache.org/jira/browse/YARN-871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13698267#comment-13698267
]
Junping Du commented on YARN-871:
-
Hi [~zjshen], given YARN-874 is committed, shall we resolve it?
Failed to run MR example against latest trunk
-
Key: YARN-871
URL: https://issues.apache.org/jira/browse/YARN-871
Project: Hadoop YARN
Issue Type: Bug
Reporter: Zhijie Shen
Attachments: yarn-zshen-resourcemanager-ZShens-MacBook-Pro.local.log
Built the latest trunk, deployed a single node cluster and ran examples, such
as
{code}
hadoop jar
hadoop-3.0.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-SNAPSHOT.jar
teragen 10 out1
{code}
The job failed with the following console message:
{code}
13/06/21 12:51:25 INFO mapreduce.Job: Running job: job_1371844267731_0001
13/06/21 12:51:31 INFO mapreduce.Job: Job job_1371844267731_0001 running in
uber mode : false
13/06/21 12:51:31 INFO mapreduce.Job: map 0% reduce 0%
13/06/21 12:51:31 INFO mapreduce.Job: Job job_1371844267731_0001 failed with
state FAILED due to: Application application_1371844267731_0001 failed 2
times due to AM Container for appattempt_1371844267731_0001_02 exited
with exitCode: 127 due to:
.Failing this attempt.. Failing the application.
13/06/21 12:51:31 INFO mapreduce.Job: Counters: 0
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-871) Failed to run MR example against latest trunk
[
https://issues.apache.org/jira/browse/YARN-871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13691868#comment-13691868
]
Devaraj K commented on YARN-871:
{code:xml}
2013-06-24 20:58:05,102 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Application
application_1372087479441_0002 failed 2 times due to Error launching
appattempt_1372087479441_0002_02. Got exception: java.io.IOException:
Failed on local exception: java.io.IOException: java.io.IOException: Server
asks us to fall back to SIMPLE auth, but this client is configured to only
allow secure connections.; Host Details : local host is:
HOST-10-18-91-57/10.18.91.57; destination host is: HOST-10-18-91-57:12356;
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:764)
at org.apache.hadoop.ipc.Client.call(Client.java:1318)
at org.apache.hadoop.ipc.Client.call(Client.java:1266)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
at $Proxy23.startContainer(Unknown Source)
at
org.apache.hadoop.yarn.api.impl.pb.client.ContainerManagementProtocolPBClientImpl.startContainer(ContainerManagementProtocolPBClientImpl.java:110)
at
org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.launch(AMLauncher.java:110)
at
org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.run(AMLauncher.java:228)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
Caused by: java.io.IOException: java.io.IOException: Server asks us to fall
back to SIMPLE auth, but this client is configured to only allow secure
connections.
at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:589)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1489)
at
org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:552)
at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:635)
at org.apache.hadoop.ipc.Client$Connection.access$2200(Client.java:258)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1367)
at org.apache.hadoop.ipc.Client.call(Client.java:1285)
... 9 more
Caused by: java.io.IOException: Server asks us to fall back to SIMPLE auth, but
this client is configured to only allow secure connections.
at
org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:250)
at
org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:464)
at org.apache.hadoop.ipc.Client$Connection.access$1500(Client.java:258)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:628)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:625)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1489)
at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:624)
... 12 more
. Failing the application.
{code}
Failed to run MR example against latest trunk
-
Key: YARN-871
URL: https://issues.apache.org/jira/browse/YARN-871
Project: Hadoop YARN
Issue Type: Bug
Reporter: Zhijie Shen
Attachments: yarn-zshen-resourcemanager-ZShens-MacBook-Pro.local.log
Built the latest trunk, deployed a single node cluster and ran examples, such
as
{code}
hadoop jar
hadoop-3.0.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-SNAPSHOT.jar
teragen 10 out1
{code}
The job failed with the following console message:
{code}
13/06/21 12:51:25 INFO mapreduce.Job: Running job: job_1371844267731_0001
13/06/21 12:51:31 INFO mapreduce.Job: Job job_1371844267731_0001 running in
uber mode : false
13/06/21 12:51:31 INFO mapreduce.Job: map 0% reduce 0%
13/06/21 12:51:31 INFO mapreduce.Job: Job job_1371844267731_0001 failed with
state FAILED due to: Application application_1371844267731_0001 failed 2
times due to AM Container for appattempt_1371844267731_0001_02 exited
with exitCode: 127 due to:
.Failing this attempt.. Failing the application.
13/06/21 12:51:31 INFO mapreduce.Job: Counters: 0
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:
[jira] [Commented] (YARN-871) Failed to run MR example against latest trunk
[
https://issues.apache.org/jira/browse/YARN-871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13692108#comment-13692108
]
Zhijie Shen commented on YARN-871:
--
[~devaraj.k], the posted exception seems to be related to HADOOP-9421 and
YARN-827. YARN-874 is tracking the issue.
Failed to run MR example against latest trunk
-
Key: YARN-871
URL: https://issues.apache.org/jira/browse/YARN-871
Project: Hadoop YARN
Issue Type: Bug
Reporter: Zhijie Shen
Attachments: yarn-zshen-resourcemanager-ZShens-MacBook-Pro.local.log
Built the latest trunk, deployed a single node cluster and ran examples, such
as
{code}
hadoop jar
hadoop-3.0.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-SNAPSHOT.jar
teragen 10 out1
{code}
The job failed with the following console message:
{code}
13/06/21 12:51:25 INFO mapreduce.Job: Running job: job_1371844267731_0001
13/06/21 12:51:31 INFO mapreduce.Job: Job job_1371844267731_0001 running in
uber mode : false
13/06/21 12:51:31 INFO mapreduce.Job: map 0% reduce 0%
13/06/21 12:51:31 INFO mapreduce.Job: Job job_1371844267731_0001 failed with
state FAILED due to: Application application_1371844267731_0001 failed 2
times due to AM Container for appattempt_1371844267731_0001_02 exited
with exitCode: 127 due to:
.Failing this attempt.. Failing the application.
13/06/21 12:51:31 INFO mapreduce.Job: Counters: 0
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
