Failure to submit job on trunk hadoop cluster

2016-06-27 Thread Tsuyoshi Ozawa
Hi, Have anyone tried to submit jobs on trunk cluster? I failed to launch jobs by class not found error with following error messages. Should I change environment variables to setup from branch-2's one? I'm using the same configuration as Hadoop 2 can run. $ hadoop jar ./share/hadoop/mapreduce/h

Re: Failure to submit job on trunk hadoop cluster

2016-06-27 Thread Sunil Govind
Hi Tsuyoshi I think you might need to set below environment variables for HADOOP_MAPRED_HOME mapreduce.admin.user.env yarn.app.mapreduce.am.env Thanks Sunil On Mon, Jun 27, 2016 at 4:10 PM Tsuyoshi Ozawa wrote: > Hi, > > Have anyone tried to submit jobs on trunk cluster? > I failed to launch

RE: Failure to submit job on trunk hadoop cluster

2016-06-27 Thread Rohith Sharma K S
Hi Tsuyoshi I think it is modified for security reasons. I too did not find any JIRA id corresponding to this commit. Related discussion happened in the following JIRA. https://issues.apache.org/jira/browse/MAPREDUCE-6704 Thanks & Regards Rohith Sharma K S -Original Message- From: T

Re: Failure to submit job on trunk hadoop cluster

2016-06-27 Thread Tsuyoshi Ozawa
Hey Sunil and Rohith, Thanks a lot! As you mentioned, it works well after configuring mapreduce.admin.user.env and yarn.app.mapreduce.am.env. As Sangjin also mentioned on MAPREDUCE-6704, it's better to configure mapred.child.env instead of mapreduce.admin.user.env until the problem described here

[DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

2016-06-27 Thread Tsuyoshi Ozawa
Hi developers, I will plan to upgrade Google Guice dependency on trunk. The change also includes asm and cglib upgrade. I checked following points: * Both HDFS and YARN UIs work well. * All webIU-related tests pass as described on HADOOP-12064. * Ran mapreduce job, and it works well. https://iss

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-06-27 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/77/ [Jun 26, 2016 10:15:32 AM] (vinayakumarb) HDFS-10536. Standby NN can not trigger log roll after EditLogTailer -1 overall The following subsystems voted -1: unit The following subsystems voted -1

[jira] [Created] (YARN-5296) NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl

2016-06-27 Thread Karam Singh (JIRA)
Karam Singh created YARN-5296: - Summary: NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl Key: YARN-5296 URL: https://issues.apache.org/jira/browse/YARN-5296 Project: Hadoop YAR

[jira] [Created] (YARN-5297) Avoid printing a stack trace when recovering an app after the RM restarts

2016-06-27 Thread Siddharth Seth (JIRA)
Siddharth Seth created YARN-5297: Summary: Avoid printing a stack trace when recovering an app after the RM restarts Key: YARN-5297 URL: https://issues.apache.org/jira/browse/YARN-5297 Project: Hadoop

[jira] [Created] (YARN-5298) Mount usercache and NM filecache directories into Docker container

2016-06-27 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5298: --- Summary: Mount usercache and NM filecache directories into Docker container Key: YARN-5298 URL: https://issues.apache.org/jira/browse/YARN-5298 Project: Hadoop YARN

[jira] [Created] (YARN-5299) Log Docker run command when container fails

2016-06-27 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5299: --- Summary: Log Docker run command when container fails Key: YARN-5299 URL: https://issues.apache.org/jira/browse/YARN-5299 Project: Hadoop YARN Issue Type: Sub-t

Minor fix request on Jenkins web page link

2016-06-27 Thread Ray Chiang
For the Jenkins jobs: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/ https://builds.apache.org/job/PreCommit-YARN-Build/ The link to PreCommit-Admin is incorrect. There's an extra "/hudson" in the path. -Ray

Re: Looking to a Hadoop 3 release

2016-06-27 Thread Andrew Wang
A heads up that I think we're getting close on the blockers for the first alpha. Looking at my list, I see two I'd like to get in still: YARN-5270 and HADOOP-13316. Will cut a branch and roll the release once those go in; my test builds have looked good thus far. My original plan was to do alphas

[jira] [Created] (YARN-5300) Exclude generated federation protobuf sources from YARN Javadoc build

2016-06-27 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5300: Summary: Exclude generated federation protobuf sources from YARN Javadoc build Key: YARN-5300 URL: https://issues.apache.org/jira/browse/YARN-5300 Project: Hadoop YAR