[jira] [Created] (YARN-2184) ResourceManager may fail due to name node in safe mode

2014-06-19 Thread Jeff Zhang (JIRA)
Jeff Zhang created YARN-2184: Summary: ResourceManager may fail due to name node in safe mode Key: YARN-2184 URL: https://issues.apache.org/jira/browse/YARN-2184 Project: Hadoop YARN Issue Type:

Success: YARN-2074 PreCommit Build #4031

2014-06-19 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2074 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4031/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Failed: YARN-1709 PreCommit Build #4030

2014-06-19 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-1709 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4030/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Failed: YARN-2179 PreCommit Build #4029

2014-06-19 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2179 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4029/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Success: YARN-2144 PreCommit Build #4028

2014-06-19 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2144 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4028/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

[jira] [Created] (YARN-2183) Cleaner service for cache manager

2014-06-19 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-2183: -- Summary: Cleaner service for cache manager Key: YARN-2183 URL: https://issues.apache.org/jira/browse/YARN-2183 Project: Hadoop YARN Issue Type: Sub-task

Re: crossPlatformifyMREnv exception

2014-06-19 Thread Grandl Robert
Hitesh, Thanks so much for your advices. You are right, there it seems to be an issue with setting hive execution engine to mr after it is tez. I configure it in hive-site.xml plus moving mapreduce-2.4 jars in tez-0.4 and now works just fine. Hurray ! Thanks again for your help, robert On

Re: crossPlatformifyMREnv exception

2014-06-19 Thread Hitesh Shah
HI Robert, Copying the hadoop-mapreduce-*-2.4 jars to the tez dir was what I would have recommended. Tez is compatible with both 2.2 and 2.4 so either set should work. For everything running as tez, I am guessing somehow you have yarn-tez set in one of the config files. For hive queries, I am

Re: crossPlatformifyMREnv exception

2014-06-19 Thread Grandl Robert
I tried to copy hadoop-mapreduce-client-2.4* from hadoop-2.4 to tez-0.4 and also copy to hdfs in /apps/tez/lib, and run Hive. But even if I set hive.execution.engine=tez or mr, jobs are running such as tez only :). (framework.name=yarn) I know I have tried before hive-0.13 and tez-0.5 and some

Re: crossPlatformifyMREnv exception

2014-06-19 Thread Grandl Robert
Hi Hitesh, It seems tez is using 2.2 while hadoop-2.4 has 2-4 for mapreduce. .Is this the problem ? If yes, how can I fix ? For tez-0.4 they are: hadoop@nectar-11:~/rgrandl$ ls tez/tez-0.4.0-incubating/lib/ avro-1.7.4.jar hadoop-mapreduce-client-core-2.2.0.jar c

Re: crossPlatformifyMREnv exception

2014-06-19 Thread Hitesh Shah
Hi Robert, If you look at the tez jars, you will probably see a couple of mapreduce jars that Tez depends on under TEZ_BASE_DIR/lib/. Are these jars inconsistent with respect to the version of hadoop/mapreduce on the cluster? — Hitesh On Jun 19, 2014, at 2:59 PM, Grandl Robert wrote: > Hmm

Re: crossPlatformifyMREnv exception

2014-06-19 Thread Grandl Robert
Hmm, Things are really weird. So If I don't add TEZ jars/conf in hadoop_classpath simply running Mapreduce jobs works. If I add TEZ jars/conf to hadoop_classpath and try to run mapreduce jobs, it fails with the exception: 14/06/19 14:46:40 INFO mapreduce.JobSubmitter: Cleaning up the staging a

Re: [VOTE] Release Apache Hadoop 2.4.1

2014-06-19 Thread Akira AJISAKA
I think we should include this issue in 2.4.1, so I uploaded a patch to fix it. I'll appreciate your review. Thanks, Akira (2014/06/18 12:13), Vinod Kumar Vavilapalli wrote: There is one item [MAPREDUCE-5830 HostUtil.getTaskLogUrl is not backwards binary compatible with 2.3] marked for 2.4.

Re: crossPlatformifyMREnv exception

2014-06-19 Thread Jian He
The problem looks like it's referencing an old jar which doesn't have this method. are you running on single node cluster? can you check you cluster setting about jar dependency. If it's easy for you, just refresh the environment and re-deploy the single node cluster. Jian On Thu, Jun 19, 2014 a

Success: YARN-1713 PreCommit Build #4027

2014-06-19 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-1713 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4027/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

[jira] [Created] (YARN-2182) Update ContainerId#toString() to avoid conflicts before and after RM restart

2014-06-19 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created YARN-2182: Summary: Update ContainerId#toString() to avoid conflicts before and after RM restart Key: YARN-2182 URL: https://issues.apache.org/jira/browse/YARN-2182 Project: Had

Success: YARN-2052 PreCommit Build #4026

2014-06-19 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2052 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4026/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Re: crossPlatformifyMREnv exception

2014-06-19 Thread Grandl Robert
Any suggestion related to this ? Thanks, robert On Wednesday, June 18, 2014 11:56 PM, Grandl Robert wrote: I am using 2.4 for client as well. Actually I took a tar gz from http://apache.petsads.us/hadoop/common/hadoop-2.4.0/, and I am trying to run. I tried even one node. I am lack of i

[VOTE] Release Apache Hadoop 0.23.11

2014-06-19 Thread Thomas Graves
Hey Everyone, There have been various bug fixes that have went into branch-0.23 since the 0.23.10 release. We think its time to do a 0.23.11. This is also the last planned release off of branch-0.23 we plan on doing. The RC is available at: http://people.apache.org/~tgraves/hadoop-0.23.11-candi

Jenkins build is back to normal : Hadoop-Yarn-trunk #588

2014-06-19 Thread Apache Jenkins Server
See

Failed: YARN-2142 PreCommit Build #4025

2014-06-19 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2142 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4025/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat