Failed: YARN-1710 PreCommit Build #4084

2014-06-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-1710 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4084/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Failed: YARN-2181 PreCommit Build #4083

2014-06-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2181 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4083/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Failed: YARN-2204 PreCommit Build #4082

2014-06-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2204 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4082/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Re: [VOTE] Release Apache Hadoop 2.4.1

2014-06-25 Thread Ravi Prakash
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 +1 Built and deployed clusters on Amazon. Ran a basic test suite. Thanks Arun On 06/25/14 17:11, Akira AJISAKA wrote: > Thanks Arun for another RC! > > I'm +1 (non-binding) for RC2. HDFS-6527 should be reverted because the issue is only in 2.5 and

Re: [VOTE] Release Apache Hadoop 2.4.1

2014-06-25 Thread Akira AJISAKA
Thanks Arun for another RC! I'm +1 (non-binding) for RC2. HDFS-6527 should be reverted because the issue is only in 2.5 and trunk. In addition, I hope HDFS-6591 to be merged. Other than that, RC1 is good to me. I tested RC1 with distributed cluster on CentOS 6.3: - Successful build from src

Failed: YARN-2208 PreCommit Build #4081

2014-06-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2208 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4081/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Re: Moving to JDK7, JDK8 and new major releases

2014-06-25 Thread Chris Nauroth
I understood the plan for avoiding JDK7-specific features in our code, and your suggestion to add an extra Jenkins job is a great way to guard against that. The thing I haven't seen discussed yet is how downstream projects will continue to consume our built artifacts. If a downstream project upgr

Re: Moving to JDK7, JDK8 and new major releases

2014-06-25 Thread Akira AJISAKA
+1 (non-binding) for 2.5 to be the last release to ensure JDK6. >>> My higher-level goal though is to avoid going through this same pain >>> again when JDK7 goes EOL. I'd like to do a JDK8-based release >>> before then for this reason. This is why I suggested skipping an >>> intermediate 2.x+JDK7

Re: Moving to JDK7, JDK8 and new major releases

2014-06-25 Thread Alejandro Abdelnur
Chris, Compiling with jdk7 and doing javac -target 1.6 is not sufficient, you are still using jdk7 libraries and you could use new APIs, thus breaking jdk6 both at compile and runtime. you need to compile with jdk6 to ensure you are not running into that scenario. that is why i was suggesting the

Re: [VOTE] Change by-laws on release votes: 5 days instead of 7

2014-06-25 Thread Kihwal Lee
+1 (binding) Kihwal On 6/24/14, 3:53 AM, "Arun C Murthy" wrote: >Folks, > > As discussed, I'd like to call a vote on changing our by-laws to change >release votes from 7 days to 5. > > I've attached the change to by-laws I'm proposing. > > Please vote, the vote will the usual period of 7 days.

[jira] [Created] (YARN-2214) preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

2014-06-25 Thread Ashwin Shankar (JIRA)
Ashwin Shankar created YARN-2214: Summary: preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness Key: YARN-2214 URL: https://issues.apache.org/jira/browse/YARN-2214 Project:

Re: Moving to JDK7, JDK8 and new major releases

2014-06-25 Thread Chris Nauroth
I'm also +1 for getting us to JDK7 within the 2.x line after reading the proposals and catching up on the discussion in this thread. Has anyone yet considered how to coordinate this change with downstream projects? Would we request downstream projects to upgrade to JDK7 first before we make the m

Re: [VOTE] Release Apache Hadoop 0.23.11

2014-06-25 Thread Karthik Kambatla
+1 (non-binding) Stood up a pseudo-dist cluster and ran a few MR jobs. On Wed, Jun 25, 2014 at 9:05 AM, Jason Lowe wrote: > +1 (binding) > > - Verified signatures and digests > - Deployed binary tarball to a single-node cluster and ran some MR example > jobs > - Built from source, deployed to

Re: [VOTE] Change by-laws on release votes: 5 days instead of 7

2014-06-25 Thread Giridharan Kesavan
+1 -giri On Wed, Jun 25, 2014 at 12:02 PM, Arpit Agarwal wrote: > +1 Arpit > > > On Tue, Jun 24, 2014 at 1:53 AM, Arun C Murthy > wrote: > > > Folks, > > > > As discussed, I'd like to call a vote on changing our by-laws to change > > release votes from 7 days to 5. > > > > I've attached the

Re: [VOTE] Change by-laws on release votes: 5 days instead of 7

2014-06-25 Thread Arpit Agarwal
+1 Arpit On Tue, Jun 24, 2014 at 1:53 AM, Arun C Murthy wrote: > Folks, > > As discussed, I'd like to call a vote on changing our by-laws to change > release votes from 7 days to 5. > > I've attached the change to by-laws I'm proposing. > > Please vote, the vote will the usual period of 7 da

Re: "SIMPLE authentication is not enabled" error for secured hdfs read

2014-06-25 Thread Chris Nauroth
Just to clarify, the new method added in HADOOP-10683 helped fix erroneous logs that showed SIMPLE for the authentication method instead of KERBEROS. Switching to that version of the method still won't automatically attach credentials to the ugi, so I expect you'll still get an authentication fail

[jira] [Created] (YARN-2213) Change proxy-user cookie log in AmIpFilter to DEBUG

2014-06-25 Thread Ted Yu (JIRA)
Ted Yu created YARN-2213: Summary: Change proxy-user cookie log in AmIpFilter to DEBUG Key: YARN-2213 URL: https://issues.apache.org/jira/browse/YARN-2213 Project: Hadoop YARN Issue Type: Task

[jira] [Created] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-06-25 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-2211: --- Summary: RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens Key: YARN-2211 URL: https://issues.apache.org/jira/browse/YARN-2211 Proj

[jira] [Created] (YARN-2212) ApplicationMaster needs to find a way to update the AMRMToken periodically

2014-06-25 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-2212: --- Summary: ApplicationMaster needs to find a way to update the AMRMToken periodically Key: YARN-2212 URL: https://issues.apache.org/jira/browse/YARN-2212 Project: Hadoop YARN

Re: Moving to JDK7, JDK8 and new major releases

2014-06-25 Thread Owen O'Malley
On Tue, Jun 24, 2014 at 4:44 PM, Alejandro Abdelnur wrote: > After reading this thread and thinking a bit about it, I think it should be > OK such move up to JDK7 in Hadoop I agree with Alejandro. Changing minimum JDKs is not an incompatible change and is fine in the 2 branch. (Although I think

Re: [VOTE] Release Apache Hadoop 0.23.11

2014-06-25 Thread Jason Lowe
+1 (binding) - Verified signatures and digests - Deployed binary tarball to a single-node cluster and ran some MR example jobs - Built from source, deployed to a single-node cluster and ran some MR example jobs Jason On 06/19/2014 10:14 AM, Thomas Graves wrote: Hey Everyone, There have bee

Failed: YARN-2052 PreCommit Build #4079

2014-06-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2052 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4079/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Success: YARN-2201 PreCommit Build #4080

2014-06-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2201 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4080/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Success: YARN-2181 PreCommit Build #4078

2014-06-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2181 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4078/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

[jira] [Resolved] (YARN-2210) resource manager fails to start if core-site.xml contains an xi:include

2014-06-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved YARN-2210. -- Resolution: Duplicate Resolving as a dup of YARN-1741, as that has more discussion around how this was

Anyone knows which class is JobHistoryServer use to talk to a secured hdfs?

2014-06-25 Thread Liu, David
> Hi all, I find JobHistoryServer have access to secured hdfs, can anyone paste some code or some class name it use for it to pass secure authentication? Thanks

Hadoop-Yarn-trunk - Build # 594 - Failure

2014-06-25 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Yarn-trunk/594/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 15489 lines...] [INFO] hadoop-yarn-common

Build failed in Jenkins: Hadoop-Yarn-trunk #594

2014-06-25 Thread Apache Jenkins Server
See Changes: [jianhe] YARN-1365. Changed ApplicationMasterService to allow an app to re-register after RM restart. Contributed by Anubhav Dhoot [szetszwo] HADOOP-10674. Improve PureJavaCrc32 performance and use java.util.zip.CRC32 f

Re: How do I use java api to read data from secured hadoop cluster?

2014-06-25 Thread Vinayakumar B
If kinit done in the machine and user, where your client program is running, then no other changes required to your program. BTW in your client configurations also need to have the authentication method configured. Regards, Vinay On Wed, Jun 25, 2014 at 5:20 AM, Liu, David wrote: > By the way,

Re: "SIMPLE authentication is not enabled" error for secured hdfs read

2014-06-25 Thread Vinayakumar B
Hi, In first snippet of the code following method can be used by providing the corresponding AuthMethod. /** * Create a user from a login name. It is intended to be used for remote * users in RPC, since it won't have any credentials. * @param user the full user principal name, must not b

Failed: YARN-2052 PreCommit Build #4077

2014-06-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2052 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4077/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Failed: YARN-2181 PreCommit Build #4076

2014-06-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2181 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4076/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Failed: YARN-2181 PreCommit Build #4074

2014-06-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2181 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4074/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Failed: YARN-2181 PreCommit Build #4075

2014-06-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2181 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4075/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Failed: YARN-2163 PreCommit Build #4073

2014-06-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/YARN-2163 Build: https://builds.apache.org/job/PreCommit-YARN-Build/4073/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat