date:20160208

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-08 Thread Chang Li

Thanks Junping!
+1 non-binding.

Verified signatures.
Built and deployed a single node cluster successfully.
Ran some MR jobs successfully.
Checked UIs.
Ran basic commands successfully.

Best,
Chang Li

On Mon, Feb 8, 2016 at 9:34 PM, Chen He  wrote:

> Thank you Junping for the release work.
>
> +1 non-binding
>
> - built from source code using Java7 and deploy to a two-node cluster;
> - run WC and loadgen, passed;
>
> Regards!
>
> Chen
>
> On Mon, Feb 8, 2016 at 6:11 PM, Mit Desai  wrote:
>
> > +1 (non-binding)
> > - verified signatures
> > - built from source and deployed to a single node cluster.
> > - ran sample map reduce jobs successfully
> >
> > Thanks Jinping Du for putting up the work to prepare the release.
> >
> > -Mit Desai
> >
> >
> >
> > On Mon, Feb 8, 2016 at 5:35 PM, Sangjin Lee  wrote:
> >
> > > +1 (not binding)
> > >
> > > - downloaded both the source and the binary tarballs, and checked the
> > > checksums and signatures
> > > - started a pseudo-distributed cluster and ran test MR jobs
> > > - spot checked the URI and the logs
> > >
> > > Sangjin
> > >
> > > On Mon, Feb 8, 2016 at 4:17 PM, Jason Lowe  >
> > > wrote:
> > >
> > > > +1 (binding)
> > > > - verified signatures and digests- built native from source-
> deployed a
> > > > single-node cluster and ran some sample MapReduce jobs.
> > > > Jason
> > > >
> > > >
> > > >   From: Junping Du 
> > > >  To: "hdfs-...@hadoop.apache.org" ; "
> > > > yarn-...@hadoop.apache.org" ; "
> > > > mapreduce-...@hadoop.apache.org" ;
> "
> > > > common-dev@hadoop.apache.org" 
> > > >  Sent: Wednesday, February 3, 2016 1:01 AM
> > > >  Subject: [VOTE] Release Apache Hadoop 2.6.4 RC0
> > > >
> > > > Hi community folks,
> > > >   I've created a release candidate RC0 for Apache Hadoop 2.6.4 (the
> > next
> > > > maintenance release to follow up 2.6.3.) according to email thread of
> > > > release plan 2.6.4 [1]. Below is details of this release candidate:
> > > >
> > > > The RC is available for validation at:
> > > > *http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/
> > > > *
> > > >
> > > > The RC tag in git is: release-2.6.4-RC0
> > > >
> > > > The maven artifacts are staged via repository.apache.org at:
> > > > *
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1028/
> > ?
> > > > <
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1028/
> > > > >*
> > > >
> > > > You can find my public key at:
> > > > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> > > >
> > > > Please try the release and vote. The vote will run for the usual 5
> > days.
> > > >
> > > > Thanks!
> > > >
> > > >
> > > > Cheers,
> > > >
> > > > Junping
> > > >
> > > >
> > > > [1]: 2.6.4 release plan:
> http://markmail.org/message/fk3ud3c665lscvx5?
> > > >
> > > >
> > > >
> > > >
> > >
> >
>

Build failed in Jenkins: Hadoop-Common-trunk #2351

2016-02-08 Thread Apache Jenkins Server

See 

Changes:

[waltersu4549] Move HDFS-9347 from 2.8.0 to 2.6.5 in CHANGES.txt.

--
[...truncated 5097 lines...]
Running org.apache.hadoop.security.ssl.TestReloadingX509TrustManager
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.189 sec - in 
org.apache.hadoop.security.ssl.TestReloadingX509TrustManager
Running org.apache.hadoop.security.TestUGILoginFromKeytab
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.42 sec - in 
org.apache.hadoop.security.TestUGILoginFromKeytab
Running org.apache.hadoop.security.TestUserGroupInformation
Tests run: 35, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.339 sec - in 
org.apache.hadoop.security.TestUserGroupInformation
Running org.apache.hadoop.security.TestUGIWithExternalKdc
Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.11 sec - in 
org.apache.hadoop.security.TestUGIWithExternalKdc
Running org.apache.hadoop.security.http.TestRestCsrfPreventionFilter
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.459 sec - in 
org.apache.hadoop.security.http.TestRestCsrfPreventionFilter
Running org.apache.hadoop.security.http.TestCrossOriginFilter
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.627 sec - in 
org.apache.hadoop.security.http.TestCrossOriginFilter
Running org.apache.hadoop.security.TestProxyUserFromEnv
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.643 sec - in 
org.apache.hadoop.security.TestProxyUserFromEnv
Running org.apache.hadoop.security.authorize.TestProxyUsers
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.268 sec - in 
org.apache.hadoop.security.authorize.TestProxyUsers
Running org.apache.hadoop.security.authorize.TestProxyServers
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.54 sec - in 
org.apache.hadoop.security.authorize.TestProxyServers
Running org.apache.hadoop.security.authorize.TestServiceAuthorization
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.604 sec - in 
org.apache.hadoop.security.authorize.TestServiceAuthorization
Running org.apache.hadoop.security.authorize.TestAccessControlList
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.189 sec - in 
org.apache.hadoop.security.authorize.TestAccessControlList
Running org.apache.hadoop.security.alias.TestCredShell
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.538 sec - in 
org.apache.hadoop.security.alias.TestCredShell
Running org.apache.hadoop.security.alias.TestCredentialProviderFactory
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.541 sec - in 
org.apache.hadoop.security.alias.TestCredentialProviderFactory
Running org.apache.hadoop.security.alias.TestCredentialProvider
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.092 sec - in 
org.apache.hadoop.security.alias.TestCredentialProvider
Running org.apache.hadoop.security.TestAuthenticationFilter
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.677 sec - in 
org.apache.hadoop.security.TestAuthenticationFilter
Running org.apache.hadoop.security.TestLdapGroupsMapping
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.854 sec - in 
org.apache.hadoop.security.TestLdapGroupsMapping
Running org.apache.hadoop.security.token.TestToken
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.524 sec - in 
org.apache.hadoop.security.token.TestToken
Running org.apache.hadoop.security.token.delegation.TestDelegationToken
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.33 sec - in 
org.apache.hadoop.security.token.delegation.TestDelegationToken
Running 
org.apache.hadoop.security.token.delegation.web.TestDelegationTokenAuthenticationHandlerWithMocks
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.836 sec - in 
org.apache.hadoop.security.token.delegation.web.TestDelegationTokenAuthenticationHandlerWithMocks
Running 
org.apache.hadoop.security.token.delegation.web.TestDelegationTokenManager
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.166 sec - in 
org.apache.hadoop.security.token.delegation.web.TestDelegationTokenManager
Running org.apache.hadoop.security.token.delegation.web.TestWebDelegationToken
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.729 sec - 
in org.apache.hadoop.security.token.delegation.web.TestWebDelegationToken
Running 
org.apache.hadoop.security.token.delegation.TestZKDelegationTokenSecretManager
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.361 sec - in 
org.apache.hadoop.security.token.delegation.TestZKDelegationTokenSecretManager
Running org.apache.hadoop.security.TestShellBasedUnixGroupsMapping
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.457 sec - in 
org.apache.hadoop.security.TestShellBasedUnixGroupsMapping
Running org.apache.hadoop.secur

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-08 Thread Chen He

Thank you Junping for the release work.

+1 non-binding

- built from source code using Java7 and deploy to a two-node cluster;
- run WC and loadgen, passed;

Regards!

Chen

On Mon, Feb 8, 2016 at 6:11 PM, Mit Desai  wrote:

> +1 (non-binding)
> - verified signatures
> - built from source and deployed to a single node cluster.
> - ran sample map reduce jobs successfully
>
> Thanks Jinping Du for putting up the work to prepare the release.
>
> -Mit Desai
>
>
>
> On Mon, Feb 8, 2016 at 5:35 PM, Sangjin Lee  wrote:
>
> > +1 (not binding)
> >
> > - downloaded both the source and the binary tarballs, and checked the
> > checksums and signatures
> > - started a pseudo-distributed cluster and ran test MR jobs
> > - spot checked the URI and the logs
> >
> > Sangjin
> >
> > On Mon, Feb 8, 2016 at 4:17 PM, Jason Lowe 
> > wrote:
> >
> > > +1 (binding)
> > > - verified signatures and digests- built native from source- deployed a
> > > single-node cluster and ran some sample MapReduce jobs.
> > > Jason
> > >
> > >
> > >   From: Junping Du 
> > >  To: "hdfs-...@hadoop.apache.org" ; "
> > > yarn-...@hadoop.apache.org" ; "
> > > mapreduce-...@hadoop.apache.org" ; "
> > > common-dev@hadoop.apache.org" 
> > >  Sent: Wednesday, February 3, 2016 1:01 AM
> > >  Subject: [VOTE] Release Apache Hadoop 2.6.4 RC0
> > >
> > > Hi community folks,
> > >   I've created a release candidate RC0 for Apache Hadoop 2.6.4 (the
> next
> > > maintenance release to follow up 2.6.3.) according to email thread of
> > > release plan 2.6.4 [1]. Below is details of this release candidate:
> > >
> > > The RC is available for validation at:
> > > *http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/
> > > *
> > >
> > > The RC tag in git is: release-2.6.4-RC0
> > >
> > > The maven artifacts are staged via repository.apache.org at:
> > > *
> > https://repository.apache.org/content/repositories/orgapachehadoop-1028/
> ?
> > > <
> > https://repository.apache.org/content/repositories/orgapachehadoop-1028/
> > > >*
> > >
> > > You can find my public key at:
> > > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> > >
> > > Please try the release and vote. The vote will run for the usual 5
> days.
> > >
> > > Thanks!
> > >
> > >
> > > Cheers,
> > >
> > > Junping
> > >
> > >
> > > [1]: 2.6.4 release plan: http://markmail.org/message/fk3ud3c665lscvx5?
> > >
> > >
> > >
> > >
> >
>

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1053

2016-02-08 Thread Apache Jenkins Server

See 

Changes:

[waltersu4549] Move HDFS-9347 from 2.8.0 to 2.6.5 in CHANGES.txt.

--
[...truncated 3845 lines...]
[INFO] Compiling 2 source files to 

[INFO] 
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-minikdc ---
[INFO] Surefire report directory: 


---
 T E S T S
---

---
 T E S T S
---
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.minikdc.TestChangeOrgNameAndDomain
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.442 sec - in 
org.apache.hadoop.minikdc.TestChangeOrgNameAndDomain
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.minikdc.TestMiniKdc
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.503 sec - in 
org.apache.hadoop.minikdc.TestMiniKdc

Results :

Tests run: 6, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-minikdc ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ 
hadoop-minikdc ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ 
hadoop-minikdc ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-minikdc 
---
[INFO] 
[INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ 
hadoop-minikdc ---
[INFO] 
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-minikdc ---
[INFO] 
Loading source files for package org.apache.hadoop.minikdc...
Constructing Javadoc information...
Standard Doclet version 1.8.0
Building tree for all the packages and classes...
Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Building index for all the packages and classes...
Generating 

Generating 

Generating 

Building index for all classes...
Generating 

Generating

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-08 Thread Mit Desai

+1 (non-binding)
- verified signatures
- built from source and deployed to a single node cluster.
- ran sample map reduce jobs successfully

Thanks Jinping Du for putting up the work to prepare the release.

-Mit Desai



On Mon, Feb 8, 2016 at 5:35 PM, Sangjin Lee  wrote:

> +1 (not binding)
>
> - downloaded both the source and the binary tarballs, and checked the
> checksums and signatures
> - started a pseudo-distributed cluster and ran test MR jobs
> - spot checked the URI and the logs
>
> Sangjin
>
> On Mon, Feb 8, 2016 at 4:17 PM, Jason Lowe 
> wrote:
>
> > +1 (binding)
> > - verified signatures and digests- built native from source- deployed a
> > single-node cluster and ran some sample MapReduce jobs.
> > Jason
> >
> >
> >   From: Junping Du 
> >  To: "hdfs-...@hadoop.apache.org" ; "
> > yarn-...@hadoop.apache.org" ; "
> > mapreduce-...@hadoop.apache.org" ; "
> > common-dev@hadoop.apache.org" 
> >  Sent: Wednesday, February 3, 2016 1:01 AM
> >  Subject: [VOTE] Release Apache Hadoop 2.6.4 RC0
> >
> > Hi community folks,
> >   I've created a release candidate RC0 for Apache Hadoop 2.6.4 (the next
> > maintenance release to follow up 2.6.3.) according to email thread of
> > release plan 2.6.4 [1]. Below is details of this release candidate:
> >
> > The RC is available for validation at:
> > *http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/
> > *
> >
> > The RC tag in git is: release-2.6.4-RC0
> >
> > The maven artifacts are staged via repository.apache.org at:
> > *
> https://repository.apache.org/content/repositories/orgapachehadoop-1028/?
> > <
> https://repository.apache.org/content/repositories/orgapachehadoop-1028/
> > >*
> >
> > You can find my public key at:
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > Please try the release and vote. The vote will run for the usual 5 days.
> >
> > Thanks!
> >
> >
> > Cheers,
> >
> > Junping
> >
> >
> > [1]: 2.6.4 release plan: http://markmail.org/message/fk3ud3c665lscvx5?
> >
> >
> >
> >
>

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1052

2016-02-08 Thread Apache Jenkins Server

See 

Changes:

[zhezhang] HDFS-9244. Support nested encryption zones.

--
[...truncated 5509 lines...]
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.retry.TestRetryProxy
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.677 sec - in 
org.apache.hadoop.io.retry.TestRetryProxy
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestDefaultStringifier
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.003 sec - in 
org.apache.hadoop.io.TestDefaultStringifier
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestBloomMapFile
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.047 sec - in 
org.apache.hadoop.io.TestBloomMapFile
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestBytesWritable
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.418 sec - in 
org.apache.hadoop.io.TestBytesWritable
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.rawcoder.TestDummyRawCoder
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.255 sec - in 
org.apache.hadoop.io.erasurecode.rawcoder.TestDummyRawCoder
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.rawcoder.TestXORRawCoder
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.516 sec - in 
org.apache.hadoop.io.erasurecode.rawcoder.TestXORRawCoder
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.rawcoder.TestRSRawCoder
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.921 sec - in 
org.apache.hadoop.io.erasurecode.rawcoder.TestRSRawCoder
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.rawcoder.TestRSRawCoder2
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.944 sec - in 
org.apache.hadoop.io.erasurecode.rawcoder.TestRSRawCoder2
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.TestECSchema
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.204 sec - in 
org.apache.hadoop.io.erasurecode.TestECSchema
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.coder.TestXORCoder
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.678 sec - in 
org.apache.hadoop.io.erasurecode.coder.TestXORCoder
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.coder.TestHHXORErasureCoder
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.624 sec - in 
org.apache.hadoop.io.erasurecode.coder.TestHHXORErasureCoder
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.coder.TestRSErasureCoder
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.257 sec - in 
org.apache.hadoop.io.erasurecode.coder.TestRSErasureCoder
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestWritableUtils
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.414 sec - in 
org.apache.hadoop.io.TestWritableUtils
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestBooleanWritable
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.487 sec - in 
org.apache.hadoop.io.TestBooleanWritable
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestDataByteBuffers
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.667 sec - in 
org.apache.hadoop.io.TestDataByteBuffers
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestVersionedWritable
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.535 sec - in 
org.apache.hadoop.io.TestVersionedWritable
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestE

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-08 Thread Sangjin Lee

+1 (not binding)

- downloaded both the source and the binary tarballs, and checked the
checksums and signatures
- started a pseudo-distributed cluster and ran test MR jobs
- spot checked the URI and the logs

Sangjin

On Mon, Feb 8, 2016 at 4:17 PM, Jason Lowe 
wrote:

> +1 (binding)
> - verified signatures and digests- built native from source- deployed a
> single-node cluster and ran some sample MapReduce jobs.
> Jason
>
>
>   From: Junping Du 
>  To: "hdfs-...@hadoop.apache.org" ; "
> yarn-...@hadoop.apache.org" ; "
> mapreduce-...@hadoop.apache.org" ; "
> common-dev@hadoop.apache.org" 
>  Sent: Wednesday, February 3, 2016 1:01 AM
>  Subject: [VOTE] Release Apache Hadoop 2.6.4 RC0
>
> Hi community folks,
>   I've created a release candidate RC0 for Apache Hadoop 2.6.4 (the next
> maintenance release to follow up 2.6.3.) according to email thread of
> release plan 2.6.4 [1]. Below is details of this release candidate:
>
> The RC is available for validation at:
> *http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/
> *
>
> The RC tag in git is: release-2.6.4-RC0
>
> The maven artifacts are staged via repository.apache.org at:
> *https://repository.apache.org/content/repositories/orgapachehadoop-1028/?
>  >*
>
> You can find my public key at:
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> Please try the release and vote. The vote will run for the usual 5 days.
>
> Thanks!
>
>
> Cheers,
>
> Junping
>
>
> [1]: 2.6.4 release plan: http://markmail.org/message/fk3ud3c665lscvx5?
>
>
>
>

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-08 Thread Jason Lowe

+1 (binding)
- verified signatures and digests- built native from source- deployed a 
single-node cluster and ran some sample MapReduce jobs.
Jason

  From: Junping Du 
 To: "hdfs-...@hadoop.apache.org" ; 
"yarn-...@hadoop.apache.org" ; 
"mapreduce-...@hadoop.apache.org" ; 
"common-dev@hadoop.apache.org"  
 Sent: Wednesday, February 3, 2016 1:01 AM
 Subject: [VOTE] Release Apache Hadoop 2.6.4 RC0

Hi community folks,
  I've created a release candidate RC0 for Apache Hadoop 2.6.4 (the next 
maintenance release to follow up 2.6.3.) according to email thread of release 
plan 2.6.4 [1]. Below is details of this release candidate:

The RC is available for validation at:
*http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/
*

The RC tag in git is: release-2.6.4-RC0

The maven artifacts are staged via repository.apache.org at:
*https://repository.apache.org/content/repositories/orgapachehadoop-1028/?
*

You can find my public key at:
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS

Please try the release and vote. The vote will run for the usual 5 days.

Thanks!

Cheers,

Junping

[1]: 2.6.4 release plan: http://markmail.org/message/fk3ud3c665lscvx5?

Jenkins build is back to normal : Hadoop-common-trunk-Java8 #1051

2016-02-08 Thread Apache Jenkins Server

See

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-08 Thread Eric Payne

Naganarasimha Garla, thanks for the reply.

Yes, I used the node ID. I did not include a port. Here are the steps I used, 
which work for me on 2.7:

- yarn rmadmin -addToClusterNodeLabels abc
- yarn rmadmin -replaceLabelsOnNode hostname.company.com=abc
- configure queue properties as appropriate
- yarn rmadmin -refreshQueues

As I say, this works for me when I try it on 2.7 and later. It's probably 
something with my environment. I will continue to look into it.

Thanks for your help
-Eric



From: Naganarasimha Garla 
To: mapreduce-...@hadoop.apache.org; Eric Payne  
Cc: "common-dev@hadoop.apache.org" ; 
"hdfs-...@hadoop.apache.org" ; 
"yarn-...@hadoop.apache.org" 
Sent: Monday, February 8, 2016 1:01 PM
Subject: Re: [VOTE] Release Apache Hadoop 2.6.4 RC0



+1 (non binding)

* Downloaded hadoop-2.6.4-RC0-src.tar.gz- built from source both package, 
install, and verified the MD5 checksum

* Did a Pseudo cluster and tested basic hdfs operations
* Ran sleep job and Pi job
* Added node label and ran job under the label by configuring 
default-node-label-expression and it ran fine

Eric Payne,
Hope you tried adding/replacing the labels using NodeId/Node Address and not 
the HTTP address!
I executed the following command to configure the label and node
  "./yarn rmadmin -replaceLabelsOnNode  "localhost:43795,test1"  "
After this was able to submit the job for a label

Regards,
+ Naga


On Mon, Feb 8, 2016 at 11:06 PM, Eric Payne  
wrote:

Hi Junping Du. Thank you for your work preparing this release.
>I did the following things to test release Hadoop 2.6.4 rc0:- Downloaded 
>hadoop-2.6.4-RC0-src.tar.gz- built from source both package, install, and 
>eclipse:eclipse- Set up a 3-node, unsecured cluster with 3 queues, one of 
>which has preemption enabled- Ran a successful test to ensure that preemption 
>would happen to containers on the preemptable queue if they were needed for an 
>application on another queue.- Ran successful streaming and yarn shell tests
>Junping, I did have a concern about labelled nodes and queues. Is full label 
>support backported to 2.6.4? I see that the syntax for the rmadmin command 
>lists label commands like -addToClusterNodeLabels and -replaceLabelsOnNode. I 
>was able to add a label (using -addToClusterNodeLabels) and I was able to 
>define a queue whose accessible node label was listed with my specified label. 
>However, when I tried to set the node label to a specific node using 
>-replaceLabelsOnNode, the label does not show up on the specified node in 
>cluster nodes UI (http://RM:8088/cluster/nodes). I also confirmed that 
>submitting a job to the labelled queue gets accepted but never runs, which is 
>the behavior I would expect if no node had the specified label. I will also 
>add that this procedure works fine in 2.7.
>Thanks,-Eric Payne
>
>  From: Junping Du 
> To: "hdfs-...@hadoop.apache.org" ; 
> "yarn-...@hadoop.apache.org" ; 
> "mapreduce-...@hadoop.apache.org" ; 
> "common-dev@hadoop.apache.org" 
> Sent: Wednesday, February 3, 2016 1:01 AM
> Subject: [VOTE] Release Apache Hadoop 2.6.4 RC0
>
>
>Hi community folks,
>  I've created a release candidate RC0 for Apache Hadoop 2.6.4 (the next 
> maintenance release to follow up 2.6.3.) according to email thread of release 
> plan 2.6.4 [1]. Below is details of this release candidate:
>
>The RC is available for validation at:
>*http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/
>*
>
>The RC tag in git is: release-2.6.4-RC0
>
>The maven artifacts are staged via repository.apache.org at:
>*https://repository.apache.org/content/repositories/orgapachehadoop-1028/?
>*
>
>You can find my public key at:
>http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
>Please try the release and vote. The vote will run for the usual 5 days.
>
>Thanks!
>
>
>Cheers,
>
>Junping
>
>
>[1]: 2.6.4 release plan: http://markmail.org/message/fk3ud3c665lscvx5?
>
>
>

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1050

2016-02-08 Thread Apache Jenkins Server

See 

Changes:

[kihwal] HDFS-9752. Permanent write failures may happen to slow writers during

--
[...truncated 5498 lines...]
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.543 sec - in 
org.apache.hadoop.cli.TestCLI
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.TestNetgroupCache
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.084 sec - in 
org.apache.hadoop.security.TestNetgroupCache
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.TestCompositeGroupMapping
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.524 sec - in 
org.apache.hadoop.security.TestCompositeGroupMapping
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.TestUGILoginFromKeytab
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.135 sec - in 
org.apache.hadoop.security.TestUGILoginFromKeytab
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.http.TestCrossOriginFilter
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.394 sec - in 
org.apache.hadoop.security.http.TestCrossOriginFilter
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.http.TestRestCsrfPreventionFilter
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.332 sec - in 
org.apache.hadoop.security.http.TestRestCsrfPreventionFilter
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.TestSecurityUtil
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.674 sec - in 
org.apache.hadoop.security.TestSecurityUtil
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.TestHttpCrossOriginFilterInitializer
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.295 sec - in 
org.apache.hadoop.security.TestHttpCrossOriginFilterInitializer
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.TestLdapGroupsMappingWithPosixGroup
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.557 sec - in 
org.apache.hadoop.security.TestLdapGroupsMappingWithPosixGroup
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.TestGroupsCaching
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.56 sec - in 
org.apache.hadoop.security.TestGroupsCaching
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.authorize.TestProxyUsers
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.637 sec - in 
org.apache.hadoop.security.authorize.TestProxyUsers
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.authorize.TestServiceAuthorization
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.758 sec - in 
org.apache.hadoop.security.authorize.TestServiceAuthorization
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.authorize.TestProxyServers
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.338 sec - in 
org.apache.hadoop.security.authorize.TestProxyServers
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.authorize.TestAccessControlList
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.709 sec - in 
org.apache.hadoop.security.authorize.TestAccessControlList
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.TestProxyUserFromEnv
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.445 sec - in 
org.apache.hadoop.security.TestProxyUserFromEnv
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.TestCredentials
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.539 sec - in 
org.apache.hadoop.security.TestCredentials
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.security.TestWhitelistBasedR

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-08 Thread Naganarasimha Garla

+1 (non binding)

* Downloaded hadoop-2.6.4-RC0-src.tar.gz- built from source both package,
install, and verified the MD5 checksum
* Did a Pseudo cluster and tested basic hdfs operations
* Ran sleep job and Pi job
* Added node label and ran job under the label by
configuring default-node-label-expression and it ran fine

Eric Payne,
Hope you tried adding/replacing the labels using NodeId/Node Address and
not the HTTP address!
I executed the following command to configure the label and node
  "./yarn rmadmin -replaceLabelsOnNode  "localhost:43795,test1"  "
After this was able to submit the job for a label

Regards,
+ Naga

On Mon, Feb 8, 2016 at 11:06 PM, Eric Payne <
eric.payne1...@yahoo.com.invalid> wrote:

> Hi Junping Du. Thank you for your work preparing this release.
> I did the following things to test release Hadoop 2.6.4 rc0:-
> Downloaded hadoop-2.6.4-RC0-src.tar.gz- built from source both package,
> install, and eclipse:eclipse- Set up a 3-node, unsecured cluster with 3
> queues, one of which has preemption enabled- Ran a successful test to
> ensure that preemption would happen to containers on the preemptable queue
> if they were needed for an application on another queue.- Ran successful
> streaming and yarn shell tests
> Junping, I did have a concern about labelled nodes and queues. Is full
> label support backported to 2.6.4? I see that the syntax for the rmadmin
> command lists label commands like -addToClusterNodeLabels
> and -replaceLabelsOnNode. I was able to add a label
> (using -addToClusterNodeLabels) and I was able to define a queue whose
> accessible node label was listed with my specified label. However, when I
> tried to set the node label to a specific node using -replaceLabelsOnNode,
> the label does not show up on the specified node in cluster nodes UI (
> http://RM:8088/cluster/nodes). I also confirmed that submitting a job to
> the labelled queue gets accepted but never runs, which is the behavior I
> would expect if no node had the specified label. I will also add that this
> procedure works fine in 2.7.
> Thanks,-Eric Payne
>
>   From: Junping Du 
>  To: "hdfs-...@hadoop.apache.org" ; "
> yarn-...@hadoop.apache.org" ; "
> mapreduce-...@hadoop.apache.org" ; "
> common-dev@hadoop.apache.org" 
>  Sent: Wednesday, February 3, 2016 1:01 AM
>  Subject: [VOTE] Release Apache Hadoop 2.6.4 RC0
>
> Hi community folks,
>   I've created a release candidate RC0 for Apache Hadoop 2.6.4 (the next
> maintenance release to follow up 2.6.3.) according to email thread of
> release plan 2.6.4 [1]. Below is details of this release candidate:
>
> The RC is available for validation at:
> *http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/
> *
>
> The RC tag in git is: release-2.6.4-RC0
>
> The maven artifacts are staged via repository.apache.org at:
> *https://repository.apache.org/content/repositories/orgapachehadoop-1028/?
>  >*
>
> You can find my public key at:
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> Please try the release and vote. The vote will run for the usual 5 days.
>
> Thanks!
>
>
> Cheers,
>
> Junping
>
>
> [1]: 2.6.4 release plan: http://markmail.org/message/fk3ud3c665lscvx5?
>
>
>
>

Jenkins build is back to normal : Hadoop-Common-trunk #2348

2016-02-08 Thread Apache Jenkins Server

See

[jira] [Created] (HADOOP-12782) Faster LDAP group name resolution with ActiveDirectory

2016-02-08 Thread Wei-Chiu Chuang (JIRA)

Wei-Chiu Chuang created HADOOP-12782:


 Summary: Faster LDAP group name resolution with ActiveDirectory
 Key: HADOOP-12782
 URL: https://issues.apache.org/jira/browse/HADOOP-12782
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Wei-Chiu Chuang
Assignee: Wei-Chiu Chuang


The typical LDAP group name resolution works well under typical scenarios. 
However, we have seen cases where a user is mapped to many groups (in an 
extreme case, a user is mapped to more than 100 groups). The way it's being 
implemented now makes this case super slow resolving groups from 
ActiveDirectory.

The current LDAP group resolution implementation sends two queries to a 
ActiveDirectory server. The first query returns a user object, which contains 
DN (distinguished name). The second query looks for groups where the user DN is 
a member. If a user is mapped to many groups, the second query returns all 
group objects associated with the user, and is thus very slow.

After studying a user object in ActiveDirectory, I found a user object actually 
contains a "memberOf" field, which is the DN of all group objects where the 
user belongs to. Assuming that an organization has no recursive group relation 
(that is, a user A is a member of group G1, and group G1 is a member of group 
G2), we can use this properties to avoid the second query, which can 
potentially run very slow.

I propose that we add a configuration to only enable this feature for users who 
want to reduce group resolution time and who does not have recursive groups, so 
that existing behavior will not be broken.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1049

2016-02-08 Thread Apache Jenkins Server

See 

Changes:

[cnauroth] HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential

--
[...truncated 3843 lines...]
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ 
hadoop-minikdc ---
[INFO] Compiling 2 source files to 

[INFO] 
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-minikdc ---
[INFO] Surefire report directory: 


---
 T E S T S
---

---
 T E S T S
---
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.minikdc.TestChangeOrgNameAndDomain
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.534 sec - in 
org.apache.hadoop.minikdc.TestChangeOrgNameAndDomain
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.minikdc.TestMiniKdc
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.888 sec - in 
org.apache.hadoop.minikdc.TestMiniKdc

Results :

Tests run: 6, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-minikdc ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ 
hadoop-minikdc ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ 
hadoop-minikdc ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-minikdc 
---
[INFO] 
[INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ 
hadoop-minikdc ---
[INFO] 
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-minikdc ---
[INFO] 
Loading source files for package org.apache.hadoop.minikdc...
Constructing Javadoc information...
Standard Doclet version 1.8.0
Building tree for all the packages and classes...
Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Building index for all the packages and classes...
Generating 

Generating 

Generating 

Building index for all classes...
Generating

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-08 Thread Eric Payne

Hi Junping Du. Thank you for your work preparing this release.
I did the following things to test release Hadoop 2.6.4 rc0:- Downloaded 
hadoop-2.6.4-RC0-src.tar.gz- built from source both package, install, and 
eclipse:eclipse- Set up a 3-node, unsecured cluster with 3 queues, one of which 
has preemption enabled- Ran a successful test to ensure that preemption would 
happen to containers on the preemptable queue if they were needed for an 
application on another queue.- Ran successful streaming and yarn shell tests
Junping, I did have a concern about labelled nodes and queues. Is full label 
support backported to 2.6.4? I see that the syntax for the rmadmin command 
lists label commands like -addToClusterNodeLabels and -replaceLabelsOnNode. I 
was able to add a label (using -addToClusterNodeLabels) and I was able to 
define a queue whose accessible node label was listed with my specified label. 
However, when I tried to set the node label to a specific node using 
-replaceLabelsOnNode, the label does not show up on the specified node in 
cluster nodes UI (http://RM:8088/cluster/nodes). I also confirmed that 
submitting a job to the labelled queue gets accepted but never runs, which is 
the behavior I would expect if no node had the specified label. I will also add 
that this procedure works fine in 2.7.
Thanks,-Eric Payne

  From: Junping Du 
 To: "hdfs-...@hadoop.apache.org" ; 
"yarn-...@hadoop.apache.org" ; 
"mapreduce-...@hadoop.apache.org" ; 
"common-dev@hadoop.apache.org"  
 Sent: Wednesday, February 3, 2016 1:01 AM
 Subject: [VOTE] Release Apache Hadoop 2.6.4 RC0
   
Hi community folks,
  I've created a release candidate RC0 for Apache Hadoop 2.6.4 (the next 
maintenance release to follow up 2.6.3.) according to email thread of release 
plan 2.6.4 [1]. Below is details of this release candidate:

The RC is available for validation at:
*http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/
*

The RC tag in git is: release-2.6.4-RC0

The maven artifacts are staged via repository.apache.org at:
*https://repository.apache.org/content/repositories/orgapachehadoop-1028/?
*

You can find my public key at:
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS

Please try the release and vote. The vote will run for the usual 5 days.

Thanks!


Cheers,

Junping


[1]: 2.6.4 release plan: http://markmail.org/message/fk3ud3c665lscvx5?

Build failed in Jenkins: Hadoop-Common-trunk #2347

2016-02-08 Thread Apache Jenkins Server

See 

Changes:

[vvasudev] Revert "HADOOP-12749. Create a threadpoolexecutor that overrides

[vvasudev] HADOOP-12749. Create a threadpoolexecutor that overrides 
afterExecute to

--
[...truncated 5117 lines...]
Running org.apache.hadoop.util.TestShell
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.683 sec - in 
org.apache.hadoop.util.TestShell
Running org.apache.hadoop.util.TestShutdownHookManager
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.235 sec - in 
org.apache.hadoop.util.TestShutdownHookManager
Running org.apache.hadoop.util.TestConfTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.377 sec - in 
org.apache.hadoop.util.TestConfTest
Running org.apache.hadoop.util.TestHttpExceptionUtils
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.431 sec - in 
org.apache.hadoop.util.TestHttpExceptionUtils
Running org.apache.hadoop.util.TestJarFinder
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.17 sec - in 
org.apache.hadoop.util.TestJarFinder
Running org.apache.hadoop.util.hash.TestHash
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.718 sec - in 
org.apache.hadoop.util.hash.TestHash
Running org.apache.hadoop.util.TestLightWeightCache
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.328 sec - in 
org.apache.hadoop.util.TestLightWeightCache
Running org.apache.hadoop.util.TestNativeCodeLoader
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.27 sec - in 
org.apache.hadoop.util.TestNativeCodeLoader
Running org.apache.hadoop.util.TestReflectionUtils
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.114 sec - in 
org.apache.hadoop.util.TestReflectionUtils
Running org.apache.hadoop.crypto.TestCryptoStreams
Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.155 sec - 
in org.apache.hadoop.crypto.TestCryptoStreams
Running org.apache.hadoop.crypto.TestCryptoStreamsForLocalFS
Tests run: 14, Failures: 0, Errors: 0, Skipped: 5, Time elapsed: 21.957 sec - 
in org.apache.hadoop.crypto.TestCryptoStreamsForLocalFS
Running org.apache.hadoop.crypto.TestOpensslCipher
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.357 sec - in 
org.apache.hadoop.crypto.TestOpensslCipher
Running org.apache.hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec
Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.528 sec - 
in org.apache.hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec
Running org.apache.hadoop.crypto.TestCryptoStreamsNormal
Tests run: 14, Failures: 0, Errors: 0, Skipped: 8, Time elapsed: 16.091 sec - 
in org.apache.hadoop.crypto.TestCryptoStreamsNormal
Running org.apache.hadoop.crypto.TestCryptoCodec
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.449 sec - in 
org.apache.hadoop.crypto.TestCryptoCodec
Running org.apache.hadoop.crypto.random.TestOsSecureRandom
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.165 sec - in 
org.apache.hadoop.crypto.random.TestOsSecureRandom
Running org.apache.hadoop.crypto.random.TestOpensslSecureRandom
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.281 sec - in 
org.apache.hadoop.crypto.random.TestOpensslSecureRandom
Running org.apache.hadoop.crypto.TestCryptoStreamsWithJceAesCtrCryptoCodec
Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.547 sec - 
in org.apache.hadoop.crypto.TestCryptoStreamsWithJceAesCtrCryptoCodec
Running org.apache.hadoop.crypto.key.TestKeyProviderDelegationTokenExtension
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.153 sec - in 
org.apache.hadoop.crypto.key.TestKeyProviderDelegationTokenExtension
Running org.apache.hadoop.crypto.key.TestCachingKeyProvider
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.548 sec - in 
org.apache.hadoop.crypto.key.TestCachingKeyProvider
Running org.apache.hadoop.crypto.key.TestKeyProviderFactory
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.619 sec - in 
org.apache.hadoop.crypto.key.TestKeyProviderFactory
Running org.apache.hadoop.crypto.key.TestValueQueue
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.405 sec - in 
org.apache.hadoop.crypto.key.TestValueQueue
Running org.apache.hadoop.crypto.key.kms.TestLoadBalancingKMSClientProvider
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.906 sec - in 
org.apache.hadoop.crypto.key.kms.TestLoadBalancingKMSClientProvider
Running org.apache.hadoop.crypto.key.TestKeyProvider
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.358 sec - in 
org.apache.hadoop.crypto.key.TestKeyProvider
Running org.apache.hadoop.crypto.key.TestKeyShell
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.704 sec - in 
org.apache.hadoop.crypto.key.TestKeyShell
Running org.apache.hadoop.crypto.key.TestKeyPr

[jira] [Resolved] (HADOOP-12749) Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors

2016-02-08 Thread Varun Vasudev (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Varun Vasudev resolved HADOOP-12749.

Resolution: Fixed

> Create a threadpoolexecutor that overrides afterExecute to log uncaught 
> exceptions/errors
> -
>
> Key: HADOOP-12749
> URL: https://issues.apache.org/jira/browse/HADOOP-12749
> Project: Hadoop Common
>  Issue Type: Sub-task
>Reporter: Sidharta Seethana
>Assignee: Sidharta Seethana
> Fix For: 2.9.0
>
> Attachments: HADOOP-12749.001.patch, HADOOP-12749.002.patch, 
> HADOOP-12749.003.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HADOOP-12781) Enable fencing for logjam-protected ssh servers

2016-02-08 Thread Olaf Flebbe (JIRA)

Olaf Flebbe created HADOOP-12781:


 Summary: Enable fencing for logjam-protected ssh servers
 Key: HADOOP-12781
 URL: https://issues.apache.org/jira/browse/HADOOP-12781
 Project: Hadoop Common
  Issue Type: Bug
  Components: auto-failover
Affects Versions: 2.7.2
 Environment: If a site uses logjam protected ssh servers no common 
ciphers can be found and fencing breaks because the fencing process cannot be 
initiated by zkfc.
Reporter: Olaf Flebbe
Assignee: Olaf Flebbe


Version 0.15.3 of jsch incorporates changes to add ciphers for logjam 
protection. See http://www.jcraft.com/jsch/ChangeLog.

Since there are no developer visible changes, updating pom is sufficient.

Doublechecked in my environment.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (HADOOP-12749) Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors

2016-02-08 Thread Varun Vasudev (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Varun Vasudev reopened HADOOP-12749:


Doh! Reopening ticket because the new files didn't get added to the repository 
in the commit. My apologies [~sidharta-s]

> Create a threadpoolexecutor that overrides afterExecute to log uncaught 
> exceptions/errors
> -
>
> Key: HADOOP-12749
> URL: https://issues.apache.org/jira/browse/HADOOP-12749
> Project: Hadoop Common
>  Issue Type: Sub-task
>Reporter: Sidharta Seethana
>Assignee: Sidharta Seethana
> Fix For: 2.9.0
>
> Attachments: HADOOP-12749.001.patch, HADOOP-12749.002.patch, 
> HADOOP-12749.003.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HADOOP-12780) During atomic rename handle crash when one directory has been renamed but not file under it.

2016-02-08 Thread madhumita chakraborty (JIRA)

madhumita chakraborty created HADOOP-12780:
--

 Summary: During atomic rename handle crash when one directory has 
been renamed but not file under it.
 Key: HADOOP-12780
 URL: https://issues.apache.org/jira/browse/HADOOP-12780
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs/azure
Affects Versions: 2.8.0
Reporter: madhumita chakraborty
Assignee: madhumita chakraborty
Priority: Critical


During atomic folder rename process preperaion we record the proposed change to 
a metadata file (-renamePending.json).
Say we are renaming parent/folderToRename to parent/renamedFolder.
folderToRename has an inner folder innerFolder and innerFolder has a file 
innerFile
Content of the –renamePending.json file will be
{ OldFolderName: /parent/ folderToRename", NewFolderName: 
"parent/renamedFolder", FileList: [ "innerFolder", "innerFolder/innerFile" ] }
Atfirst we rename all files within the source directory and then rename the 
source directory at the last step
The steps are
1.  Atfirst we will rename innerFolder, 
2.  Then rename innerFolder/innerFile 
3.  Then rename source directory folderToRename
Say the process crashes after step 1.
So innerFolder has been renamed. 
Note that Azure storage does not natively support folder. So if a directory 
created by mkdir command, we create an empty placeholder blob with metadata for 
the directory.
So after step 1, the empty blob corresponding to the directory innerFolder has 
been renamed.
When the process comes up, in redo path it will go through the 
–renamePending.json file try to redo the renames. 
For each file in file list of renamePending file it checks if the source file 
exists, if source file exists then it renames the file. When it gets 
innerFolder, it calls filesystem.exists(innerFolder). Now 
filesystem.exists(innerFolder) will return true, because file under that folder 
exists even though the empty blob corresponding th that folder does not exist. 
So it will try to rename this folder, and as the empty blob has already been 
deleted so this fails with exception that “source blob does not exist”.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build is back to normal : Hadoop-common-trunk-Java8 #1047

2016-02-08 Thread Apache Jenkins Server

See

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1046

2016-02-08 Thread Apache Jenkins Server

See 

Changes:

[vvasudev] HADOOP-12749. Create a threadpoolexecutor that overrides 
afterExecute to

--
[...truncated 5503 lines...]
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.82 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileUnsortedByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileStreams
Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.278 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileStreams
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFile
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.138 sec - in 
org.apache.hadoop.io.file.tfile.TestTFile
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsJClassComparatorByteArrays
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.205 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsJClassComparatorByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileJClassComparatorByteArrays
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.223 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileJClassComparatorByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsStreams
Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.354 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsStreams
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileSplit
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.171 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileSplit
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileComparator2
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.05 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileComparator2
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsByteArrays
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.256 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileByteArrays
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.101 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileSeqFileComparison
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.671 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileSeqFileComparison
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestVLong
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.441 sec - in 
org.apache.hadoop.io.file.tfile.TestVLong
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestTextNonUTF8
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.209 sec - in 
org.apache.hadoop.io.TestTextNonUTF8
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestArrayWritable
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.205 sec - in 
org.apache.hadoop.io.TestArrayWritable
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.rawcoder.TestXORRawCoder
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.23 sec - in 
org.apache.hadoop.io.erasurecode.rawcoder.TestXORRawCoder
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.rawcoder.TestDummyRawCoder
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.087 sec - in 
org.apache.hadoop.io.erasurecode.rawcoder.TestDummyRawCoder
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
R

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

Build failed in Jenkins: Hadoop-Common-trunk #2351

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1053

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1052

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

Jenkins build is back to normal : Hadoop-common-trunk-Java8 #1051

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1050

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

Jenkins build is back to normal : Hadoop-Common-trunk #2348

[jira] [Created] (HADOOP-12782) Faster LDAP group name resolution with ActiveDirectory

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1049

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

Build failed in Jenkins: Hadoop-Common-trunk #2347

[jira] [Resolved] (HADOOP-12749) Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors

[jira] [Created] (HADOOP-12781) Enable fencing for logjam-protected ssh servers

[jira] [Reopened] (HADOOP-12749) Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors

[jira] [Created] (HADOOP-12780) During atomic rename handle crash when one directory has been renamed but not file under it.

Jenkins build is back to normal : Hadoop-common-trunk-Java8 #1047

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1046

23 matches

Site Navigation

Mail list logo

Footer information