Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

[John Zhuge]

+1 (non-binding)

- Verified checksums and signatures of the tarballs
- Built source with Java 1.7.0_111 on Centos 6.6 with native
- Verified licenses and notices using verify-license-notice.sh
- Deployed a pseudo cluster

- Ran basic dfs, distcp, ACL commands
- Ran MapReduce wordcount example
- Ran balancer


Thanks,
John

John Zhuge
Software Engineer, Cloudera

On Sun, Oct 2, 2016 at 5:12 PM, Sangjin Lee  wrote:

> Hi folks,
>
> I have pushed a new release candidate (R1) for the Apache Hadoop 2.6.5
> release (the next maintenance release in the 2.6.x release line). RC1
> contains fixes to CHANGES.txt, and is otherwise identical to RC0.
>
> Below are the details of this release candidate:
>
> The RC is available for validation at:
> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/.
>
> The RC tag in git is release-2.6.5-RC1 and its git commit is
> e8c9fe0b4c252caf2ebf1464220599650f119997.
>
> The maven artifacts are staged via repository.apache.org at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1050/.
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS.
>
> Please try the release and vote. The vote will run for the usual 5 days. I
> would greatly appreciate your timely vote. Thanks!
>
> Regards,
> Sangjin
>

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

[Junping Du]

+1 binding, based on:

- Download and build from source, check signatures

- Deploy a single node cluster and run some simple jobs, like sleep, PI, etc.

Thanks Sangjin and Chris for working on 2.6.5 release!

Thanks,

Junping

From: larry mccay 
Sent: Saturday, October 08, 2016 3:43 AM
To: Karthik Kambatla
Cc: Yongjun Zhang; Sangjin Lee; Andrew Wang; Wangda Tan; Zhihai Xu; Masatake 
Iwasaki; common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; 
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

+1 (non-binding)


* Downloaded and verified signatures

* Built from source

* Deployed a standalone cluster

* Tested HDFS commands and job submit

* Tested webhdfs through Apache Knox

On Fri, Oct 7, 2016 at 10:35 PM, Karthik Kambatla 
wrote:

> Thanks for putting the RC together, Sangjin.
>
> +1 (binding)
>
> Built from source, deployed pseudo distributed cluster and ran some example
> MR jobs.
>
> On Fri, Oct 7, 2016 at 6:01 PM, Yongjun Zhang  wrote:
>
> > Hi Sangjin,
> >
> > Thanks a lot for your work here.
> >
> > My +1 (binding).
> >
> > - Downloaded both binary and src tarballs
> > - Verified md5 checksum and signature for both
> > - Build from source tarball
> > - Deployed 2 pseudo clusters, one with the released tarball and the other
> > with what I built from source, and did the following on both:
> > - Run basic HDFS operations, and distcp jobs
> > - Run pi job
> > - Examined HDFS webui, YARN webui.
> >
> > Best,
> >
> > --Yongjun
> >
> > > > > * verified basic HDFS operations and Pi job.
> > > > > * Did a sanity check for RM and NM UI.
> >
> >
> > On Fri, Oct 7, 2016 at 5:08 PM, Sangjin Lee  wrote:
> >
> > > I'm casting my vote: +1 (binding)
> > >
> > > Regards,
> > > Sangjin
> > >
> > > On Fri, Oct 7, 2016 at 3:12 PM, Andrew Wang 
> > > wrote:
> > >
> > > > Thanks to Chris and Sangjin for working on this release.
> > > >
> > > > +1 binding
> > > >
> > > > * Verified signatures
> > > > * Built from source tarball
> > > > * Started HDFS and did some basic ops
> > > >
> > > > Thanks,
> > > > Andrew
> > > >
> > > > On Fri, Oct 7, 2016 at 2:50 PM, Wangda Tan 
> > wrote:
> > > >
> > > > > Thanks Sangjin for cutting this release!
> > > > >
> > > > > +1 (Binding)
> > > > >
> > > > > - Downloaded binary tar ball and setup a single node cluster.
> > > > > - Submit a few applications and which can successfully run.
> > > > >
> > > > > Thanks,
> > > > > Wangda
> > > > >
> > > > >
> > > > > On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xu  >
> > > > wrote:
> > > > >
> > > > > > Thanks Sangjin for creating release 2.6.5 RC1.
> > > > > >
> > > > > > +1 (non-binding)
> > > > > >
> > > > > > * Downloaded and built from source
> > > > > > * Verified md5 checksums and signature
> > > > > > * Deployed a pseudo cluster
> > > > > > * verified basic HDFS operations and Pi job.
> > > > > > * Did a sanity check for RM and NM UI.
> > > > > >
> > > > > > Thanks
> > > > > > zhihai
> > > > > >
> > > > > > On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee 
> > > wrote:
> > > > > >
> > > > > > > Thanks Masatake!
> > > > > > >
> > > > > > > Today's the last day for this vote, and I'd like to ask you to
> > try
> > > > out
> > > > > > the
> > > > > > > RC and vote on this today. So far there has been no binding
> vote.
> > > > > Thanks
> > > > > > > again.
> > > > > > >
> > > > > > > Regards,
> > > > > > > Sangjin
> > > > > > >
> > > > > > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki <
> > > > > > > iwasak...@oss.nttdata.co.jp> wrote:
> > > > > > >
> > > > > > > > +1(non-binding)
> > > > > > > >
> > > > > > > > * verified signature and md5.
> > > > > > > > * built with -Pnative on CentOS6 and OpenJDK7.
> > > > > > > > * built documentation and skimmed the contents.
> > > > > > > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and
> > > > > mapreduce
> > > > > > on
> > > > > > > > 3-node cluster.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Masatake Iwasaki
> > > > > > > >
> > > > > > > > On 10/3/16 09:12, Sangjin Lee wrote:
> > > > > > > >
> > > > > > > >> Hi folks,
> > > > > > > >>
> > > > > > > >> I have pushed a new release candidate (R1) for the Apache
> > Hadoop
> > > > > 2.6.5
> > > > > > > >> release (the next maintenance release in the 2.6.x release
> > > line).
> > > > > RC1
> > > > > > > >> contains fixes to CHANGES.txt, and is otherwise identical to
> > > RC0.
> > > > > > > >>
> > > > > > > >> Below are the details of this release candidate:
> > > > > > > >>
> > > > > > > >> The RC is available for validation at:
> > > > > > > >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/.
> > > > > > > >>
> > > > > > > >> The RC tag in git is release-2.6.5-RC1 and its git commit is
> > > > > > > >> e8c9fe0b4c252caf2ebf1464220599650f119997.
> > > > > > > >>
> > > > > > > >> The maven artifacts are staged via repository.apache.org
> at:
> > > > > > > >> https://repository.apache.org/content/repositor

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

[larry mccay]

+1 (non-binding)


* Downloaded and verified signatures

* Built from source

* Deployed a standalone cluster

* Tested HDFS commands and job submit

* Tested webhdfs through Apache Knox

On Fri, Oct 7, 2016 at 10:35 PM, Karthik Kambatla 
wrote:

> Thanks for putting the RC together, Sangjin.
>
> +1 (binding)
>
> Built from source, deployed pseudo distributed cluster and ran some example
> MR jobs.
>
> On Fri, Oct 7, 2016 at 6:01 PM, Yongjun Zhang  wrote:
>
> > Hi Sangjin,
> >
> > Thanks a lot for your work here.
> >
> > My +1 (binding).
> >
> > - Downloaded both binary and src tarballs
> > - Verified md5 checksum and signature for both
> > - Build from source tarball
> > - Deployed 2 pseudo clusters, one with the released tarball and the other
> > with what I built from source, and did the following on both:
> > - Run basic HDFS operations, and distcp jobs
> > - Run pi job
> > - Examined HDFS webui, YARN webui.
> >
> > Best,
> >
> > --Yongjun
> >
> > > > > * verified basic HDFS operations and Pi job.
> > > > > * Did a sanity check for RM and NM UI.
> >
> >
> > On Fri, Oct 7, 2016 at 5:08 PM, Sangjin Lee  wrote:
> >
> > > I'm casting my vote: +1 (binding)
> > >
> > > Regards,
> > > Sangjin
> > >
> > > On Fri, Oct 7, 2016 at 3:12 PM, Andrew Wang 
> > > wrote:
> > >
> > > > Thanks to Chris and Sangjin for working on this release.
> > > >
> > > > +1 binding
> > > >
> > > > * Verified signatures
> > > > * Built from source tarball
> > > > * Started HDFS and did some basic ops
> > > >
> > > > Thanks,
> > > > Andrew
> > > >
> > > > On Fri, Oct 7, 2016 at 2:50 PM, Wangda Tan 
> > wrote:
> > > >
> > > > > Thanks Sangjin for cutting this release!
> > > > >
> > > > > +1 (Binding)
> > > > >
> > > > > - Downloaded binary tar ball and setup a single node cluster.
> > > > > - Submit a few applications and which can successfully run.
> > > > >
> > > > > Thanks,
> > > > > Wangda
> > > > >
> > > > >
> > > > > On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xu  >
> > > > wrote:
> > > > >
> > > > > > Thanks Sangjin for creating release 2.6.5 RC1.
> > > > > >
> > > > > > +1 (non-binding)
> > > > > >
> > > > > > * Downloaded and built from source
> > > > > > * Verified md5 checksums and signature
> > > > > > * Deployed a pseudo cluster
> > > > > > * verified basic HDFS operations and Pi job.
> > > > > > * Did a sanity check for RM and NM UI.
> > > > > >
> > > > > > Thanks
> > > > > > zhihai
> > > > > >
> > > > > > On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee 
> > > wrote:
> > > > > >
> > > > > > > Thanks Masatake!
> > > > > > >
> > > > > > > Today's the last day for this vote, and I'd like to ask you to
> > try
> > > > out
> > > > > > the
> > > > > > > RC and vote on this today. So far there has been no binding
> vote.
> > > > > Thanks
> > > > > > > again.
> > > > > > >
> > > > > > > Regards,
> > > > > > > Sangjin
> > > > > > >
> > > > > > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki <
> > > > > > > iwasak...@oss.nttdata.co.jp> wrote:
> > > > > > >
> > > > > > > > +1(non-binding)
> > > > > > > >
> > > > > > > > * verified signature and md5.
> > > > > > > > * built with -Pnative on CentOS6 and OpenJDK7.
> > > > > > > > * built documentation and skimmed the contents.
> > > > > > > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and
> > > > > mapreduce
> > > > > > on
> > > > > > > > 3-node cluster.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Masatake Iwasaki
> > > > > > > >
> > > > > > > > On 10/3/16 09:12, Sangjin Lee wrote:
> > > > > > > >
> > > > > > > >> Hi folks,
> > > > > > > >>
> > > > > > > >> I have pushed a new release candidate (R1) for the Apache
> > Hadoop
> > > > > 2.6.5
> > > > > > > >> release (the next maintenance release in the 2.6.x release
> > > line).
> > > > > RC1
> > > > > > > >> contains fixes to CHANGES.txt, and is otherwise identical to
> > > RC0.
> > > > > > > >>
> > > > > > > >> Below are the details of this release candidate:
> > > > > > > >>
> > > > > > > >> The RC is available for validation at:
> > > > > > > >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/.
> > > > > > > >>
> > > > > > > >> The RC tag in git is release-2.6.5-RC1 and its git commit is
> > > > > > > >> e8c9fe0b4c252caf2ebf1464220599650f119997.
> > > > > > > >>
> > > > > > > >> The maven artifacts are staged via repository.apache.org
> at:
> > > > > > > >> https://repository.apache.org/content/repositories/
> > > > > > > orgapachehadoop-1050/.
> > > > > > > >>
> > > > > > > >> You can find my public key at
> > > > > > > >> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS.
> > > > > > > >>
> > > > > > > >> Please try the release and vote. The vote will run for the
> > > usual 5
> > > > > > > days. I
> > > > > > > >> would greatly appreciate your timely vote. Thanks!
> > > > > > > >>
> > > > > > > >> Regards,
> > > > > > > >> Sangjin
> > > > > > > >>
> > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

[Karthik Kambatla]

Thanks for putting the RC together, Sangjin.

+1 (binding)

Built from source, deployed pseudo distributed cluster and ran some example
MR jobs.

On Fri, Oct 7, 2016 at 6:01 PM, Yongjun Zhang  wrote:

> Hi Sangjin,
>
> Thanks a lot for your work here.
>
> My +1 (binding).
>
> - Downloaded both binary and src tarballs
> - Verified md5 checksum and signature for both
> - Build from source tarball
> - Deployed 2 pseudo clusters, one with the released tarball and the other
> with what I built from source, and did the following on both:
> - Run basic HDFS operations, and distcp jobs
> - Run pi job
> - Examined HDFS webui, YARN webui.
>
> Best,
>
> --Yongjun
>
> > > > * verified basic HDFS operations and Pi job.
> > > > * Did a sanity check for RM and NM UI.
>
>
> On Fri, Oct 7, 2016 at 5:08 PM, Sangjin Lee  wrote:
>
> > I'm casting my vote: +1 (binding)
> >
> > Regards,
> > Sangjin
> >
> > On Fri, Oct 7, 2016 at 3:12 PM, Andrew Wang 
> > wrote:
> >
> > > Thanks to Chris and Sangjin for working on this release.
> > >
> > > +1 binding
> > >
> > > * Verified signatures
> > > * Built from source tarball
> > > * Started HDFS and did some basic ops
> > >
> > > Thanks,
> > > Andrew
> > >
> > > On Fri, Oct 7, 2016 at 2:50 PM, Wangda Tan 
> wrote:
> > >
> > > > Thanks Sangjin for cutting this release!
> > > >
> > > > +1 (Binding)
> > > >
> > > > - Downloaded binary tar ball and setup a single node cluster.
> > > > - Submit a few applications and which can successfully run.
> > > >
> > > > Thanks,
> > > > Wangda
> > > >
> > > >
> > > > On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xu 
> > > wrote:
> > > >
> > > > > Thanks Sangjin for creating release 2.6.5 RC1.
> > > > >
> > > > > +1 (non-binding)
> > > > >
> > > > > * Downloaded and built from source
> > > > > * Verified md5 checksums and signature
> > > > > * Deployed a pseudo cluster
> > > > > * verified basic HDFS operations and Pi job.
> > > > > * Did a sanity check for RM and NM UI.
> > > > >
> > > > > Thanks
> > > > > zhihai
> > > > >
> > > > > On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee 
> > wrote:
> > > > >
> > > > > > Thanks Masatake!
> > > > > >
> > > > > > Today's the last day for this vote, and I'd like to ask you to
> try
> > > out
> > > > > the
> > > > > > RC and vote on this today. So far there has been no binding vote.
> > > > Thanks
> > > > > > again.
> > > > > >
> > > > > > Regards,
> > > > > > Sangjin
> > > > > >
> > > > > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki <
> > > > > > iwasak...@oss.nttdata.co.jp> wrote:
> > > > > >
> > > > > > > +1(non-binding)
> > > > > > >
> > > > > > > * verified signature and md5.
> > > > > > > * built with -Pnative on CentOS6 and OpenJDK7.
> > > > > > > * built documentation and skimmed the contents.
> > > > > > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and
> > > > mapreduce
> > > > > on
> > > > > > > 3-node cluster.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Masatake Iwasaki
> > > > > > >
> > > > > > > On 10/3/16 09:12, Sangjin Lee wrote:
> > > > > > >
> > > > > > >> Hi folks,
> > > > > > >>
> > > > > > >> I have pushed a new release candidate (R1) for the Apache
> Hadoop
> > > > 2.6.5
> > > > > > >> release (the next maintenance release in the 2.6.x release
> > line).
> > > > RC1
> > > > > > >> contains fixes to CHANGES.txt, and is otherwise identical to
> > RC0.
> > > > > > >>
> > > > > > >> Below are the details of this release candidate:
> > > > > > >>
> > > > > > >> The RC is available for validation at:
> > > > > > >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/.
> > > > > > >>
> > > > > > >> The RC tag in git is release-2.6.5-RC1 and its git commit is
> > > > > > >> e8c9fe0b4c252caf2ebf1464220599650f119997.
> > > > > > >>
> > > > > > >> The maven artifacts are staged via repository.apache.org at:
> > > > > > >> https://repository.apache.org/content/repositories/
> > > > > > orgapachehadoop-1050/.
> > > > > > >>
> > > > > > >> You can find my public key at
> > > > > > >> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS.
> > > > > > >>
> > > > > > >> Please try the release and vote. The vote will run for the
> > usual 5
> > > > > > days. I
> > > > > > >> would greatly appreciate your timely vote. Thanks!
> > > > > > >>
> > > > > > >> Regards,
> > > > > > >> Sangjin
> > > > > > >>
> > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

[Yongjun Zhang]

Hi Sangjin,

Thanks a lot for your work here.

My +1 (binding).

- Downloaded both binary and src tarballs
- Verified md5 checksum and signature for both
- Build from source tarball
- Deployed 2 pseudo clusters, one with the released tarball and the other
with what I built from source, and did the following on both:
- Run basic HDFS operations, and distcp jobs
- Run pi job
- Examined HDFS webui, YARN webui.

Best,

--Yongjun

> > > * verified basic HDFS operations and Pi job.
> > > * Did a sanity check for RM and NM UI.


On Fri, Oct 7, 2016 at 5:08 PM, Sangjin Lee  wrote:

> I'm casting my vote: +1 (binding)
>
> Regards,
> Sangjin
>
> On Fri, Oct 7, 2016 at 3:12 PM, Andrew Wang 
> wrote:
>
> > Thanks to Chris and Sangjin for working on this release.
> >
> > +1 binding
> >
> > * Verified signatures
> > * Built from source tarball
> > * Started HDFS and did some basic ops
> >
> > Thanks,
> > Andrew
> >
> > On Fri, Oct 7, 2016 at 2:50 PM, Wangda Tan  wrote:
> >
> > > Thanks Sangjin for cutting this release!
> > >
> > > +1 (Binding)
> > >
> > > - Downloaded binary tar ball and setup a single node cluster.
> > > - Submit a few applications and which can successfully run.
> > >
> > > Thanks,
> > > Wangda
> > >
> > >
> > > On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xu 
> > wrote:
> > >
> > > > Thanks Sangjin for creating release 2.6.5 RC1.
> > > >
> > > > +1 (non-binding)
> > > >
> > > > * Downloaded and built from source
> > > > * Verified md5 checksums and signature
> > > > * Deployed a pseudo cluster
> > > > * verified basic HDFS operations and Pi job.
> > > > * Did a sanity check for RM and NM UI.
> > > >
> > > > Thanks
> > > > zhihai
> > > >
> > > > On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee 
> wrote:
> > > >
> > > > > Thanks Masatake!
> > > > >
> > > > > Today's the last day for this vote, and I'd like to ask you to try
> > out
> > > > the
> > > > > RC and vote on this today. So far there has been no binding vote.
> > > Thanks
> > > > > again.
> > > > >
> > > > > Regards,
> > > > > Sangjin
> > > > >
> > > > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki <
> > > > > iwasak...@oss.nttdata.co.jp> wrote:
> > > > >
> > > > > > +1(non-binding)
> > > > > >
> > > > > > * verified signature and md5.
> > > > > > * built with -Pnative on CentOS6 and OpenJDK7.
> > > > > > * built documentation and skimmed the contents.
> > > > > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and
> > > mapreduce
> > > > on
> > > > > > 3-node cluster.
> > > > > >
> > > > > > Thanks,
> > > > > > Masatake Iwasaki
> > > > > >
> > > > > > On 10/3/16 09:12, Sangjin Lee wrote:
> > > > > >
> > > > > >> Hi folks,
> > > > > >>
> > > > > >> I have pushed a new release candidate (R1) for the Apache Hadoop
> > > 2.6.5
> > > > > >> release (the next maintenance release in the 2.6.x release
> line).
> > > RC1
> > > > > >> contains fixes to CHANGES.txt, and is otherwise identical to
> RC0.
> > > > > >>
> > > > > >> Below are the details of this release candidate:
> > > > > >>
> > > > > >> The RC is available for validation at:
> > > > > >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/.
> > > > > >>
> > > > > >> The RC tag in git is release-2.6.5-RC1 and its git commit is
> > > > > >> e8c9fe0b4c252caf2ebf1464220599650f119997.
> > > > > >>
> > > > > >> The maven artifacts are staged via repository.apache.org at:
> > > > > >> https://repository.apache.org/content/repositories/
> > > > > orgapachehadoop-1050/.
> > > > > >>
> > > > > >> You can find my public key at
> > > > > >> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS.
> > > > > >>
> > > > > >> Please try the release and vote. The vote will run for the
> usual 5
> > > > > days. I
> > > > > >> would greatly appreciate your timely vote. Thanks!
> > > > > >>
> > > > > >> Regards,
> > > > > >> Sangjin
> > > > > >>
> > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
>

[jira] [Created] (HADOOP-13700) Incompatible changes in TrashPolicy

[Haibo Chen (JIRA)]

Haibo Chen created HADOOP-13700:
---

 Summary: Incompatible changes in TrashPolicy 
 Key: HADOOP-13700
 URL: https://issues.apache.org/jira/browse/HADOOP-13700
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs
Affects Versions: 3.0.0-alpha1
Reporter: Haibo Chen
Assignee: Andrew Wang
Priority: Critical
 Fix For: 3.0.0-alpha2


TrashPolicy is marked as public & evolving, but its public API, specifically 
TrashPolicy.getInstance() has been changed in an incompatible way. 
1) The path parameter is removed in 3.0
2) A new IOException is thrown in 3.0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

[Sangjin Lee]

I'm casting my vote: +1 (binding)

Regards,
Sangjin

On Fri, Oct 7, 2016 at 3:12 PM, Andrew Wang 
wrote:

> Thanks to Chris and Sangjin for working on this release.
>
> +1 binding
>
> * Verified signatures
> * Built from source tarball
> * Started HDFS and did some basic ops
>
> Thanks,
> Andrew
>
> On Fri, Oct 7, 2016 at 2:50 PM, Wangda Tan  wrote:
>
> > Thanks Sangjin for cutting this release!
> >
> > +1 (Binding)
> >
> > - Downloaded binary tar ball and setup a single node cluster.
> > - Submit a few applications and which can successfully run.
> >
> > Thanks,
> > Wangda
> >
> >
> > On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xu 
> wrote:
> >
> > > Thanks Sangjin for creating release 2.6.5 RC1.
> > >
> > > +1 (non-binding)
> > >
> > > * Downloaded and built from source
> > > * Verified md5 checksums and signature
> > > * Deployed a pseudo cluster
> > > * verified basic HDFS operations and Pi job.
> > > * Did a sanity check for RM and NM UI.
> > >
> > > Thanks
> > > zhihai
> > >
> > > On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee  wrote:
> > >
> > > > Thanks Masatake!
> > > >
> > > > Today's the last day for this vote, and I'd like to ask you to try
> out
> > > the
> > > > RC and vote on this today. So far there has been no binding vote.
> > Thanks
> > > > again.
> > > >
> > > > Regards,
> > > > Sangjin
> > > >
> > > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki <
> > > > iwasak...@oss.nttdata.co.jp> wrote:
> > > >
> > > > > +1(non-binding)
> > > > >
> > > > > * verified signature and md5.
> > > > > * built with -Pnative on CentOS6 and OpenJDK7.
> > > > > * built documentation and skimmed the contents.
> > > > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and
> > mapreduce
> > > on
> > > > > 3-node cluster.
> > > > >
> > > > > Thanks,
> > > > > Masatake Iwasaki
> > > > >
> > > > > On 10/3/16 09:12, Sangjin Lee wrote:
> > > > >
> > > > >> Hi folks,
> > > > >>
> > > > >> I have pushed a new release candidate (R1) for the Apache Hadoop
> > 2.6.5
> > > > >> release (the next maintenance release in the 2.6.x release line).
> > RC1
> > > > >> contains fixes to CHANGES.txt, and is otherwise identical to RC0.
> > > > >>
> > > > >> Below are the details of this release candidate:
> > > > >>
> > > > >> The RC is available for validation at:
> > > > >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/.
> > > > >>
> > > > >> The RC tag in git is release-2.6.5-RC1 and its git commit is
> > > > >> e8c9fe0b4c252caf2ebf1464220599650f119997.
> > > > >>
> > > > >> The maven artifacts are staged via repository.apache.org at:
> > > > >> https://repository.apache.org/content/repositories/
> > > > orgapachehadoop-1050/.
> > > > >>
> > > > >> You can find my public key at
> > > > >> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS.
> > > > >>
> > > > >> Please try the release and vote. The vote will run for the usual 5
> > > > days. I
> > > > >> would greatly appreciate your timely vote. Thanks!
> > > > >>
> > > > >> Regards,
> > > > >> Sangjin
> > > > >>
> > > > >>
> > > > >
> > > >
> > >
> >
>

[jira] [Created] (HADOOP-13699) Configuration does not substitute multiple references to the same var

[Andrew Wang (JIRA)]

Andrew Wang created HADOOP-13699:


 Summary: Configuration does not substitute multiple references to 
the same var
 Key: HADOOP-13699
 URL: https://issues.apache.org/jira/browse/HADOOP-13699
 Project: Hadoop Common
  Issue Type: Bug
  Components: conf
Affects Versions: 3.0.0-alpha1
Reporter: Andrew Wang
Assignee: Andrew Wang
Priority: Critical


Config var loop detection was originally introduced by HADOOP-6871. Due to 
cycle detection changes in the trunk patch for HADOOP-11506, resolution for 
multiple references to the same variable no longer resolved, e.g.

{noformat}
somekey = "${otherkey} ${otherkey}"
{noformat}

This loop detection business is fragile, expensive, and not in branch-2, so 
let's reduce it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

surprising

[Lawrence Rosen]

Hey! 

You'll be surprised  about what I've found on the web, just take  a look 


Hugs, Lawrence Rosen

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

[Andrew Wang]

Thanks to Chris and Sangjin for working on this release.

+1 binding

* Verified signatures
* Built from source tarball
* Started HDFS and did some basic ops

Thanks,
Andrew

On Fri, Oct 7, 2016 at 2:50 PM, Wangda Tan  wrote:

> Thanks Sangjin for cutting this release!
>
> +1 (Binding)
>
> - Downloaded binary tar ball and setup a single node cluster.
> - Submit a few applications and which can successfully run.
>
> Thanks,
> Wangda
>
>
> On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xu  wrote:
>
> > Thanks Sangjin for creating release 2.6.5 RC1.
> >
> > +1 (non-binding)
> >
> > * Downloaded and built from source
> > * Verified md5 checksums and signature
> > * Deployed a pseudo cluster
> > * verified basic HDFS operations and Pi job.
> > * Did a sanity check for RM and NM UI.
> >
> > Thanks
> > zhihai
> >
> > On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee  wrote:
> >
> > > Thanks Masatake!
> > >
> > > Today's the last day for this vote, and I'd like to ask you to try out
> > the
> > > RC and vote on this today. So far there has been no binding vote.
> Thanks
> > > again.
> > >
> > > Regards,
> > > Sangjin
> > >
> > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki <
> > > iwasak...@oss.nttdata.co.jp> wrote:
> > >
> > > > +1(non-binding)
> > > >
> > > > * verified signature and md5.
> > > > * built with -Pnative on CentOS6 and OpenJDK7.
> > > > * built documentation and skimmed the contents.
> > > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and
> mapreduce
> > on
> > > > 3-node cluster.
> > > >
> > > > Thanks,
> > > > Masatake Iwasaki
> > > >
> > > > On 10/3/16 09:12, Sangjin Lee wrote:
> > > >
> > > >> Hi folks,
> > > >>
> > > >> I have pushed a new release candidate (R1) for the Apache Hadoop
> 2.6.5
> > > >> release (the next maintenance release in the 2.6.x release line).
> RC1
> > > >> contains fixes to CHANGES.txt, and is otherwise identical to RC0.
> > > >>
> > > >> Below are the details of this release candidate:
> > > >>
> > > >> The RC is available for validation at:
> > > >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/.
> > > >>
> > > >> The RC tag in git is release-2.6.5-RC1 and its git commit is
> > > >> e8c9fe0b4c252caf2ebf1464220599650f119997.
> > > >>
> > > >> The maven artifacts are staged via repository.apache.org at:
> > > >> https://repository.apache.org/content/repositories/
> > > orgapachehadoop-1050/.
> > > >>
> > > >> You can find my public key at
> > > >> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS.
> > > >>
> > > >> Please try the release and vote. The vote will run for the usual 5
> > > days. I
> > > >> would greatly appreciate your timely vote. Thanks!
> > > >>
> > > >> Regards,
> > > >> Sangjin
> > > >>
> > > >>
> > > >
> > >
> >
>

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

[Wangda Tan]

Thanks Sangjin for cutting this release!

+1 (Binding)

- Downloaded binary tar ball and setup a single node cluster.
- Submit a few applications and which can successfully run.

Thanks,
Wangda


On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xu  wrote:

> Thanks Sangjin for creating release 2.6.5 RC1.
>
> +1 (non-binding)
>
> * Downloaded and built from source
> * Verified md5 checksums and signature
> * Deployed a pseudo cluster
> * verified basic HDFS operations and Pi job.
> * Did a sanity check for RM and NM UI.
>
> Thanks
> zhihai
>
> On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee  wrote:
>
> > Thanks Masatake!
> >
> > Today's the last day for this vote, and I'd like to ask you to try out
> the
> > RC and vote on this today. So far there has been no binding vote. Thanks
> > again.
> >
> > Regards,
> > Sangjin
> >
> > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki <
> > iwasak...@oss.nttdata.co.jp> wrote:
> >
> > > +1(non-binding)
> > >
> > > * verified signature and md5.
> > > * built with -Pnative on CentOS6 and OpenJDK7.
> > > * built documentation and skimmed the contents.
> > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and mapreduce
> on
> > > 3-node cluster.
> > >
> > > Thanks,
> > > Masatake Iwasaki
> > >
> > > On 10/3/16 09:12, Sangjin Lee wrote:
> > >
> > >> Hi folks,
> > >>
> > >> I have pushed a new release candidate (R1) for the Apache Hadoop 2.6.5
> > >> release (the next maintenance release in the 2.6.x release line). RC1
> > >> contains fixes to CHANGES.txt, and is otherwise identical to RC0.
> > >>
> > >> Below are the details of this release candidate:
> > >>
> > >> The RC is available for validation at:
> > >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/.
> > >>
> > >> The RC tag in git is release-2.6.5-RC1 and its git commit is
> > >> e8c9fe0b4c252caf2ebf1464220599650f119997.
> > >>
> > >> The maven artifacts are staged via repository.apache.org at:
> > >> https://repository.apache.org/content/repositories/
> > orgapachehadoop-1050/.
> > >>
> > >> You can find my public key at
> > >> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS.
> > >>
> > >> Please try the release and vote. The vote will run for the usual 5
> > days. I
> > >> would greatly appreciate your timely vote. Thanks!
> > >>
> > >> Regards,
> > >> Sangjin
> > >>
> > >>
> > >
> >
>

[jira] [Created] (HADOOP-13698) Document caveat for KeyShell when underlying KeyProvider does not delete a key

[Xiao Chen (JIRA)]

Xiao Chen created HADOOP-13698:
--

 Summary: Document caveat for KeyShell when underlying KeyProvider 
does not delete a key
 Key: HADOOP-13698
 URL: https://issues.apache.org/jira/browse/HADOOP-13698
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation, kms
Affects Versions: 2.8.0
Reporter: Xiao Chen
Assignee: Xiao Chen
Priority: Minor


For cases like:
{noformat}
$ hadoop key create d
d has not been created. java.io.IOException: HTTP status [500], exception 
[DuplicateKeyException], message [Key with name "d" already exists in 
"KeyProvider@5e552a98. Key exists but has been disabled. Use undelete to 
enable.] 
java.io.IOException: HTTP status [500], exception 
[KeyProvider$DuplicateKeyException], message [Key with name "d" already exists 
in "KeyProvider@5e552a98. Key exists but has been disabled. Use undelete to 
enable.] 
at 
org.apache.hadoop.util.HttpExceptionUtils.validateResponse(HttpExceptionUtils.java:159)
at 
org.apache.hadoop.crypto.key.kms.KMSClientProvider.call(KMSClientProvider.java:615)
at 
org.apache.hadoop.crypto.key.kms.KMSClientProvider.call(KMSClientProvider.java:573)
at 
org.apache.hadoop.crypto.key.kms.KMSClientProvider.createKeyInternal(KMSClientProvider.java:739)
at 
org.apache.hadoop.crypto.key.kms.KMSClientProvider.createKey(KMSClientProvider.java:747)
at 
org.apache.hadoop.crypto.key.KeyShell$CreateCommand.execute(KeyShell.java:506)
at org.apache.hadoop.crypto.key.KeyShell.run(KeyShell.java:91)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.crypto.key.KeyShell.main(KeyShell.java:538)
$ hadoop key delete d
You are about to DELETE all versions of  key d from KeyProvider 
KMSClientProvider[http://localhost:16000/kms/v1/]. Continue?  (Y or N) Y
Deleting key: d from KeyProvider: 
KMSClientProvider[http://localhost:16000/kms/v1/]
d has not been deleted. java.io.IOException: Key named d was already deleted 
but is disabled. Use purge to destroy all traces or undelete to reactivate.
java.io.IOException: Key named d was already deleted but is disabled. Use purge 
to destroy all traces or undelete to reactivate.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at 
org.apache.hadoop.util.HttpExceptionUtils.validateResponse(HttpExceptionUtils.java:157)
at 
org.apache.hadoop.crypto.key.kms.KMSClientProvider.call(KMSClientProvider.java:615)
at 
org.apache.hadoop.crypto.key.kms.KMSClientProvider.call(KMSClientProvider.java:573)
at 
org.apache.hadoop.crypto.key.kms.KMSClientProvider.deleteKey(KMSClientProvider.java:877)
at 
org.apache.hadoop.crypto.key.KeyShell$DeleteCommand.execute(KeyShell.java:436)
at org.apache.hadoop.crypto.key.KeyShell.run(KeyShell.java:91)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.crypto.key.KeyShell.main(KeyShell.java:538)
$ hadoop key create d
d has not been created. java.io.IOException: HTTP status [500], exception 
[KeyProvider$DuplicateKeyException], message [Key with name "d" already exists 
in "KeyProvider@5e552a98. Key exists but has been disabled. Use undelete to 
enable.] 
java.io.IOException: HTTP status [500], exception 
[KeyProvider$DuplicateKeyException], message [Key with name "d" already exists 
in "KeyProvider@5e552a98. Key exists but has been disabled. Use undelete to 
enable.] 
at 
org.apache.hadoop.util.HttpExceptionUtils.validateResponse(HttpExceptionUtils.java:159)
at 
org.apache.hadoop.crypto.key.kms.KMSClientProvider.call(KMSClientProvider.java:615)
at 
org.apache.hadoop.crypto.key.kms.KMSClientProvider.call(KMSClientProvider.java:573)
at 
org.apache.hadoop.crypto.key.kms.KMSClientProvider.createKeyInternal(KMSClientProvider.java:739)
at 
org.apache.hadoop.crypto.key.kms.KMSClientProvider.createKey(KMSClientProvider.java:747)
at 
org.apache.hadoop.crypto.key.KeyShell$CreateCommand.execute(KeyShell.java:506)
at org.apache.hadoop.crypto.key.KeyShell.run(KeyShell.java:91)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.crypto.key.KeyShell.main(KeyShell.java:538)
{noformat}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

[Apache Jenkins Server]

For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/117/

[Oct 6, 2016 1:58:25 PM] (vinayakumarb) HDFS-10957. Retire BKJM from trunk 
(Vinayakumar B)
[Oct 6, 2016 3:12:36 PM] (rohithsharmaks) YARN-5101. YARN_APPLICATION_UPDATED 
event is parsed in
[Oct 6, 2016 3:31:00 PM] (stevel) HADOOP-13678 Update jackson from 1.9.13 to 
2.x in hadoop-tools.
[Oct 6, 2016 5:57:01 PM] (cnauroth) HADOOP-13323. Downgrade stack trace on FS 
load from Warn to debug.
[Oct 6, 2016 6:19:38 PM] (wang) HADOOP-13688. Stop bundling HTML source code in 
javadoc JARs.
[Oct 6, 2016 8:11:14 PM] (kihwal) HDFS-10939. Reduce performance penalty of 
encryption zones. Contributed
[Oct 6, 2016 8:19:16 PM] (cnauroth) HADOOP-13150. Avoid use of toString() in 
output of HDFS ACL shell
[Oct 6, 2016 9:33:46 PM] (kihwal) HDFS-10955. Pass IIP for FSDirAttr methods. 
Contributed by Daryn Sharp.
[Oct 6, 2016 10:08:24 PM] (wang) HADOOP-13689. Do not attach javadoc and 
sources jars during non-dist
[Oct 7, 2016 11:51:40 AM] (stevel) HADOOP-12977 s3a to handle delete("/", true) 
robustly. Contributed by




-1 overall


The following subsystems voted -1:
compile unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer 
   hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate 
   hadoop.hdfs.TestFileCorruption 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService 
   hadoop.yarn.server.nodemanager.TestNodeManagerShutdown 
   hadoop.yarn.server.timeline.TestRollingLevelDB 
   hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices 
   hadoop.yarn.server.timeline.TestTimelineDataManager 
   hadoop.yarn.server.timeline.TestLeveldbTimelineStore 
   hadoop.yarn.server.timeline.recovery.TestLeveldbTimelineStateStore 
   hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore 
   
hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer 
   hadoop.yarn.server.timelineservice.storage.common.TestRowKeys 
   hadoop.yarn.server.timelineservice.storage.common.TestKeyConverters 
   hadoop.yarn.server.timelineservice.storage.common.TestSeparator 
   hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer 
   hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore 
   hadoop.yarn.server.resourcemanager.TestRMRestart 
   hadoop.yarn.server.resourcemanager.TestResourceTrackerService 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.yarn.client.api.impl.TestNMClient 
   hadoop.yarn.server.timeline.TestLevelDBCacheTimelineStore 
   hadoop.yarn.server.timeline.TestOverrideTimelineStoreYarnClient 
   hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore 
   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorage 
   
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction
 
   hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun 
   
hadoop.yarn.server.timelineservice.storage.TestPhoenixOfflineAggregationWriterImpl
 
   
hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage
 
   
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity 
   hadoop.yarn.applications.distributedshell.TestDistributedShell 
   hadoop.mapred.TestShuffleHandler 
   hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService 

Timed out junit tests :

   org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache 
   org.apache.hadoop.mapred.TestMRIntermediateDataEncryption 
  

   compile:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/117/artifact/out/patch-compile-root.txt
  [316K]

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/117/artifact/out/patch-compile-root.txt
  [316K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/117/artifact/out/patch-compile-root.txt
  [316K]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/117/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [200K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/117/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
  [52K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/117/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
  [52K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-j

[jira] [Created] (HADOOP-13697) LogLevel#main throws exception if no arguments provided

[Mingliang Liu (JIRA)]

Mingliang Liu created HADOOP-13697:
--

 Summary: LogLevel#main throws exception if no arguments provided
 Key: HADOOP-13697
 URL: https://issues.apache.org/jira/browse/HADOOP-13697
 Project: Hadoop Common
  Issue Type: Bug
Affects Versions: 2.9.0
Reporter: Mingliang Liu
Assignee: Mingliang Liu


{code}
root@b9ab37566005:/# hadoop daemonlog

Usage: General options are:
[-getlevel   [-protocol (http|https)]
[-setlevel[-protocol (http|https)]

Exception in thread "main" org.apache.hadoop.HadoopIllegalArgumentException: No 
arguments specified
at org.apache.hadoop.log.LogLevel$CLI.parseArguments(LogLevel.java:138)
at org.apache.hadoop.log.LogLevel$CLI.run(LogLevel.java:106)
at org.apache.hadoop.log.LogLevel.main(LogLevel.java:70)
{code}

I think we can catch the exception in the main method, and dump a log error 
message instead of throw the stack which may frustrate users.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

[Zhihai Xu]

Thanks Sangjin for creating release 2.6.5 RC1.

+1 (non-binding)

* Downloaded and built from source
* Verified md5 checksums and signature
* Deployed a pseudo cluster
* verified basic HDFS operations and Pi job.
* Did a sanity check for RM and NM UI.

Thanks
zhihai

On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee  wrote:

> Thanks Masatake!
>
> Today's the last day for this vote, and I'd like to ask you to try out the
> RC and vote on this today. So far there has been no binding vote. Thanks
> again.
>
> Regards,
> Sangjin
>
> On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki <
> iwasak...@oss.nttdata.co.jp> wrote:
>
> > +1(non-binding)
> >
> > * verified signature and md5.
> > * built with -Pnative on CentOS6 and OpenJDK7.
> > * built documentation and skimmed the contents.
> > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and mapreduce on
> > 3-node cluster.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 10/3/16 09:12, Sangjin Lee wrote:
> >
> >> Hi folks,
> >>
> >> I have pushed a new release candidate (R1) for the Apache Hadoop 2.6.5
> >> release (the next maintenance release in the 2.6.x release line). RC1
> >> contains fixes to CHANGES.txt, and is otherwise identical to RC0.
> >>
> >> Below are the details of this release candidate:
> >>
> >> The RC is available for validation at:
> >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/.
> >>
> >> The RC tag in git is release-2.6.5-RC1 and its git commit is
> >> e8c9fe0b4c252caf2ebf1464220599650f119997.
> >>
> >> The maven artifacts are staged via repository.apache.org at:
> >> https://repository.apache.org/content/repositories/
> orgapachehadoop-1050/.
> >>
> >> You can find my public key at
> >> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS.
> >>
> >> Please try the release and vote. The vote will run for the usual 5
> days. I
> >> would greatly appreciate your timely vote. Thanks!
> >>
> >> Regards,
> >> Sangjin
> >>
> >>
> >
>

[jira] [Created] (HADOOP-13696) change hadoop-common dependency scope of jsch to provided.

[Steve Loughran (JIRA)]

Steve Loughran created HADOOP-13696:
---

 Summary: change hadoop-common dependency scope of jsch to provided.
 Key: HADOOP-13696
 URL: https://issues.apache.org/jira/browse/HADOOP-13696
 Project: Hadoop Common
  Issue Type: Improvement
  Components: build
Affects Versions: 2.7.3
Reporter: Steve Loughran
Priority: Minor


The dependency on jsch in Hadoop common is "compile", so it gets everywhere 
downstream. Marking it as "provided" would mean that it would only be needed by 
those programs which wanted the SFTP filesystem, and, if they wanted to use a 
different jsch version, there'd be no maven problems




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

[Sangjin Lee]

Thanks Masatake!

Today's the last day for this vote, and I'd like to ask you to try out the
RC and vote on this today. So far there has been no binding vote. Thanks
again.

Regards,
Sangjin

On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki <
iwasak...@oss.nttdata.co.jp> wrote:

> +1(non-binding)
>
> * verified signature and md5.
> * built with -Pnative on CentOS6 and OpenJDK7.
> * built documentation and skimmed the contents.
> * built rpms by bigtop and ran smoke-tests of hdfs, yarn and mapreduce on
> 3-node cluster.
>
> Thanks,
> Masatake Iwasaki
>
> On 10/3/16 09:12, Sangjin Lee wrote:
>
>> Hi folks,
>>
>> I have pushed a new release candidate (R1) for the Apache Hadoop 2.6.5
>> release (the next maintenance release in the 2.6.x release line). RC1
>> contains fixes to CHANGES.txt, and is otherwise identical to RC0.
>>
>> Below are the details of this release candidate:
>>
>> The RC is available for validation at:
>> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/.
>>
>> The RC tag in git is release-2.6.5-RC1 and its git commit is
>> e8c9fe0b4c252caf2ebf1464220599650f119997.
>>
>> The maven artifacts are staged via repository.apache.org at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1050/.
>>
>> You can find my public key at
>> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS.
>>
>> Please try the release and vote. The vote will run for the usual 5 days. I
>> would greatly appreciate your timely vote. Thanks!
>>
>> Regards,
>> Sangjin
>>
>>
>

[jira] [Created] (HADOOP-13695) S3A to use a thread pool for async path operations

[Steve Loughran (JIRA)]

Steve Loughran created HADOOP-13695:
---

 Summary: S3A to use a thread pool for async path operations
 Key: HADOOP-13695
 URL: https://issues.apache.org/jira/browse/HADOOP-13695
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: fs/s3
Affects Versions: 2.8.0
Reporter: Steve Loughran


S3A path operations are often slow due to directory scanning, mock directory 
create/delete, etc. Many of these can be done asynchronously

* because deletion is eventually consistent, deleting parent dirs after an 
operation has returned doesn't alter the behaviour, except in the special case 
of : operation failure.
* scanning for paths/parents of a file in the create operation only needs to 
complete before the close() operation instantiates the object, no need to block 
create().
* parallelized COPY calls would permit asynchronous rename.

We could either use the thread pool used for block writes, or somehow isolate 
low cost path ops (GET, DELETE) from the more expensive calls (COPY, PUT) so 
that a thread doing basic IO doesn't block for the duration of the long op. 
Maybe also use {{Semaphore.tryAcquire()}} and only start async work if there 
actually is an idle thread, doing it synchronously if not. Maybe it depends on 
the operation. path query/cleanup before/after a write is something which could 
be scheduled as just more futures to schedule in the block write.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

[jira] [Resolved] (HADOOP-13231) Isolate test path used by a few S3A tests for more reliable parallel execution.

[Steve Loughran (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HADOOP-13231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran resolved HADOOP-13231.
-
Resolution: Duplicate
  Assignee: Steve Loughran  (was: Chris Nauroth)

HADOOP-13614 fixes this

> Isolate test path used by a few S3A tests for more reliable parallel 
> execution.
> ---
>
> Key: HADOOP-13231
> URL: https://issues.apache.org/jira/browse/HADOOP-13231
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: fs/s3, test
>Reporter: Chris Nauroth
>Assignee: Steve Loughran
>Priority: Minor
>
> I have noticed a few more spots in S3A tests that do not make use of the 
> isolated test directory path when running in parallel mode.  While I don't 
> have any evidence that this is really causing problems for parallel test runs 
> right now, it would still be good practice to clean these up.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

[jira] [Resolved] (HADOOP-13516) Listing an empty s3a NON root directory throws FileNotFound.

[Steve Loughran (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HADOOP-13516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran resolved HADOOP-13516.
-
  Resolution: Cannot Reproduce
Target Version/s:   (was: 2.8.0)

closing as cannot reproduce. If this surfaces, test against the latest Hadoop 
release, then, if it occurs there, please re-open

> Listing an empty s3a NON root directory throws FileNotFound.
> 
>
> Key: HADOOP-13516
> URL: https://issues.apache.org/jira/browse/HADOOP-13516
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: fs/s3
>Affects Versions: 2.7.0
>Reporter: Shaik Idris Ali
>Assignee: Steve Loughran
>Priority: Minor
>
> With an empty s3 bucket and run
> {code}
> $ hadoop fs -D... -ls s3a://hdfs-s3a-test/emptyDirectory
> 15/05/04 15:21:34 WARN util.NativeCodeLoader: Unable to load native-hadoop 
> library for your platform... using builtin-java classes where applicable
> ls: `s3a://hdfs-s3a-test/emtpyDirectory': No such file or directory
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

[Apache Jenkins Server]

For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/

[Oct 6, 2016 6:57:15 AM] (aajisaka) MAPREDUCE-6789. Fix TestAMWebApp failure. 
Contributed by Daniel
[Oct 6, 2016 12:17:31 PM] (brahma) HDFS-10963. Reduce log level when network 
topology cannot find enough
[Oct 6, 2016 12:36:08 PM] (brahma) HADOOP-13690. Fix typos in core-default.xml. 
Contributed by Yiqun Lin
[Oct 6, 2016 1:58:25 PM] (vinayakumarb) HDFS-10957. Retire BKJM from trunk 
(Vinayakumar B)
[Oct 6, 2016 3:12:36 PM] (rohithsharmaks) YARN-5101. YARN_APPLICATION_UPDATED 
event is parsed in
[Oct 6, 2016 3:31:00 PM] (stevel) HADOOP-13678 Update jackson from 1.9.13 to 
2.x in hadoop-tools.
[Oct 6, 2016 5:57:01 PM] (cnauroth) HADOOP-13323. Downgrade stack trace on FS 
load from Warn to debug.
[Oct 6, 2016 6:19:38 PM] (wang) HADOOP-13688. Stop bundling HTML source code in 
javadoc JARs.
[Oct 6, 2016 8:11:14 PM] (kihwal) HDFS-10939. Reduce performance penalty of 
encryption zones. Contributed
[Oct 6, 2016 8:19:16 PM] (cnauroth) HADOOP-13150. Avoid use of toString() in 
output of HDFS ACL shell
[Oct 6, 2016 9:33:46 PM] (kihwal) HDFS-10955. Pass IIP for FSDirAttr methods. 
Contributed by Daryn Sharp.
[Oct 6, 2016 10:08:24 PM] (wang) HADOOP-13689. Do not attach javadoc and 
sources jars during non-dist




-1 overall


The following subsystems voted -1:
asflicense unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices 
   
hadoop.yarn.server.resourcemanager.scheduler.fair.TestContinuousScheduling 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/diff-compile-javac-root.txt
  [168K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/diff-checkstyle-root.txt
  [16M]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/diff-patch-pylint.txt
  [16K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/diff-patch-shelldocs.txt
  [16K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/whitespace-eol.txt
  [11M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/whitespace-tabs.txt
  [1.3M]

   javadoc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/diff-javadoc-javadoc-root.txt
  [2.2M]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
  [12K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
  [56K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
  [268K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt
  [124K]

   asflicense:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/patch-asflicense-problems.txt
  [4.0K]

Powered by Apache Yetus 0.4.0-SNAPSHOT   http://yetus.apache.org



-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

[Masatake Iwasaki]

+1(non-binding)

* verified signature and md5.
* built with -Pnative on CentOS6 and OpenJDK7.
* built documentation and skimmed the contents.
* built rpms by bigtop and ran smoke-tests of hdfs, yarn and mapreduce 
on 3-node cluster.


Thanks,
Masatake Iwasaki

On 10/3/16 09:12, Sangjin Lee wrote:

Hi folks,

I have pushed a new release candidate (R1) for the Apache Hadoop 2.6.5
release (the next maintenance release in the 2.6.x release line). RC1
contains fixes to CHANGES.txt, and is otherwise identical to RC0.

Below are the details of this release candidate:

The RC is available for validation at:
http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/.

The RC tag in git is release-2.6.5-RC1 and its git commit is
e8c9fe0b4c252caf2ebf1464220599650f119997.

The maven artifacts are staged via repository.apache.org at:
https://repository.apache.org/content/repositories/orgapachehadoop-1050/.

You can find my public key at
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS.

Please try the release and vote. The vote will run for the usual 5 days. I
would greatly appreciate your timely vote. Thanks!

Regards,
Sangjin




-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org