Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
+1 binding, based on: - Download and build from source, check signatures - Deploy a single node cluster and run some simple jobs, like sleep, PI, etc. Thanks Sangjin and Chris for working on 2.6.5 release! Thanks, Junping From: larry mccaySent: Saturday, October 08, 2016 3:43 AM To: Karthik Kambatla Cc: Yongjun Zhang; Sangjin Lee; Andrew Wang; Wangda Tan; Zhihai Xu; Masatake Iwasaki; common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1) +1 (non-binding) * Downloaded and verified signatures * Built from source * Deployed a standalone cluster * Tested HDFS commands and job submit * Tested webhdfs through Apache Knox On Fri, Oct 7, 2016 at 10:35 PM, Karthik Kambatla wrote: > Thanks for putting the RC together, Sangjin. > > +1 (binding) > > Built from source, deployed pseudo distributed cluster and ran some example > MR jobs. > > On Fri, Oct 7, 2016 at 6:01 PM, Yongjun Zhang wrote: > > > Hi Sangjin, > > > > Thanks a lot for your work here. > > > > My +1 (binding). > > > > - Downloaded both binary and src tarballs > > - Verified md5 checksum and signature for both > > - Build from source tarball > > - Deployed 2 pseudo clusters, one with the released tarball and the other > > with what I built from source, and did the following on both: > > - Run basic HDFS operations, and distcp jobs > > - Run pi job > > - Examined HDFS webui, YARN webui. > > > > Best, > > > > --Yongjun > > > > > > > * verified basic HDFS operations and Pi job. > > > > > * Did a sanity check for RM and NM UI. > > > > > > On Fri, Oct 7, 2016 at 5:08 PM, Sangjin Lee wrote: > > > > > I'm casting my vote: +1 (binding) > > > > > > Regards, > > > Sangjin > > > > > > On Fri, Oct 7, 2016 at 3:12 PM, Andrew Wang > > > wrote: > > > > > > > Thanks to Chris and Sangjin for working on this release. > > > > > > > > +1 binding > > > > > > > > * Verified signatures > > > > * Built from source tarball > > > > * Started HDFS and did some basic ops > > > > > > > > Thanks, > > > > Andrew > > > > > > > > On Fri, Oct 7, 2016 at 2:50 PM, Wangda Tan > > wrote: > > > > > > > > > Thanks Sangjin for cutting this release! > > > > > > > > > > +1 (Binding) > > > > > > > > > > - Downloaded binary tar ball and setup a single node cluster. > > > > > - Submit a few applications and which can successfully run. > > > > > > > > > > Thanks, > > > > > Wangda > > > > > > > > > > > > > > > On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xu > > > > > wrote: > > > > > > > > > > > Thanks Sangjin for creating release 2.6.5 RC1. > > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > * Downloaded and built from source > > > > > > * Verified md5 checksums and signature > > > > > > * Deployed a pseudo cluster > > > > > > * verified basic HDFS operations and Pi job. > > > > > > * Did a sanity check for RM and NM UI. > > > > > > > > > > > > Thanks > > > > > > zhihai > > > > > > > > > > > > On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee > > > wrote: > > > > > > > > > > > > > Thanks Masatake! > > > > > > > > > > > > > > Today's the last day for this vote, and I'd like to ask you to > > try > > > > out > > > > > > the > > > > > > > RC and vote on this today. So far there has been no binding > vote. > > > > > Thanks > > > > > > > again. > > > > > > > > > > > > > > Regards, > > > > > > > Sangjin > > > > > > > > > > > > > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki < > > > > > > > iwasak...@oss.nttdata.co.jp> wrote: > > > > > > > > > > > > > > > +1(non-binding) > > > > > > > > > > > > > > > > * verified signature and md5. > > > > > > > > * built with -Pnative on CentOS6 and OpenJDK7. > > > > > > > > * built documentation and skimmed the contents. > > > > > > > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and > > > > > mapreduce > > > > > > on > > > > > > > > 3-node cluster. > > > > > > > > > > > > > > > > Thanks, > > > > > > > > Masatake Iwasaki > > > > > > > > > > > > > > > > On 10/3/16 09:12, Sangjin Lee wrote: > > > > > > > > > > > > > > > >> Hi folks, > > > > > > > >> > > > > > > > >> I have pushed a new release candidate (R1) for the Apache > > Hadoop > > > > > 2.6.5 > > > > > > > >> release (the next maintenance release in the 2.6.x release > > > line). > > > > > RC1 > > > > > > > >> contains fixes to CHANGES.txt, and is otherwise identical to > > > RC0. > > > > > > > >> > > > > > > > >> Below are the details of this release candidate: > > > > > > > >> > > > > > > > >> The RC is available for validation at: > > > > > > > >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/. > > > > > > > >> > > > > > > > >> The RC tag in git is release-2.6.5-RC1 and its git commit is > > > > > > > >>
Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
+1 (non-binding) * Downloaded and verified signatures * Built from source * Deployed a standalone cluster * Tested HDFS commands and job submit * Tested webhdfs through Apache Knox On Fri, Oct 7, 2016 at 10:35 PM, Karthik Kambatlawrote: > Thanks for putting the RC together, Sangjin. > > +1 (binding) > > Built from source, deployed pseudo distributed cluster and ran some example > MR jobs. > > On Fri, Oct 7, 2016 at 6:01 PM, Yongjun Zhang wrote: > > > Hi Sangjin, > > > > Thanks a lot for your work here. > > > > My +1 (binding). > > > > - Downloaded both binary and src tarballs > > - Verified md5 checksum and signature for both > > - Build from source tarball > > - Deployed 2 pseudo clusters, one with the released tarball and the other > > with what I built from source, and did the following on both: > > - Run basic HDFS operations, and distcp jobs > > - Run pi job > > - Examined HDFS webui, YARN webui. > > > > Best, > > > > --Yongjun > > > > > > > * verified basic HDFS operations and Pi job. > > > > > * Did a sanity check for RM and NM UI. > > > > > > On Fri, Oct 7, 2016 at 5:08 PM, Sangjin Lee wrote: > > > > > I'm casting my vote: +1 (binding) > > > > > > Regards, > > > Sangjin > > > > > > On Fri, Oct 7, 2016 at 3:12 PM, Andrew Wang > > > wrote: > > > > > > > Thanks to Chris and Sangjin for working on this release. > > > > > > > > +1 binding > > > > > > > > * Verified signatures > > > > * Built from source tarball > > > > * Started HDFS and did some basic ops > > > > > > > > Thanks, > > > > Andrew > > > > > > > > On Fri, Oct 7, 2016 at 2:50 PM, Wangda Tan > > wrote: > > > > > > > > > Thanks Sangjin for cutting this release! > > > > > > > > > > +1 (Binding) > > > > > > > > > > - Downloaded binary tar ball and setup a single node cluster. > > > > > - Submit a few applications and which can successfully run. > > > > > > > > > > Thanks, > > > > > Wangda > > > > > > > > > > > > > > > On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xu > > > > > wrote: > > > > > > > > > > > Thanks Sangjin for creating release 2.6.5 RC1. > > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > * Downloaded and built from source > > > > > > * Verified md5 checksums and signature > > > > > > * Deployed a pseudo cluster > > > > > > * verified basic HDFS operations and Pi job. > > > > > > * Did a sanity check for RM and NM UI. > > > > > > > > > > > > Thanks > > > > > > zhihai > > > > > > > > > > > > On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee > > > wrote: > > > > > > > > > > > > > Thanks Masatake! > > > > > > > > > > > > > > Today's the last day for this vote, and I'd like to ask you to > > try > > > > out > > > > > > the > > > > > > > RC and vote on this today. So far there has been no binding > vote. > > > > > Thanks > > > > > > > again. > > > > > > > > > > > > > > Regards, > > > > > > > Sangjin > > > > > > > > > > > > > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki < > > > > > > > iwasak...@oss.nttdata.co.jp> wrote: > > > > > > > > > > > > > > > +1(non-binding) > > > > > > > > > > > > > > > > * verified signature and md5. > > > > > > > > * built with -Pnative on CentOS6 and OpenJDK7. > > > > > > > > * built documentation and skimmed the contents. > > > > > > > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and > > > > > mapreduce > > > > > > on > > > > > > > > 3-node cluster. > > > > > > > > > > > > > > > > Thanks, > > > > > > > > Masatake Iwasaki > > > > > > > > > > > > > > > > On 10/3/16 09:12, Sangjin Lee wrote: > > > > > > > > > > > > > > > >> Hi folks, > > > > > > > >> > > > > > > > >> I have pushed a new release candidate (R1) for the Apache > > Hadoop > > > > > 2.6.5 > > > > > > > >> release (the next maintenance release in the 2.6.x release > > > line). > > > > > RC1 > > > > > > > >> contains fixes to CHANGES.txt, and is otherwise identical to > > > RC0. > > > > > > > >> > > > > > > > >> Below are the details of this release candidate: > > > > > > > >> > > > > > > > >> The RC is available for validation at: > > > > > > > >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/. > > > > > > > >> > > > > > > > >> The RC tag in git is release-2.6.5-RC1 and its git commit is > > > > > > > >> e8c9fe0b4c252caf2ebf1464220599650f119997. > > > > > > > >> > > > > > > > >> The maven artifacts are staged via repository.apache.org > at: > > > > > > > >> https://repository.apache.org/content/repositories/ > > > > > > > orgapachehadoop-1050/. > > > > > > > >> > > > > > > > >> You can find my public key at > > > > > > > >> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS. > > > > > > > >> > > > > > > > >> Please try the release and vote. The vote will run for the > > > usual 5 > > > > > > > days. I > > > > > > > >> would greatly appreciate your timely vote. Thanks! > > > > > > > >> > > > > > > > >> Regards, > > > > > > > >> Sangjin > > > > > > >
Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
Thanks for putting the RC together, Sangjin. +1 (binding) Built from source, deployed pseudo distributed cluster and ran some example MR jobs. On Fri, Oct 7, 2016 at 6:01 PM, Yongjun Zhangwrote: > Hi Sangjin, > > Thanks a lot for your work here. > > My +1 (binding). > > - Downloaded both binary and src tarballs > - Verified md5 checksum and signature for both > - Build from source tarball > - Deployed 2 pseudo clusters, one with the released tarball and the other > with what I built from source, and did the following on both: > - Run basic HDFS operations, and distcp jobs > - Run pi job > - Examined HDFS webui, YARN webui. > > Best, > > --Yongjun > > > > > * verified basic HDFS operations and Pi job. > > > > * Did a sanity check for RM and NM UI. > > > On Fri, Oct 7, 2016 at 5:08 PM, Sangjin Lee wrote: > > > I'm casting my vote: +1 (binding) > > > > Regards, > > Sangjin > > > > On Fri, Oct 7, 2016 at 3:12 PM, Andrew Wang > > wrote: > > > > > Thanks to Chris and Sangjin for working on this release. > > > > > > +1 binding > > > > > > * Verified signatures > > > * Built from source tarball > > > * Started HDFS and did some basic ops > > > > > > Thanks, > > > Andrew > > > > > > On Fri, Oct 7, 2016 at 2:50 PM, Wangda Tan > wrote: > > > > > > > Thanks Sangjin for cutting this release! > > > > > > > > +1 (Binding) > > > > > > > > - Downloaded binary tar ball and setup a single node cluster. > > > > - Submit a few applications and which can successfully run. > > > > > > > > Thanks, > > > > Wangda > > > > > > > > > > > > On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xu > > > wrote: > > > > > > > > > Thanks Sangjin for creating release 2.6.5 RC1. > > > > > > > > > > +1 (non-binding) > > > > > > > > > > * Downloaded and built from source > > > > > * Verified md5 checksums and signature > > > > > * Deployed a pseudo cluster > > > > > * verified basic HDFS operations and Pi job. > > > > > * Did a sanity check for RM and NM UI. > > > > > > > > > > Thanks > > > > > zhihai > > > > > > > > > > On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee > > wrote: > > > > > > > > > > > Thanks Masatake! > > > > > > > > > > > > Today's the last day for this vote, and I'd like to ask you to > try > > > out > > > > > the > > > > > > RC and vote on this today. So far there has been no binding vote. > > > > Thanks > > > > > > again. > > > > > > > > > > > > Regards, > > > > > > Sangjin > > > > > > > > > > > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki < > > > > > > iwasak...@oss.nttdata.co.jp> wrote: > > > > > > > > > > > > > +1(non-binding) > > > > > > > > > > > > > > * verified signature and md5. > > > > > > > * built with -Pnative on CentOS6 and OpenJDK7. > > > > > > > * built documentation and skimmed the contents. > > > > > > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and > > > > mapreduce > > > > > on > > > > > > > 3-node cluster. > > > > > > > > > > > > > > Thanks, > > > > > > > Masatake Iwasaki > > > > > > > > > > > > > > On 10/3/16 09:12, Sangjin Lee wrote: > > > > > > > > > > > > > >> Hi folks, > > > > > > >> > > > > > > >> I have pushed a new release candidate (R1) for the Apache > Hadoop > > > > 2.6.5 > > > > > > >> release (the next maintenance release in the 2.6.x release > > line). > > > > RC1 > > > > > > >> contains fixes to CHANGES.txt, and is otherwise identical to > > RC0. > > > > > > >> > > > > > > >> Below are the details of this release candidate: > > > > > > >> > > > > > > >> The RC is available for validation at: > > > > > > >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/. > > > > > > >> > > > > > > >> The RC tag in git is release-2.6.5-RC1 and its git commit is > > > > > > >> e8c9fe0b4c252caf2ebf1464220599650f119997. > > > > > > >> > > > > > > >> The maven artifacts are staged via repository.apache.org at: > > > > > > >> https://repository.apache.org/content/repositories/ > > > > > > orgapachehadoop-1050/. > > > > > > >> > > > > > > >> You can find my public key at > > > > > > >> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS. > > > > > > >> > > > > > > >> Please try the release and vote. The vote will run for the > > usual 5 > > > > > > days. I > > > > > > >> would greatly appreciate your timely vote. Thanks! > > > > > > >> > > > > > > >> Regards, > > > > > > >> Sangjin > > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
Hi Sangjin, Thanks a lot for your work here. My +1 (binding). - Downloaded both binary and src tarballs - Verified md5 checksum and signature for both - Build from source tarball - Deployed 2 pseudo clusters, one with the released tarball and the other with what I built from source, and did the following on both: - Run basic HDFS operations, and distcp jobs - Run pi job - Examined HDFS webui, YARN webui. Best, --Yongjun > > > * verified basic HDFS operations and Pi job. > > > * Did a sanity check for RM and NM UI. On Fri, Oct 7, 2016 at 5:08 PM, Sangjin Leewrote: > I'm casting my vote: +1 (binding) > > Regards, > Sangjin > > On Fri, Oct 7, 2016 at 3:12 PM, Andrew Wang > wrote: > > > Thanks to Chris and Sangjin for working on this release. > > > > +1 binding > > > > * Verified signatures > > * Built from source tarball > > * Started HDFS and did some basic ops > > > > Thanks, > > Andrew > > > > On Fri, Oct 7, 2016 at 2:50 PM, Wangda Tan wrote: > > > > > Thanks Sangjin for cutting this release! > > > > > > +1 (Binding) > > > > > > - Downloaded binary tar ball and setup a single node cluster. > > > - Submit a few applications and which can successfully run. > > > > > > Thanks, > > > Wangda > > > > > > > > > On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xu > > wrote: > > > > > > > Thanks Sangjin for creating release 2.6.5 RC1. > > > > > > > > +1 (non-binding) > > > > > > > > * Downloaded and built from source > > > > * Verified md5 checksums and signature > > > > * Deployed a pseudo cluster > > > > * verified basic HDFS operations and Pi job. > > > > * Did a sanity check for RM and NM UI. > > > > > > > > Thanks > > > > zhihai > > > > > > > > On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee > wrote: > > > > > > > > > Thanks Masatake! > > > > > > > > > > Today's the last day for this vote, and I'd like to ask you to try > > out > > > > the > > > > > RC and vote on this today. So far there has been no binding vote. > > > Thanks > > > > > again. > > > > > > > > > > Regards, > > > > > Sangjin > > > > > > > > > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki < > > > > > iwasak...@oss.nttdata.co.jp> wrote: > > > > > > > > > > > +1(non-binding) > > > > > > > > > > > > * verified signature and md5. > > > > > > * built with -Pnative on CentOS6 and OpenJDK7. > > > > > > * built documentation and skimmed the contents. > > > > > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and > > > mapreduce > > > > on > > > > > > 3-node cluster. > > > > > > > > > > > > Thanks, > > > > > > Masatake Iwasaki > > > > > > > > > > > > On 10/3/16 09:12, Sangjin Lee wrote: > > > > > > > > > > > >> Hi folks, > > > > > >> > > > > > >> I have pushed a new release candidate (R1) for the Apache Hadoop > > > 2.6.5 > > > > > >> release (the next maintenance release in the 2.6.x release > line). > > > RC1 > > > > > >> contains fixes to CHANGES.txt, and is otherwise identical to > RC0. > > > > > >> > > > > > >> Below are the details of this release candidate: > > > > > >> > > > > > >> The RC is available for validation at: > > > > > >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/. > > > > > >> > > > > > >> The RC tag in git is release-2.6.5-RC1 and its git commit is > > > > > >> e8c9fe0b4c252caf2ebf1464220599650f119997. > > > > > >> > > > > > >> The maven artifacts are staged via repository.apache.org at: > > > > > >> https://repository.apache.org/content/repositories/ > > > > > orgapachehadoop-1050/. > > > > > >> > > > > > >> You can find my public key at > > > > > >> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS. > > > > > >> > > > > > >> Please try the release and vote. The vote will run for the > usual 5 > > > > > days. I > > > > > >> would greatly appreciate your timely vote. Thanks! > > > > > >> > > > > > >> Regards, > > > > > >> Sangjin > > > > > >> > > > > > >> > > > > > > > > > > > > > > > > > > > > >
Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
I'm casting my vote: +1 (binding) Regards, Sangjin On Fri, Oct 7, 2016 at 3:12 PM, Andrew Wangwrote: > Thanks to Chris and Sangjin for working on this release. > > +1 binding > > * Verified signatures > * Built from source tarball > * Started HDFS and did some basic ops > > Thanks, > Andrew > > On Fri, Oct 7, 2016 at 2:50 PM, Wangda Tan wrote: > > > Thanks Sangjin for cutting this release! > > > > +1 (Binding) > > > > - Downloaded binary tar ball and setup a single node cluster. > > - Submit a few applications and which can successfully run. > > > > Thanks, > > Wangda > > > > > > On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xu > wrote: > > > > > Thanks Sangjin for creating release 2.6.5 RC1. > > > > > > +1 (non-binding) > > > > > > * Downloaded and built from source > > > * Verified md5 checksums and signature > > > * Deployed a pseudo cluster > > > * verified basic HDFS operations and Pi job. > > > * Did a sanity check for RM and NM UI. > > > > > > Thanks > > > zhihai > > > > > > On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee wrote: > > > > > > > Thanks Masatake! > > > > > > > > Today's the last day for this vote, and I'd like to ask you to try > out > > > the > > > > RC and vote on this today. So far there has been no binding vote. > > Thanks > > > > again. > > > > > > > > Regards, > > > > Sangjin > > > > > > > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki < > > > > iwasak...@oss.nttdata.co.jp> wrote: > > > > > > > > > +1(non-binding) > > > > > > > > > > * verified signature and md5. > > > > > * built with -Pnative on CentOS6 and OpenJDK7. > > > > > * built documentation and skimmed the contents. > > > > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and > > mapreduce > > > on > > > > > 3-node cluster. > > > > > > > > > > Thanks, > > > > > Masatake Iwasaki > > > > > > > > > > On 10/3/16 09:12, Sangjin Lee wrote: > > > > > > > > > >> Hi folks, > > > > >> > > > > >> I have pushed a new release candidate (R1) for the Apache Hadoop > > 2.6.5 > > > > >> release (the next maintenance release in the 2.6.x release line). > > RC1 > > > > >> contains fixes to CHANGES.txt, and is otherwise identical to RC0. > > > > >> > > > > >> Below are the details of this release candidate: > > > > >> > > > > >> The RC is available for validation at: > > > > >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/. > > > > >> > > > > >> The RC tag in git is release-2.6.5-RC1 and its git commit is > > > > >> e8c9fe0b4c252caf2ebf1464220599650f119997. > > > > >> > > > > >> The maven artifacts are staged via repository.apache.org at: > > > > >> https://repository.apache.org/content/repositories/ > > > > orgapachehadoop-1050/. > > > > >> > > > > >> You can find my public key at > > > > >> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS. > > > > >> > > > > >> Please try the release and vote. The vote will run for the usual 5 > > > > days. I > > > > >> would greatly appreciate your timely vote. Thanks! > > > > >> > > > > >> Regards, > > > > >> Sangjin > > > > >> > > > > >> > > > > > > > > > > > > > > >
Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
Thanks to Chris and Sangjin for working on this release. +1 binding * Verified signatures * Built from source tarball * Started HDFS and did some basic ops Thanks, Andrew On Fri, Oct 7, 2016 at 2:50 PM, Wangda Tanwrote: > Thanks Sangjin for cutting this release! > > +1 (Binding) > > - Downloaded binary tar ball and setup a single node cluster. > - Submit a few applications and which can successfully run. > > Thanks, > Wangda > > > On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xu wrote: > > > Thanks Sangjin for creating release 2.6.5 RC1. > > > > +1 (non-binding) > > > > * Downloaded and built from source > > * Verified md5 checksums and signature > > * Deployed a pseudo cluster > > * verified basic HDFS operations and Pi job. > > * Did a sanity check for RM and NM UI. > > > > Thanks > > zhihai > > > > On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee wrote: > > > > > Thanks Masatake! > > > > > > Today's the last day for this vote, and I'd like to ask you to try out > > the > > > RC and vote on this today. So far there has been no binding vote. > Thanks > > > again. > > > > > > Regards, > > > Sangjin > > > > > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki < > > > iwasak...@oss.nttdata.co.jp> wrote: > > > > > > > +1(non-binding) > > > > > > > > * verified signature and md5. > > > > * built with -Pnative on CentOS6 and OpenJDK7. > > > > * built documentation and skimmed the contents. > > > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and > mapreduce > > on > > > > 3-node cluster. > > > > > > > > Thanks, > > > > Masatake Iwasaki > > > > > > > > On 10/3/16 09:12, Sangjin Lee wrote: > > > > > > > >> Hi folks, > > > >> > > > >> I have pushed a new release candidate (R1) for the Apache Hadoop > 2.6.5 > > > >> release (the next maintenance release in the 2.6.x release line). > RC1 > > > >> contains fixes to CHANGES.txt, and is otherwise identical to RC0. > > > >> > > > >> Below are the details of this release candidate: > > > >> > > > >> The RC is available for validation at: > > > >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/. > > > >> > > > >> The RC tag in git is release-2.6.5-RC1 and its git commit is > > > >> e8c9fe0b4c252caf2ebf1464220599650f119997. > > > >> > > > >> The maven artifacts are staged via repository.apache.org at: > > > >> https://repository.apache.org/content/repositories/ > > > orgapachehadoop-1050/. > > > >> > > > >> You can find my public key at > > > >> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS. > > > >> > > > >> Please try the release and vote. The vote will run for the usual 5 > > > days. I > > > >> would greatly appreciate your timely vote. Thanks! > > > >> > > > >> Regards, > > > >> Sangjin > > > >> > > > >> > > > > > > > > > >
[jira] [Created] (YARN-5716) Add global scheduler interface definition and update CapacityScheduler to use it.
Wangda Tan created YARN-5716: Summary: Add global scheduler interface definition and update CapacityScheduler to use it. Key: YARN-5716 URL: https://issues.apache.org/jira/browse/YARN-5716 Project: Hadoop YARN Issue Type: Sub-task Reporter: Wangda Tan Assignee: Wangda Tan -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
Thanks Sangjin for cutting this release! +1 (Binding) - Downloaded binary tar ball and setup a single node cluster. - Submit a few applications and which can successfully run. Thanks, Wangda On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xuwrote: > Thanks Sangjin for creating release 2.6.5 RC1. > > +1 (non-binding) > > * Downloaded and built from source > * Verified md5 checksums and signature > * Deployed a pseudo cluster > * verified basic HDFS operations and Pi job. > * Did a sanity check for RM and NM UI. > > Thanks > zhihai > > On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee wrote: > > > Thanks Masatake! > > > > Today's the last day for this vote, and I'd like to ask you to try out > the > > RC and vote on this today. So far there has been no binding vote. Thanks > > again. > > > > Regards, > > Sangjin > > > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki < > > iwasak...@oss.nttdata.co.jp> wrote: > > > > > +1(non-binding) > > > > > > * verified signature and md5. > > > * built with -Pnative on CentOS6 and OpenJDK7. > > > * built documentation and skimmed the contents. > > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and mapreduce > on > > > 3-node cluster. > > > > > > Thanks, > > > Masatake Iwasaki > > > > > > On 10/3/16 09:12, Sangjin Lee wrote: > > > > > >> Hi folks, > > >> > > >> I have pushed a new release candidate (R1) for the Apache Hadoop 2.6.5 > > >> release (the next maintenance release in the 2.6.x release line). RC1 > > >> contains fixes to CHANGES.txt, and is otherwise identical to RC0. > > >> > > >> Below are the details of this release candidate: > > >> > > >> The RC is available for validation at: > > >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/. > > >> > > >> The RC tag in git is release-2.6.5-RC1 and its git commit is > > >> e8c9fe0b4c252caf2ebf1464220599650f119997. > > >> > > >> The maven artifacts are staged via repository.apache.org at: > > >> https://repository.apache.org/content/repositories/ > > orgapachehadoop-1050/. > > >> > > >> You can find my public key at > > >> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS. > > >> > > >> Please try the release and vote. The vote will run for the usual 5 > > days. I > > >> would greatly appreciate your timely vote. Thanks! > > >> > > >> Regards, > > >> Sangjin > > >> > > >> > > > > > >
Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/117/ [Oct 6, 2016 1:58:25 PM] (vinayakumarb) HDFS-10957. Retire BKJM from trunk (Vinayakumar B) [Oct 6, 2016 3:12:36 PM] (rohithsharmaks) YARN-5101. YARN_APPLICATION_UPDATED event is parsed in [Oct 6, 2016 3:31:00 PM] (stevel) HADOOP-13678 Update jackson from 1.9.13 to 2.x in hadoop-tools. [Oct 6, 2016 5:57:01 PM] (cnauroth) HADOOP-13323. Downgrade stack trace on FS load from Warn to debug. [Oct 6, 2016 6:19:38 PM] (wang) HADOOP-13688. Stop bundling HTML source code in javadoc JARs. [Oct 6, 2016 8:11:14 PM] (kihwal) HDFS-10939. Reduce performance penalty of encryption zones. Contributed [Oct 6, 2016 8:19:16 PM] (cnauroth) HADOOP-13150. Avoid use of toString() in output of HDFS ACL shell [Oct 6, 2016 9:33:46 PM] (kihwal) HDFS-10955. Pass IIP for FSDirAttr methods. Contributed by Daryn Sharp. [Oct 6, 2016 10:08:24 PM] (wang) HADOOP-13689. Do not attach javadoc and sources jars during non-dist [Oct 7, 2016 11:51:40 AM] (stevel) HADOOP-12977 s3a to handle delete("/", true) robustly. Contributed by -1 overall The following subsystems voted -1: compile unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate hadoop.hdfs.TestFileCorruption hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService hadoop.yarn.server.nodemanager.TestNodeManagerShutdown hadoop.yarn.server.timeline.TestRollingLevelDB hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices hadoop.yarn.server.timeline.TestTimelineDataManager hadoop.yarn.server.timeline.TestLeveldbTimelineStore hadoop.yarn.server.timeline.recovery.TestLeveldbTimelineStateStore hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer hadoop.yarn.server.timelineservice.storage.common.TestRowKeys hadoop.yarn.server.timelineservice.storage.common.TestKeyConverters hadoop.yarn.server.timelineservice.storage.common.TestSeparator hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore hadoop.yarn.server.resourcemanager.TestRMRestart hadoop.yarn.server.resourcemanager.TestResourceTrackerService hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.client.api.impl.TestNMClient hadoop.yarn.server.timeline.TestLevelDBCacheTimelineStore hadoop.yarn.server.timeline.TestOverrideTimelineStoreYarnClient hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorage hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun hadoop.yarn.server.timelineservice.storage.TestPhoenixOfflineAggregationWriterImpl hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity hadoop.yarn.applications.distributedshell.TestDistributedShell hadoop.mapred.TestShuffleHandler hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService Timed out junit tests : org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache org.apache.hadoop.mapred.TestMRIntermediateDataEncryption compile: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/117/artifact/out/patch-compile-root.txt [316K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/117/artifact/out/patch-compile-root.txt [316K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/117/artifact/out/patch-compile-root.txt [316K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/117/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [200K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/117/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [52K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/117/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [52K]
Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
Thanks Sangjin for creating release 2.6.5 RC1. +1 (non-binding) * Downloaded and built from source * Verified md5 checksums and signature * Deployed a pseudo cluster * verified basic HDFS operations and Pi job. * Did a sanity check for RM and NM UI. Thanks zhihai On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Leewrote: > Thanks Masatake! > > Today's the last day for this vote, and I'd like to ask you to try out the > RC and vote on this today. So far there has been no binding vote. Thanks > again. > > Regards, > Sangjin > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki < > iwasak...@oss.nttdata.co.jp> wrote: > > > +1(non-binding) > > > > * verified signature and md5. > > * built with -Pnative on CentOS6 and OpenJDK7. > > * built documentation and skimmed the contents. > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and mapreduce on > > 3-node cluster. > > > > Thanks, > > Masatake Iwasaki > > > > On 10/3/16 09:12, Sangjin Lee wrote: > > > >> Hi folks, > >> > >> I have pushed a new release candidate (R1) for the Apache Hadoop 2.6.5 > >> release (the next maintenance release in the 2.6.x release line). RC1 > >> contains fixes to CHANGES.txt, and is otherwise identical to RC0. > >> > >> Below are the details of this release candidate: > >> > >> The RC is available for validation at: > >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/. > >> > >> The RC tag in git is release-2.6.5-RC1 and its git commit is > >> e8c9fe0b4c252caf2ebf1464220599650f119997. > >> > >> The maven artifacts are staged via repository.apache.org at: > >> https://repository.apache.org/content/repositories/ > orgapachehadoop-1050/. > >> > >> You can find my public key at > >> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS. > >> > >> Please try the release and vote. The vote will run for the usual 5 > days. I > >> would greatly appreciate your timely vote. Thanks! > >> > >> Regards, > >> Sangjin > >> > >> > > >
Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
Thanks Masatake! Today's the last day for this vote, and I'd like to ask you to try out the RC and vote on this today. So far there has been no binding vote. Thanks again. Regards, Sangjin On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki < iwasak...@oss.nttdata.co.jp> wrote: > +1(non-binding) > > * verified signature and md5. > * built with -Pnative on CentOS6 and OpenJDK7. > * built documentation and skimmed the contents. > * built rpms by bigtop and ran smoke-tests of hdfs, yarn and mapreduce on > 3-node cluster. > > Thanks, > Masatake Iwasaki > > On 10/3/16 09:12, Sangjin Lee wrote: > >> Hi folks, >> >> I have pushed a new release candidate (R1) for the Apache Hadoop 2.6.5 >> release (the next maintenance release in the 2.6.x release line). RC1 >> contains fixes to CHANGES.txt, and is otherwise identical to RC0. >> >> Below are the details of this release candidate: >> >> The RC is available for validation at: >> http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/. >> >> The RC tag in git is release-2.6.5-RC1 and its git commit is >> e8c9fe0b4c252caf2ebf1464220599650f119997. >> >> The maven artifacts are staged via repository.apache.org at: >> https://repository.apache.org/content/repositories/orgapachehadoop-1050/. >> >> You can find my public key at >> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS. >> >> Please try the release and vote. The vote will run for the usual 5 days. I >> would greatly appreciate your timely vote. Thanks! >> >> Regards, >> Sangjin >> >> >
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/ [Oct 6, 2016 6:57:15 AM] (aajisaka) MAPREDUCE-6789. Fix TestAMWebApp failure. Contributed by Daniel [Oct 6, 2016 12:17:31 PM] (brahma) HDFS-10963. Reduce log level when network topology cannot find enough [Oct 6, 2016 12:36:08 PM] (brahma) HADOOP-13690. Fix typos in core-default.xml. Contributed by Yiqun Lin [Oct 6, 2016 1:58:25 PM] (vinayakumarb) HDFS-10957. Retire BKJM from trunk (Vinayakumar B) [Oct 6, 2016 3:12:36 PM] (rohithsharmaks) YARN-5101. YARN_APPLICATION_UPDATED event is parsed in [Oct 6, 2016 3:31:00 PM] (stevel) HADOOP-13678 Update jackson from 1.9.13 to 2.x in hadoop-tools. [Oct 6, 2016 5:57:01 PM] (cnauroth) HADOOP-13323. Downgrade stack trace on FS load from Warn to debug. [Oct 6, 2016 6:19:38 PM] (wang) HADOOP-13688. Stop bundling HTML source code in javadoc JARs. [Oct 6, 2016 8:11:14 PM] (kihwal) HDFS-10939. Reduce performance penalty of encryption zones. Contributed [Oct 6, 2016 8:19:16 PM] (cnauroth) HADOOP-13150. Avoid use of toString() in output of HDFS ACL shell [Oct 6, 2016 9:33:46 PM] (kihwal) HDFS-10955. Pass IIP for FSDirAttr methods. Contributed by Daryn Sharp. [Oct 6, 2016 10:08:24 PM] (wang) HADOOP-13689. Do not attach javadoc and sources jars during non-dist -1 overall The following subsystems voted -1: asflicense unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices hadoop.yarn.server.resourcemanager.scheduler.fair.TestContinuousScheduling hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.server.TestMiniYarnClusterNodeUtilization cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/diff-compile-javac-root.txt [168K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/diff-checkstyle-root.txt [16M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/diff-patch-pylint.txt [16K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/whitespace-eol.txt [11M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/diff-javadoc-javadoc-root.txt [2.2M] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [56K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [268K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt [124K] asflicense: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/187/artifact/out/patch-asflicense-problems.txt [4.0K] Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
+1(non-binding) * verified signature and md5. * built with -Pnative on CentOS6 and OpenJDK7. * built documentation and skimmed the contents. * built rpms by bigtop and ran smoke-tests of hdfs, yarn and mapreduce on 3-node cluster. Thanks, Masatake Iwasaki On 10/3/16 09:12, Sangjin Lee wrote: Hi folks, I have pushed a new release candidate (R1) for the Apache Hadoop 2.6.5 release (the next maintenance release in the 2.6.x release line). RC1 contains fixes to CHANGES.txt, and is otherwise identical to RC0. Below are the details of this release candidate: The RC is available for validation at: http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/. The RC tag in git is release-2.6.5-RC1 and its git commit is e8c9fe0b4c252caf2ebf1464220599650f119997. The maven artifacts are staged via repository.apache.org at: https://repository.apache.org/content/repositories/orgapachehadoop-1050/. You can find my public key at http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS. Please try the release and vote. The vote will run for the usual 5 days. I would greatly appreciate your timely vote. Thanks! Regards, Sangjin - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
> On Oct 6, 2016, at 1:39 PM, Akira Ajisakawrote: > > > It wasn't 'renamed' to jenkins, prior releases were actually built by and > > on the Jenkins infrastructure. Which was a very very bad idea: it's > > insecure and pretty much against ASF policy. > > Sorry for the confusion. I should not have used the word 'rename'. > What I meant is that "would you change the name to 'jenkins' by using the > Jenkins infra?" To re-iterate, building on the jenkins servers is a violation of ASF release policy and the PMC pretty much has a duty to vote -1 on any such release. http://www.apache.org/dev/release.html#owned-controlled-hardware --snip-- Must releases be built on hardware owned and controlled by the committer? Practically speaking, when a release consists of anything beyond an archive (e.g., tarball or zip file) of a source control tag, the only practical way to validate that archive is to build it locally; manually inspecting generated files (especially binary files) is not feasible. So, basically, "Yes". --snip-- The ASF build servers are multi-user and run many many many untested code bases. It would be extremely easy to inject class files into any running compile (Docker-ized or otherwise). This means that any build that comes from those servers should be considered untrusted, especially from a release perspective. For 3.x releases, I rewrote create-release and added the --asfrelease option to specifically provide a way for us to get consistent release candidates regardless of who builds it. It should also speed up the release process since it also does a lot of the previously manually steps, such as signing. - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org