Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (binding) Looked through the src tarball. Checksum and signature match, skimmed NOTICE/LICENSE, ran some unit tests. -C On Sat, Jul 29, 2017 at 4:29 PM, Konstantin Shvachko wrote: > Hi everybody, > > Here is the next release of Apache Hadoop 2.7 line. The previous stable > release 2.7.3 was a

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Forgot to mention, also did Namenode performance testing using Dynamometer (see http://mail-archives.apache.org/mod_mbox/hadoop-common-dev/201707.mbox/%3CCAGkyFnM7Ltpb-C_rxP43VUguRXb1bvxPH7GMqdSweE2iJx7i%2Bg%40mail.gmail.com%3E). Reran production traces from multi-thousand node clusters and did n

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (non-binding) - Verified checksum and signature of source and binary tarballs - Built from source, macOS Sierra 10.12.3 and RHEL 6.6, Oracle JDK 1.8.0_72 - Ran basic HDFS commands and some MR example jobs (using 2.7.4 client) against a 2.6.1 cluster - Started MiniCluster, ran basic HDFS comman

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi Wei-Chi, There is bunch of performance jiras in Hadoop. This one is not marked as blocker and seems to be hard to reproduce. And I see that you are still discussing the problem and the solution with Daryn in the jira. I don't think it should block the release. If this or anything else will prov

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi, I'm sorry coming to this vote late. Daryn mentioned in HDFS-12136 that HDFS-11160 has a performance regression at DataNode due to the way it locks dataset lock. HDFS-11160 is in Hadoop 2.7.4.

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (binding) - Verified the checksum and the signature of the source tarball - Built from source with CentOS 7.2 and OpenJDK 1.8.0_141 - Built Hive 2.1.0/2.3.0 and Tez 0.8.5/0.9.0 with Hadoop 2.7.4 artifacts - Built single node cluster and ran some Hive on Tez queries successfully Regards, Akira

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (non-binding) 1. Verified signatures and digests. 2. Built source. 3. Installed on a pseudo-distributed cluster. 4. Ran sample MR jobs and Tez example jobs like orderedwordcount successfully. Thank you Konstantin and others for this release. Regards, Kuhu On Thursday, August 3, 2017, 7:19:

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks Konstantin +1 (binding) 1. Build tar ball from source package 2. Ran basic MR jobs and verified UI. 3. Enabled node labels and ran sleep job. Works fine. 4. Verified CLI commands related to node labels and its working fine. 5. RM WorkPreserving restart cases are also verified, and looks fi

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks! I'll check whether Apache Hive and Tez can be built with the artiacts. -Akira On 2017/08/03 16:34, Konstantin Shvachko wrote: Hi Akira, The artifacts are on Nexus in Staging Repositories: https://repository.apache.org/#stagingRepositories or https://repository.apache.org/content/reposi

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi Akira, The artifacts are on Nexus in Staging Repositories: https://repository.apache.org/#stagingRepositories or https://repository.apache.org/content/repositories/orgapachehadoop-1061/ They are not released yet, which happens once the release is approved. See in Publishing section #5 https://

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks Konstantin for the work! I have a question: Where are the maven artifacts deployed? -Akira On 2017/07/30 8:29, Konstantin Shvachko wrote: Hi everybody, Here is the next release of Apache Hadoop 2.7 line. The previous stable release 2.7.3 was available since 25 August, 2016. Release 2.7.

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks Konstantin! +1 (non-binding) I have tried several steps including: - Download source package and check the checksums - Build from source using Java 8 - Deploy a test cluster using docker containers w/ 5 DNs and 1 NN - Run basic HDFS client/admin operations (e.g. read/write files, dfsadmin)

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

doop.apache.org" ; "mapreduce-...@hadoop.apache.org" ; "yarn-...@hadoop.apache.org" Sent: Monday, July 31, 2017 8:57 PM Subject: Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0) Uploaded new binaries hadoop-2.7.4-RC0.tar.gz, which adds lib/native/. Same place: http://home.a

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks for driving the 2.7.4 release! +1 (binding) - Verified signatures and digests- Successfully built from source including native- Deployed to a single-node cluster and ran sample MapReduce jobs Jason On Saturday, July 29, 2017 6:29 PM, Konstantin Shvachko wrote: Hi everybody, Her

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

- Verified all checksums signatures - Built from src on macOS 10.12.6 with Java 1.8.0u65 - Deployed single node pseudo cluster - Successfully ran sleep and pi jobs - Navigated the various UIs +1 (non-binding) Thanks, Eric On Wednesday, August 2, 2017 12:31 PM, Chris Douglas wrote: On Wed

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

On Wed, Aug 2, 2017 at 12:02 AM, Zhe Zhang wrote: > Quick question for Chris: was your +1 for the RC, or to support > Konstantin's statement regarding packaging? For Konstantin's statement. I haven't had a chance to look through the RC yet, but it's on my list. -C > On Mon, Jul 31, 2017 at 3:56

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Quick question for Chris: was your +1 for the RC, or to support Konstantin's statement regarding packaging? Thanks, On Mon, Jul 31, 2017 at 3:56 PM Chris Douglas wrote: > On Mon, Jul 31, 2017 at 3:02 PM, Konstantin Shvachko > wrote: > > For the packaging, here is the exact phrasing from the si

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (binding) 1. Downloaded src tar ball, verified m5dsum 2. Built from source on Linux RHEL6, Java 1_8_0_40 3. Tried some HDFS CLI methods with the above build, against two clusters, one running 2.6.1 and another running 2.7.4 (server bin/conf built by an internal Jenkins job, as Ye Zhou mentioned

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi, Konstantin. Thanks for leading the release. +1 (non-binding) -Built from the source on mac with jdk_1.8.0_40 -Built on internal Jenkins with jdk_1.8.0_40. -Deployed on a cluster with 121 nodes(Including RM, NM, NN, DN) -Basic shell commands -Distcp 3.7TB data to HDFS -Run GridMix test which s

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (non-binding). Thanks, Edwina On 7/31/17, 6:57 PM, "Konstantin Shvachko" wrote: Uploaded new binaries hadoop-2.7.4-RC0.tar.gz, which adds lib/native/. Same place: http://home.apache.org/~shv/hadoop-2.7.4-RC0/ Thanks, --Konstantin On Mon, Jul 31, 2017 at 3:56 P

RE: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

ndrew Wang; Allen Wittenauer; common-...@hadoop.apache.org; hdfs-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0) Uploaded new binaries hadoop-2.7.4-RC0.tar.gz, which adds lib/native/. Same place:

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (non-binding) Thanks for preparing the 2.7.4-RC0 release. - Built from source on Mac OS X 10.12.6 with Java 1.8.0_111 - Deployed to a pseudo cluster - Passed the following sanity checks - Basic dfs operations - Wordcount - DFSIO- read/write Thanks, Ajay On 7/31/17, 6:57 PM, "Kon

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Uploaded new binaries hadoop-2.7.4-RC0.tar.gz, which adds lib/native/. Same place: http://home.apache.org/~shv/hadoop-2.7.4-RC0/ Thanks, --Konstantin On Mon, Jul 31, 2017 at 3:56 PM, Chris Douglas wrote: > On Mon, Jul 31, 2017 at 3:02 PM, Konstantin Shvachko > wrote: > > For the packaging, her

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

On Mon, Jul 31, 2017 at 3:02 PM, Konstantin Shvachko wrote: > For the packaging, here is the exact phrasing from the sited release-policy > document relevant to binaries: > "As a convenience to users that might not have the appropriate tools to > build a compiled version of the source, binary/byte

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Maven dependencies should be fine. For the packaging, here is the exact phrasing from the sited release-policy document relevant to binaries: "As a convenience to users that might not have the appropriate tools to build a compiled version of the source, binary/bytecode packages MAY be distributed

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi Konstantin, Thanks for putting up 2.7.4-RC0 release! +1 (non-binding). With following checks: - build the source on MacOS 10.12.5 with java version 1.8.0_91. - deployed on a single node pseudo-custer - tested HDFS basics: write/read/append/acl - mapreduce job wordcount/bbp/grep Thanks! Chen

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi Konstantin, Thanks for preparing the 2.7.4-RC0 release. - Built from source on Mac OS X 10.11.6 with Java 1.7.0_79 - Deployed both binary and built source to a pseudo cluster - Passed the following sanity checks - Basic dfs operations - Wordcount +1 (non-binding) Thanks, Hanisha

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Just confirmed that HADOOP-13707 does fix the NN servlet issuet in branch-2.7. On Mon, Jul 31, 2017 at 11:38 AM, Konstantin Shvachko wrote: > Hi John, > > Thank you for checking and voting. > As far as I know test failures on 2.7.4 are intermittent. We have a jira > for that > https://issues.apa

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

I agree with Brahma on the two issues flagged (having src in the binary tarball, missing native libs). These are regressions from prior releases. As an aside, "we release binaries as a convenience" doesn't relax the quality bar. The binaries are linked on our website and distributed through offici

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

To avoid any confusion in this regard. I built RC0 manually in compliance with Apache release policy http://www.apache.org/legal/release-policy.html I edited the HowToReleasePreDSBCR page to make sure people don't use Jenkins option for building. A side note. This particular build is broken anyway

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

> On Jul 31, 2017, at 11:20 AM, Konstantin Shvachko > wrote: > > https://wiki.apache.org/hadoop/HowToReleasePreDSBCR FYI: If you are using ASF Jenkins to create an ASF release artifact, it's pretty much an automatic vote failure as any such release is in violation of

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi John, Thank you for checking and voting. As far as I know test failures on 2.7.4 are intermittent. We have a jira for that https://issues.apache.org/jira/browse/HDFS-11985 but decided it should not block the release. The "dr,who" thing is a configuration issue. This page may be helpful: http://

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi Brahma Reddy Battula, Formally Apache releases sources. We provide binaries as a reference for convenience. The release instructions for Hadoop 2.7 line at https://wiki.apache.org/hadoop/HowToReleasePreDSBCR don't give much guidance on how to actually build and package the binary tarball. I int

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks for putting this up, Konstantin. I'm +1(non-binding) on the source tarball. * verified signature and mds, * built from source on CentOS 7 and OpenJDK 8 with native profile, * built RPMs by bigtop, deployed 5 nodes cluster by docker provisioner, ran smoke-tests of hdfs, yarn and mapreduce

RE: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (non-binding) -Installed HA cluster. -Verified HDFS basic. -Read/Write/Append. -Snapshot -ACL -xAttr -Truncate -Quota -Admin operations -Surendra Singh Lilhore -Original Message- From: Konstantin Shvachko [mailto:shv.had.

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi Konstantin, Thanks a lot for the effort to prepare the 2.7.4-RC0 release! +1 (non-binding) - Verified checksums and signatures of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Verified cloud connectors: - All S3A integration tests - Deploy

RE: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks konstantin. Native files (lib/native) is missed And src folder exists in tar ball. Please check the same. Host1:/home/Brahma/Release/hadoop-2.7.4 # ll total 144 -rw-r--r-- 1 20415 messagebus 86424 Jul 30 02:54 LICENSE.txt -rw-r--r-- 1 20415 messagebus 14978 Jul 30 02:54 NOTICE.txt -rw-r