Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Zhe Zhang
+1 (non-binding) Did the following on 7 RHEL 6.6 servers - Downloaded and built from source - Downloaded and verified checksum of the binary tar.gz file - Setup a cluster with 1 NN and 6 DNs - Tried regular HDFS commands - Tried EC commands (listPolicies, getPolicy, setPolicy), they work fine -

[jira] [Created] (HADOOP-13564) modify mapred to use hadoop_subcommand_opts

2016-08-30 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-13564: - Summary: modify mapred to use hadoop_subcommand_opts Key: HADOOP-13564 URL: https://issues.apache.org/jira/browse/HADOOP-13564 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Allen Wittenauer
> On Aug 30, 2016, at 2:20 PM, Eric Badger wrote: > > Well that's embarrassing. I had accidentally slightly renamed my > log4j.properties file in my conf directory, so it was there, just not being > read. Nah. You were just testing out the shell rewrite's

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Eric Badger
Well that's embarrassing. I had accidentally slightly renamed my log4j.properties file in my conf directory, so it was there, just not being read. Apologies for the unnecessary spam. With this and the public key from Andrew, I give my non-binding +1. Eric On Tuesday, August 30, 2016 4:11

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Andrew Wang
Hi Eric, thanks for trying this out, I tried this gpg command to get my key, seemed to work: # gpg --keyserver pgp.mit.edu --recv-keys 7501105C gpg: requesting key 7501105C from hkp server pgp.mit.edu gpg: /root/.gnupg/trustdb.gpg: trustdb created gpg: key 7501105C: public key "Andrew Wang (CODE

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Allen Wittenauer
> On Aug 30, 2016, at 2:06 PM, Eric Badger > wrote: > > > WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete. ^^ > > After running the above command, the RM UI showed a successful job, but as > you can

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Eric Badger
I don't know why my email client keeps getting rid of all of my spacing. Resending the same email so that it is actually legible... All on OSX 10.11.6: - Verified the hashes. However, Andrew, I don't know where to find your public key, so I wasn't able to verify that they were signed by you. -

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Eric Badger
All on OSX 10.11.6: Verified the hashes. However, Andrew, I don't know where to find your public key, so I wasn't able to verify that they were signed by you.Built from sourceDeployed a pseudo-distributed clusterRan a few sample jobsPoked around the RM UIPoked around the attached website

[jira] [Reopened] (HADOOP-13357) Modify common to use hadoop_subcommand_opts

2016-08-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reopened HADOOP-13357: --- > Modify common to use hadoop_subcommand_opts >

[jira] [Reopened] (HADOOP-13356) Add a function to handle command_subcommand_OPTS

2016-08-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reopened HADOOP-13356: --- > Add a function to handle command_subcommand_OPTS >

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Allen Wittenauer
> On Aug 30, 2016, at 10:17 AM, Zhe Zhang wrote: > > Thanks Andrew for the great work! It's really exciting to finally see a > Hadoop 3 RC. > > I noticed CHANGES and RELEASENOTES markdown files which were not in > previous RCs like 2.7.3. What are good tools to verify them? I

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Andrew Wang
I'll put my own +1 on it: * Built from source * Started pseudo cluster and ran Pi job successfully On Tue, Aug 30, 2016 at 10:17 AM, Zhe Zhang wrote: > > Thanks Andrew for the great work! It's really exciting to finally see a > Hadoop 3 RC. > > I noticed CHANGES and

[jira] [Created] (HADOOP-13563) hadoop_subcommand_opts should print name not actual content during debug

2016-08-30 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-13563: - Summary: hadoop_subcommand_opts should print name not actual content during debug Key: HADOOP-13563 URL: https://issues.apache.org/jira/browse/HADOOP-13563

Re: [REMINDER] How to set fix versions when committing

2016-08-30 Thread Andrew Wang
Hi Junping, On Tue, Aug 30, 2016 at 4:30 AM, Junping Du wrote: > Hi Andrew and all, > Thanks for the notice on the change. I still concern this rule change > may cause some confusion from conflicting against our previous rule - no > need to set trunk version if it is

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Zhe Zhang
Thanks Andrew for the great work! It's really exciting to finally see a Hadoop 3 RC. I noticed CHANGES and RELEASENOTES markdown files which were not in previous RCs like 2.7.3. What are good tools to verify them? I tried reading them on IntelliJ but format looks odd. I'm still testing the RC: -

[VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Andrew Wang
Hi all, Thanks to the combined work of many, many contributors, here's an RC0 for 3.0.0-alpha1: http://home.apache.org/~wang/3.0.0-alpha1-RC0/ alpha1 is the first in a series of planned alpha releases leading up to GA. The objective is to get an artifact out to downstreams for testing and to

ApacheCon Seville CFP closes September 9th

2016-08-30 Thread Rich Bowen
It's traditional. We wait for the last minute to get our talk proposals in for conferences. Well, the last minute has arrived. The CFP for ApacheCon Seville closes on September 9th, which is less than 2 weeks away. It's time to get your talks in, so that we can make this the best ApacheCon yet.

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-08-30 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/149/ [Aug 29, 2016 3:55:38 PM] (jlowe) HADOOP-13552. RetryInvocationHandler logs all remote exceptions. [Aug 29, 2016 4:14:55 PM] (jlowe) YARN-5560. Clean up bad exception catching practices in TestYarnClient.

[jira] [Created] (HADOOP-13562) Change hadoop_subcommand_opts to use only uppercase

2016-08-30 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-13562: - Summary: Change hadoop_subcommand_opts to use only uppercase Key: HADOOP-13562 URL: https://issues.apache.org/jira/browse/HADOOP-13562 Project: Hadoop

[jira] [Created] (HADOOP-13560) make sure s3 blob >5GB files copies, with metadata

2016-08-30 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13560: --- Summary: make sure s3 blob >5GB files copies, with metadata Key: HADOOP-13560 URL: https://issues.apache.org/jira/browse/HADOOP-13560 Project: Hadoop Common

[jira] [Created] (HADOOP-13561) make sure s3 blob >5GB files copies, with metadata

2016-08-30 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13561: --- Summary: make sure s3 blob >5GB files copies, with metadata Key: HADOOP-13561 URL: https://issues.apache.org/jira/browse/HADOOP-13561 Project: Hadoop Common

Re: [REMINDER] How to set fix versions when committing

2016-08-30 Thread Junping Du
Hi Andrew and all, Thanks for the notice on the change. I still concern this rule change may cause some confusion from conflicting against our previous rule - no need to set trunk version if it is landing on 2.x branch. As we can see, there are 4 cases of version setting for JIRA landing