Re: [VOTE] Release Hadoop-3.1.3-RC0

2019-09-17 Thread Zhankun Tang
Hi Masatake, Thanks for helping to verify! I checked that branch-3.2 has the HDFS-14759 committed already. Release-3.2.1-RC0 should have no such issue. For branch-3.1, cherry-pick the same commit has conflicts. I'm confirming if we can fix it or there's a feasible plan to backport the whole Hadoo

Re: [VOTE] Release Hadoop-3.1.3-RC0

2019-09-17 Thread Masatake Iwasaki
Thanks for putting this up, Zhankun Tang. While I was testing the RC0 wich CLI, noisy INFO message was emitted on every data transfer operation.::   2019-09-17 16:00:42,942 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false The i

Re: [VOTE] Release Hadoop-3.1.3-RC0

2019-09-17 Thread Rohith Sharma K S
+1 (binding) - verified sha512 for all the artifacts - built from source and installed pseudo cluster. Run sample MR jobs and distributed shell. -Rohith Sharma K S

Re: Compile 64bit native Hadoop 3.2.0 binaries for AIX 7.1

2019-09-17 Thread Matt Foley
Hi Candy, It’s possible that you’ve already tried the below, but one can’t tell from your message, so here goes: 1. Presumably you’ve read https://hadoop.apache.org/docs/r3.2.0/hadoop-project-dist/hadoop-common/NativeLibraries.html Admittedly it doesn’t answer your question, but it does point ou

Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0

2019-09-17 Thread zhankun tang
+1 (non-binding). Installed and verified it by running several Spark job and DS jobs. BR, Zhankun On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla < naganarasimha...@apache.org> wrote: > Verified the source and the binary tar and the sha512 checksums > Installed and verified the basic hadoop op

[jira] [Created] (HADOOP-16584) S3A Test failures when S3Guard is not enabled

2019-09-17 Thread Siddharth Seth (Jira)
Siddharth Seth created HADOOP-16584: --- Summary: S3A Test failures when S3Guard is not enabled Key: HADOOP-16584 URL: https://issues.apache.org/jira/browse/HADOOP-16584 Project: Hadoop Common

[jira] [Created] (HADOOP-16583) Minor fixes to S3 testing instructions

2019-09-17 Thread Siddharth Seth (Jira)
Siddharth Seth created HADOOP-16583: --- Summary: Minor fixes to S3 testing instructions Key: HADOOP-16583 URL: https://issues.apache.org/jira/browse/HADOOP-16583 Project: Hadoop Common Issue

Compile 64bit native Hadoop 3.2.0 binaries for AIX 7.1

2019-09-17 Thread Candy Ho
Dear all, I have mostly implemented the various 'fixes' and peculiarities of the Unix-based AIX systems required for Hadoop and now I'm stuck with the compile error Linking C shared library target/usr/local/lib/libhadoop.a ld: 0711-736 ERROR: Input file /usr/java8_64/jre/lib/ppc64/j9vm/libjvm.so

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-09-17 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/448/ [Sep 17, 2019 4:34:54 PM] (weichiu) HDFS-14771. Backport HDFS-14617 to branch-2 (Improve fsimage load time - To unsubscribe, e-mail: co

Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0

2019-09-17 Thread Naganarasimha Garla
Verified the source and the binary tar and the sha512 checksums Installed and verified the basic hadoop operations (ran few MR tasks) +1. Thanks, + Naga On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni wrote: > +1 (non-binding) > > On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella wrote: > > > +1

Re: [DISCUSS] Separate Hadoop Core trunk and Hadoop Ozone trunk source tree

2019-09-17 Thread Weiwei Yang
+1 (binding) Thanks Weiwei On Wed, Sep 18, 2019 at 6:35 AM Wangda Tan wrote: > +1 (binding). > > From my experiences of Submarine project, I think moving to a separate repo > helps. > > - Wangda > > On Tue, Sep 17, 2019 at 11:41 AM Subru Krishnan wrote: > > > +1 (binding). > > > > IIUC, there

Re: [DISCUSS] Separate Hadoop Core trunk and Hadoop Ozone trunk source tree

2019-09-17 Thread Wangda Tan
+1 (binding). >From my experiences of Submarine project, I think moving to a separate repo helps. - Wangda On Tue, Sep 17, 2019 at 11:41 AM Subru Krishnan wrote: > +1 (binding). > > IIUC, there will not be an Ozone module in trunk anymore as that was my > only concern from the original discuss

[jira] [Created] (HADOOP-16582) LocalFileSystem's mkdirs() does not work as expected under viewfs.

2019-09-17 Thread Kihwal Lee (Jira)
Kihwal Lee created HADOOP-16582: --- Summary: LocalFileSystem's mkdirs() does not work as expected under viewfs. Key: HADOOP-16582 URL: https://issues.apache.org/jira/browse/HADOOP-16582 Project: Hadoop Co

[jira] [Created] (HADOOP-16581) ValueQueue does not trigger an async refill when number of values falls below watermark

2019-09-17 Thread Yuval Degani (Jira)
Yuval Degani created HADOOP-16581: - Summary: ValueQueue does not trigger an async refill when number of values falls below watermark Key: HADOOP-16581 URL: https://issues.apache.org/jira/browse/HADOOP-16581

Re: [DISCUSS] Separate Hadoop Core trunk and Hadoop Ozone trunk source tree

2019-09-17 Thread Subru Krishnan
+1 (binding). IIUC, there will not be an Ozone module in trunk anymore as that was my only concern from the original discussion thread? IMHO, this should be the default approach for new modules. On Tue, Sep 17, 2019 at 9:58 AM Salvatore LaMendola (BLOOMBERG/ 731 LEX) < slamendo...@bloomberg.net>

Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0

2019-09-17 Thread Anil Sadineni
+1 (non-binding) On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella wrote: > +1 (non-binding) > > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S < > rohithsharm...@apache.org> wrote: > > > Hi folks, > > > > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1. > > > > The RC is

Re: [DISCUSS] Separate Hadoop Core trunk and Hadoop Ozone trunk source tree

2019-09-17 Thread Dinesh Chitlangia
+1 -Dinesh On Tue, Sep 17, 2019 at 12:58 PM Salvatore LaMendola (BLOOMBERG/ 731 LEX) < slamendo...@bloomberg.net> wrote: > +1 > > From: e...@apache.org At: 09/17/19 05:48:32To: hdfs-...@hadoop.apache.org, > mapreduce-...@hadoop.apache.org, common-dev@hadoop.apache.org, > yarn-...@hadoop.apa

Re:[DISCUSS] Separate Hadoop Core trunk and Hadoop Ozone trunk source tree

2019-09-17 Thread Salvatore LaMendola (BLOOMBERG/ 731 LEX)
+1 From: e...@apache.org At: 09/17/19 05:48:32To: hdfs-...@hadoop.apache.org, mapreduce-...@hadoop.apache.org, common-dev@hadoop.apache.org, yarn-...@hadoop.apache.org Subject: [DISCUSS] Separate Hadoop Core trunk and Hadoop Ozone trunk source tree TLDR; I propose to move Ozone related cod

Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0

2019-09-17 Thread Santosh Marella
+1 (non-binding) On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S < rohithsharm...@apache.org> wrote: > Hi folks, > > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1. > > The RC is available at: > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/ > > The RC tag in g

Re: [DISCUSS] Separate Hadoop Core trunk and Hadoop Ozone trunk source tree

2019-09-17 Thread Anu Engineer
+1 —Anu > On Sep 17, 2019, at 2:49 AM, Elek, Marton wrote: > > > > TLDR; I propose to move Ozone related code out from Hadoop trunk and store it > in a separated *Hadoop* git repository apache/hadoop-ozone.git > > > > > When Ozone was adopted as a new Hadoop subproject it was proposed[1]

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2019-09-17 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1262/ [Sep 16, 2019 12:18:01 PM] (elek) HDDS-2044.Remove 'ozone' from the recon module names. [Sep 16, 2019 12:55:06 PM] (elek) HDDS-2096. Ozone ACL document missing AddAcl API [Sep 16, 2019 1:22:11 PM] (elek)

[jira] [Created] (HADOOP-16580) Disable retry of FailoverOnNetworkExceptionRetry in case of AccessControlException

2019-09-17 Thread Adam Antal (Jira)
Adam Antal created HADOOP-16580: --- Summary: Disable retry of FailoverOnNetworkExceptionRetry in case of AccessControlException Key: HADOOP-16580 URL: https://issues.apache.org/jira/browse/HADOOP-16580 Pr

[jira] [Created] (HADOOP-16579) Upgrade to Apache Curator 4.2.0 in Hadoop

2019-09-17 Thread Mate Szalay-Beko (Jira)
Mate Szalay-Beko created HADOOP-16579: - Summary: Upgrade to Apache Curator 4.2.0 in Hadoop Key: HADOOP-16579 URL: https://issues.apache.org/jira/browse/HADOOP-16579 Project: Hadoop Common

[jira] [Resolved] (HADOOP-16371) Option to disable GCM for SSL connections when running on Java 8

2019-09-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16371. - Fix Version/s: 3.3.0 Resolution: Fixed > Option to disable GCM for SSL connectio

[DISCUSS] Separate Hadoop Core trunk and Hadoop Ozone trunk source tree

2019-09-17 Thread Elek, Marton
TLDR; I propose to move Ozone related code out from Hadoop trunk and store it in a separated *Hadoop* git repository apache/hadoop-ozone.git When Ozone was adopted as a new Hadoop subproject it was proposed[1] to be part of the source tree but with separated release cadence, mainly beca