Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-28 Thread Wilfred Spiegelenburg
+1 (non binding) - build from source on MacOSX 10.14.1, 1.8.0u181 - successful native build on Ubuntu 16.04.3 - confirmed the checksum and signature - deployed a single node cluster (jdk 1.8u191 / centos 7.5) Wilfred > On 23 Nov 2018, at 23:06, Sunil G wrote: > > Hi folks, > > > > Thanks

[jira] [Created] (HDFS-14113) EC : Add Configuration to restrict UserDefined Policies

2018-11-28 Thread Ayush Saxena (JIRA)
Ayush Saxena created HDFS-14113: --- Summary: EC : Add Configuration to restrict UserDefined Policies Key: HDFS-14113 URL: https://issues.apache.org/jira/browse/HDFS-14113 Project: Hadoop HDFS

[jira] [Created] (HDFS-14112) Avoid recursive call to external authorizer for getContentSummary.

2018-11-28 Thread Jitendra Nath Pandey (JIRA)
Jitendra Nath Pandey created HDFS-14112: --- Summary: Avoid recursive call to external authorizer for getContentSummary. Key: HDFS-14112 URL: https://issues.apache.org/jira/browse/HDFS-14112

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-28 Thread Sunil G
Hi Eric, Thanks for helping in verifying the release. Post YARN-7370, preemption configs are refreshable. I tried to test by making some changes in capacity-scheduler.xml and invoking yarn rmadmin -refreshQueues. I can see the changes reflected as per logs after refresh. Could you please help to

Re: RPC connect error when using kerberos Auth

2018-11-28 Thread Wei-Chiu Chuang
Not sure about integrity -- I've seen very few if at all installations with integrity option enabled. Regarding privacy -- have you made sure both client and server enabled SASL privacy? Both sides must have consistent RPC settings for them to talk. On Wed, Nov 28, 2018 at 12:58 AM ZongtianHou

[jira] [Created] (HDDS-881) Add support for transform client requests to OM into RaftClient requests

2018-11-28 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDDS-881: --- Summary: Add support for transform client requests to OM into RaftClient requests Key: HDDS-881 URL: https://issues.apache.org/jira/browse/HDDS-881 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-28 Thread Chandni Singh
+1 (non-binding) - Build from source - Launched example sleeper service - Tested upgrade of sleeper service - Tested cancellation of upgrade - Tested express upgrade On Wed, Nov 28, 2018 at 8:22 AM Peter Bacsko wrote: > +1 (non-binding) > > - Built from source at tag 3.2.0-rc0 (Ubuntu 18.10,

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-28 Thread Eric Payne
Sunil, So, the basic symptoms are that if preemption is enabled on any queue, the preemption is disabled after a 'yarn rm -refreshQueues'. In addition, all of the preemption-specific properties are set back to the default values. This was introduced in branch-3.1, so it is NOT new behavior for

[jira] [Created] (HDDS-880) Create api for ACL handling in Ozone

2018-11-28 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDDS-880: --- Summary: Create api for ACL handling in Ozone Key: HDDS-880 URL: https://issues.apache.org/jira/browse/HDDS-880 Project: Hadoop Distributed Data Store Issue Type: Bug

[jira] [Created] (HDDS-879) Add InitiateMultipartUpload in ozone

2018-11-28 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDDS-879: --- Summary: Add InitiateMultipartUpload in ozone Key: HDDS-879 URL: https://issues.apache.org/jira/browse/HDDS-879 Project: Hadoop Distributed Data Store

[jira] [Created] (HDFS-14111) hdfsOpenFile on HDFS causes unnecessary IO from file offset 0

2018-11-28 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-14111: -- Summary: hdfsOpenFile on HDFS causes unnecessary IO from file offset 0 Key: HDFS-14111 URL: https://issues.apache.org/jira/browse/HDFS-14111 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-10369) hdfsread crash when reading data reaches to 128M

2018-11-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-10369. Resolution: Invalid You're mallocing a buffer of 5 bytes here, seems your C code is just broken.

[jira] [Created] (HDFS-14110) NPE when serving http requests while NameNode is starting up

2018-11-28 Thread Chao Sun (JIRA)
Chao Sun created HDFS-14110: --- Summary: NPE when serving http requests while NameNode is starting up Key: HDFS-14110 URL: https://issues.apache.org/jira/browse/HDFS-14110 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-28 Thread Eric Payne
Sunil, thanks for all of the hard work on this release. I have discovered that queue refresh doesn't work in some cases. For example, when I change yarn.scheduler.capacity.root.default.disable_preemption, it doesn't take effect unless I restart the RM. I am still investigating, but I thought I

[jira] [Resolved] (HDDS-813) [JDK11] mvn javadoc:javadoc -Phdds fails

2018-11-28 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia resolved HDDS-813. Resolution: Implemented > [JDK11] mvn javadoc:javadoc -Phdds fails >

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-28 Thread Peter Bacsko
+1 (non-binding) - Built from source at tag 3.2.0-rc0 (Ubuntu 18.10, JDK1.8.0_191) - Verified checksums of hadoop-3.2.0.tar.gz - Installed on a 3-node physical cluster - Ran teragen/terasort/teravalidate - Ran distributed shell a couple of times - Checked UIs (RM, NM, DN, JHS) Peter On Wed, Nov

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-28 Thread Jason Lowe
Thanks for driving this release, Sunil! +1 (binding) - Verified signatures and digests - Successfully performed a native build - Deployed a single-node cluster - Ran some sample jobs Jason On Fri, Nov 23, 2018 at 6:07 AM Sunil G wrote: > Hi folks, > > > > Thanks to all contributors who

[jira] [Created] (HDFS-14109) Improve hdfs auditlog format and support federation friendly

2018-11-28 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14109: -- Summary: Improve hdfs auditlog format and support federation friendly Key: HDFS-14109 URL: https://issues.apache.org/jira/browse/HDFS-14109 Project: Hadoop HDFS

[jira] [Created] (HDDS-878) Do the disk failure check before ContainerSet initialization

2018-11-28 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDDS-878: -- Summary: Do the disk failure check before ContainerSet initialization Key: HDDS-878 URL: https://issues.apache.org/jira/browse/HDDS-878 Project: Hadoop Distributed Data Store