Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-28 Thread Wilfred Spiegelenburg
+1 (non binding) - build from source on MacOSX 10.14.1, 1.8.0u181 - successful native build on Ubuntu 16.04.3 - confirmed the checksum and signature - deployed a single node cluster (jdk 1.8u191 / centos 7.5) Wilfred > On 23 Nov 2018, at 23:06, Sunil G wrote: > > Hi folks, > > > > Thanks

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-28 Thread Sunil G
Hi Eric, Thanks for helping in verifying the release. Post YARN-7370, preemption configs are refreshable. I tried to test by making some changes in capacity-scheduler.xml and invoking yarn rmadmin -refreshQueues. I can see the changes reflected as per logs after refresh. Could you please help to

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-28 Thread Chandni Singh
+1 (non-binding) - Build from source - Launched example sleeper service - Tested upgrade of sleeper service - Tested cancellation of upgrade - Tested express upgrade On Wed, Nov 28, 2018 at 8:22 AM Peter Bacsko wrote: > +1 (non-binding) > > - Built from source at tag 3.2.0-rc0 (Ubuntu 18.10,

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-28 Thread Eric Payne
Sunil, So, the basic symptoms are that if preemption is enabled on any queue, the preemption is disabled after a 'yarn rm -refreshQueues'. In addition, all of the preemption-specific properties are set back to the default values. This was introduced in branch-3.1, so it is NOT new behavior for

[jira] [Created] (MAPREDUCE-7167) Extra LF ("\n") pushed directly to storage

2018-11-28 Thread Saurabh (JIRA)
Saurabh created MAPREDUCE-7167: -- Summary: Extra LF ("\n") pushed directly to storage Key: MAPREDUCE-7167 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7167 Project: Hadoop Map/Reduce

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-28 Thread Eric Payne
Sunil, thanks for all of the hard work on this release. I have discovered that queue refresh doesn't work in some cases. For example, when I change yarn.scheduler.capacity.root.default.disable_preemption, it doesn't take effect unless I restart the RM. I am still investigating, but I thought I

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-28 Thread Peter Bacsko
+1 (non-binding) - Built from source at tag 3.2.0-rc0 (Ubuntu 18.10, JDK1.8.0_191) - Verified checksums of hadoop-3.2.0.tar.gz - Installed on a 3-node physical cluster - Ran teragen/terasort/teravalidate - Ran distributed shell a couple of times - Checked UIs (RM, NM, DN, JHS) Peter On Wed, Nov

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-28 Thread Jason Lowe
Thanks for driving this release, Sunil! +1 (binding) - Verified signatures and digests - Successfully performed a native build - Deployed a single-node cluster - Ran some sample jobs Jason On Fri, Nov 23, 2018 at 6:07 AM Sunil G wrote: > Hi folks, > > > > Thanks to all contributors who

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-11-28 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/971/ [Nov 27, 2018 7:31:22 AM] (nanda) HDDS-868. Handle quasi closed container replicas in SCM. Contributed by [Nov 27, 2018 9:03:38 AM] (sunilg) YARN-9058. [CSI] YARN service fail to launch due to CSI

[jira] [Created] (MAPREDUCE-7166) map-only job should ignore node lost event when task is already succeeded

2018-11-28 Thread Zhaohui Xin (JIRA)
Zhaohui Xin created MAPREDUCE-7166: -- Summary: map-only job should ignore node lost event when task is already succeeded Key: MAPREDUCE-7166 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7166