Thanks @Konstantin for reporting this issue, I will post comments on the
JIRA (HADOOP-15205)
- Wangda
On Tue, Apr 10, 2018 at 12:08 PM, Konstantin Shvachko
wrote:
> A note to release managers. As discussed in
> https://issues.apache.org/jira/browse/HADOOP-15205
> We are producing release artifa
A note to release managers. As discussed in
https://issues.apache.org/jira/browse/HADOOP-15205
We are producing release artifacts without sources jars. See e.g.
https://repository.apache.org/content/repositories/releases/org/apache/hadoop/hadoop-common/3.1.0/
I believe this has something to do with
Thanks guys for the additional votes! I just sent out announcement email.
Best,
Wangda
On Fri, Apr 6, 2018 at 2:32 AM, 俊平堵 wrote:
> Thanks Wangda for the great work! Sorry for my late coming +1 (binding),
> based on:
>
> - Verified signatures
>
> - Verified checksums for source and binary artif
Thanks Wangda for the great work! Sorry for my late coming +1 (binding),
based on:
- Verified signatures
- Verified checksums for source and binary artifacts
- Built from source
- Deployed a single node cluster
- Verified web UIs, include Namenode, RM, etc.
* Tried shell commands of HDFS and
S web UIs
> * Tried out HDFS shell commands
> * Ran sample MapReduce jobs
>
> Thanks!
>
>
> --
> From: Wangda Tan
> Date: Monday, April 2, 2018 at 9:25 PM
> To: Ar
> * Ran sample MapReduce jobs
>
> Thanks!
>
>
> --
> From: Wangda Tan
> Date: Monday, April 2, 2018 at 9:25 PM
> To: Arpit Agarwal
> Cc: Gera Shegalov , Sunil G , "
> yarn-...@hadoop.apache.org&q
ameNode HA
>>> * Verified HDFS web UIs
>>> * Tried out HDFS shell commands
>>> * Ran sample MapReduce jobs
>>>
>>> Thanks!
>>>
>>>
>>> --
>>> F
t; > >
> > > +1 (binding), modulo that remaining question.
> > >
> > > * Verified signatures
> > > * Verified checksums for source and binary artefacts
> > > * Sanity checked jars on r.a.o.
> > > * Built from source
> > > *
gt; * Deployed to 3 node secure cluster with NameNode HA
> > * Verified HDFS web UIs
> > * Tried out HDFS shell commands
> > * Ran sample MapReduce jobs
> >
> > Thanks!
> >
> >
> > ---------------------
gt;>
> Date: Monday, April 2, 2018 at 9:25 PM
> To: Arpit Agarwal mailto:aagarwal@hortonworks.
> com>>
> Cc: Gera Shegalov mailto:ger...@gmail.com>>, Sunil G <
> sun...@apache.org<mailto:sun...@apache.org>>, "
> yarn-...@hadoop.apache.org<mailto:yarn-...@h
;>, Hadoop Common
mailto:common-dev@hadoop.apache.org>>,
"mapreduce-...@hadoop.apache.org<mailto:mapreduce-...@hadoop.apache.org>"
mailto:mapreduce-...@hadoop.apache.org>>,
Vinod Kumar Vavilapalli mailto:vino...@apache.org>>
Subject: Re: [VOTE] Release Apache Hadoop 3.1.0
gt;
>> Thanks!
>>
>>
>> --
>> From: Wangda Tan
>> Date: Monday, April 2, 2018 at 9:25 PM
>> To: Arpit Agarwal
>> Cc: Gera Shegalov , Sunil G , "
>> yarn-...@hadoop.apache.or
t;, "
> yarn-...@hadoop.apache.org <mailto:yarn-...@hadoop.apache.org>" <
> yarn-...@hadoop.apache.org <mailto:yarn-...@hadoop.apache.org>>, Hdfs-dev
> mailto:hdfs-...@hadoop.apache.org>>, Hadoop
> Common mailto:common-dev@hadoop.apache.org>>,
> "mapreduce-...
<mailto:hdfs-...@hadoop.apache.org>>, Hadoop Common
> mailto:common-dev@hadoop.apache.org>>,
> "mapreduce-...@hadoop.apache.org <mailto:mapreduce-...@hadoop.apache.org>"
> mailto:mapreduce-...@hadoop.apache.org>>,
> Vinod Kumar Vavilapalli mail
rom: Wangda Tan
> Date: Monday, April 2, 2018 at 9:25 PM
> To: Arpit Agarwal
> Cc: Gera Shegalov , Sunil G , "
> yarn-...@hadoop.apache.org" , Hdfs-dev <
> hdfs-...@hadoop.apache.org>, Hadoop Common ,
> "mapreduce-...@hadoop.apache.org" ,
> Vinod
+1 (binding)
Thanks Wangda for doing the work to produce this release.
I did the following to test the release:
- Built from source
- Installed on 6-node pseudo cluster
- Interacted with RM CLI and GUI
- Tested streaming jobs
- Tested yarn distributed shell jobs
- Tested Max AM Resource Percent
-
Built from source
> >>* Deployed to 3 node secure cluster with NameNode HA
> >>* Verified HDFS web UIs
> >>* Tried out HDFS shell commands
> >>* Ran sample MapReduce jobs
> >>
> >>Thanks!
> >>
> >>
> >>-------
>>
>>
>>--
>>From: Wangda Tan
>>Date: Monday, April 2, 2018 at 9:25 PM
>>To: Arpit Agarwal
>>Cc: Gera Shegalov , Sunil G ,
>>"yarn-...@hadoop.apache.org" , Hdfs-dev
>>, Hado
>From: Wangda Tan
>Date: Monday, April 2, 2018 at 9:25 PM
>To: Arpit Agarwal
>Cc: Gera Shegalov , Sunil G ,
>"yarn-...@hadoop.apache.org" , Hdfs-dev
>, Hadoop Common ,
>"mapreduce-...@hadoop.ap
, 2018 at 9:25 PM
To: Arpit Agarwal
Cc: Gera Shegalov , Sunil G ,
"yarn-...@hadoop.apache.org" , Hdfs-dev
, Hadoop Common ,
"mapreduce-...@hadoop.apache.org" , Vinod
Kumar Vavilapalli
Subject: Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)
As pointed by Arpit, the previo
1:25 PM
To: Arpit Agarwal
Cc: Gera Shegalov ; Sunil G ;
yarn-...@hadoop.apache.org; Hdfs-dev ; Hadoop
Common ; mapreduce-...@hadoop.apache.org; Vinod
Kumar Vavilapalli
Subject: Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)
As pointed by Arpit, the previously deployed shared jars are incor
+1 (binding)
Thanks for putting this together, Wangda.
I deployed a 7-node hadoop cluster and:
- ran various MR jobs
- ran the same jobs with a mix of opportunistic containers via centralized
scheduling
- ran the jobs with opportunistic containers and distributed scheduling
- ran some jobs with v
As pointed by Arpit, the previously deployed shared jars are incorrect.
Just redeployed jars and staged. @Arpit, could you please check the updated
Maven repo?
https://repository.apache.org/content/repositories/orgapachehadoop-1092
Since the jars inside binary tarballs are correct (
http://people.
Hi Arpit,
Thanks for pointing out this.
I just removed all .md5 files from artifacts. I found md5 checksums still
exist in .mds files and I didn't remove them from .mds file because it is
generated by create-release script and Apache guidance is "should not"
instead of "must not". Please let me k
Thanks for putting together this RC, Wangda.
The guidance from Apache is to omit MD5s, specifically:
> SHOULD NOT supply a MD5 checksum file (because MD5 is too broken).
https://www.apache.org/dev/release-distribution#sigs-and-sums
On Apr 2, 2018, at 7:03 AM, Wangda Tan
mailto:wheele...@gma
Hi Gera,
It's my bad, I thought only src/bin tarball is enough.
I just uploaded all other things under artifact/ to
http://people.apache.org/~wangda/hadoop-3.1.0-RC1/
Please let me know if you have any other comments.
Thanks,
Wangda
On Mon, Apr 2, 2018 at 12:50 AM, Gera Shegalov wrote:
> Th
+1 (binding)
On Mon 2 Apr, 2018, 12:24 Sunil G, wrote:
> Thanks Wangda for initiating the release.
>
> I tested this RC built from source file.
>
>
>- Tested MR apps (sleep, wc) and verified both new YARN UI and old RM
>UI.
>- Below feature sanity is done
> - Application priori
Thanks, Wangda!
There are many more artifacts in previous votes, e.g., see
http://home.apache.org/~junping_du/hadoop-2.8.3-RC0/ . Among others the
site tarball is missing.
On Sun, Apr 1, 2018 at 11:54 PM Sunil G wrote:
> Thanks Wangda for initiating the release.
>
> I tested this RC built from
Thanks Wangda for initiating the release.
I tested this RC built from source file.
- Tested MR apps (sleep, wc) and verified both new YARN UI and old RM UI.
- Below feature sanity is done
- Application priority
- Application timeout
- Intra Queue preemption with priority
Hi Wangda
+1 (non-binding)
- Smoke tests with teragen/terasort/DS jobs
- Various of metrics, UI displays validation, compatible tests
- Tested GPU resource-type
- Verified RM fail-over, app-recovery
- Verified 2 threads async-scheduling
- Enabled placement constraints, tested affinity/anti-affini
Wangda thanks for driving this.
+1(binding)
--Built from source
--Installed HA cluster
--Verified Basic Shell commands
--Ran Sample Jobs
--Browsed the UI's.
On Fri, Mar 30, 2018 at 9:45 AM, Wangda Tan wrote:
> Hi folks,
>
> Thanks to the many who helped with this release since Dec 2017 [1]. W
+1 (binding)
* Downloaded source, built from source with -Dhbase.profile=2.0.
* Installed RM HA cluster integrated with ATSv2. Installed HBase-2.0-beta1
for ATSv2 back end. Scheduler is configured with 2 level queue hierarchy.
* Ran sample jobs such as MR/Distributed shell and verified for
** ATS
Thanks Wangda for working on this!
+1 (non-binding)
- Downloaded the binary tarball and verified the checksum.
- Started a pseudo cluster inside one docker container
- Run Resource Manager with Fair Scheduler
- Verified distributed shell
- Verified mapreduce pi job
- Sanity che
Hi folks,
Thanks to the many who helped with this release since Dec 2017 [1]. We've
created RC1 for Apache Hadoop 3.1.0. The artifacts are available here:
http://people.apache.org/~wangda/hadoop-3.1.0-RC1
The RC tag in git is release-3.1.0-RC1. Last git commit SHA is
16b70619a24cdcf5d3b0fcf4b58c
34 matches
Mail list logo
