Re: [ANNOUNCE] Apache Hadoop 3.0.0 GA is released

2017-12-14 Thread Weiwei Yang
Hi Andrew

Congratulations on the 3.0 GA, another mile stone of Hadoop history. Thanks for 
driving this release, excellent work!
Took a look at the release notes, also seems nice. But one question, who is 
maintaining https://wiki.apache.org/hadoop/PoweredBy? Some of info is quite out 
of date, would like to know how to update.

Thanks

--
Weiwei

On 15 Dec 2017, 2:45 AM +0800, Andrew Wang , wrote:
Hi all,

I'm pleased to announce that Apache Hadoop 3.0.0 is generally available
(GA).

3.0.0 GA consists of 302 bug fixes, improvements, and other enhancements
since 3.0.0-beta1. This release marks a point of quality and stability for
the 3.0.0 release line, and users of earlier 3.0.0-alpha and -beta releases
are encouraged to upgrade.

Looking back, 3.0.0 GA is the culmination of over a year of work on the
3.0.0 line, starting with 3.0.0-alpha1 which was released in September
2016. Altogether, 3.0.0 incorporates 6,242 changes since 2.7.0.

Users are encouraged to read the overview of major changes
 in 3.0.0. The GA release
notes


Re: [VOTE] Release Apache Hadoop 2.7.5 (RC1)

2017-12-14 Thread Zhe Zhang
Great work Konstantin.

+1 (binding)
- Downloaded both source and binary tar files and verified checksums
- Deployed pseudo-distributed cluster and verified basic HDFS operations
(mkdir, copyFromLocal)
- Verified both NameNode and RM UIs

On Wed, Dec 13, 2017 at 12:05 PM Jonathan Hung  wrote:

> Thanks Konstantin for working on this.
>
> +1 (non-binding)
> - Downloaded binary and verified md5
> - Deployed RM HA and tested failover
>
>
>
>
> Jonathan Hung
>
> On Wed, Dec 13, 2017 at 11:02 AM, Eric Payne  .invalid
> > wrote:
>
> > Thanks for the hard work on this release, Konstantin.
> > +1 (binding)
> > - Built from source
> > - Verified that refreshing of queues works as expected.
> >
> > - Verified can run multiple users in a single queue
> > - Ran terasort test
> > - Verified that cross-queue preemption works as expected
> > Thanks. Eric Payne
> >
> >   From: Konstantin Shvachko 
> >  To: "common-...@hadoop.apache.org" ; "
> > hdfs-...@hadoop.apache.org" ; "
> > mapreduce-...@hadoop.apache.org" ; "
> > yarn-dev@hadoop.apache.org" 
> >  Sent: Thursday, December 7, 2017 9:22 PM
> >  Subject: [VOTE] Release Apache Hadoop 2.7.5 (RC1)
> >
> > Hi everybody,
> >
> > I updated CHANGES.txt and fixed documentation links.
> > Also committed  MAPREDUCE-6165, which fixes a consistently failing test.
> >
> > This is RC1 for the next dot release of Apache Hadoop 2.7 line. The
> > previous one 2.7.4 was release August 4, 2017.
> > Release 2.7.5 includes critical bug fixes and optimizations. See more
> > details in Release Note:
> > http://home.apache.org/~shv/hadoop-2.7.5-RC1/releasenotes.html
> >
> > The RC0 is available at: http://home.apache.org/~shv/hadoop-2.7.5-RC1/
> >
> > Please give it a try and vote on this thread. The vote will run for 5
> days
> > ending 12/13/2017.
> >
> > My up to date public key is available from:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > Thanks,
> > --Konstantin
> >
> >
> >
> >
>
-- 
Zhe Zhang
Apache Hadoop Committer
http://zhe-thoughts.github.io/about/ | @oldcap


Re: Apache YARN Committers & Contributors Meetup #5

2017-12-14 Thread Sunil G
Hi All,

Bangalore Hadoop Meetup was recently conducted @Microsoft campus on Dec 8th
almost in line with YARN Contributors Meetup @CA. Many thanks to Newton
from MS for organizing this quickly.

Quick Update about this:
1. We had *150*+ participants for this event which was one of the best
turnout for Hadoop specific meetup in recent times.
2. There were 5 talks in total and majority of the talks were on YARN
(scale/GPU etc). Also shared meetup link below for detailed schedule.
3. We were happy to see a excellent turn out from all Hadoop/YARN
committers and contributors @Bangalore for this event.
4. Discussed majorly about upcoming Hadoop 3.0 and next major releases in
same line. Lot of interests on Resource types / GPU scheduling / EC etc and
also doubts about rolling upgrade to Hadoop 3.

Meetup Link: (Slides and Videos will be shared in same link shortly)
http://meetup.com/Bangalore-Hadoop-Meetups/events/245123037/

Thanks once again to all folks who joined. We will plan a Bug Bash in same
timeline when Meetup #5 is going to happen at CA.

Warm Regards,
Sunil G



On Sat, Dec 2, 2017 at 3:55 AM Daniel Templeton  wrote:

> And thanks to Vinod we now have an official Meetup online:
>
> https://www.meetup.com/Hadoop-Contributors/events/245569075/
>
> Daniel
>
> On 11/22/17 12:20 PM, Daniel Templeton wrote:
> > We're long past due for another contributors meetup.  Cloudera is
> > excited to host this event at our new Palo Alto Galactic Headquarters
> > (
> https://www.google.com/maps/place/Cloudera+Galactic+HQ/@37.4254615,-122.1413431,17z
> )
> > on December 6th from 2pm-5pm PST.  We will have a Google Hangout set
> > up so that remote participants can dial in.  We will also provide
> > drinks and snacks.
> >
> > Our agenda will be roughly:
> >
> > * Celebrate Hadoop 3.0.0, identify any loose ends, and talk about 3.0.1
> > * Planning around Hadoop 3.1.0
> > * Planning around the branch-2 releases, Hadoop 2.10.0, etc.
> > * Key signing
> > * Plan for the next bug bash
> >
> > Hope to see you there!
> > Daniel
> >
> > PS: I wasn't able to figure out how to create an event in our meetup
> > group for this.  Anyone want to give me a pointer or set it up?
>
>
> -
> To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
>
>


[ANNOUNCE] Apache Hadoop 3.0.0 GA is released

2017-12-14 Thread Andrew Wang
Hi all,

I'm pleased to announce that Apache Hadoop 3.0.0 is generally available
(GA).

3.0.0 GA consists of 302 bug fixes, improvements, and other enhancements
since 3.0.0-beta1. This release marks a point of quality and stability for
the 3.0.0 release line, and users of earlier 3.0.0-alpha and -beta releases
are encouraged to upgrade.

Looking back, 3.0.0 GA is the culmination of over a year of work on the
3.0.0 line, starting with 3.0.0-alpha1 which was released in September
2016. Altogether, 3.0.0 incorporates 6,242 changes since 2.7.0.

Users are encouraged to read the overview of major changes
 in 3.0.0. The GA release
notes

 and changelog

detail
the changes since 3.0.0-beta1.

The ASF press release provides additional color and highlights some of the
major features:

https://globenewswire.com/news-release/2017/12/14/1261879/0/en/The-Apache-Software-Foundation-Announces-Apache-Hadoop-v3-0-0-General-Availability.html

Let me end by thanking the many, many contributors who helped with this
release line. We've only had three major releases in Hadoop's 10 year
history, and this is our biggest major release ever. It's an incredible
accomplishment for our community, and I'm proud to have worked with all of
you.

Best,
Andrew


[jira] [Resolved] (YARN-7658) Capacity scheduler UI hangs when rendering if labels are present

2017-12-14 Thread Eric Payne (JIRA)

 [ 
https://issues.apache.org/jira/browse/YARN-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Eric Payne resolved YARN-7658.
--
Resolution: Duplicate

> Capacity scheduler UI hangs when rendering if labels are present
> 
>
> Key: YARN-7658
> URL: https://issues.apache.org/jira/browse/YARN-7658
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: capacity scheduler
>Reporter: Eric Payne
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org



[jira] [Created] (YARN-7658) Capacity scheduler UI hangs when rendering if labels are present

2017-12-14 Thread Eric Payne (JIRA)
Eric Payne created YARN-7658:


 Summary: Capacity scheduler UI hangs when rendering if labels are 
present
 Key: YARN-7658
 URL: https://issues.apache.org/jira/browse/YARN-7658
 Project: Hadoop YARN
  Issue Type: Bug
  Components: capacity scheduler
Reporter: Eric Payne






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org



Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-12-14 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/622/

[Dec 13, 2017 5:19:58 PM] (sunilg) YARN-7643. Handle recovery of applications 
in case of auto-created leaf
[Dec 13, 2017 9:05:32 PM] (wang) Update CHANGES, RELEASENOTES, jdiff for 3.0.0 
release.
[Dec 13, 2017 10:56:14 PM] (cliang) HADOOP-14914. Change to a safely casting 
long to int. Contributed by
[Dec 14, 2017 12:29:04 AM] (eyang) YARN-7540.  Route YARN service CLI function 
through YARN Service API.
[Dec 14, 2017 3:05:11 AM] (zhengkai.zk) Revert "HADOOP-15039. Move 
SemaphoredDelegatingExecutor to
[Dec 14, 2017 3:14:52 AM] (zhengkai.zk) HADOOP-15039. Move 
SemaphoredDelegatingExecutor to hadoop-common.
[Dec 14, 2017 8:00:53 AM] (yqlin) HDFS-12883. RBF: Document Router and State 
Store metrics. Contributed by
[Dec 14, 2017 10:41:57 AM] (sunilg) YARN-7119. Support multiple resource types 
in rmadmin updateNodeResource
[Dec 14, 2017 3:45:44 PM] (jlowe) HDFS-12881. Output streams closed with 
IOUtils suppressing write errors.
[Dec 14, 2017 4:18:08 PM] (jlowe) HADOOP-15085. Output streams closed with 
IOUtils suppressing write

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-7657) Queue Mapping could provide options to provide 'user' specific auto-created queues under a specified group parent queue

2017-12-14 Thread Suma Shivaprasad (JIRA)
Suma Shivaprasad created YARN-7657:
--

 Summary: Queue Mapping could provide options to provide 'user' 
specific auto-created queues under a specified group parent queue
 Key: YARN-7657
 URL: https://issues.apache.org/jira/browse/YARN-7657
 Project: Hadoop YARN
  Issue Type: Sub-task
Reporter: Suma Shivaprasad
Assignee: Suma Shivaprasad


Current Queue-Mapping only provides %user as an option for 'user' specific 
queues as u:%user:%user. We can also support %user with group as 
'g:makerting-group:marketing.%user'  and user specific queues can be 
automatically created under a group queue in this case.

cc [~leftnoteasy]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org