Re: [DISCUSS] official docker image(s) for hadoop

2017-09-13 Thread Mingliang Liu
> It would be very helpful for testing the RC. For testing and voting, I have been using docker containers for a while, see code at: https://github.com/weiqingy/caochong > TL;DR: I propose to create official hadoop images and upload them to the >

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-09-13 Thread Jian He
Hi Allen, Thanks for sharing the feedback. I opened YARN-7191 for addressing the feedback. We can move the discussions there. Thanks, Jian > On Sep 13, 2017, at 10:10 AM, Allen Wittenauer > wrote: > > >> On Sep 8, 2017, at 9:25 AM, Jian He

Re: [DISCUSS] official docker image(s) for hadoop

2017-09-13 Thread Yufei Gu
It would be very helpful for testing the RC. To vote a RC, committers and PMCs usually spend lots of time to compile, deploy the RC, do several sanity tests, then +1 for the RC. The docker image potentially saves the compilation and deployment time, and people can do more tests. Best, Yufei On

Re: [DISCUSS] official docker image(s) for hadoop

2017-09-13 Thread Bharat Viswanadham
+1 (non-binding) It would be really nice to have Docker to try different features of Hadoop (like HA, Federation Enabled, Erasure coding…), which will helpful for both developers and users. Thanks, Bharat On 9/13/17, 11:31 AM, "Eric Badger" wrote: +1

Re: [DISCUSS] official docker image(s) for hadoop

2017-09-13 Thread Eric Badger
+1 definitely think an official Hadoop docker image (possibly 1 per major or minor release) would be a positive both for contributors and for users of Hadoop. Eric On Wed, Sep 13, 2017 at 1:19 PM, Wangda Tan wrote: > +1 to add Hadoop docker image for easier testing /

[jira] [Created] (HADOOP-14867) Update HDFS Federation Document, for incorrect property name for secondary name node

2017-09-13 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HADOOP-14867: --- Summary: Update HDFS Federation Document, for incorrect property name for secondary name node Key: HADOOP-14867 URL:

Re: [DISCUSS] official docker image(s) for hadoop

2017-09-13 Thread Wangda Tan
+1 to add Hadoop docker image for easier testing / prototyping, it gonna be super helpful! Thanks, Wangda On Wed, Sep 13, 2017 at 10:48 AM, Miklos Szegedi < miklos.szeg...@cloudera.com> wrote: > Marton, thank you for working on this. I think Official Docker images for > Hadoop would be very

[jira] [Resolved] (HADOOP-14804) correct wrong parameters format order in core-default.xml

2017-09-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang resolved HADOOP-14804. - Resolution: Fixed > correct wrong parameters format order in core-default.xml >

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-09-13 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/522/ [Sep 12, 2017 4:19:09 PM] (wangda) YARN-4081. Add support for multiple resource types in the Resource [Sep 12, 2017 4:19:09 PM] (wangda) YARN-4172. Extend DominantResourceCalculator to account for all

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-09-13 Thread Allen Wittenauer
> On Sep 8, 2017, at 9:25 AM, Jian He wrote: > > Hi Allen, > The documentations are committed. Please check QuickStart.md and others in > the same folder. > YarnCommands.md doc is updated to include new commands. > DNS default port is also documented. > Would you like to

Re: impersonation in hadoop

2017-09-13 Thread Steve Loughran
On 13 Sep 2017, at 14:03, Srikrishan Malik > wrote: Hello, I was trying to understand how impersonation works in hadoop environment. I found a few resources like: About doAs and proxy users: http://dewoods.com/blog/hadoop-kerberos-guide and about

impersonation in hadoop

2017-09-13 Thread Srikrishan Malik
Hello, I was trying to understand how impersonation works in hadoop environment. I found a few resources like: About doAs and proxy users: http://dewoods.com/blog/hadoop-kerberos-guide and about tokens: https://hortonworks.com/blog/the-role-of-delegation-tokens-in-apache-hadoop-security/ .. But

[jira] [Created] (HADOOP-14866) Backport implementation of parallel block copy in Distcp to hadoop 2.8

2017-09-13 Thread Huafeng Wang (JIRA)
Huafeng Wang created HADOOP-14866: - Summary: Backport implementation of parallel block copy in Distcp to hadoop 2.8 Key: HADOOP-14866 URL: https://issues.apache.org/jira/browse/HADOOP-14866 Project: