Re: Should ToolRunner call UserGroupInformation.setConfiguration?

2017-07-26 Thread John Zhuge
The static UGI.conf is set to a new Configuration object in UGI.ensureInitialized if setConfiguration is not already called. ToolRunner.conf does take -D overrides but it is not copied to UGI.conf. On Wed, Jul 26, 2017 at 8:42 PM, John Zhuge wrote: > Hi Gurus, > > Unlike

Should ToolRunner call UserGroupInformation.setConfiguration?

2017-07-26 Thread John Zhuge
Hi Gurus, Unlike YarnChild, DN, NN, and many others, ToolRunner does not call UserGroupInformation.setConfiguration. Is this by design? The means you can not use "-D" to override any conf property used in UGI. The only direct call I found is: String cmd =

Some Questions about the Windows Build

2017-07-26 Thread Allen Wittenauer
I've noticed that in almost all of the (official) documentation, it's written that in order to build on Windows the maven command should be some form of: mvn package -Pdist,native-win -DskipTests The one constant is that the native-win profile is always listed. What's interesting is that

[jira] [Created] (HADOOP-14689) Dummy jira for testing barnch-2.7 build.

2017-07-26 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HADOOP-14689: Summary: Dummy jira for testing barnch-2.7 build. Key: HADOOP-14689 URL: https://issues.apache.org/jira/browse/HADOOP-14689 Project: Hadoop Common

[jira] [Resolved] (HADOOP-14686) Branch-2.7 .gitignore is out of date

2017-07-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HADOOP-14686. -- Resolution: Fixed Hadoop Flags: Reviewed Also updated CHANGES.txt. I

[jira] [Reopened] (HADOOP-14686) Branch-2.7 .gitignore is out of date

2017-07-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reopened HADOOP-14686: -- Will have to revert this, because it also removed {{contract-test-options.xml}}

[jira] [Created] (HADOOP-14688) Intern strings in KeyVersion and EncryptedKeyVersion

2017-07-26 Thread Xiao Chen (JIRA)
Xiao Chen created HADOOP-14688: -- Summary: Intern strings in KeyVersion and EncryptedKeyVersion Key: HADOOP-14688 URL: https://issues.apache.org/jira/browse/HADOOP-14688 Project: Hadoop Common

Re: [DISCUSS] Looking to a 2.9.0 release

2017-07-26 Thread J. Rottinghuis
Thanks Vrushali for being entirely open as to the current status of ATSv2. I appreciate that we want to ensure things are tested at scale, and as you said we are working on that right now on our clusters. We have tested the feature to demonstrate it works at what we consider moderate scale. I

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-07-26 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/475/ [Jul 24, 2017 7:24:23 AM] (aajisaka) HDFS-12176. dfsadmin shows DFS Used%: NaN% if the cluster has zero [Jul 24, 2017 3:19:20 PM] (jlowe) YARN-6768. Improve performance of yarn api record toString and

[jira] [Created] (HADOOP-14687) AuthenticatedURL will reuse bad/expired session cookies

2017-07-26 Thread Daryn Sharp (JIRA)
Daryn Sharp created HADOOP-14687: Summary: AuthenticatedURL will reuse bad/expired session cookies Key: HADOOP-14687 URL: https://issues.apache.org/jira/browse/HADOOP-14687 Project: Hadoop Common

Re: [DISCUSS] Looking to a 2.9.0 release

2017-07-26 Thread Vrushali Channapattan
Thanks Subru for initiating this discussion. Wanted to share some thoughts in the context of Timeline Service v2. The current status of this module is that we are ramping up for a second merge to trunk. We still have a few merge blocker jiras outstanding, which we think we will finish soon.