[jira] [Created] (HADOOP-13353) LdapGroupsMapping getPassward shouldn't return null when IOException throws
Zhaohao Liang created HADOOP-13353: -- Summary: LdapGroupsMapping getPassward shouldn't return null when IOException throws Key: HADOOP-13353 URL: https://issues.apache.org/jira/browse/HADOOP-13353 Project: Hadoop Common Issue Type: Bug Components: security Affects Versions: 2.6.0 Reporter: Zhaohao Liang When IOException throws in getPassword(), getPassword() return null String, this will cause setConf() throws java.lang.NullPointerException when check isEmpty() on null string. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13352) Make X-FRAME-OPTIONS configurable in HttpServer2
Anu Engineer created HADOOP-13352: - Summary: Make X-FRAME-OPTIONS configurable in HttpServer2 Key: HADOOP-13352 URL: https://issues.apache.org/jira/browse/HADOOP-13352 Project: Hadoop Common Issue Type: Bug Components: net, security Reporter: Anu Engineer Assignee: Anu Engineer Fix For: 2.9.0 In HADOOP-12964 we introduced support for X-FRAME-OPTIONS in HttpServer2. This JIRA makes it configurable. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13351) TestDFSClientSocketSize buffer size tests are flaky
Aaron Fabbri created HADOOP-13351:
-
Summary: TestDFSClientSocketSize buffer size tests are flaky
Key: HADOOP-13351
URL: https://issues.apache.org/jira/browse/HADOOP-13351
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 2.8.0, 3.0.0-alpha1
Reporter: Aaron Fabbri
{{TestDFSClientSocketSize}} has two tests that assert that a value that was set
via {{java.net.Socket#setSendBufferSize}} is equal to the value subsequently
returned by {{java.net.Socket#getSendBufferSize}}.
These tests are flaky when we run them. The occasionally fail.
This is expected behavior, actually, because {{Socket#setSendBufferSize()}}[is
only a
hint|https://docs.oracle.com/javase/7/docs/api/java/net/Socket.html#setSendBufferSize(int)].
(Similar to how the underlying libc {{setsockopt(SO_SNDBUF)}} works).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Reopened] (HADOOP-13335) Add an option to suppress the 'use yarn jar' warning or remove it
[ https://issues.apache.org/jira/browse/HADOOP-13335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reopened HADOOP-13335: - [~aw] - lets try coming to a conclusion here. Re-opening. Kindly do not close the ticket till there's a resolution. > Add an option to suppress the 'use yarn jar' warning or remove it > - > > Key: HADOOP-13335 > URL: https://issues.apache.org/jira/browse/HADOOP-13335 > Project: Hadoop Common > Issue Type: Improvement >Affects Versions: 2.7.0 >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Attachments: HADOOP-13335.01.patch, HADOOP-13335.02.patch, > HADOOP-13335.02_branch-2.patch, HADOOP-13335.03.patch, > HADOOP-13335.03_branch-2.patch, HADOOP-13335.04.patch > > > https://issues.apache.org/jira/browse/HADOOP-11257 added a 'deprecation' > warning for 'hadoop jar'. > hadoop jar is used for a lot more that starting jobs. As an example - hive > uses it to start all it's services (HiveServer2, the hive client, beeline > etc). > Using 'yarn jar' for to start these services / tools doesn't make a lot of > sense - there's no relation to yarn other than requiring the classpath to > include yarn libraries. > I'd propose reverting the changes where this message is printed if YARN > variables are set (leave it in the help message), or adding a mechanism which > would allow users to suppress this WARNING. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13350) Additional fix to LICENSE and NOTICE
Xiao Chen created HADOOP-13350: -- Summary: Additional fix to LICENSE and NOTICE Key: HADOOP-13350 URL: https://issues.apache.org/jira/browse/HADOOP-13350 Project: Hadoop Common Issue Type: Bug Affects Versions: 2.8.0, 3.0.0-alpha1 Reporter: Xiao Chen Assignee: Xiao Chen Priority: Blocker Fix up LICENSE and NOTICE after HADOOP-12893. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/87/
[Jul 6, 2016 5:36:48 PM] (wangda) YARN-5294. Pass remote ip address down to
YarnAuthorizationProvider.
[Jul 6, 2016 5:43:27 PM] (jianhe) YARN-5227. Yarn logs command: no need to
specify applicationId when
[Jul 6, 2016 9:10:54 PM] (vinodkv) YARN-5224. Added new web-services
/containers/{containerid}/logs &
[Jul 6, 2016 11:44:46 PM] (jianhe) YARN-5233. Support for specifying a path for
ATS plugin jars.
[Jul 7, 2016 12:51:42 AM] (aajisaka) HDFS-10582. Change deprecated
configuration fs.checkpoint.dir to
-1 overall
The following subsystems voted -1:
mvnsite unit
The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace
The following subsystems are considered long running:
(runtime bigger than 1h 0m 0s)
unit
Specific tests:
Failed junit tests :
hadoop.hdfs.TestEncryptionZones
hadoop.yarn.server.TestMiniYarnClusterNodeUtilization
hadoop.yarn.server.TestContainerManagerSecurity
hadoop.yarn.client.cli.TestLogsCLI
hadoop.yarn.client.api.impl.TestYarnClient
cc:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/87/artifact/out/diff-compile-cc-root.txt
[4.0K]
javac:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/87/artifact/out/diff-compile-javac-root.txt
[168K]
checkstyle:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/87/artifact/out/diff-checkstyle-root.txt
[16M]
mvnsite:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/87/artifact/out/patch-mvnsite-root.txt
[112K]
pylint:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/87/artifact/out/diff-patch-pylint.txt
[16K]
shellcheck:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/87/artifact/out/diff-patch-shellcheck.txt
[20K]
shelldocs:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/87/artifact/out/diff-patch-shelldocs.txt
[8.0K]
whitespace:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/87/artifact/out/whitespace-eol.txt
[12M]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/87/artifact/out/whitespace-tabs.txt
[1.3M]
javadoc:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/87/artifact/out/diff-javadoc-javadoc-root.txt
[2.3M]
unit:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/87/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
[192K]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/87/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
[268K]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/87/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
[16K]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/87/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt
[124K]
Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)
Thanks all for the discussion. I merged it on 2nd July :-) I think the last task about JDK 8 compilation support is to configure maven-enforcer-plugin. Thanks, - Tsuyoshi On Wed, Jul 6, 2016 at 3:41 AM, Ravi Prakash wrote: > Go Go Go! Thanks for all the upgrade work Tsuyoshi! > > On Thu, Jun 30, 2016 at 12:03 PM, Tsuyoshi Ozawa wrote: >> >> Thanks, Andrew. >> >> Based on discussion here, I would like to merge it into *trunk* if >> there are no objection tomorrow. >> >> Thanks, >> - Tsuyoshi >> >> On Wed, Jun 29, 2016 at 12:28 PM, Andrew Wang >> wrote: >> > I think it's okay to merge. We've already bumped other deps in trunk. >> > >> > On Wed, Jun 29, 2016 at 12:27 PM, Tsuyoshi Ozawa >> > wrote: >> >> >> >> I forgot to mention about importance point: it's a blocker issue to >> >> compile Hadoop with JDK8. Hence, we need to merge it on both client >> >> side and server slide anyway. >> >> >> >> Thanks, >> >> - Tsuyoshi >> >> >> >> On Wed, Jun 29, 2016 at 12:24 PM, Tsuyoshi Ozawa >> >> wrote: >> >> > Thanks Vinod, Sangjin, Sean for your comment. >> >> > >> >> > Okay, I will take a look at the class path isolation. >> >> > Should I postpone to merge Guice upgrade to trunk? IMHO, it works >> >> > with >> >> > tests, so it's okay to merge to runk. Thoughts? >> >> > >> >> > - Tsuyoshi >> >> > >> >> > On Wed, Jun 29, 2016 at 12:10 PM, Sangjin Lee >> >> > wrote: >> >> >> Yeah it would be awesome if we can get feedback and/or suggestions >> >> >> on >> >> >> these >> >> >> JIRAs (HADOOP-11804 and HADOOP-13070). >> >> >> >> >> >> Thanks, >> >> >> Sangjin >> >> >> >> >> >> On Wed, Jun 29, 2016 at 10:55 AM, Sean Busbey >> >> >> wrote: >> >> >>> >> >> >>> At the very least, I'm running through an updated shaded hadoop >> >> >>> client >> >> >>> this week[1] (HBase is my test application and it wandered onto >> >> >>> some >> >> >>> private things that broke in branch-2). And Sangjin has a good lead >> >> >>> on >> >> >>> an lower-short-term-cost incremental improvement for runtime >> >> >>> isolation >> >> >>> of apps built on yarn/mapreduce[2]. He's been patiently waiting for >> >> >>> more review feedback. >> >> >>> >> >> >>> >> >> >>> [1]: https://issues.apache.org/jira/browse/HADOOP-11804 >> >> >>> [2]: https://issues.apache.org/jira/browse/HADOOP-13070 >> >> >>> >> >> >>> On Wed, Jun 29, 2016 at 12:33 PM, Vinod Kumar Vavilapalli >> >> >>> wrote: >> >> >>> > My strong expectation is that we’ll have a version of classpath >> >> >>> > isolation in our first release of 3.x. I’m planning to spending >> >> >>> > some >> >> >>> > cycles >> >> >>> > right away on this. >> >> >>> > >> >> >>> > Assuming classpath isolation gets in, it is reasonable to bump up >> >> >>> > our >> >> >>> > dependencies like Jetty / Guice to the latest stable versions. >> >> >>> > >> >> >>> > Thanks >> >> >>> > +Vinod >> >> >>> > >> >> >>> >> On Jun 27, 2016, at 6:01 AM, Tsuyoshi Ozawa >> >> >>> >> wrote: >> >> >>> >> >> >> >>> >> Hi developers, >> >> >>> >> >> >> >>> >> I will plan to upgrade Google Guice dependency on trunk. The >> >> >>> >> change >> >> >>> >> also includes asm and cglib upgrade. >> >> >>> >> I checked following points: >> >> >>> >> >> >> >>> >> * Both HDFS and YARN UIs work well. >> >> >>> >> * All webIU-related tests pass as described on HADOOP-12064. >> >> >>> >> * Ran mapreduce job, and it works well. >> >> >>> >> >> >> >>> >> https://issues.apache.org/jira/browse/HADOOP-12064 >> >> >>> >> >> >> >>> >> Do you have any concern or opinion? I would like to merge it to >> >> >>> >> trunk >> >> >>> >> on this Friday if you have no objections. >> >> >>> >> >> >> >>> >> Best, >> >> >>> >> - Tsuyoshi >> >> >>> >> >> >> >>> >> >> >> >>> >> >> >> >>> >> - >> >> >>> >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org >> >> >>> >> For additional commands, e-mail: >> >> >>> >> common-dev-h...@hadoop.apache.org >> >> >>> >> >> >> >>> >> >> >> >>> > >> >> >>> > >> >> >>> > >> >> >>> > >> >> >>> > - >> >> >>> > To unsubscribe, e-mail: >> >> >>> > mapreduce-dev-unsubscr...@hadoop.apache.org >> >> >>> > For additional commands, e-mail: >> >> >>> > mapreduce-dev-h...@hadoop.apache.org >> >> >>> > >> >> >>> >> >> >>> >> >> >>> >> >> >>> -- >> >> >>> busbey >> >> >>> >> >> >>> >> >> >>> - >> >> >>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org >> >> >>> For additional commands, e-mail: common-dev-h...@hadoop.apache.org >> >> >>> >> >> >> >> >> >> >> - >> >> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org >> >> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org >> >> >> > >> >> - >> To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.a
[jira] [Created] (HADOOP-13349) HADOOP_CLASSPATH vs HADOOP_USER_CLASSPATH
Allen Wittenauer created HADOOP-13349: - Summary: HADOOP_CLASSPATH vs HADOOP_USER_CLASSPATH Key: HADOOP-13349 URL: https://issues.apache.org/jira/browse/HADOOP-13349 Project: Hadoop Common Issue Type: Bug Components: scripts Affects Versions: 3.0.0-alpha1 Reporter: Allen Wittenauer Assignee: Allen Wittenauer Priority: Blocker There seems to be some confusion in HADOOP_CLASSPATH vs. HADOOP_USER_CLASSPATH in the code and documentation, especially since HADOOP_USER_CLASSPATH doesn't appear to be wired up. This needs to to get fixed ASAP. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
