[jira] [Resolved] (HADOOP-8515) Upgrade Jetty to the current Jetty 7 release
[ https://issues.apache.org/jira/browse/HADOOP-8515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-8515. Resolution: Duplicate Hadoop Flags: (was: Incompatible change) Upgrade Jetty to the current Jetty 7 release Key: HADOOP-8515 URL: https://issues.apache.org/jira/browse/HADOOP-8515 Project: Hadoop Common Issue Type: Improvement Reporter: Luke Lu Labels: jetty Attachments: hadoop_jetty.patch.v2 According to http://dev.eclipse.org/mhonarc/lists/jetty-announce/msg00026.html, jetty-6 has been effectively EOL since January. Let's bump jetty to the 7 series. The current jetty 6.1.26 contains at least one known vulnerability: CVE-2011-4461. Note this can be an incompatible change if you reference jetty-6 packages (org.mortbay.*). -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10790) http://hadoop.apache.org/index.html only lists versions up to 2.2
Steve Loughran created HADOOP-10790: --- Summary: http://hadoop.apache.org/index.html only lists versions up to 2.2 Key: HADOOP-10790 URL: https://issues.apache.org/jira/browse/HADOOP-10790 Project: Hadoop Common Issue Type: Bug Components: documentation Affects Versions: 2.4.1 Reporter: Steve Loughran Although the releases page is current, the [root index.html page|http://hadoop.apache.org/index.html] stops at release 2.2 -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10791) AuthenticationFilter should support externalizing the secret for signing and provide rotation support
Alejandro Abdelnur created HADOOP-10791: --- Summary: AuthenticationFilter should support externalizing the secret for signing and provide rotation support Key: HADOOP-10791 URL: https://issues.apache.org/jira/browse/HADOOP-10791 Project: Hadoop Common Issue Type: Improvement Components: security Affects Versions: 2.4.1 Reporter: Alejandro Abdelnur It should be possible to externalize the secret used to sign the hadoop-auth cookies. In the case of WebHDFS the shared secret used by NN and DNs could be used. In the case of Oozie HA, the secret could be stored in Oozie HA control data in ZooKeeper. In addition, it is desirable for the secret to change periodically, this means that the AuthenticationService should remember a previous secret for the max duration of hadoop-auth cookie. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (HADOOP-10785) UnsatisfiedLinkError in cryptocodec tests with OpensslCipher#initContext
[
https://issues.apache.org/jira/browse/HADOOP-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Colin Patrick McCabe resolved HADOOP-10785.
---
Resolution: Duplicate
UnsatisfiedLinkError in cryptocodec tests with OpensslCipher#initContext
Key: HADOOP-10785
URL: https://issues.apache.org/jira/browse/HADOOP-10785
Project: Hadoop Common
Issue Type: Sub-task
Components: fs
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G
Fix For: 3.0.0
{noformat}
java.lang.UnsatisfiedLinkError:
org.apache.hadoop.crypto.OpensslCipher.initContext(II)J
at org.apache.hadoop.crypto.OpensslCipher.initContext(Native Method)
at
org.apache.hadoop.crypto.OpensslCipher.getInstance(OpensslCipher.java:90)
at
org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec$OpensslAesCtrCipher.init(OpensslAesCtrCryptoCodec.java:73)
at
org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec.createEncryptor(OpensslAesCtrCryptoCodec.java:53)
at
org.apache.hadoop.crypto.CryptoOutputStream.init(CryptoOutputStream.java:95)
at
org.apache.hadoop.crypto.CryptoOutputStream.init(CryptoOutputStream.java:79)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
Build failed in Jenkins: Hadoop-Common-trunk #1164
See https://builds.apache.org/job/Hadoop-Common-trunk/1164/changes Changes: [suresh] HADOOP-10782. Fix typo in DataChecksum class. Contributed by Jingguo Yao. [cnauroth] HDFS-6617. Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op. Contributed by Liang Xie. -- [...truncated 8082 lines...] A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/impl/pb/ApplicationFinishDataPBImpl.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryManagerImpl.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryStore.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryWriter.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryClientService.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/FileSystemApplicationHistoryStore.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryReader.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/MemoryApplicationHistoryStore.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/NullApplicationHistoryStore.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AHSController.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/ContainerPage.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/NavBlock.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AHSView.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AHSWebApp.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/JAXBContextResolver.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AHSLogsPage.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AHSWebServices.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java A hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/timeline A
[jira] [Created] (HADOOP-10792) Add FileSystem#closeIfNotReferred method
Kousuke Saruta created HADOOP-10792: --- Summary: Add FileSystem#closeIfNotReferred method Key: HADOOP-10792 URL: https://issues.apache.org/jira/browse/HADOOP-10792 Project: Hadoop Common Issue Type: Improvement Components: fs Reporter: Kousuke Saruta FileSystem#close closes FileSystem even if the same instance of FileSystem is referred by someone. For instance, a library using FileSystem calls FileSystem.get, and a program using the library calls FileSystem.get, both of instances of FileSystem is same. When the library and the program is implemented as different threads and one calls FileSystem.close, another fails most of operations of FileSystem. So, we need the method like cloesIfNotReferred, which closes FileSystem only if a instance of FileSystem is not referred by anyone. -- This message was sent by Atlassian JIRA (v6.2#6252)
Build failed in Jenkins: Hadoop-Common-trunk #1165
See https://builds.apache.org/job/Hadoop-Common-trunk/1165/changes Changes: [cnauroth] MAPREDUCE-5866. TestFixedLengthInputFormat fails in windows. Contributed by Varun Vasudev. [vinodkv] MAPREDUCE-5868. Fixed an issue with TestPipeApplication that was causing the nightly builds to fail. Contributed by Akira Ajisaka. -- [...truncated 65678 lines...] Setting project property: settings.localRepository - /home/jenkins/.m2/repository Setting project property: org.apache.hadoop:hadoop-annotations:jar - https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-annotations/target/hadoop-annotations-3.0.0-SNAPSHOT.jar Setting project property: jdk.tools:jdk.tools:jar - /home/jenkins/tools/java/jdk1.6.0_20-32/jre/../lib/tools.jar Setting project property: com.google.guava:guava:jar - /home/jenkins/.m2/repository/com/google/guava/guava/11.0.2/guava-11.0.2.jar Setting project property: commons-cli:commons-cli:jar - /home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar Setting project property: org.apache.commons:commons-math3:jar - /home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar Setting project property: xmlenc:xmlenc:jar - /home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar Setting project property: commons-httpclient:commons-httpclient:jar - /home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar Setting project property: commons-codec:commons-codec:jar - /home/jenkins/.m2/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar Setting project property: commons-io:commons-io:jar - /home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar Setting project property: commons-net:commons-net:jar - /home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar Setting project property: commons-collections:commons-collections:jar - /home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar Setting project property: javax.servlet:servlet-api:jar - /home/jenkins/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar Setting project property: org.mortbay.jetty:jetty:jar - /home/jenkins/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar Setting project property: org.mortbay.jetty:jetty-util:jar - /home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar Setting project property: javax.servlet.jsp:jsp-api:jar - /home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar Setting project property: com.sun.jersey:jersey-core:jar - /home/jenkins/.m2/repository/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar Setting project property: com.sun.jersey:jersey-json:jar - /home/jenkins/.m2/repository/com/sun/jersey/jersey-json/1.9/jersey-json-1.9.jar Setting project property: org.codehaus.jettison:jettison:jar - /home/jenkins/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar Setting project property: com.sun.xml.bind:jaxb-impl:jar - /home/jenkins/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar Setting project property: javax.xml.bind:jaxb-api:jar - /home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar Setting project property: javax.xml.stream:stax-api:jar - /home/jenkins/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar Setting project property: javax.activation:activation:jar - /home/jenkins/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar Setting project property: org.codehaus.jackson:jackson-jaxrs:jar - /home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar Setting project property: org.codehaus.jackson:jackson-xc:jar - /home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar Setting project property: com.sun.jersey:jersey-server:jar - /home/jenkins/.m2/repository/com/sun/jersey/jersey-server/1.9/jersey-server-1.9.jar Setting project property: asm:asm:jar - /home/jenkins/.m2/repository/asm/asm/3.2/asm-3.2.jar Setting project property: commons-logging:commons-logging:jar - /home/jenkins/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar Setting project property: log4j:log4j:jar - /home/jenkins/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar Setting project property: net.java.dev.jets3t:jets3t:jar - /home/jenkins/.m2/repository/net/java/dev/jets3t/jets3t/0.9.0/jets3t-0.9.0.jar Setting project property: org.apache.httpcomponents:httpclient:jar - /home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar Setting project property: org.apache.httpcomponents:httpcore:jar - /home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.2.5/httpcore-4.2.5.jar Setting project property: com.jamesmurty.utils:java-xmlbuilder:jar -
Build failed in Jenkins: Hadoop-Common-trunk #1166
See https://builds.apache.org/job/Hadoop-Common-trunk/1166/changes Changes: [vinodkv] MAPREDUCE-5517. Fixed MapReduce ApplicationMaster to not validate reduce side resource configuration for deciding uber-mode on map-only jobs. Contributed by Siqi Li. -- [...truncated 33016 lines...] Setting project property: com.jcraft:jsch:jar - /home/jenkins/.m2/repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar Setting project property: com.google.code.findbugs:jsr305:jar - /home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar Setting project property: org.apache.zookeeper:zookeeper:jar - /home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar Setting project property: io.netty:netty:jar - /home/jenkins/.m2/repository/io/netty/netty/3.6.2.Final/netty-3.6.2.Final.jar Setting project property: org.apache.zookeeper:zookeeper:test-jar:tests - /home/jenkins/.m2/repository/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6-tests.jar Setting project property: jline:jline:jar - /home/jenkins/.m2/repository/jline/jline/0.9.94/jline-0.9.94.jar Setting project property: org.apache.commons:commons-compress:jar - /home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar Setting project property: org.tukaani:xz:jar - /home/jenkins/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar Setting project property: maven.project.dependencies.versions - 3.0.0-SNAPSHOT:1.6:11.0.2:1.2:3.1.1:0.52:3.1:1.4:2.4:3.1:3.2.1:2.5:6.1.26:6.1.26:2.1:1.9:1.9:1.1:2.2.3-1:2.2.2:1.0-2:1.1:1.9.13:1.9.13:1.9:3.2:1.1.3:1.2.17:0.9.0:4.2.5:4.2.5:0.4:4.11:1.3:2.6:1.6:1.8:1.7.0:1.8.0:1.7.5:1.7.5:1.9.13:1.9.13:1.8.5:1.7.4:2.3:1.0.4.1:1.8.1:1.8.1:2.5.0:2.2.4:3.0.0-SNAPSHOT:2.0.0-M15:2.0.0-M15:1.0.0-M20:1.0.0-M20:0.1.42:1.3.9:3.4.6:3.6.2.Final:3.4.6:0.9.94:1.4.1:1.0: Setting project property: maven.dependency.org.apache.hadoop.hadoop-annotations.jar.path - https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-annotations/target/hadoop-annotations-3.0.0-SNAPSHOT.jar Setting project property: maven.dependency.jdk.tools.jdk.tools.jar.path - /home/jenkins/tools/java/jdk1.6.0_20-32/jre/../lib/tools.jar Setting project property: maven.dependency.com.google.guava.guava.jar.path - /home/jenkins/.m2/repository/com/google/guava/guava/11.0.2/guava-11.0.2.jar Setting project property: maven.dependency.commons-cli.commons-cli.jar.path - /home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar Setting project property: maven.dependency.org.apache.commons.commons-math3.jar.path - /home/jenkins/.m2/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar Setting project property: maven.dependency.xmlenc.xmlenc.jar.path - /home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar Setting project property: maven.dependency.commons-httpclient.commons-httpclient.jar.path - /home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar Setting project property: maven.dependency.commons-codec.commons-codec.jar.path - /home/jenkins/.m2/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar Setting project property: maven.dependency.commons-io.commons-io.jar.path - /home/jenkins/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar Setting project property: maven.dependency.commons-net.commons-net.jar.path - /home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar Setting project property: maven.dependency.commons-collections.commons-collections.jar.path - /home/jenkins/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar Setting project property: maven.dependency.javax.servlet.servlet-api.jar.path - /home/jenkins/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar Setting project property: maven.dependency.org.mortbay.jetty.jetty.jar.path - /home/jenkins/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar Setting project property: maven.dependency.org.mortbay.jetty.jetty-util.jar.path - /home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar Setting project property: maven.dependency.javax.servlet.jsp.jsp-api.jar.path - /home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar Setting project property: maven.dependency.com.sun.jersey.jersey-core.jar.path - /home/jenkins/.m2/repository/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar Setting project property: maven.dependency.com.sun.jersey.jersey-json.jar.path - /home/jenkins/.m2/repository/com/sun/jersey/jersey-json/1.9/jersey-json-1.9.jar Setting project property: maven.dependency.org.codehaus.jettison.jettison.jar.path - /home/jenkins/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar Setting project property: maven.dependency.com.sun.xml.bind.jaxb-impl.jar.path -
Jenkins Build Slaves
All Yahoo is in the process of retiring all the hadoop jenkins build slaves, *hadoop[1-9]* and replace them with a newer set of beefier hosts. These new machines are configured with *ubuntu-14.04*. Over the next couple of days I will be configuring the build jobs to run on these newly configured build slaves. To automate the installation of tools and build libraries I have put together ansible scripts and here is the link to the toolchain repo. *https://github.com/apache/toolchain https://github.com/apache/toolchain* During the transition, the old build slave will be accessible, and expected to be shutdown by 07/15. I will send out an update later this week when this transition is complete. *Mean while, I would like to request the project owners to remove/cleanup any stale * *jenkins job for their respective project and help with any builds issue to make this * *transition seamless. * Thanks - Giri -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
