[jira] [Created] (HADOOP-8475) 4-layer topology (with NodeGroup layer) implementation of Container Assignment and Task Scheduling (for YARN)
Junping Du created HADOOP-8475: -- Summary: 4-layer topology (with NodeGroup layer) implementation of Container Assignment and Task Scheduling (for YARN) Key: HADOOP-8475 URL: https://issues.apache.org/jira/browse/HADOOP-8475 Project: Hadoop Common Issue Type: Sub-task Affects Versions: 2.0.0-alpha, 1.0.0 Reporter: Junping Du Assignee: Junping Du There are several classes in YARN’s container assignment and task scheduling algorithms that related to data locality which were updated to give preference to running a container on the same nodegroup. This section summarized the changes in the patch that provides a new implementation to support a four-layer hierarchy. When the ApplicationMaster makes a resource allocation request to the scheduler of ResourceManager, it will add the node group to the list of attributes in the ResourceRequest. The parameters of the resource request will change from priority, (host, rack, *), memory, #containers to priority, (host, nodegroup, rack, *), memory, #containers. After receiving the ResoureRequest the RM scheduler will assign containers for requests in the sequence of data-local, nodegroup-local, rack-local and off-switch.Then, ApplicationMaster schedules tasks on allocated containers in sequence of data- local, nodegroup-local, rack-local and off-switch. In terms of code changes made to YARN task scheduling, we updated the class ContainerRequestEvent so that applications can requests for containers can include anodegroup. In RM schedulers, FifoScheduler and CapacityScheduler were updated. For the FifoScheduler, the changes were in the method assignContainers. For the Capacity Scheduler the method assignContainersOnNode in the class of LeafQueue was updated. In both changes a new method, assignNodeGroupLocalContainers() was added in between the assignment data-local and rack-local. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Build failed in Jenkins: Hadoop-Common-trunk #428
See https://builds.apache.org/job/Hadoop-Common-trunk/428/changes Changes: [eli] HADOOP-8450. Remove src/test/system. Contributed by Eli Collins -- [...truncated 5 lines...] Setting project property: project.packaging - jar Setting project property: project.build.directory - https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-common/target Setting project property: project.build.outputDirectory - https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-common/target/classes Setting project property: project.build.testOutputDirectory - https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-common/target/test-classes Setting project property: project.build.sourceDirectory - https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-common/src/main/java Setting project property: project.build.testSourceDirectory - https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-common/src/test/java Setting project property: localRepository -id: local url: file:///home/jenkins/.m2/repository/ layout: none Setting project property: settings.localRepository - /home/jenkins/.m2/repository Setting project property: org.apache.hadoop:hadoop-annotations:jar - https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-annotations/target/hadoop-annotations-3.0.0-SNAPSHOT.jar Setting project property: jdiff:jdiff:jar - /home/jenkins/.m2/repository/jdiff/jdiff/1.0.9/jdiff-1.0.9.jar Setting project property: com.google.guava:guava:jar - /home/jenkins/.m2/repository/com/google/guava/guava/11.0.2/guava-11.0.2.jar Setting project property: com.google.code.findbugs:jsr305:jar - /home/jenkins/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar Setting project property: commons-cli:commons-cli:jar - /home/jenkins/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar Setting project property: org.apache.commons:commons-math:jar - /home/jenkins/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar Setting project property: xmlenc:xmlenc:jar - /home/jenkins/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar Setting project property: commons-httpclient:commons-httpclient:jar - /home/jenkins/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar Setting project property: commons-codec:commons-codec:jar - /home/jenkins/.m2/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar Setting project property: commons-net:commons-net:jar - /home/jenkins/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar Setting project property: commons-io:commons-io:jar - /home/jenkins/.m2/repository/commons-io/commons-io/2.1/commons-io-2.1.jar Setting project property: javax.servlet:servlet-api:jar - /home/jenkins/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar Setting project property: org.mortbay.jetty:jetty:jar - /home/jenkins/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar Setting project property: org.mortbay.jetty:jetty-util:jar - /home/jenkins/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar Setting project property: asm:asm:jar - /home/jenkins/.m2/repository/asm/asm/3.2/asm-3.2.jar Setting project property: com.sun.jersey:jersey-core:jar - /home/jenkins/.m2/repository/com/sun/jersey/jersey-core/1.8/jersey-core-1.8.jar Setting project property: com.sun.jersey:jersey-json:jar - /home/jenkins/.m2/repository/com/sun/jersey/jersey-json/1.8/jersey-json-1.8.jar Setting project property: org.codehaus.jettison:jettison:jar - /home/jenkins/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar Setting project property: stax:stax-api:jar - /home/jenkins/.m2/repository/stax/stax-api/1.0.1/stax-api-1.0.1.jar Setting project property: com.sun.xml.bind:jaxb-impl:jar - /home/jenkins/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar Setting project property: javax.xml.bind:jaxb-api:jar - /home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar Setting project property: javax.activation:activation:jar - /home/jenkins/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar Setting project property: org.codehaus.jackson:jackson-core-asl:jar - /home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.8.8/jackson-core-asl-1.8.8.jar Setting project property: org.codehaus.jackson:jackson-jaxrs:jar - /home/jenkins/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.8.8/jackson-jaxrs-1.8.8.jar Setting project property: org.codehaus.jackson:jackson-xc:jar - /home/jenkins/.m2/repository/org/codehaus/jackson/jackson-xc/1.8.8/jackson-xc-1.8.8.jar Setting project property: com.sun.jersey:jersey-server:jar -
Build failed in Jenkins: Hadoop-Common-0.23-Build #273
See https://builds.apache.org/job/Hadoop-Common-0.23-Build/273/ -- [...truncated 12431 lines...] [javadoc] Loading source files for package org.apache.hadoop.fs.ftp... [javadoc] Loading source files for package org.apache.hadoop.fs.kfs... [javadoc] Loading source files for package org.apache.hadoop.fs.local... [javadoc] Loading source files for package org.apache.hadoop.fs.permission... [javadoc] Loading source files for package org.apache.hadoop.fs.s3... [javadoc] Loading source files for package org.apache.hadoop.fs.s3native... [javadoc] Loading source files for package org.apache.hadoop.fs.shell... [javadoc] Loading source files for package org.apache.hadoop.fs.viewfs... [javadoc] Loading source files for package org.apache.hadoop.http... [javadoc] Loading source files for package org.apache.hadoop.http.lib... [javadoc] Loading source files for package org.apache.hadoop.io... [javadoc] Loading source files for package org.apache.hadoop.io.compress... [javadoc] Loading source files for package org.apache.hadoop.io.compress.bzip2... [javadoc] Loading source files for package org.apache.hadoop.io.compress.lz4... [javadoc] Loading source files for package org.apache.hadoop.io.compress.snappy... [javadoc] Loading source files for package org.apache.hadoop.io.compress.zlib... [javadoc] Loading source files for package org.apache.hadoop.io.file.tfile... [javadoc] Loading source files for package org.apache.hadoop.io.nativeio... [javadoc] Loading source files for package org.apache.hadoop.io.retry... [javadoc] Loading source files for package org.apache.hadoop.io.serializer... [javadoc] Loading source files for package org.apache.hadoop.io.serializer.avro... [javadoc] Loading source files for package org.apache.hadoop.ipc... [javadoc] Loading source files for package org.apache.hadoop.ipc.metrics... [javadoc] Loading source files for package org.apache.hadoop.jmx... [javadoc] Loading source files for package org.apache.hadoop.log... [javadoc] Loading source files for package org.apache.hadoop.log.metrics... [javadoc] Loading source files for package org.apache.hadoop.metrics... [javadoc] Loading source files for package org.apache.hadoop.metrics.file... [javadoc] Loading source files for package org.apache.hadoop.metrics.ganglia... [javadoc] Loading source files for package org.apache.hadoop.metrics.jvm... [javadoc] Loading source files for package org.apache.hadoop.metrics.spi... [javadoc] Loading source files for package org.apache.hadoop.metrics.util... [javadoc] Loading source files for package org.apache.hadoop.metrics2... [javadoc] Loading source files for package org.apache.hadoop.metrics2.annotation... [javadoc] Loading source files for package org.apache.hadoop.metrics2.filter... [javadoc] Loading source files for package org.apache.hadoop.metrics2.impl... [javadoc] Loading source files for package org.apache.hadoop.metrics2.lib... [javadoc] Loading source files for package org.apache.hadoop.metrics2.sink... [javadoc] Loading source files for package org.apache.hadoop.metrics2.sink.ganglia... [javadoc] Loading source files for package org.apache.hadoop.metrics2.source... [javadoc] Loading source files for package org.apache.hadoop.metrics2.util... [javadoc] Loading source files for package org.apache.hadoop.net... [javadoc] Loading source files for package org.apache.hadoop.record... [javadoc] Loading source files for package org.apache.hadoop.record.compiler... [javadoc] Loading source files for package org.apache.hadoop.record.compiler.ant... [javadoc] Loading source files for package org.apache.hadoop.record.compiler.generated... [javadoc] Loading source files for package org.apache.hadoop.record.meta... [javadoc] Loading source files for package org.apache.hadoop.security... [javadoc] Loading source files for package org.apache.hadoop.security.authorize... [javadoc] Loading source files for package org.apache.hadoop.security.token... [javadoc] Loading source files for package org.apache.hadoop.security.token.delegation... [javadoc] Loading source files for package org.apache.hadoop.tools... [javadoc] Loading source files for package org.apache.hadoop.util... [javadoc] Loading source files for package org.apache.hadoop.util.bloom... [javadoc] Loading source files for package org.apache.hadoop.util.hash... [javadoc] 2 errors [xslt] Processing https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsXml.xml to https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/site/findbugs.html [xslt] Loading stylesheet /home/jenkins/tools/findbugs/latest/src/xsl/default.xsl [INFO] Executed tasks [INFO] [INFO] --- maven-antrun-plugin:1.6:run (pre-dist) @ hadoop-common --- [INFO] Executing tasks main: [INFO] Executed tasks
[jira] [Created] (HADOOP-8476) Remove duplicate VM arguments for hadoop deamon
Vinay created HADOOP-8476:
-
Summary: Remove duplicate VM arguments for hadoop deamon
Key: HADOOP-8476
URL: https://issues.apache.org/jira/browse/HADOOP-8476
Project: Hadoop Common
Issue Type: Bug
Components: conf
Affects Versions: 2.0.0-alpha, 3.0.0
Reporter: Vinay
Assignee: Vinay
Priority: Minor
remove the duplicate the VM arguments passed to hadoop daemon
Following are the VM arguments currently duplicated.
{noformat}-Dproc_namenode
-Xmx1000m
-Djava.net.preferIPv4Stack=true
-Xmx128m
-Xmx128m
-Dhadoop.log.dir=/home/nn2/logs
-Dhadoop.log.file=hadoop-root-namenode-HOST-xx-xx-xx-105.log
-Dhadoop.home.dir=/home/nn2/
-Dhadoop.id.str=root
-Dhadoop.root.logger=INFO,RFA
-Dhadoop.policy.file=hadoop-policy.xml
-Djava.net.preferIPv4Stack=true
-Dhadoop.security.logger=INFO,RFAS
-Dhdfs.audit.logger=INFO,NullAppender
-Dhadoop.security.logger=INFO,RFAS
-Dhdfs.audit.logger=INFO,NullAppender
-Dhadoop.security.logger=INFO,RFAS
-Dhdfs.audit.logger=INFO,NullAppender
-Xdebug
-Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=8001
-Dhadoop.security.logger=INFO,RFAS{noformat}
In above VM argumants -Xmx1000m will be Overridden by -Xmx128m.
BTW Other duplicate arguments wont harm
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-8477) Pull in Yahoo! Hadoop Tutorial and update it accordingly.
Robert Joseph Evans created HADOOP-8477: --- Summary: Pull in Yahoo! Hadoop Tutorial and update it accordingly. Key: HADOOP-8477 URL: https://issues.apache.org/jira/browse/HADOOP-8477 Project: Hadoop Common Issue Type: Improvement Components: documentation Affects Versions: 1.1.0, 2.0.1-alpha Reporter: Robert Joseph Evans I was able to get the Yahoo! Hadoop tutorial released under an Apache 2.0 license. This allows us to make it a official part of the Hadoop Project. This ticket is to pull the tutorial and update it as needed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HADOOP-8101) Access Control support for Non-secure deployment of Hadoop on Windows
[ https://issues.apache.org/jira/browse/HADOOP-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8101. -- Resolution: Fixed Target Version/s: HADOOP-1-Windows (was: 1.1.0, 0.24.0) Access Control support for Non-secure deployment of Hadoop on Windows - Key: HADOOP-8101 URL: https://issues.apache.org/jira/browse/HADOOP-8101 Project: Hadoop Common Issue Type: Improvement Components: native Reporter: Sanjay Radia Attachments: security.patch, security1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-8479) update HDFS quotas guide: currently says setting quota fails if the directory would be in violation of the new quota
Stephen Chu created HADOOP-8479: --- Summary: update HDFS quotas guide: currently says setting quota fails if the directory would be in violation of the new quota Key: HADOOP-8479 URL: https://issues.apache.org/jira/browse/HADOOP-8479 Project: Hadoop Common Issue Type: Bug Components: documentation Reporter: Stephen Chu http://hadoop.apache.org/common/docs/r0.20.0/hdfs_quota_admin_guide.html The guide says The attempt to set a quota fails if the directory would be in violation of the new quota for both Name Quotas and Space Quotas. That doesn't seem to be the case, though. I can set the quota successfully even when the directory violates the new quota. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
trunk branch-2 builds now require cmake
As a heads up, autoconf is dead, long live cmake HADOOP-8368 is in in both trunk and branch-2 (thanks Colin) If you are building native Hadoop (-Pnative) you may need to install CMAKE in your system. Thx -- Alejandro
[jira] [Created] (HADOOP-8480) The native build should honor -DskipTests
Colin Patrick McCabe created HADOOP-8480:
Summary: The native build should honor -DskipTests
Key: HADOOP-8480
URL: https://issues.apache.org/jira/browse/HADOOP-8480
Project: Hadoop Common
Issue Type: Bug
Reporter: Colin Patrick McCabe
Priority: Trivial
Currently, the native build does not honor -DskipTests. The native unit tests
will be run even when you specify:
{code}
mvn compile -Pnative -DskipTests -X -e
{code}
This seems inconsistent; shouldn't we fix this to work like the other tests do?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: include HDFS-96: HDFS does not support blocks greater than 2GB in 1.1 release?
Yes, I'll include this too. --Matt On Sat, Jun 2, 2012 at 7:04 PM, Jim Donofrio donofrio...@gmail.com wrote: Can you include HDFS-96: HDFS does not support blocks greater than 2GB in 1.1? This is a small change which is only present in trunk and branch-2, it should also be present in the production 1 line. Thanks.
[jira] [Created] (HADOOP-8481) update BUILDING.txt to talk about cmake rather than autotools
Colin Patrick McCabe created HADOOP-8481: Summary: update BUILDING.txt to talk about cmake rather than autotools Key: HADOOP-8481 URL: https://issues.apache.org/jira/browse/HADOOP-8481 Project: Hadoop Common Issue Type: Bug Reporter: Colin Patrick McCabe Assignee: Colin Patrick McCabe Priority: Trivial update BUILDING.txt to talk about cmake rather than autotools -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-8482) give a better error message if native build dependencies are missng
Colin Patrick McCabe created HADOOP-8482: Summary: give a better error message if native build dependencies are missng Key: HADOOP-8482 URL: https://issues.apache.org/jira/browse/HADOOP-8482 Project: Hadoop Common Issue Type: Bug Reporter: Colin Patrick McCabe Priority: Trivial It would be nice to check if native build dependencies are missing, and give a clearer error from one of the top-level pom.xml files. At a minimum, we need make and CMake to be installed. Currently, the error is just along the lines of CMake: file not found or make: file not found but we could improve it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Make Hadoop NetworkTopology and data locality more pluggable for other deploying topology like: virtualization.
That's great Junping. Hoping to see this in trunk / hadoop 2.0 and hadoop 1.1 soon. - milind On Jun 4, 2012, at 8:48 AM, Jun Ping Du wrote: Hello Folks, I just filed a Umbrella jira today to address current NetworkTopology issue that binding strictly to three tier network. The motivation here is to make hadoop more flexible for deploying topology (especially for cloud/virtualization case) and more configurable in data locality related policies like: replica placement, task scheduling, choosing block for DFSClient reading, balancing. We submit a draft proposal in this Umbrella as well as the implementation code. As code base is large (~260K), the code is separated into 7 sub JIRA issues which seems to be more convenient for reviewing. However, we split the code based on functionality which cause some dependencies between patches which way we are not sure the best. Welcome to provide comments and suggestions on doc and code, and look forward to work with all of you to enhance hadoop in some new situations towards perfect. Hope this is a good start. Cheers, Junping - Original Message - From: Junping Du (JIRA) j...@apache.org To: common-iss...@hadoop.apache.org Sent: Monday, June 4, 2012 12:09:22 PM Subject: [jira] [Created] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies Junping Du created HADOOP-8468: -- Summary: Umbrella of enhancements to support different failure and locality topologies Key: HADOOP-8468 URL: https://issues.apache.org/jira/browse/HADOOP-8468 Project: Hadoop Common Issue Type: Bug Components: ha, io Affects Versions: 2.0.0-alpha, 1.0.0 Reporter: Junping Du Assignee: Junping Du Priority: Critical The current hadoop network topology (described in some previous issues like: Hadoop-692) works well in classic three-tiers network when it comes out. However, it does not take into account other failure models or changes in the infrastructure that can affect network bandwidth efficiency like: virtualization. Virtualized platform has following genes that shouldn't been ignored by hadoop topology in scheduling tasks, placing replica, do balancing or fetching block for reading: 1. VMs on the same physical host are affected by the same hardware failure. In order to match the reliability of a physical deployment, replication of data across two virtual machines on the same host should be avoided. 2. The network between VMs on the same physical host has higher throughput and lower latency and does not consume any physical switch bandwidth. Thus, we propose to make hadoop network topology extend-able and introduce a new level in the hierarchical topology, a node group level, which maps well onto an infrastructure that is based on a virtualized environment. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HADOOP-8430) Backport new FileSystem methods introduced by HADOOP-8014 to branch-1
[ https://issues.apache.org/jira/browse/HADOOP-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-8430. - Resolution: Fixed Fix Version/s: 1.1.0 Target Version/s: (was: 1.1.0) Thanks Daryn. I've committed this to branch-1 and merged to branch-1.1 Backport new FileSystem methods introduced by HADOOP-8014 to branch-1 -- Key: HADOOP-8430 URL: https://issues.apache.org/jira/browse/HADOOP-8430 Project: Hadoop Common Issue Type: Improvement Reporter: Eli Collins Assignee: Eli Collins Fix For: 1.1.0 Attachments: hadoop-8430-1.txt Per HADOOP-8422 let's backport the new FileSystem methods from HADOOP-8014 to branch-1 so users can transition over in Hadoop 1.x releases, which helps upstream projects like HBase work against federation (see HBASE-6067). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-8483) test-patch +1 even there are build failures
Tsz Wo (Nicholas), SZE created HADOOP-8483: -- Summary: test-patch +1 even there are build failures Key: HADOOP-8483 URL: https://issues.apache.org/jira/browse/HADOOP-8483 Project: Hadoop Common Issue Type: Improvement Reporter: Tsz Wo (Nicholas), SZE Priority: Critical For example, there are build failures in [build #1062|https://builds.apache.org/job/PreCommit-HADOOP-Build/1062/console] but it still has all +1's. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HADOOP-7338) LocalDirAllocator improvements for MR-2178
[ https://issues.apache.org/jira/browse/HADOOP-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HADOOP-7338. - Resolution: Fixed Hadoop Flags: Reviewed +1 I just committed this to branch 0.22.1. Thank you Benoy. LocalDirAllocator improvements for MR-2178 -- Key: HADOOP-7338 URL: https://issues.apache.org/jira/browse/HADOOP-7338 Project: Hadoop Common Issue Type: Improvement Affects Versions: 0.22.0 Reporter: Todd Lipcon Assignee: Benoy Antony Fix For: 0.22.1 Attachments: hadoop-7338-022.patch, hadoop-7338.patch, hadoop-7338.txt These are some changes that come from the following yahoo-merge commit, necessary for MAPREDUCE-2178 to build. commit 446e41f2424ddc866770cda677450c18feeb597f Author: Chris Douglas cdoug...@apache.org Date: Sun Oct 3 02:00:15 2010 -0700 Apply y201 to trunk git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/yahoo-merge@1079151 13f79535-47bb-0310-9956-ffa450edef68 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Jenkins build is back to normal : Hadoop-Common-trunk #429
See https://builds.apache.org/job/Hadoop-Common-trunk/429/changes
Hadoop view on Jenkins
Hey gang, fyi, I created a view in jenkins so you can see all the enabled Hadoop builds: https://builds.apache.org/view/Hadoop Thanks, Eli
[jira] [Created] (HADOOP-8484) Prevent Configuration getter methods that are passed a default value from throwing RuntimeException
Ahmed Radwan created HADOOP-8484: Summary: Prevent Configuration getter methods that are passed a default value from throwing RuntimeException Key: HADOOP-8484 URL: https://issues.apache.org/jira/browse/HADOOP-8484 Project: Hadoop Common Issue Type: Bug Components: conf Affects Versions: 2.0.0-alpha Reporter: Ahmed Radwan Fix For: 2.0.1-alpha Configuration getter methods that are passed default values can throw RuntimeExceptions if the value provided is invalid (e.g. NumberFormatException). In many cases such exception results in more serious consequences (failure to sart a service, see for example NodeManager DeletionService). This can be avoided by returning the default value and just printing a warning message. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HADOOP-8381) Substitute _HOST with hostname for HTTP principals
[ https://issues.apache.org/jira/browse/HADOOP-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HADOOP-8381. - Resolution: Fixed Hadoop Flags: Reviewed +1 I just committed this to branch 0.22.1. Thank you Benoy. Substitute _HOST with hostname for HTTP principals Key: HADOOP-8381 URL: https://issues.apache.org/jira/browse/HADOOP-8381 Project: Hadoop Common Issue Type: Sub-task Components: security Affects Versions: 0.22.0 Reporter: Benoy Antony Assignee: Benoy Antony Priority: Minor Fix For: 0.22.1 Attachments: HOST-substitution-spnego.patch, HOST-substitution-spnego.patch SPNEGO based Web Authentication uses HTTP/fqdn@REALM as the kerberos principal for each host. Since it is difficult to modify the config for each host, a substitution feature where _HOST gets replaced by fqdn is implemented. The task is to provide similar feature for the kerberos principals used for SPNEGO principals -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
