Hadoop-Hdfs-trunk - Build # 2161 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2161/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6860 lines...] [INFO] --- maven-enforcer-plugin:1.3.1:enf

Build failed in Jenkins: Hadoop-Hdfs-trunk #2161

See Changes: [wang] HDFS-8605. Merge Refactor of DFSOutputStream from HDFS-7285 branch. (vinayakumarb) [cmccabe] HADOOP-12100. ImmutableFsPermission should not override applyUmask since that method doesn't modify the FsPermission (

[jira] [Created] (HDFS-8641) Mirror repository on GitHub is not synced with ASF repo

Masatake Iwasaki created HDFS-8641: -- Summary: Mirror repository on GitHub is not synced with ASF repo Key: HDFS-8641 URL: https://issues.apache.org/jira/browse/HDFS-8641 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-8602) Erasure Coding: Client can't read(decode) the EC files which have corrupt blocks.

[ https://issues.apache.org/jira/browse/HDFS-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8602. - Resolution: Fixed Hadoop Flags: Reviewed Thanks for the confirmation and updating the patch, [~kaisas

Re: F 6/19: Jenkins clogged up

Thanks for hte heads up. On Fri, Jun 19, 2015 at 1:43 PM, Chris Nauroth wrote: > Hi everyone, > > I was just in contact with Apache infrastructure. Jenkins wasn't running > jobs for a while, so there is a large backlog in the queue now (over 200 > jobs). Infra has fixed the problems, so jobs a

[jira] [Resolved] (HDFS-6762) hadoop-hdfs build fails at module-javadocs

[ https://issues.apache.org/jira/browse/HDFS-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HDFS-6762. Resolution: Not A Problem I have seen similar build failures with the message "Exit code: 137

F 6/19: Jenkins clogged up

Hi everyone, I was just in contact with Apache infrastructure. Jenkins wasn't running jobs for a while, so there is a large backlog in the queue now (over 200 jobs). Infra has fixed the problems, so jobs are running now, but our test-patch runs might have to sit in the queue a long time today.

[jira] [Resolved] (HDFS-8254) Avoid assigning a leading streamer in StripedDataStreamer to tolerate datanode failure

[ https://issues.apache.org/jira/browse/HDFS-8254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8254. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed +1 as well. I've committed th

Re: YARN replica selection

Moving conversation to yarn-dev. BCC’ed hdfs-dev. YARN actually does not do anything except give back containers based on what an application requested for. It is up to each and every application to first figure out where the data is located and then make optimal choices based on which node to

Re: YARN replica selection

Dear Users, Please remove me from the thread. I am no longer associated with Hadoop On Fri, Jun 19, 2015 at 1:54 PM, Arun Suresh wrote: > +yarn-dev@ > > Currently you can provide the scheduler hints as to the set of nodes / > racks the task may be scheduled. > But what you are probably looking

Re: Retrieving keys via KMS from map/reduce phase.

Dear Users, Please remove me from the thread. I am no longer associated with Hadoop On Fri, Jun 19, 2015 at 2:37 PM, Sitaraman Vilayannur < vrsitaramanietfli...@gmail.com> wrote: > Thanks for the info Arun. I asked this question for a custom application of > mine wherein i > need to retrieve the

[jira] [Created] (HDFS-8640) Make reserved RBW space visible through JMX

kanaka kumar avvaru created HDFS-8640: - Summary: Make reserved RBW space visible through JMX Key: HDFS-8640 URL: https://issues.apache.org/jira/browse/HDFS-8640 Project: Hadoop HDFS Issue

Re: Retrieving keys via KMS from map/reduce phase.

Thanks for the info Arun. I asked this question for a custom application of mine wherein i need to retrieve the key from MapReduce code. Is there a way that i can replicate my keyprovider across the data nodes and then access the local key provider from MR code at each data node? If so what method

[jira] [Created] (HDFS-8639) Option for HTTP port of NameNode by MiniDFSClusterManager

Kai Sasaki created HDFS-8639: Summary: Option for HTTP port of NameNode by MiniDFSClusterManager Key: HDFS-8639 URL: https://issues.apache.org/jira/browse/HDFS-8639 Project: Hadoop HDFS Issue Typ

Re: YARN replica selection

+yarn-dev@ Currently you can provide the scheduler hints as to the set of nodes / racks the task may be scheduled. But what you are probably looking for is the Node Labeling feature which is currently under development : https://issues.apache.org/jira/browse/YARN-2492 -Arun On Fri, Jun 19, 201

YARN replica selection

Hi, How does YARN decide which replica to use when scheduling a task or is it random? Does the YARN scheduler give a priority to SSD storage types over DISK storage types for the HOT_STORAGE_POLICY when scheduling data local tasks? Please let me know if this should be posted in YARN developers m