[jira] [Reopened] (HDFS-12177) NameNode exits due to setting BlockPlacementPolicy loglevel to Debug

2017-07-20 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang reopened HDFS-12177: -- > NameNode exits due to setting BlockPlacementPolicy loglevel to Debug >

[jira] [Created] (HDFS-12177) NameNode exits due to setting BlockPlacementPolicy loglevel to Debug

2017-07-20 Thread Jiandan Yang (JIRA)
Jiandan Yang created HDFS-12177: Summary: NameNode exits due to setting BlockPlacementPolicy loglevel to Debug Key: HDFS-12177 URL: https://issues.apache.org/jira/browse/HDFS-12177 Project: Hadoop

RE: Pre-Commit build is failing

2017-07-20 Thread Brahma Reddy Battula
Looks this problem is in only branc-2.7.. --Brahma Reddy Battula From: Brahma Reddy Battula Sent: 21 July 2017 09:36 To: common-...@hadoop.apache.org; hdfs-dev@hadoop.apache.org Subject: Pre-Commit build is failing Importance: High Looks pre-commit build is failing with following error.

Pre-Commit build is failing

2017-07-20 Thread Brahma Reddy Battula
Looks pre-commit build is failing with following error. /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-a444ed1/precommit/core.d/00-yetuslib.sh: line 87: /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/patch-dryrun.log: No such file

[jira] [Created] (HDFS-12176) dfsadmin shows DFS Used%: NaN% if the cluster has zero block.

2017-07-20 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12176: -- Summary: dfsadmin shows DFS Used%: NaN% if the cluster has zero block. Key: HDFS-12176 URL: https://issues.apache.org/jira/browse/HDFS-12176 Project: Hadoop HDFS

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-07-20 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/470/ [Jul 19, 2017 7:41:22 AM] (jlowe) HADOOP-14669. GenericTestUtils.waitFor should use monotonic time. [Jul 19, 2017 8:21:43 AM] (brahma) HDFS-12067. Correct dfsadmin commands usage message to reflects IPC

Re: Corona is here -- And Ozone works !!!!

2017-07-20 Thread Mingliang Liu
Still, it’s good news! Best, > On Jul 20, 2017, at 2:44 PM, Anu Engineer wrote: > > Sorry, it was meant for a wrong alias. My apologies. > > —Anu > > > > > > On 7/20/17, 2:40 PM, "Anu Engineer" wrote: > >> Hi All, >> >> I just

[jira] [Created] (HDFS-12175) Fix Leaking in TestStorageContainerManager#testRpcPermission

2017-07-20 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12175: - Summary: Fix Leaking in TestStorageContainerManager#testRpcPermission Key: HDFS-12175 URL: https://issues.apache.org/jira/browse/HDFS-12175 Project: Hadoop HDFS

Re: Corona is here -- And Ozone works !!!!

2017-07-20 Thread Anu Engineer
Sorry, it was meant for a wrong alias. My apologies. —Anu On 7/20/17, 2:40 PM, "Anu Engineer" wrote: >Hi All, > >I just deployed a test cluster with Nandakumar and we were able to run corona >from a single node, with 10 thread for 12 mins. > >We were able to

[jira] [Created] (HDFS-12173) MiniDFSCluster cannot reliably use NameNode#stop

2017-07-20 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12173: -- Summary: MiniDFSCluster cannot reliably use NameNode#stop Key: HDFS-12173 URL: https://issues.apache.org/jira/browse/HDFS-12173 Project: Hadoop HDFS Issue Type:

Apache Hadoop 2.8.2 Release Plan

2017-07-20 Thread Junping Du
Hi all, Per Vinod's previous email, we just announce Apache Hadoop 2.8.1 get released today which is a special security release. Now, we should work towards 2.8.2 release which aim for production deployment. The focus obviously is to fix blocker/critical issues [2], bug-fixes and *no*

Re: About 2.7.4 Release

2017-07-20 Thread Vinod Kumar Vavilapalli
Thanks for taking 2.7.4 over Konstantin! Regarding rolling RC next week, I still see that there are 4 blocker / critical tickets targeted for 2.7.4:

[jira] [Created] (HDFS-12172) Reduce EZ lookup overhead

2017-07-20 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12172: -- Summary: Reduce EZ lookup overhead Key: HDFS-12172 URL: https://issues.apache.org/jira/browse/HDFS-12172 Project: Hadoop HDFS Issue Type: Improvement

Re: LinkedIn Dynamometer Tool (was About 2.7.4 Release)

2017-07-20 Thread Erik Krogen
Hi Anu, Thanks for the interest! 1. Unfortunately I am very doubtful that LinkedIn security would let us release our traces. If you collect your audit logs that's the only thing necessary to build traces. 2. Our current approach is to use 'truncate' to create sparse files which have the expected

[jira] [Created] (HDFS-12171) Reduce IIP object allocations for inode lookup

2017-07-20 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12171: -- Summary: Reduce IIP object allocations for inode lookup Key: HDFS-12171 URL: https://issues.apache.org/jira/browse/HDFS-12171 Project: Hadoop HDFS Issue Type:

Re: LinkedIn Dynamometer Tool (was About 2.7.4 Release)

2017-07-20 Thread Anu Engineer
Hi Erik, Looking forward to the release of this tool. Thank you very much for the contribution. Had a couple of questions about how the tool works. 1. Would you be able to provide the traces along with this tool? In other words, would I be able to use this out of the box, or do I have to

LinkedIn Dynamometer Tool (was About 2.7.4 Release)

2017-07-20 Thread Erik Krogen
forking off of the 2.7.4 release thread to answer this question about Dynamometer Dynamometer is a tool developed at LinkedIn for scale testing HDFS, specifically the NameNode. We have been using it for some time now and have recently been making some enhancements to ease of use and

[jira] [Created] (HDFS-12170) Ozone: OzoneFileSystem: KSM should maintain key creation time and modification time

2017-07-20 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12170: Summary: Ozone: OzoneFileSystem: KSM should maintain key creation time and modification time Key: HDFS-12170 URL: https://issues.apache.org/jira/browse/HDFS-12170

[jira] [Created] (HDFS-12169) libhdfs++: Exceptions from third party libs aren't caught

2017-07-20 Thread James Clampffer (JIRA)
James Clampffer created HDFS-12169: -- Summary: libhdfs++: Exceptions from third party libs aren't caught Key: HDFS-12169 URL: https://issues.apache.org/jira/browse/HDFS-12169 Project: Hadoop HDFS

[jira] [Created] (HDFS-12168) libhdfs++: test4tests doesn't detect C++ test changes

2017-07-20 Thread James Clampffer (JIRA)
James Clampffer created HDFS-12168: -- Summary: libhdfs++: test4tests doesn't detect C++ test changes Key: HDFS-12168 URL: https://issues.apache.org/jira/browse/HDFS-12168 Project: Hadoop HDFS

[jira] [Created] (HDFS-12167) Ozone: Intermittent failure TestContainerPersistence#testListKey

2017-07-20 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12167: -- Summary: Ozone: Intermittent failure TestContainerPersistence#testListKey Key: HDFS-12167 URL: https://issues.apache.org/jira/browse/HDFS-12167 Project: Hadoop HDFS

Re: Running HDFS from source broken since HDFS-11596

2017-07-20 Thread John Zhuge
Hi Lars, I am able to run pseudo-distributed mode from a dev tree. Here is the wiki: https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html#Pseudo-Distributed_Operation . Check out my script pseudo_dist

Running HDFS from source broken since HDFS-11596

2017-07-20 Thread Lars Francke
I've already asked in but haven't gotten a reply so far so I thought I'd bump it here. The issue replaces the compile time dependency of the various HDFS projects to hdfs-client with a "provided" dependency. Unfortunately that means that HDFS