[jira] [Created] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-21 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-12190: Summary: Enable 'hdfs dfs -stat' to display access time Key: HDFS-12190 URL: https://issues.apache.org/jira/browse/HDFS-12190 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12189) TestPread#testPreadFailureWithChangedBlockLocations fails intermittently

2017-07-21 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-12189: --- Summary: TestPread#testPreadFailureWithChangedBlockLocations fails intermittently Key: HDFS-12189 URL: https://issues.apache.org/jira/browse/HDFS-12189

[jira] [Created] (HDFS-12188) TestDecommissioningStatus#testDecommissionStatus fails intermittently

2017-07-21 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-12188: --- Summary: TestDecommissioningStatus#testDecommissionStatus fails intermittently Key: HDFS-12188 URL: https://issues.apache.org/jira/browse/HDFS-12188

Re: Pre-Commit build is failing

2017-07-21 Thread Konstantin Shvachko
What stuff? Is there a jira? It did work like a week ago. Is it a new Yetus requirement. Anyways I can commit a change to fix the build on our side. Just need to know what is missing. Thanks, --Konst On Fri, Jul 21, 2017 at 5:50 PM, Allen Wittenauer wrote: > > > On

Re: Pre-Commit build is failing

2017-07-21 Thread Allen Wittenauer
> On Jul 21, 2017, at 5:46 PM, Konstantin Shvachko wrote: > > + d...@yetus.apache.org > > Guys, could you please take a look. Seems like Yetus problem with > pre-commit build for branch-2.7. branch-2.7 is missing stuff in .gitignore.

Re: Pre-Commit build is failing

2017-07-21 Thread Konstantin Shvachko
+ d...@yetus.apache.org Guys, could you please take a look. Seems like Yetus problem with pre-commit build for branch-2.7. Thanks, --Konstantin On Thu, Jul 20, 2017 at 7:19 PM, Brahma Reddy Battula < brahmareddy.batt...@huawei.com> wrote: > Looks this problem is in only branc-2.7.. > > >

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-07-21 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/471/ [Jul 20, 2017 8:15:46 AM] (haibochen) YARN-6685. Add job count in to SLS JSON input format. (Yufei Gu via [Jul 20, 2017 9:03:04 AM] (jlowe) YARN-6837. Null LocalResource visibility or resource type can

Re: LinkedIn Dynamometer Tool (was About 2.7.4 Release)

2017-07-21 Thread Erik Krogen
Hi Sanjay, Actually I was not aware of that work… This seems to be a better way of achieving some of the same things we do externally to the DN process. I will look into reimplementing some parts on top of this; seems it should just require some very small extensions to DataNodeCluster. Thank

Re: Apache Hadoop 2.8.2 Release Plan

2017-07-21 Thread Junping Du
Already get back from Daniel who is from ASF INFRA team, I plan to do following operations on next Monday morning: 1. Drop current branch-2.8.2 and recut branch-2.8.2 from branch-2.8 2. Drop abandoned branch-2.8.1 and rename branch-2.8.1-private to branch-2.8.1 where we just released 2.8.1 from.

Re: Apache Hadoop 2.8.2 Release Plan

2017-07-21 Thread Junping Du
Make sense, just raise: https://issues.apache.org/jira/browse/INFRA-14669 Thanks, Junping From: Vinod Kumar Vavilapalli Sent: Friday, July 21, 2017 12:31 PM To: Junping Du Cc: Kihwal Lee; common-...@hadoop.apache.org;

[jira] [Created] (HDFS-12187) Ozone : add support to DEBUG CLI for ksm.db

2017-07-21 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12187: - Summary: Ozone : add support to DEBUG CLI for ksm.db Key: HDFS-12187 URL: https://issues.apache.org/jira/browse/HDFS-12187 Project: Hadoop HDFS Issue Type:

Re: Apache Hadoop 2.8.2 Release Plan

2017-07-21 Thread Vinod Kumar Vavilapalli
Junping, If we are looking at a month, I’d not rebranch branch-2.8.2 right now given how these things go. We can just continue to commit on branch-2.8 for now. I also think we should just follow up with ASF INFRA and clean up the branches - Delete branch-2.8.2 so that we can recreate it afresh

[jira] [Created] (HDFS-12186) Add INodeAttributeProvider startup progress into HDFS Web UI

2017-07-21 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12186: -- Summary: Add INodeAttributeProvider startup progress into HDFS Web UI Key: HDFS-12186 URL: https://issues.apache.org/jira/browse/HDFS-12186 Project: Hadoop HDFS

[jira] [Created] (HDFS-12185) Ozone: Fix Leaking in TestXceiverClientManager

2017-07-21 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12185: - Summary: Ozone: Fix Leaking in TestXceiverClientManager Key: HDFS-12185 URL: https://issues.apache.org/jira/browse/HDFS-12185 Project: Hadoop HDFS Issue Type:

Re: Apache Hadoop 2.8.2 Release Plan

2017-07-21 Thread Junping Du
Thanks for suggestions, Jason and Kihwal! +1 on releasing 2.8.2 on latest branch-2.8 too. Practically, if branch-2.8.2 cannot be abandoned/replaced (suspect all branches are read-only now), I will manually merge all commits that not landed on 2.8.2 yet. Thanks, Junping

[jira] [Created] (HDFS-12184) Avoid redundant ancestor metadata traversals for listStatus child entries.

2017-07-21 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12184: -- Summary: Avoid redundant ancestor metadata traversals for listStatus child entries. Key: HDFS-12184 URL: https://issues.apache.org/jira/browse/HDFS-12184 Project: Hadoop

Re: LinkedIn Dynamometer Tool (was About 2.7.4 Release)

2017-07-21 Thread sanjay Radia
Erik Great stuff. BTW did you build on top of the “simulated data nodes” in HDFS which has a way to storing only the length of data (but not real data)? That work allowed supplementing with a matching editsLog for the NN. Your approach of using a real image has the advantage of being able

[jira] [Created] (HDFS-12183) Ozone: KSM : Use proper defaults for block client address

2017-07-21 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-12183: --- Summary: Ozone: KSM : Use proper defaults for block client address Key: HDFS-12183 URL: https://issues.apache.org/jira/browse/HDFS-12183 Project: Hadoop HDFS

Re: Apache Hadoop 2.8.2 Release Plan

2017-07-21 Thread Jason Lowe
+1 to base the 2.8.2 release off of the more recent activity on branch-2.8.  Because branch-2.8.2 was cut so long ago it is missing a lot of fixes that are in branch-2.8.  There also are a lot of JIRAs that claim they are fixed in 2.8.2 but are not in branch-2.8.2.  Having the 2.8.2 release be

Re: Apache Hadoop 2.8.2 Release Plan

2017-07-21 Thread Kihwal Lee
Thanks for driving the next 2.8 release, Junping. While I was committing a blocker for 2.7.4, I noticed some of the jiras are back-ported to 2.7, but missing in branch-2.8.2.  Perhaps it is safer and easier to simply rebranch 2.8.2. Thanks,Kihwal On Thursday, July 20, 2017, 3:32:16 PM CDT,

[jira] [Created] (HDFS-12182) BlockManager.metSave does not distinguish between "under replicated" and "corrupt" blocks

2017-07-21 Thread Wellington Chevreuil (JIRA)
Wellington Chevreuil created HDFS-12182: --- Summary: BlockManager.metSave does not distinguish between "under replicated" and "corrupt" blocks Key: HDFS-12182 URL:

[jira] [Created] (HDFS-12181) Ozone:TestContainerReplicationManager fails because LogCapturer fails to find expected log messages

2017-07-21 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12181: Summary: Ozone:TestContainerReplicationManager fails because LogCapturer fails to find expected log messages Key: HDFS-12181 URL:

[jira] [Created] (HDFS-12180) Ozone: Corona: Add stats and progress bar to corona

2017-07-21 Thread Nandakumar (JIRA)
Nandakumar created HDFS-12180: - Summary: Ozone: Corona: Add stats and progress bar to corona Key: HDFS-12180 URL: https://issues.apache.org/jira/browse/HDFS-12180 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12179) Ozone: Corona: Adding corona as part of hdfs command

2017-07-21 Thread Nandakumar (JIRA)
Nandakumar created HDFS-12179: - Summary: Ozone: Corona: Adding corona as part of hdfs command Key: HDFS-12179 URL: https://issues.apache.org/jira/browse/HDFS-12179 Project: Hadoop HDFS Issue

Re: Running HDFS from source broken since HDFS-11596

2017-07-21 Thread Lars Francke
Thanks John, that was helpful. I see that you're using the hadoop-dist directory while the wiki points directly to the project folders (e.g. hadoop-hdfs-project etc.). The former works the latter doesn't. So I guess it's a matter of updating the wiki. On Thu, Jul 20, 2017 at 9:09 AM, John Zhuge

[jira] [Resolved] (HDFS-12029) Data node process crashes after kernel upgrade

2017-07-21 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar resolved HDFS-12029. --- Resolution: Not A Bug > Data node process crashes after kernel upgrade >