[jira] [Created] (HDFS-6747) Display the most recent GC info on NN webUI

2014-07-23 Thread Ming Ma (JIRA)
Ming Ma created HDFS-6747: - Summary: Display the most recent GC info on NN webUI Key: HDFS-6747 URL: https://issues.apache.org/jira/browse/HDFS-6747 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-6746) Support datanode list pagination and filtering for big clusters on NN webUI

2014-07-23 Thread Ming Ma (JIRA)
Ming Ma created HDFS-6746: - Summary: Support datanode list pagination and filtering for big clusters on NN webUI Key: HDFS-6746 URL: https://issues.apache.org/jira/browse/HDFS-6746 Project: Hadoop HDFS

[jira] [Created] (HDFS-6745) Display the list of "very-under-replicated blocks" as well as the files on NN webUI

2014-07-23 Thread Ming Ma (JIRA)
Ming Ma created HDFS-6745: - Summary: Display the list of "very-under-replicated blocks" as well as the files on NN webUI Key: HDFS-6745 URL: https://issues.apache.org/jira/browse/HDFS-6745 Project: Hadoop HDF

[jira] [Created] (HDFS-6744) Improve decommissioning nodes and dead nodes access on the new NN webUI

2014-07-23 Thread Ming Ma (JIRA)
Ming Ma created HDFS-6744: - Summary: Improve decommissioning nodes and dead nodes access on the new NN webUI Key: HDFS-6744 URL: https://issues.apache.org/jira/browse/HDFS-6744 Project: Hadoop HDFS

[jira] [Created] (HDFS-6743) Put IP address into a new column on the new NN webUI

2014-07-23 Thread Ming Ma (JIRA)
Ming Ma created HDFS-6743: - Summary: Put IP address into a new column on the new NN webUI Key: HDFS-6743 URL: https://issues.apache.org/jira/browse/HDFS-6743 Project: Hadoop HDFS Issue Type: Improvem

[jira] [Created] (HDFS-6742) Support sorting datanode list on the new NN webUI

2014-07-23 Thread Ming Ma (JIRA)
Ming Ma created HDFS-6742: - Summary: Support sorting datanode list on the new NN webUI Key: HDFS-6742 URL: https://issues.apache.org/jira/browse/HDFS-6742 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-6741) Improve permission denied message when FSPermissionChecker#checkOwner fails

2014-07-23 Thread Stephen Chu (JIRA)
Stephen Chu created HDFS-6741: - Summary: Improve permission denied message when FSPermissionChecker#checkOwner fails Key: HDFS-6741 URL: https://issues.apache.org/jira/browse/HDFS-6741 Project: Hadoop HDF

[jira] [Resolved] (HDFS-645) Namenode does not leave safe mode even if all blocks are available

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-645. --- Resolution: Fixed This was fixed in 1.x at some point. > Namenode does not leave safe mode eve

[jira] [Resolved] (HDFS-635) HDFS Project page does not show 0.20.1 documentation/release information.

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-635. --- Resolution: Fixed > HDFS Project page does not show 0.20.1 documentation/release information. >

[jira] [Created] (HDFS-6740) FSDataset add volumes dynamically

2014-07-23 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-6740: --- Summary: FSDataset add volumes dynamically Key: HDFS-6740 URL: https://issues.apache.org/jira/browse/HDFS-6740 Project: Hadoop HDFS Issue Type: Sub-task Af

[jira] [Resolved] (HDFS-4634) Make HDFS home directory configurable per user

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-4634. Resolution: Duplicate > Make HDFS home directory configurable per user > ---

[jira] [Resolved] (HDFS-593) Support for getting user home dir from server side

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-593. --- Resolution: Duplicate I'm going to dupe this to HADOOP-10334 . It covers a lot of the same gro

[jira] [Resolved] (HDFS-591) Namenode should mark the replica as corrupted if a DN has reported different length of a Complete block

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-591. --- Resolution: Duplicate > Namenode should mark the replica as corrupted if a DN has reported diff

[jira] [Resolved] (HDFS-583) HDFS should enforce a max block size

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-583. --- Resolution: Won't Fix I'm going to close this as Won't Fix. At some point in time, block sizes

[jira] [Resolved] (HDFS-331) hadoop fsck should ignore lost+found

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-331. --- Resolution: Fixed Looks like this is fixed. > hadoop fsck should ignore lost+found > -

[jira] [Resolved] (HDFS-5642) libhdfs Windows compatibility.

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-5642. Resolution: Duplicate Closing this one in favor of HDFS-573. > libhdfs Windows compatibilit

[jira] [Resolved] (HDFS-571) Hdfs source code has significant number of JavaDocs errors and warnings

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-571. --- Resolution: Fixed Likely stale. > Hdfs source code has significant number of JavaDocs errors a

[jira] [Resolved] (HDFS-6732) Fix inconsistent description in NFS user guide doc for proxy user

2014-07-23 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li resolved HDFS-6732. -- Resolution: Duplicate > Fix inconsistent description in NFS user guide doc for proxy user >

[jira] [Resolved] (HDFS-559) Work out the memory consumption of NN artifacts on a compressed pointer JVM

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-559. --- Resolution: Won't Fix I'm going to close this as Won't Fix, simply because compressed oops is n

[jira] [Created] (HDFS-6739) Add getDatanodeStorageReport to ClientProtocol

2014-07-23 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-6739: - Summary: Add getDatanodeStorageReport to ClientProtocol Key: HDFS-6739 URL: https://issues.apache.org/jira/browse/HDFS-6739 Project: Hadoop HDFS Is

[jira] [Resolved] (HDFS-515) test-patch doesn't work on git checkouts

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-515. --- Resolution: Fixed Likely stale. > test-patch doesn't work on git checkouts > -

[jira] [Resolved] (HDFS-460) Expose NN and DN hooks to service plugins

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-460. --- Resolution: Won't Fix Closing this as won't fix and leaving it at that. > Expose NN and DN

[jira] [Resolved] (HDFS-450) eclipse-files target does not create HDFS_Ant_Builder

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-450. --- Resolution: Fixed We stepped on all of our ants. Closing. > eclipse-files target does not crea

[jira] [Resolved] (HDFS-448) An IOException thrown in the BlockReceiver file causes some tests to hang

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-448. --- Resolution: Fixed Release Note: Stale. > An IOException thrown in the BlockReceiver file

Re: [DISCUSS] Assume Private-Unstable for classes that are not annotated

2014-07-23 Thread Karthik Kambatla
Fair points, Jason. The fact that we include this in the compatibility guideline "should not" affect how developers go about this. We should still strive to annotate every new class we add, and reviewers should continue to check for them. However, in case we miss annotations, we won't be burdened

[jira] [Resolved] (HDFS-6686) Archival Storage: Use fallback storage types

2014-07-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-6686. --- Resolution: Fixed Fix Version/s: Archival Storage (HDFS-6584) Hadoop Flags:

Finding file size during block placement

2014-07-23 Thread Arjun
Hi, I want to write a block placement policy that takes the size of the file being placed into account. Something like what is done in CoHadoop or BEEMR paper. I have the following questions: 1- Is srcPath in chooseTarget the path to the original un-chunked file, or it is a path to a single

[jira] [Resolved] (HDFS-6733) Creating encryption zone results in NPE when KeyProvider is null

2014-07-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb resolved HDFS-6733. Resolution: Fixed Fix Version/s: fs-encryption (HADOOP-10150 and HDFS-6134) Target V

Re: [DISCUSS] Assume Private-Unstable for classes that are not annotated

2014-07-23 Thread Jason Lowe
I think that's a reasonable proposal as long as we understand it changes the burden from finding all the things that should be marked @Private to finding all the things that should be marked @Public. As Tom Graves pointed out in an earlier discussion about @LimitedPrivate, it may be impossible

Hadoop-Hdfs-trunk - Build # 1813 - Still Failing

2014-07-23 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1813/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 13874 lines...] [INFO] --- maven-site-plugin:3.3:attach-d

Build failed in Jenkins: Hadoop-Hdfs-trunk #1813

2014-07-23 Thread Apache Jenkins Server
See Changes: [sandy] YARN-2313. Livelock can occur in FairScheduler when there are lots of running apps (Tsuyoshi Ozawa via Sandy Ryza) [wang] HADOOP-10881. Clarify usage of encryption and encrypted encryption key in KeyProviderCry

Re: [DISCUSS] Assume Private-Unstable for classes that are not annotated

2014-07-23 Thread Tsuyoshi OZAWA
+1 for Karthik's suggestion. - Tsuyoshi On Wed, Jul 23, 2014 at 6:54 AM, Karthik Kambatla wrote: > Hi devs > > As you might have noticed, we have several classes and methods in them that > are not annotated at all. This is seldom intentional. Avoiding incompatible > changes to all these classes