[jira] [Commented] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

2015-05-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529416#comment-14529416 ] Chris Nauroth commented on HDFS-5223: - bq. The fact that presently all features are

[jira] [Commented] (HDFS-8326) Documentation about when checkpoints are run is out of date

2015-05-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528775#comment-14528775 ] Andrew Wang commented on HDFS-8326: --- Hi Misty, a few review comments: * I believe the

[jira] [Updated] (HDFS-8326) Documentation about when checkpoints are run is out of date

2015-05-05 Thread Misty Stanley-Jones (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HDFS-8326: -- Attachment: HDFS-8326.patch Here is my attempt to update the documentation.

[jira] [Updated] (HDFS-8326) Documentation about when checkpoints are run is out of date

2015-05-05 Thread Misty Stanley-Jones (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HDFS-8326: -- Status: Patch Available (was: Open) Documentation about when checkpoints are run is

[jira] [Commented] (HDFS-8326) Documentation about when checkpoints are run is out of date

2015-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528773#comment-14528773 ] Hadoop QA commented on HDFS-8326: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8322) Display warning if hadoop fs -ls is showing the local filesystem

2015-05-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528706#comment-14528706 ] Andrew Wang commented on HDFS-8322: --- Eddy, if you really want to put this in, let's do it

[jira] [Commented] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

2015-05-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528808#comment-14528808 ] Andrew Wang commented on HDFS-8306: --- I had a thought about testing.

[jira] [Created] (HDFS-8326) Documentation about when checkpoints are run is out of date

2015-05-05 Thread Misty Stanley-Jones (JIRA)
Misty Stanley-Jones created HDFS-8326: - Summary: Documentation about when checkpoints are run is out of date Key: HDFS-8326 URL: https://issues.apache.org/jira/browse/HDFS-8326 Project: Hadoop

[jira] [Updated] (HDFS-8322) Display warning if hadoop fs -ls is showing the local filesystem

2015-05-05 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8322: Resolution: Won't Fix Status: Resolved (was: Patch Available) Thanks for suggestions, [~aw]

[jira] [Commented] (HDFS-8237) Move all protocol classes used by ClientProtocol to hdfs-client

2015-05-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528293#comment-14528293 ] Hudson commented on HDFS-8237: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #184 (See

[jira] [Commented] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

2015-05-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528291#comment-14528291 ] Hudson commented on HDFS-8290: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #184 (See

[jira] [Commented] (HDFS-7397) Add more detail to the documentation for the conf key dfs.client.read.shortcircuit.streams.cache.size

2015-05-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528297#comment-14528297 ] Hudson commented on HDFS-7397: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #184 (See

[jira] [Updated] (HDFS-8305) HDFS INotify: the destination field of RenameOp should always end with the file name

2015-05-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8305: --- Resolution: Fixed Fix Version/s: 2.7.1 Target Version/s: 2.7.1 (was:

[jira] [Commented] (HDFS-8019) Erasure Coding: erasure coding chunk buffer allocation and management

2015-05-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528958#comment-14528958 ] Tsz Wo Nicholas Sze commented on HDFS-8019: --- Sure, using ByteArrayManager for now

[jira] [Updated] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-2484: --- Attachment: (was: HDFS-2484.02.patch) checkLease should throw FileNotFoundException when file does not

[jira] [Updated] (HDFS-8311) DataStreamer.transfer() should timeout the socket InputStream.

2015-05-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8311: --- Target Version/s: 2.8.0 Status: Patch Available (was: Open)

[jira] [Commented] (HDFS-7672) Erasure Coding: handle write failure for stripping coding blocks

2015-05-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529029#comment-14529029 ] Tsz Wo Nicholas Sze commented on HDFS-7672: --- 1. endBlock is from DataStreamer in

[jira] [Commented] (HDFS-8284) Add usage of tracing originated in DFSClient to doc

2015-05-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529094#comment-14529094 ] Colin Patrick McCabe commented on HDFS-8284: Thanks, [~iwasakims]. This looks

[jira] [Updated] (HDFS-8255) Rename getBlockReplication to getPreferredBlockStorageNum

2015-05-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8255: Attachment: HDFS-8255.001.patch Thanks Andrew for the comment. Yes we do want to support striping +

[jira] [Updated] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality (pread)

2015-05-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7678: Attachment: HDFS-7678-HDFS-7285.010.patch Thanks Jing for the review; it's very helpful. Updating the patch

[jira] [Commented] (HDFS-7672) Erasure Coding: handle write failure for stripping coding blocks

2015-05-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529129#comment-14529129 ] Jing Zhao commented on HDFS-7672: - Thanks for updating the patch, Nicholas! The latest

[jira] [Commented] (HDFS-8311) DataStreamer.transfer() should timeout the socket InputStream.

2015-05-05 Thread Kiran Kumar M R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528057#comment-14528057 ] Kiran Kumar M R commented on HDFS-8311: --- Thats fine, reassigned

[jira] [Commented] (HDFS-8242) Erasure Coding: XML based end-to-end test for ECCli commands

2015-05-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528018#comment-14528018 ] Rakesh R commented on HDFS-8242: [~vinayrpet] and [~zhz], thank you for the helpful code

[jira] [Updated] (HDFS-6348) Secondary namenode - RMI Thread prevents JVM from exiting after main() completes

2015-05-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-6348: --- Labels: BB2015-05-RFC (was: ) Secondary namenode - RMI Thread prevents JVM from exiting after main()

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528058#comment-14528058 ] Hadoop QA commented on HDFS-7758: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8242) Erasure Coding: XML based end-to-end test for ECCli commands

2015-05-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8242: Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Status:

[jira] [Updated] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-2484: --- Fix Version/s: 2.8.0 Labels: BB2015-05-RFC (was: ) checkLease should throw FileNotFoundException

[jira] [Updated] (HDFS-6348) Secondary namenode - RMI Thread prevents JVM from exiting after main() completes

2015-05-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-6348: --- Target Version/s: 2.8.0 Secondary namenode - RMI Thread prevents JVM from exiting after main() completes

[jira] [Updated] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-2484: --- Target Version/s: 2.8.0 checkLease should throw FileNotFoundException when file does not exist

[jira] [Updated] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-2484: --- Fix Version/s: (was: 2.8.0) checkLease should throw FileNotFoundException when file does not exist

[jira] [Updated] (HDFS-4185) Add a metric for number of active leases

2015-05-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-4185: --- Target Version/s: 2.8.0 Labels: BB2015-05-RFC (was: ) Add a metric for number of active leases

[jira] [Updated] (HDFS-8311) DataStreamer.transfer() should timeout the socket InputStream.

2015-05-05 Thread Kiran Kumar M R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kiran Kumar M R updated HDFS-8311: -- Assignee: Esteban Gutierrez (was: Kiran Kumar M R) DataStreamer.transfer() should timeout the

[jira] [Updated] (HDFS-8097) TestFileTruncate.testTruncate4Symlink is failing intermittently

2015-05-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8097: --- Attachment: HDFS-8097-003.patch Attached another patch to get the jenkins report.

[jira] [Commented] (HDFS-8314) Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE to the users

2015-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528049#comment-14528049 ] Hadoop QA commented on HDFS-8314: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality (pread)

2015-05-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528086#comment-14528086 ] Jing Zhao commented on HDFS-7678: - Thanks for the explanation and updating the patch, Zhe!

[jira] [Commented] (HDFS-8314) Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE to the users

2015-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528123#comment-14528123 ] Hadoop QA commented on HDFS-8314: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8219) setStoragePolicy with folder behavior is different after cluster restart

2015-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528116#comment-14528116 ] Hadoop QA commented on HDFS-8219: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-6407) new namenode UI, lost ability to sort columns in datanode tab

2015-05-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529143#comment-14529143 ] Haohui Mai commented on HDFS-6407: -- {code} +jQuery.fn.dataTable.ext.type.detect.unshift(

[jira] [Commented] (HDFS-8315) Datanode does not log reads

2015-05-05 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529178#comment-14529178 ] Gopal V commented on HDFS-8315: --- [~kihwal]: the HDFS in-memory layer is IOPS bound on logging

[jira] [Updated] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

2015-05-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5223: Attachment: HDFS-5223.005.patch Allow edit log/fsimage format changes without changing layout

[jira] [Updated] (HDFS-8219) setStoragePolicy with folder behavior is different after cluster restart

2015-05-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8219: - Resolution: Fixed Fix Version/s: 2.8.0 Release Note: The fix has been committed to trunk and

[jira] [Commented] (HDFS-8246) Get HDFS file name based on block pool id and block id

2015-05-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529256#comment-14529256 ] Colin Patrick McCabe commented on HDFS-8246: How about having

[jira] [Commented] (HDFS-8271) NameNode should bind on both IPv6 and IPv4 if running on dual-stack machine and IPv6 enabled

2015-05-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529197#comment-14529197 ] Colin Patrick McCabe commented on HDFS-8271: An uber jira is a good idea.

[jira] [Updated] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

2015-05-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5223: Attachment: HDFS-5223-HDFS-Downgrade-Extended-Support.pdf I've been testing a patch based on

[jira] [Commented] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

2015-05-05 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529231#comment-14529231 ] Aaron T. Myers commented on HDFS-5223: -- Hey Chris, thanks a lot for working on this.

[jira] [Updated] (HDFS-8219) setStoragePolicy with folder behavior is different after cluster restart

2015-05-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8219: Release Note: (was: The fix has been committed to trunk and branch-2.) setStoragePolicy with

[jira] [Commented] (HDFS-8219) setStoragePolicy with folder behavior is different after cluster restart

2015-05-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529242#comment-14529242 ] Hudson commented on HDFS-8219: -- FAILURE: Integrated in Hadoop-trunk-Commit #7740 (See

[jira] [Updated] (HDFS-7672) Erasure Coding: handle write failure for stripping coding blocks

2015-05-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7672: -- Attachment: h7672_20150505.patch h7672_20150505.patch Here is a new patch. Please let

[jira] [Updated] (HDFS-8255) Rename getBlockReplication to getPreferredBlockStorageNum

2015-05-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8255: Affects Version/s: 2.8.0 Rename getBlockReplication to getPreferredBlockStorageNum

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-05-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528973#comment-14528973 ] Hudson commented on HDFS-7758: -- FAILURE: Integrated in Hadoop-trunk-Commit #7737 (See

[jira] [Updated] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-2484: --- Attachment: HDFS-2484.02.patch checkLease should throw FileNotFoundException when file does not exist

[jira] [Commented] (HDFS-8219) setStoragePolicy with folder behavior is different after cluster restart

2015-05-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529044#comment-14529044 ] Xiaoyu Yao commented on HDFS-8219: -- The patch looks good to me. Thanks [~surendrasingh]

[jira] [Updated] (HDFS-8291) Modify NN WebUI to display correct unit

2015-05-05 Thread Zhongyi Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongyi Xie updated HDFS-8291: -- Attachment: HDFS-8291.002.patch Fixed the jmx page as well Modify NN WebUI to display correct unit

[jira] [Commented] (HDFS-8305) HDFS INotify: the destination field of RenameOp should always end with the file name

2015-05-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528948#comment-14528948 ] Hudson commented on HDFS-8305: -- FAILURE: Integrated in Hadoop-trunk-Commit #7736 (See

[jira] [Updated] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-2484: --- Attachment: HDFS-2484.02.patch checkLease should throw FileNotFoundException when file does not exist

[jira] [Commented] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-05-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528998#comment-14528998 ] Colin Patrick McCabe commented on HDFS-7847: +1. Thanks, [~clamb]. Modify

[jira] [Commented] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

2015-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529045#comment-14529045 ] Hadoop QA commented on HDFS-7980: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8255) Rename getBlockReplication to getPreferredBlockStorageNum

2015-05-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528882#comment-14528882 ] Andrew Wang commented on HDFS-8255: --- Seems like use of this field is overloaded in EC to

[jira] [Commented] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528895#comment-14528895 ] Konstantin Shvachko commented on HDFS-2484: --- Hey Rakesh, your change looks good

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-05-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528910#comment-14528910 ] Colin Patrick McCabe commented on HDFS-7758: +1. Thanks, Eddy. Retire

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-05-05 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528918#comment-14528918 ] Lei (Eddy) Xu commented on HDFS-7758: - Thanks a lot for your suggestions and reviews,

[jira] [Commented] (HDFS-8295) Add MODIFY and REMOVE ECSchema editlog operations

2015-05-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528965#comment-14528965 ] Tsz Wo Nicholas Sze commented on HDFS-8295: --- Please do not add MODIFY and REMOVE

[jira] [Commented] (HDFS-8062) Remove hard-coded values in favor of EC schema

2015-05-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528970#comment-14528970 ] Tsz Wo Nicholas Sze commented on HDFS-8062: --- [~drankye], why May 8th? What is

[jira] [Updated] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-05-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7758: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-8296) BlockManager.getUnderReplicatedBlocksCount() is not giving correct count if namenode in safe mode.

2015-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528983#comment-14528983 ] Hadoop QA commented on HDFS-8296: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

2015-05-05 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8306: Attachment: HDFS-8306.002.patch Updated the patch to fix checkstyle warnings. bq. We can do

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-05-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529040#comment-14529040 ] Tsz Wo Nicholas Sze commented on HDFS-7859: --- Please do not commit this JIRA to

[jira] [Commented] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-05-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529036#comment-14529036 ] Hudson commented on HDFS-7847: -- FAILURE: Integrated in Hadoop-trunk-Commit #7739 (See

[jira] [Commented] (HDFS-8284) Add usage of tracing originated in DFSClient to doc

2015-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528183#comment-14528183 ] Hadoop QA commented on HDFS-8284: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8138) Refine or extend EC command to support all cases

2015-05-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528189#comment-14528189 ] Vinayakumar B commented on HDFS-8138: - For the current phase's recovery task, CODEC is

[jira] [Commented] (HDFS-8019) Erasure Coding: erasure coding chunk buffer allocation and management

2015-05-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528210#comment-14528210 ] Vinayakumar B commented on HDFS-8019: - for client side erasure encoding, chunk buffers

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-05-05 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Attachment: HDFS-7847.004.patch [~cmccabe], I've rebased the patch. Modify NNThroughputBenchmark to

[jira] [Created] (HDFS-8324) Add trace info to DFSClient#getErasureCodingZoneInfo(..)

2015-05-05 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-8324: --- Summary: Add trace info to DFSClient#getErasureCodingZoneInfo(..) Key: HDFS-8324 URL: https://issues.apache.org/jira/browse/HDFS-8324 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8138) Refine or extend EC command to support all cases

2015-05-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8138: Parent Issue: HDFS-8031 (was: HDFS-7285) Refine or extend EC command to support all cases

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-05-05 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Attachment: (was: HDFS-7847.004.patch) Modify NNThroughputBenchmark to be able to operate on a

[jira] [Commented] (HDFS-7688) Client side api/config changes to support online encoding

2015-05-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528215#comment-14528215 ] Vinayakumar B commented on HDFS-7688: - You are right [~szetszwo]. I think client side

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-05-05 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Attachment: HDFS-7847.005.patch Modify NNThroughputBenchmark to be able to operate on a remote

[jira] [Resolved] (HDFS-7688) Client side api/config changes to support online encoding

2015-05-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B resolved HDFS-7688. - Resolution: Duplicate Client side api/config changes to support online encoding

[jira] [Updated] (HDFS-8324) Add trace info to DFSClient#getErasureCodingZoneInfo(..)

2015-05-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8324: Attachment: HDFS-8324-HDFS-7285.01.patch Add trace info to DFSClient#getErasureCodingZoneInfo(..)

[jira] [Updated] (HDFS-8324) Add trace info to DFSClient#getErasureCodingZoneInfo(..)

2015-05-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8324: Status: Patch Available (was: In Progress) Add trace info to

[jira] [Work started] (HDFS-8324) Add trace info to DFSClient#getErasureCodingZoneInfo(..)

2015-05-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8324 started by Vinayakumar B. --- Add trace info to DFSClient#getErasureCodingZoneInfo(..)

[jira] [Commented] (HDFS-8097) TestFileTruncate.testTruncate4Symlink is failing intermittently

2015-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528225#comment-14528225 ] Hadoop QA commented on HDFS-8097: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7310) Mover can give first priority to local DN if it has target storage type available in local DN

2015-05-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529292#comment-14529292 ] Tsz Wo Nicholas Sze commented on HDFS-7310: --- FYI, Mover/Balancer may schedule two

[jira] [Commented] (HDFS-8291) Modify NN WebUI to display correct unit

2015-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529293#comment-14529293 ] Hadoop QA commented on HDFS-8291: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8314) Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE to the users

2015-05-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated HDFS-8314: Attachment: (was: HDFS-8314-trunk.004.patch) Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE

[jira] [Updated] (HDFS-8284) Add usage of tracing originated in DFSClient to doc

2015-05-05 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8284: --- Attachment: HDFS-8284.003.patch bq. The only thing I would suggest is that we should remove

[jira] [Commented] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

2015-05-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529313#comment-14529313 ] Chris Nauroth commented on HDFS-5223: - Hi [~atm]. bq. Seems like this approach would

[jira] [Updated] (HDFS-8314) Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE to the users

2015-05-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated HDFS-8314: Attachment: HDFS-8314-trunk.004.patch Could not reproduce the UT failure locally. Can anybody double check this? I'm

[jira] [Commented] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

2015-05-05 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529336#comment-14529336 ] Aaron T. Myers commented on HDFS-5223: -- bq. Complexity in HDFS often arises from

[jira] [Commented] (HDFS-7672) Erasure Coding: handle write failure for stripping coding blocks

2015-05-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529341#comment-14529341 ] Zhe Zhang commented on HDFS-7672: - Thanks for the new patch Nicholas. A few comments: Nits:

[jira] [Commented] (HDFS-8157) Writes to RAM DISK reserve locked memory for block files

2015-05-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529275#comment-14529275 ] Colin Patrick McCabe commented on HDFS-8157: Thanks for this, [~arpitagarwal].

[jira] [Commented] (HDFS-8314) Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE to the users

2015-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529287#comment-14529287 ] Hadoop QA commented on HDFS-8314: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529302#comment-14529302 ] Konstantin Shvachko commented on HDFS-2484: --- +1 pending Jenkins. checkLease

[jira] [Commented] (HDFS-8019) Erasure Coding: erasure coding chunk buffer allocation and management

2015-05-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528262#comment-14528262 ] Kai Zheng commented on HDFS-8019: - Hi Vinay, thanks for the taking and good question. I

[jira] [Work started] (HDFS-7663) Erasure Coding: support Append on stripping EC file

2015-05-05 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7663 started by Yong Zhang. Erasure Coding: support Append on stripping EC file

<    1   2   3   4   5