[jira] [Commented] (HDFS-9576) HTrace: collect position/length information on read operations

2016-01-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088314#comment-15088314 ] Xiao Chen commented on HDFS-9576: - Thanks Zhe for the new rev. +1 (non-binding) from me once the checkstyle

[jira] [Commented] (HDFS-9626) TestBlockReplacement#testBlockReplacement fails occasionally

2016-01-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088318#comment-15088318 ] Xiao Chen commented on HDFS-9626: - Thanks Zhe for the review. Failed tests are not touched by this patch.

[jira] [Commented] (HDFS-9588) DiskBalancer : Add submitDiskbalancer RPC

2016-01-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088412#comment-15088412 ] Arpit Agarwal commented on HDFS-9588: - Hi [~anu], my comments below. # Missing check for presence of

[jira] [Commented] (HDFS-8356) Document missing properties in hdfs-default.xml

2016-01-07 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088415#comment-15088415 ] Ray Chiang commented on HDFS-8356: -- Just as a quick FYI, I've already run this verifier using HADOOP-12101

[jira] [Updated] (HDFS-9469) DiskBalancer : Add Planner

2016-01-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9469: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-1312 Status:

[jira] [Commented] (HDFS-9627) libhdfs++: Add a mechanism to retrieve human readable error messages through the C API

2016-01-07 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088336#comment-15088336 ] Bob Hansen commented on HDFS-9627: -- Quick comments: Should libhdfspp.h live in bindings/c? Minor nitpick:

[jira] [Commented] (HDFS-9627) libhdfs++: Add a mechanism to retrieve human readable error messages through the C API

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088376#comment-15088376 ] Hadoop QA commented on HDFS-9627: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2016-01-07 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088431#comment-15088431 ] Anu Engineer commented on HDFS-1312: [~andrew.wang] I really appreciate you taking time out to read the

[jira] [Commented] (HDFS-9621) getListing wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088524#comment-15088524 ] Hadoop QA commented on HDFS-9621: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088369#comment-15088369 ] Kai Zheng commented on HDFS-8999: - This isn't a review but just want to understand the work. Some minor

[jira] [Commented] (HDFS-9574) Reduce client failures during datanode restart

2016-01-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088438#comment-15088438 ] Kihwal Lee commented on HDFS-9574: -- The new patch addresses the review comments. - All relevant

[jira] [Updated] (HDFS-9574) Reduce client failures during datanode restart

2016-01-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9574: - Attachment: HDFS-9574.v3.patch > Reduce client failures during datanode restart >

[jira] [Updated] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-07 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9624: Attachment: HDFS-9624.003.patch Update the latest patch. > DataNode start slowly due to the initial DU

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2016-01-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088505#comment-15088505 ] Andrew Wang commented on HDFS-1312: --- Hi Anu, thanks for the reply, bq. Our own experience from the field

[jira] [Updated] (HDFS-9588) DiskBalancer : Add submitDiskbalancer RPC

2016-01-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9588: Fix Version/s: (was: HDFS-1312) Status: Patch Available (was: Open) > DiskBalancer :

[jira] [Updated] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-07 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9624: Attachment: (was: HDFS-9624.003.patch) > DataNode start slowly due to the initial DU command operations

[jira] [Created] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-07 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-9629: --- Summary: Update the footer of Web UI to show year 2016 Key: HDFS-9629 URL: https://issues.apache.org/jira/browse/HDFS-9629 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088491#comment-15088491 ] Xiao Chen commented on HDFS-9629: - HDFS-8149 changed the trademark year from 2014 to 2015 last year. For

[jira] [Updated] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9629: Labels: supportability (was: ) > Update the footer of Web UI to show year 2016 >

[jira] [Commented] (HDFS-9621) getListing wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088498#comment-15088498 ] Hadoop QA commented on HDFS-9621: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8298) HA: NameNode should not shut down completely without quorum, doesn't recover from temporary network outages

2016-01-07 Thread Gokul (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087128#comment-15087128 ] Gokul commented on HDFS-8298: - Hi [~qwertymaniac], Do we know how to avoid Namenode shutdown due to long GC

[jira] [Commented] (HDFS-9619) DataNode sometimes can not find blockpool for the correct namenode

2016-01-07 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087071#comment-15087071 ] Vinayakumar B commented on HDFS-9619: - +1, committing shortly > DataNode sometimes can not find

[jira] [Updated] (HDFS-9625) set replication for empty file failed when set storage policy

2016-01-07 Thread danie deng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] danie deng updated HDFS-9625: - Component/s: namenode > set replication for empty file failed when set storage policy >

[jira] [Updated] (HDFS-9619) SimulatedFSDataset sometimes can not find blockpool for the correct namenode

2016-01-07 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9619: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Assigned] (HDFS-9625) set replication for empty file failed when set storage policy

2016-01-07 Thread danie deng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] danie deng reassigned HDFS-9625: Assignee: danie deng > set replication for empty file failed when set storage policy >

[jira] [Updated] (HDFS-9625) set replication for empty file failed when set storage policy

2016-01-07 Thread danie deng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] danie deng updated HDFS-9625: - Description: When setReplication, the FSDirectory#updateCount need calculate the lelated

[jira] [Updated] (HDFS-9619) SimulatedFSDataset sometimes can not find blockpool for the correct namenode

2016-01-07 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9619: Summary: SimulatedFSDataset sometimes can not find blockpool for the correct namenode (was:

[jira] [Updated] (HDFS-9522) Cleanup o.a.h.hdfs.protocol.SnapshotDiffReport

2016-01-07 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9522: - Attachment: HDFS-9522-003.patch Patch 003: * Fix checkstyle and findbugs errors and warnings. * Abandon

[jira] [Commented] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087318#comment-15087318 ] Kai Zheng commented on HDFS-9624: - Yeah, it would be good to make the hard-coded value configurable. The

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

2016-01-07 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087292#comment-15087292 ] Phil Yang commented on HDFS-9600: - Thanks :) > do not check replication if the block is under construction

[jira] [Commented] (HDFS-9047) Retire libwebhdfs

2016-01-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087388#comment-15087388 ] Kihwal Lee commented on HDFS-9047: -- +1 on removing this from 2.7. [~vinodkv], what do you think? > Retire

[jira] [Commented] (HDFS-9522) Cleanup o.a.h.hdfs.protocol.SnapshotDiffReport

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087303#comment-15087303 ] Hadoop QA commented on HDFS-9522: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9047) Retire libwebhdfs

2016-01-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087482#comment-15087482 ] Junping Du commented on HDFS-9047: -- bq. IMO +1 on removing them in 2.6 / 2.7 if it's breaking the

[jira] [Commented] (HDFS-9625) set replication for empty file failed when set storage policy

2016-01-07 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088580#comment-15088580 ] DENG FEI commented on HDFS-9625: ok,i will upload a trunk patch for it > set replication for empty file

[jira] [Updated] (HDFS-9625) set replication for empty file failed when set storage policy

2016-01-07 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DENG FEI updated HDFS-9625: --- Attachment: patch.HDFS-9625.002 > set replication for empty file failed when set storage policy >

[jira] [Commented] (HDFS-9469) DiskBalancer : Add Planner

2016-01-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088583#comment-15088583 ] Tsz Wo Nicholas Sze commented on HDFS-9469: --- [~arpitagarwal], thanks for reviewing and committing

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

2016-01-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088624#comment-15088624 ] Kai Zheng commented on HDFS-8562: - Hi Yanping, That sounds great and thanks for your effort! bq. they

[jira] [Commented] (HDFS-9588) DiskBalancer : Add submitDiskbalancer RPC

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088632#comment-15088632 ] Hadoop QA commented on HDFS-9588: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2016-01-07 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088688#comment-15088688 ] Anu Engineer commented on HDFS-1312: Hi [~andrew.wang] Thanks for the quick response. I was thinking

[jira] [Commented] (HDFS-9574) Reduce client failures during datanode restart

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088673#comment-15088673 ] Hadoop QA commented on HDFS-9574: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-07 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9624: Attachment: HDFS-9624.003.patch Thanks [~drankye] for review. I update the testcase for beyond internal time

[jira] [Updated] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

2016-01-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8562: Attachment: HDFS-8562.004b.patch Rebased the patch. > HDFS Performance is impacted by FileInputStream

[jira] [Commented] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088660#comment-15088660 ] Hadoop QA commented on HDFS-9624: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9613) Don't compare file checksums after copy if block size and checksum opt are not preserved for replicated files

2016-01-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088792#comment-15088792 ] Kai Zheng commented on HDFS-9613: - HDFS-9630 is just opened to handle the refactoring things separately. >

[jira] [Updated] (HDFS-9631) Restarting namenode after deleting a directory with snapshot will fail

2016-01-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9631: -- Affects Version/s: 3.0.0 > Restarting namenode after deleting a directory with snapshot will

[jira] [Created] (HDFS-9631) Restarting namenode after deleting a directory with snapshot will fail

2016-01-07 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9631: - Summary: Restarting namenode after deleting a directory with snapshot will fail Key: HDFS-9631 URL: https://issues.apache.org/jira/browse/HDFS-9631 Project: Hadoop

[jira] [Updated] (HDFS-9631) Restarting namenode after deleting a directory with snapshot will fail

2016-01-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9631: -- Description: I found a number of {{TestOpenFilesWithSnapshot}} tests failed quite frequently.

[jira] [Updated] (HDFS-9631) Restarting namenode after deleting a directory with snapshot will fail

2016-01-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9631: -- Description: I found a number of {{TestOpenFilesWithSnapshot}} tests failed quite frequently.

[jira] [Updated] (HDFS-9630) DistCp minor refactoring and clean up

2016-01-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9630: Status: Patch Available (was: Open) > DistCp minor refactoring and clean up >

[jira] [Updated] (HDFS-9630) DistCp minor refactoring and clean up

2016-01-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9630: Attachment: HDFS-9630-v1.patch Uploaded a patch doing the minor clean up. > DistCp minor refactoring and

[jira] [Updated] (HDFS-9631) Restarting namenode after deleting a directory with snapshot will fail

2016-01-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9631: -- Description: I found a number of {{TestOpenFilesWithSnapshot}} tests failed quite frequently.

[jira] [Updated] (HDFS-9631) Restarting namenode after deleting a directory with snapshot will fail

2016-01-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9631: -- Description: I found a number of {{TestOpenFilesWithSnapshot}} tests failed quite frequently.

[jira] [Updated] (HDFS-9631) Restarting namenode after deleting a directory with snapshot will fail

2016-01-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9631: -- Description: I found a number of {{TestOpenFilesWithSnapshot}} tests failed quite frequently.

[jira] [Commented] (HDFS-9625) set replication for empty file failed when set storage policy

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088722#comment-15088722 ] Hadoop QA commented on HDFS-9625: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9522) Cleanup o.a.h.hdfs.protocol.SnapshotDiffReport

2016-01-07 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9522: - Attachment: HDFS-9522-004.patch Revert changes that fix existing checkstyle warnings. Revert formatting

[jira] [Updated] (HDFS-9613) Don't compare file checksums after copy if block size and checksum opt are not preserved for replicated files

2016-01-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9613: Summary: Don't compare file checksums after copy if block size and checksum opt are not preserved for

[jira] [Updated] (HDFS-9613) Don't compare file checksums after copy if block size and checksum opt are not preserved for replicated files

2016-01-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9613: Description: While working on related issue, it was noticed there are some places in {{distcp}} that's

[jira] [Commented] (HDFS-9613) Don't compare file checksums after copy if block size and checksum opt are not preserved for replicated files

2016-01-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088786#comment-15088786 ] Kai Zheng commented on HDFS-9613: - I refined the description and repurposed it a bit. This will only focus

[jira] [Created] (HDFS-9630) DistCp minor refactoring and clean up

2016-01-07 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-9630: --- Summary: DistCp minor refactoring and clean up Key: HDFS-9630 URL: https://issues.apache.org/jira/browse/HDFS-9630 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-9625) set replication for empty file failed when set storage policy

2016-01-07 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088802#comment-15088802 ] Vinayakumar B commented on HDFS-9625: - [~Deng FEI], Thanks for the good find and patch. Fix looks

[jira] [Commented] (HDFS-9626) TestBlockReplacement#testBlockReplacement fails occasionally

2016-01-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088824#comment-15088824 ] Xiao Chen commented on HDFS-9626: - Also, the test failed locally about 1 in 200 runs before the patch.

[jira] [Commented] (HDFS-9630) DistCp minor refactoring and clean up

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088832#comment-15088832 ] Hadoop QA commented on HDFS-9630: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9607) Advance Hadoop Architecture (AHA) - HDFS

2016-01-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088000#comment-15088000 ] Konstantin Shvachko commented on HDFS-9607: --- Dinesh, "random writes" should be indeed a valuable

[jira] [Commented] (HDFS-9626) TestBlockReplacement#testBlockReplacement fails occasionally

2016-01-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088001#comment-15088001 ] Xiao Chen commented on HDFS-9626: - The failed "Testcase 4" is as follows: Initially have blocks on rack0,

[jira] [Commented] (HDFS-9607) Advance Hadoop Architecture (AHA) - HDFS

2016-01-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088023#comment-15088023 ] Konstantin Shvachko commented on HDFS-9607: --- Just want to add that random writes seem feasible to

[jira] [Assigned] (HDFS-9610) cmake tests don't fail when they should?

2016-01-07 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reassigned HDFS-9610: - Assignee: James Clampffer > cmake tests don't fail when they should? >

[jira] [Updated] (HDFS-9610) cmake tests don't fail when they should?

2016-01-07 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9610: -- Status: Patch Available (was: Open) > cmake tests don't fail when they should? >

[jira] [Updated] (HDFS-9610) cmake tests don't fail when they should?

2016-01-07 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9610: -- Attachment: HDFS-9610.HDFS-8707.000.patch Adding patch 000. Intentionally flipped an assert in

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2016-01-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088012#comment-15088012 ] Andrew Wang commented on HDFS-1312: --- Hi Anu, thanks for picking up this JIRA, it's a long-standing issue.

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

2016-01-07 Thread Yanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088032#comment-15088032 ] Yanping Wang commented on HDFS-8562: Hi, Kai and Colin I got update from Oracle Java team, they agree

[jira] [Created] (HDFS-9627) libhdfs++: Add a mechanism to retrieve human readable error messages through the C API

2016-01-07 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9627: - Summary: libhdfs++: Add a mechanism to retrieve human readable error messages through the C API Key: HDFS-9627 URL: https://issues.apache.org/jira/browse/HDFS-9627

[jira] [Commented] (HDFS-9621) getListing wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory

2016-01-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087845#comment-15087845 ] Jing Zhao commented on HDFS-9621: - Thanks for the review, Kai! Will update the patch to address your

[jira] [Updated] (HDFS-9625) set replication for empty file failed when set storage policy

2016-01-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9625: Status: Patch Available (was: Open) > set replication for empty file failed when set storage

[jira] [Commented] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087896#comment-15087896 ] Hadoop QA commented on HDFS-9624: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9244) Support nested encryption zones

2016-01-07 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9244: Status: Patch Available (was: Open) Thanks Xiaoyu for reporting this! Attaching initial patch for the fix.

[jira] [Commented] (HDFS-9625) set replication for empty file failed when set storage policy

2016-01-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087946#comment-15087946 ] Xiaoyu Yao commented on HDFS-9625: -- [~Deng FEI], thanks for reporting the issue and attach the fix. Can

[jira] [Assigned] (HDFS-9244) Support nested encryption zones

2016-01-07 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reassigned HDFS-9244: --- Assignee: Zhe Zhang > Support nested encryption zones > --- > >

[jira] [Updated] (HDFS-9244) Support nested encryption zones

2016-01-07 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9244: Attachment: HDFS-9244.00.patch > Support nested encryption zones > --- > >

[jira] [Commented] (HDFS-9619) SimulatedFSDataset sometimes can not find blockpool for the correct namenode

2016-01-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088203#comment-15088203 ] Wei-Chiu Chuang commented on HDFS-9619: --- Thank you very much [~vinayrpet] for the quick commit and

[jira] [Assigned] (HDFS-9556) libhdfs++: allow connection to defaultFS from configuration

2016-01-07 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen reassigned HDFS-9556: Assignee: Bob Hansen > libhdfs++: allow connection to defaultFS from configuration >

[jira] [Commented] (HDFS-9610) cmake tests don't fail when they should?

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088154#comment-15088154 ] Hadoop QA commented on HDFS-9610: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-07 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-9628: Summary: libhdfs++: Implement builder apis from C bindings Key: HDFS-9628 URL: https://issues.apache.org/jira/browse/HDFS-9628 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9625) set replication for empty file failed when set storage policy

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088160#comment-15088160 ] Hadoop QA commented on HDFS-9625: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9626) TestBlockReplacement#testBlockReplacement fails occasionally

2016-01-07 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088242#comment-15088242 ] Zhe Zhang commented on HDFS-9626: - Thanks for the fix Xiao. Patch LGTM, +1 pending Jenkins. >

[jira] [Commented] (HDFS-9244) Support nested encryption zones

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088243#comment-15088243 ] Hadoop QA commented on HDFS-9244: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9621) getListing wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory

2016-01-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9621: Attachment: HDFS-9621.001.patch The root cause of the issue is the semantic of the current

[jira] [Updated] (HDFS-9621) getListing wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory

2016-01-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9621: Attachment: HDFS-9621.002.patch With the change looks like the {{fromINode}} call is no longer required for

[jira] [Commented] (HDFS-9626) TestBlockReplacement#testBlockReplacement fails occasionally

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088303#comment-15088303 ] Hadoop QA commented on HDFS-9626: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9627) libhdfs++: Add a mechanism to retrieve human readable error messages through the C API

2016-01-07 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9627: -- Status: Patch Available (was: Open) > libhdfs++: Add a mechanism to retrieve human readable

[jira] [Updated] (HDFS-9627) libhdfs++: Add a mechanism to retrieve human readable error messages through the C API

2016-01-07 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9627: -- Attachment: HDFS-9627.HDFS-8707.000.patch > libhdfs++: Add a mechanism to retrieve human

[jira] [Commented] (HDFS-9610) cmake tests don't fail when they should?

2016-01-07 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088305#comment-15088305 ] James Clampffer commented on HDFS-9610: --- Looks like the gmock tests will properly fail. I'll check

[jira] [Commented] (HDFS-9466) TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky

2016-01-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088308#comment-15088308 ] Xiao Chen commented on HDFS-9466: - Thanks Wei-Chiu. +1 (non-binding). >