[jira] [Commented] (HDFS-8430) Erasure coding: compute file checksum for stripe files

2016-01-21 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110436#comment-15110436 ] Kai Zheng commented on HDFS-8430: - bq. Added a new protocol method rawBlockChecksum() to retrieve the whole

[jira] [Updated] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8999: -- Attachment: h8999_20160121.patch h8999_20160121.patch: keeps original FSEditLogLoader

[jira] [Commented] (HDFS-9542) Move BlockIdManager from FSNamesystem to BlockManager

2016-01-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110480#comment-15110480 ] Tsz Wo Nicholas Sze commented on HDFS-9542: --- +1 the patch clean up a lot the Namesystem

[jira] [Commented] (HDFS-9542) Move BlockIdManager from FSNamesystem to BlockManager

2016-01-21 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110531#comment-15110531 ] Kai Zheng commented on HDFS-9542: - Yeah, nice refactoring. Just wonder if it's a good idea to rename:

[jira] [Commented] (HDFS-9625) set replication for empty file failed when set storage policy

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110557#comment-15110557 ] Hadoop QA commented on HDFS-9625: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110573#comment-15110573 ] Tsz Wo Nicholas Sze commented on HDFS-8999: --- > We now have two places in completeFileInternal to

[jira] [Commented] (HDFS-9403) Erasure coding: some EC tests are missing timeout

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110586#comment-15110586 ] Hadoop QA commented on HDFS-9403: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9625) set replication for empty file failed when set storage policy

2016-01-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9625: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110495#comment-15110495 ] Tsz Wo Nicholas Sze commented on HDFS-8999: --- > We can always use getMinStorageNum instead of

[jira] [Commented] (HDFS-9534) Add CLI command to clear storage policy from a path.

2016-01-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110288#comment-15110288 ] Vinayakumar B commented on HDFS-9534: - 1. {code} /** + * Remove the storage policy st for a given

[jira] [Updated] (HDFS-9675) BlockSender incorrectly output error logs with non-English locale

2016-01-21 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9675: Assignee: (was: Akira AJISAKA) > BlockSender incorrectly output error logs with non-English

[jira] [Commented] (HDFS-9625) set replication for empty file failed when set storage policy

2016-01-21 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110400#comment-15110400 ] DENG FEI commented on HDFS-9625: [~Vinayakumar B] Thanks for you advice,your test code is suitable. > set

[jira] [Created] (HDFS-9675) BlockSender incorrectly output error logs with non-English locale

2016-01-21 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created HDFS-9675: --- Summary: BlockSender incorrectly output error logs with non-English locale Key: HDFS-9675 URL: https://issues.apache.org/jira/browse/HDFS-9675 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9625) set replication for empty file failed when set storage policy

2016-01-21 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DENG FEI updated HDFS-9625: --- Attachment: HDFS-9625.004.patch > set replication for empty file failed when set storage policy >

[jira] [Commented] (HDFS-9668) Many long-time BLOCKED threads on FsDatasetImpl in a tiered storage test

2016-01-21 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110252#comment-15110252 ] Jingcheng Du commented on HDFS-9668: Thanks for comment. [~cmccabe]. I am not sure if there is

[jira] [Created] (HDFS-9676) “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.

2016-01-21 Thread DuRuiling (JIRA)
DuRuiling created HDFS-9676: --- Summary: “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0. Key: HDFS-9676 URL: https://issues.apache.org/jira/browse/HDFS-9676 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9403) Erasure coding: some EC tests are missing timeout

2016-01-21 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110348#comment-15110348 ] GAO Rui commented on HDFS-9403: --- [~zhz], sorry for the delay. I have updated a new 02 patch. Please review it

[jira] [Assigned] (HDFS-9675) BlockSender incorrectly output error logs with non-English locale

2016-01-21 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA reassigned HDFS-9675: --- Assignee: Akira AJISAKA > BlockSender incorrectly output error logs with non-English locale >

[jira] [Updated] (HDFS-9676) “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.

2016-01-21 Thread DuRuiling (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DuRuiling updated HDFS-9676: Description: I find the bug when I backup about 240T data from local file system to HDFS, I use command

[jira] [Commented] (HDFS-6973) DFSClient does not closing a closed socket resulting in thousand of CLOSE_WAIT sockets

2016-01-21 Thread Max Schmidt (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110342#comment-15110342 ] Max Schmidt commented on HDFS-6973: --- Sorry here, but i found out that our driver programm forgot to close

[jira] [Updated] (HDFS-9403) Erasure coding: some EC tests are missing timeout

2016-01-21 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-9403: -- Attachment: HDFS-9403-origin-trunk.02.patch > Erasure coding: some EC tests are missing timeout >

[jira] [Updated] (HDFS-9403) Erasure coding: some EC tests are missing timeout

2016-01-21 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-9403: -- Status: Patch Available (was: Open) > Erasure coding: some EC tests are missing timeout >

[jira] [Commented] (HDFS-9668) Many long-time BLOCKED threads on FsDatasetImpl in a tiered storage test

2016-01-21 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110259#comment-15110259 ] Jingcheng Du commented on HDFS-9668: Thanks [~vinayrpet]. I ran the same HBase test in few cases for

[jira] [Updated] (HDFS-4884) Provide a way to enforce new Block Placement Policy on existing data after switching from old one

2016-01-21 Thread Nawab Qureshi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nawab Qureshi updated HDFS-4884: Target Version/s: (was: 2.7.1) > Provide a way to enforce new Block Placement Policy on existing

[jira] [Updated] (HDFS-9403) Erasure coding: some EC tests are missing timeout

2016-01-21 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-9403: -- Status: Open (was: Patch Available) > Erasure coding: some EC tests are missing timeout >

[jira] [Updated] (HDFS-4884) Provide a way to enforce new Block Placement Policy on existing data after switching from old one

2016-01-21 Thread Nawab Qureshi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nawab Qureshi updated HDFS-4884: Target Version/s: 2.7.1 (was: 3.0.0) > Provide a way to enforce new Block Placement Policy on

[jira] [Commented] (HDFS-9625) set replication for empty file failed when set storage policy

2016-01-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110641#comment-15110641 ] Hudson commented on HDFS-9625: -- FAILURE: Integrated in Hadoop-trunk-Commit #9147 (See

[jira] [Commented] (HDFS-9634) webhdfs client side exceptions don't provide enough details

2016-01-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110644#comment-15110644 ] Eric Payne commented on HDFS-9634: -- Sorry, that should have been java 1.7 and 1.8. > webhdfs client side

[jira] [Commented] (HDFS-9643) libhdfs++: Support async cancellation of read operations

2016-01-21 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110720#comment-15110720 ] Bob Hansen commented on HDFS-9643: -- In {{ReaderGroup::GetLiveReaders()}}, you need to trim the readers_

[jira] [Updated] (HDFS-9634) webhdfs client side exceptions don't provide enough details

2016-01-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9634: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2016-01-21 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110816#comment-15110816 ] Staffan Friberg commented on HDFS-9260: --- Thanks for the comments [~cmccabe]! Did all your suggested

[jira] [Commented] (HDFS-9634) webhdfs client side exceptions don't provide enough details

2016-01-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110643#comment-15110643 ] Eric Payne commented on HDFS-9634: -- Thanks a lot, [~kihwal] and [~shahrs87]. I have run

[jira] [Commented] (HDFS-9634) webhdfs client side exceptions don't provide enough details

2016-01-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110800#comment-15110800 ] Hudson commented on HDFS-9634: -- FAILURE: Integrated in Hadoop-trunk-Commit #9149 (See

[jira] [Commented] (HDFS-9634) webhdfs client side exceptions don't provide enough details

2016-01-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110779#comment-15110779 ] Kihwal Lee commented on HDFS-9634: -- Ok, it might be my env. I will commit it and will keep an eye on 2.7

[jira] [Commented] (HDFS-8898) Create API and command-line argument to get quota and quota usage without detailed content summary

2016-01-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110815#comment-15110815 ] Kihwal Lee commented on HDFS-8898: -- The patch looks good. The checkstyle warnings seem to be due to the

[jira] [Updated] (HDFS-9647) DiskBalancer : Add getRuntimeSettings

2016-01-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9647: --- Attachment: HDFS-9647-HDFS-1312.002.patch > DiskBalancer : Add getRuntimeSettings >

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2016-01-21 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: HDFS-9260.011.patch > Improve performance and GC friendliness of startup and FBRs >

[jira] [Commented] (HDFS-9647) DiskBalancer : Add getRuntimeSettings

2016-01-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110971#comment-15110971 ] Anu Engineer commented on HDFS-9647: updated the new patch that addresses all comments from [~eddyxu]

[jira] [Updated] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9629: Attachment: HDFS-9629.04.patch Attached the patch to change footer during build. > Update the

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111083#comment-15111083 ] Hadoop QA commented on HDFS-8999: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-6973) DFSClient does not closing a closed socket resulting in thousand of CLOSE_WAIT sockets

2016-01-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110999#comment-15110999 ] Vinayakumar B commented on HDFS-6973: - HBASE-9393, is due to unclosed streams maintained in hbase for

[jira] [Commented] (HDFS-8898) Create API and command-line argument to get quota and quota usage without detailed content summary

2016-01-21 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110998#comment-15110998 ] Ming Ma commented on HDFS-8898: --- Ran these local tests locally with java 1.7 and 1.8. They all passed. No

[jira] [Commented] (HDFS-9643) libhdfs++: Support async cancellation of read operations

2016-01-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110973#comment-15110973 ] James Clampffer commented on HDFS-9643: --- "you need to trim the readers_ member once you're done with

[jira] [Commented] (HDFS-9676) “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.

2016-01-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111009#comment-15111009 ] Vinayakumar B commented on HDFS-9676: - Hi [~drlhome], Can you please give some more details.. like

[jira] [Updated] (HDFS-8898) Create API and command-line argument to get quota and quota usage without detailed content summary

2016-01-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8898: - Target Version/s: 2.8.0 > Create API and command-line argument to get quota and quota usage without >

[jira] [Commented] (HDFS-8898) Create API and command-line argument to get quota and quota usage without detailed content summary

2016-01-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111021#comment-15111021 ] Kihwal Lee commented on HDFS-8898: -- It looks like branch-2 & branch-2.8 needs a different patch. > Create

[jira] [Commented] (HDFS-9576) HTrace: collect position/length information on read operations

2016-01-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111091#comment-15111091 ] Zhe Zhang commented on HDFS-9576: - Thanks Masatake, Xiao, and Colin for the reviews! > HTrace: collect

[jira] [Commented] (HDFS-9542) Move BlockIdManager from FSNamesystem to BlockManager

2016-01-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110985#comment-15110985 ] Vinayakumar B commented on HDFS-9542: - bq. Just wonder if it's a good idea to rename: generationStampV1

[jira] [Commented] (HDFS-8898) Create API and command-line argument to get quota and quota usage without detailed content summary

2016-01-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111011#comment-15111011 ] Kihwal Lee commented on HDFS-8898: -- +1 > Create API and command-line argument to get quota and quota

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111059#comment-15111059 ] Xiao Chen commented on HDFS-9629: - Thanks [~wheat9], [~drankye] for the comments, and [~vinayrpet] for the

[jira] [Updated] (HDFS-9671) DiskBalancer : SubmitPlan implementation

2016-01-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9671: --- Attachment: (was: HDFS-9671-HDFS-1312.001.patch) > DiskBalancer : SubmitPlan implementation >

[jira] [Assigned] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9677: --- Assignee: Mingliang Liu > Rename generationStampV1/generationStampV2 to >

[jira] [Created] (HDFS-9678) Standby NN sometimes does not clear needRollbackFsImage

2016-01-21 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-9678: Summary: Standby NN sometimes does not clear needRollbackFsImage Key: HDFS-9678 URL: https://issues.apache.org/jira/browse/HDFS-9678 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9647) DiskBalancer : Add getRuntimeSettings

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111256#comment-15111256 ] Hadoop QA commented on HDFS-9647: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9678) Standby NN sometimes does not clear needRollbackFsImage

2016-01-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111257#comment-15111257 ] Kihwal Lee commented on HDFS-9678: -- If the regular/recommended upgrade process is successfully followed,

[jira] [Created] (HDFS-9680) Doing a lsr against WebImageViewer is slow

2016-01-21 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9680: Summary: Doing a lsr against WebImageViewer is slow Key: HDFS-9680 URL: https://issues.apache.org/jira/browse/HDFS-9680 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-9681) DiskBalancer : Add QueryPlan implementation

2016-01-21 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9681: -- Summary: DiskBalancer : Add QueryPlan implementation Key: HDFS-9681 URL: https://issues.apache.org/jira/browse/HDFS-9681 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-9679) libhdfs++: Implement lseek in the extended C API

2016-01-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9679: -- Summary: libhdfs++: Implement lseek in the extended C API (was: libhdfs++: Implement hdfsSeek

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111592#comment-15111592 ] Hadoop QA commented on HDFS-9629: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9643) libhdfs++: Support async cancellation of read operations

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111342#comment-15111342 ] Hadoop QA commented on HDFS-9643: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111529#comment-15111529 ] Hadoop QA commented on HDFS-8999: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111648#comment-15111648 ] Hadoop QA commented on HDFS-9525: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2016-01-21 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9094: Attachment: HDFS-9094-HDFS-9000.008.patch V008 handled the return code and kept err msg unchanged by

[jira] [Updated] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8999: Attachment: h8999_20160121b.patch rebase the patch. > Namenode need not wait for {{blockReceived}} for the

[jira] [Commented] (HDFS-9680) Doing a lsr against WebImageViewer is slow

2016-01-21 Thread Chen Qiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111642#comment-15111642 ] Chen Qiang commented on HDFS-9680: -- To correct the description: The fsimage is about 3GB in size with

[jira] [Updated] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9629: Attachment: HDFS-9629.05.patch > Update the footer of Web UI to show year 2016 >

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Status: Patch Available (was: Open) > Replace -namenode option with -fs for NNThroughputBenchmark >

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Affects Version/s: (was: 2.8.0) Target Version/s: 3.0.0 (was: 2.8.0) Status:

[jira] [Updated] (HDFS-9679) libhdfs++: Implement lseek in the extended C API

2016-01-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9679: -- Description: It'd be nice to have a version of hdfsSeek that returns the new offset as a 64 bit

[jira] [Created] (HDFS-9679) libhdfs++: Implement hdfsSeek and hdfsTell that return 64 bit types

2016-01-21 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9679: - Summary: libhdfs++: Implement hdfsSeek and hdfsTell that return 64 bit types Key: HDFS-9679 URL: https://issues.apache.org/jira/browse/HDFS-9679 Project: Hadoop

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111646#comment-15111646 ] Xiao Chen commented on HDFS-9629: - Patch 5 to fix whitespace. > Update the footer of Web UI to show year

[jira] [Commented] (HDFS-9674) The HTrace span for OpWriteBlock should record the maxWriteToDisk time

2016-01-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111371#comment-15111371 ] Hudson commented on HDFS-9674: -- FAILURE: Integrated in Hadoop-trunk-Commit #9156 (See

[jira] [Assigned] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9672: --- Assignee: Mingliang Liu > o.a.h.hdfs.TestLeaseRecovery2 fails intermittently >

[jira] [Commented] (HDFS-9643) libhdfs++: Support async cancellation of read operations

2016-01-21 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111305#comment-15111305 ] Bob Hansen commented on HDFS-9643: -- Ah, I missed it in the header because I was looking for a close, not a

[jira] [Updated] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2016-01-21 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9094: Attachment: HDFS-9094-HDFS-9000.007.patch > Add command line option to ask NameNode reload

[jira] [Commented] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2016-01-21 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111315#comment-15111315 ] Xiaobing Zhou commented on HDFS-9094: - V007 fixed the aforementioned issues, thanks [~arpitagarwal]. >

[jira] [Commented] (HDFS-9674) The HTrace span for OpWriteBlock should record the maxWriteToDisk time

2016-01-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111325#comment-15111325 ] Zhe Zhang commented on HDFS-9674: - Thanks Colin. +1 on the patch. The failed tests are not related to the

[jira] [Updated] (HDFS-9674) The HTrace span for OpWriteBlock should record the maxWriteToDisk time

2016-01-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9674: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved (was:

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111350#comment-15111350 ] Jing Zhao commented on HDFS-8999: - Thanks for updating the patch, Nicholas! bq. No, it does not work for

[jira] [Updated] (HDFS-8898) Create API and command-line argument to get quota and quota usage without detailed content summary

2016-01-21 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-8898: -- Attachment: HDFS-8898-branch-2.patch Here is the patch for branch-2. I have run it with all unit tests. The

[jira] [Commented] (HDFS-7037) Using distcp to copy data from insecure to secure cluster via hftp doesn't work (branch-2 only)

2016-01-21 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111814#comment-15111814 ] Aaron T. Myers commented on HDFS-7037: -- [~wheat9] - reviving this very old thread... can you please

[jira] [Commented] (HDFS-9682) Fix a typo "aplication" in webhdfs document

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111829#comment-15111829 ] Hadoop QA commented on HDFS-9682: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9618) Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111873#comment-15111873 ] Hadoop QA commented on HDFS-9618: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2016-01-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111879#comment-15111879 ] Hudson commented on HDFS-9601: -- FAILURE: Integrated in Hadoop-trunk-Commit #9158 (See

[jira] [Commented] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111714#comment-15111714 ] Hadoop QA commented on HDFS-9094: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9319) Make DatanodeInfo thread safe

2016-01-21 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111789#comment-15111789 ] Aaron T. Myers commented on HDFS-9319: -- [~jingzhao] - do you plan on committing this soon? I see that

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111794#comment-15111794 ] Hadoop QA commented on HDFS-9629: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9682) Fix a typo "aplication" in webhdfs document

2016-01-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-9682: -- Status: Patch Available (was: Open) > Fix a typo "aplication" in webhdfs document >

[jira] [Updated] (HDFS-9682) Fix a typo "aplication" in webhdfs document

2016-01-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-9682: -- Fix Version/s: (was: 2.8.0) > Fix a typo "aplication" in webhdfs document >

[jira] [Updated] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9672: Status: Patch Available (was: Open) > o.a.h.hdfs.TestLeaseRecovery2 fails intermittently >

[jira] [Updated] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9672: Attachment: HDFS-9672.000.patch > o.a.h.hdfs.TestLeaseRecovery2 fails intermittently >

[jira] [Commented] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111693#comment-15111693 ] Mingliang Liu commented on HDFS-9672: - The test sets the lease period (which should not happen in real

[jira] [Commented] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111745#comment-15111745 ] Mingliang Liu commented on HDFS-9672: - The mini cluster is reused for all the tests. If any of the test

[jira] [Assigned] (HDFS-9676) “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.

2016-01-21 Thread DuRuiling (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DuRuiling reassigned HDFS-9676: --- Assignee: DuRuiling > “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0. >

[jira] [Created] (HDFS-9682) Fix a typo "aplication" in webhdfs document

2016-01-21 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-9682: - Summary: Fix a typo "aplication" in webhdfs document Key: HDFS-9682 URL: https://issues.apache.org/jira/browse/HDFS-9682 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-9618) Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks

2016-01-21 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9618: --- Attachment: HDFS-9618.002.patch > Fix mismatch between log level and guard in >

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111815#comment-15111815 ] Hadoop QA commented on HDFS-8999: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9676) “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.

2016-01-21 Thread DuRuiling (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111820#comment-15111820 ] DuRuiling commented on HDFS-9676: - Ok, I execute command “hdfs dfs -D dfs.replication=3 -put $localPath

[jira] [Commented] (HDFS-7037) Using distcp to copy data from insecure to secure cluster via hftp doesn't work (branch-2 only)

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111818#comment-15111818 ] Hadoop QA commented on HDFS-7037: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-4478) Token operations should not lock namespace

2016-01-21 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111866#comment-15111866 ] Aaron T. Myers commented on HDFS-4478: -- [~daryn] - is this perhaps a duplicate of HDFS-5029? > Token

  1   2   >