[jira] [Commented] (HDFS-10671) Fix typo in HdfsRollingUpgrade.md

2016-07-25 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393275#comment-15393275 ] Yiqun Lin commented on HDFS-10671: -- Thanks [~iwasakims] for the review and commit! Can you help close

[jira] [Updated] (HDFS-10668) Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount

2016-07-25 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10668: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0

[jira] [Commented] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393254#comment-15393254 ] Hadoop QA commented on HDFS-10620: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393181#comment-15393181 ] John Zhuge commented on HDFS-9276: -- And because of the wrong unit test, changes in 17 and 18 were not

[jira] [Commented] (HDFS-10667) Report more accurate info about data corruption location

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393171#comment-15393171 ] Hadoop QA commented on HDFS-10667: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393157#comment-15393157 ] John Zhuge commented on HDFS-9276: -- [~xiaochen], Thanks for the catch on the unit test! Patch 17

[jira] [Commented] (HDFS-10642) Fix intermittently failing UT TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393111#comment-15393111 ] Hadoop QA commented on HDFS-10642: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393095#comment-15393095 ] Hadoop QA commented on HDFS-10682: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10689) "hdfs dfs -chmod 777" does not remove sticky bit

2016-07-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393081#comment-15393081 ] Manoj Govindassamy commented on HDFS-10689: --- Whenever the leading bit in the numeric format is

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393073#comment-15393073 ] Hudson commented on HDFS-10301: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10148 (See

[jira] [Updated] (HDFS-10667) Report more accurate info about data corruption location

2016-07-25 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10667: -- Attachment: HDFS-10667.003.patch > Report more accurate info about data corruption location >

[jira] [Updated] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10620: - Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 3.0.0-alpha2) > StringBuilder created and appended

[jira] [Created] (HDFS-10689) "hdfs dfs -chmod 777" does not remove sticky bit

2016-07-25 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-10689: - Summary: "hdfs dfs -chmod 777" does not remove sticky bit Key: HDFS-10689 URL: https://issues.apache.org/jira/browse/HDFS-10689 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10667) Report more accurate info about data corruption location

2016-07-25 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393065#comment-15393065 ] Yuanbo Liu commented on HDFS-10667: --- [~yzhangal] Sure, I've uploaded v3 patch per your comment. >

[jira] [Updated] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10620: - Status: Patch Available (was: Reopened) > StringBuilder created and appended even if logging is

[jira] [Updated] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10620: - Attachment: HDFS-10620-branch-2.01.patch > StringBuilder created and appended even if logging is

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393060#comment-15393060 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Reopened] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reopened HDFS-10620: -- > StringBuilder created and appended even if logging is disabled >

[jira] [Commented] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393059#comment-15393059 ] Akira Ajisaka commented on HDFS-10620: -- Reverted. Thanks [~jzhuge]! I'll upload a patch for the

[jira] [Updated] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10620: - Fix Version/s: (was: 2.8.0) > StringBuilder created and appended even if logging is disabled

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10301: --- Attachment: HDFS-10301.branch-2.patch I just committed this trunk. Congratulations

[jira] [Commented] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393056#comment-15393056 ] Akira Ajisaka commented on HDFS-10620: -- Thank you for the comment. I'll revert this commit from

[jira] [Commented] (HDFS-10629) Federation Router

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393052#comment-15393052 ] Hadoop QA commented on HDFS-10629: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-07-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393048#comment-15393048 ] Mingliang Liu commented on HDFS-10678: -- Thanks for your prompt comment, [~shv]. Yes it's reasonable

[jira] [Commented] (HDFS-10620) StringBuilder created and appended even if logging is disabled

2016-07-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393046#comment-15393046 ] John Zhuge commented on HDFS-10620: --- Hi [~ajisakaa], when you merged the fix to branch-2 and branch-2.8,

[jira] [Commented] (HDFS-10671) Fix typo in HdfsRollingUpgrade.md

2016-07-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393041#comment-15393041 ] Hudson commented on HDFS-10671: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10147 (See

[jira] [Commented] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393042#comment-15393042 ] Hudson commented on HDFS-10688: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10147 (See

[jira] [Commented] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-07-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393030#comment-15393030 ] Konstantin Shvachko commented on HDFS-10678: Hey [~liuml07]. Documenting NNThroughputBenchmark

[jira] [Updated] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10688: - Description: Currently in BPServiceActor#offerService, when datanode runs into a local IOException, the

[jira] [Commented] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393014#comment-15393014 ] Hadoop QA commented on HDFS-10519: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10688: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-10671) Fix typo in HdfsRollingUpgrade.md

2016-07-25 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393012#comment-15393012 ] Masatake Iwasaki commented on HDFS-10671: - +1, committing this. > Fix typo in

[jira] [Updated] (HDFS-10677) Über-jira: Enhancements to NNThroughputBenchmark tool

2016-07-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10677: - Target Version/s: 2.8.0 (was: 3.0.0-alpha2) > Über-jira: Enhancements to NNThroughputBenchmark

[jira] [Commented] (HDFS-10586) Erasure Code misfunctions when 3 DataNode down

2016-07-25 Thread gao shan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393010#comment-15393010 ] gao shan commented on HDFS-10586: - The MR job failed and exited. > Erasure Code misfunctions when 3

[jira] [Updated] (HDFS-10642) Fix intermittently failing UT TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas

2016-07-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10642: - Attachment: HDFS-10642.001.patch The v1 patch logs the exception while waiting for the storage

[jira] [Updated] (HDFS-10642) Fix intermittently failing UT TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas

2016-07-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10642: - Attachment: HDFS-10642.000.patch The root cause of the test (and related ones) is that, the tests

[jira] [Updated] (HDFS-10642) Fix intermittently failing UT TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas

2016-07-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10642: - Status: Patch Available (was: Open) > Fix intermittently failing UT >

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392984#comment-15392984 ] Xiao Chen commented on HDFS-9276: - Thanks [~jzhuge] for revving. As we talked offline, fixing the copy

[jira] [Updated] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Attachment: HDFS-10682.003.patch > Add metric to measure lock held time in FSDataSetImpl >

[jira] [Updated] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: In Progress (was: Patch Available) > Add metric to measure lock held time in FSDataSetImpl >

[jira] [Updated] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: Patch Available (was: In Progress) > Add metric to measure lock held time in FSDataSetImpl >

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392940#comment-15392940 ] John Zhuge commented on HDFS-9276: -- Test error in

[jira] [Commented] (HDFS-10676) Add namenode metric to measure time spent in generating EDEKs

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392936#comment-15392936 ] Hadoop QA commented on HDFS-10676: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392929#comment-15392929 ] Hadoop QA commented on HDFS-9276: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-10629) Federation Router

2016-07-25 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392884#comment-15392884 ] Jason Kace edited comment on HDFS-10629 at 7/26/16 12:13 AM: - Updating

[jira] [Updated] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-25 Thread Jiayi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayi Zhou updated HDFS-10519: -- Attachment: HDFS-10519.011.patch > Add a configuration option to enable in-progress edit log tailing >

[jira] [Comment Edited] (HDFS-10629) Federation Router

2016-07-25 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392884#comment-15392884 ] Jason Kace edited comment on HDFS-10629 at 7/26/16 12:07 AM: - Updating

[jira] [Updated] (HDFS-10629) Federation Router

2016-07-25 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10629: -- Attachment: HDFS-10629-HDFS-10467-002.patch Updating Federation Router Patch: 1) Added basic unit

[jira] [Commented] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392883#comment-15392883 ] Hadoop QA commented on HDFS-10682: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392882#comment-15392882 ] Hadoop QA commented on HDFS-10609: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392868#comment-15392868 ] Konstantin Shvachko commented on HDFS-10301: {{TestWebHdfsTimeouts}} failure does not look to

[jira] [Commented] (HDFS-10676) Add namenode metric to measure time spent in generating EDEKs

2016-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392851#comment-15392851 ] Arpit Agarwal commented on HDFS-10676: -- Thanks for submitting the patch [~hanishakoneru]. Two quick

[jira] [Commented] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392856#comment-15392856 ] Hadoop QA commented on HDFS-10688: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392845#comment-15392845 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392844#comment-15392844 ] Hadoop QA commented on HDFS-10650: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10667) Report more accurate info about data corruption location

2016-07-25 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392784#comment-15392784 ] Yongjun Zhang commented on HDFS-10667: -- Hi [~yuanbo], one suggestion, when investigating an issue, we

[jira] [Commented] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392766#comment-15392766 ] Hadoop QA commented on HDFS-10519: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10598) DiskBalancer does not execute multi-steps plan.

2016-07-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392760#comment-15392760 ] Wei-Chiu Chuang commented on HDFS-10598: Hi [~eddyxu] thanks identifying the bug and submitting

[jira] [Updated] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9276: - Attachment: HDFS-9276.18.patch Patch 18: * Change {{Token}} copy constructor to do deep copies. * No need

[jira] [Updated] (HDFS-10676) Add namenode metric to measure time spent in generating EDEKs

2016-07-25 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10676: -- Status: Patch Available (was: In Progress) > Add namenode metric to measure time spent in

[jira] [Updated] (HDFS-10676) Add namenode metric to measure time spent in generating EDEKs

2016-07-25 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10676: -- Attachment: HDFS-10676.001.patch > Add namenode metric to measure time spent in generating

[jira] [Commented] (HDFS-10681) DiskBalancer: query command should report Plan file path apart from PlanID

2016-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392701#comment-15392701 ] Hadoop QA commented on HDFS-10681: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-07-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392670#comment-15392670 ] Xiao Chen commented on HDFS-10650: -- Thanks for the comments, Chris and John. I think patch 2 is good.

[jira] [Commented] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-07-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392661#comment-15392661 ] Mingliang Liu commented on HDFS-10678: -- Ping [~shv] for the proposal. > Documenting

[jira] [Commented] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392648#comment-15392648 ] Chen Liang commented on HDFS-10682: --- Removed an unnecessary instrumentation call > Add metric to

[jira] [Updated] (HDFS-10642) Fix intermittently failing UT TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas

2016-07-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10642: - Affects Version/s: (was: 3.0.0-alpha2) Target Version/s: 2.8.0 > Fix intermittently

[jira] [Updated] (HDFS-10668) Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount

2016-07-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10668: - Target Version/s: 2.8.0 > Fix intermittently failing UT

[jira] [Commented] (HDFS-10668) Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount

2016-07-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392656#comment-15392656 ] Mingliang Liu commented on HDFS-10668: -- Thanks [~brahmareddy] for your review. > Fix intermittently

[jira] [Updated] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: Patch Available (was: In Progress) > Add metric to measure lock held time in FSDataSetImpl >

[jira] [Updated] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: In Progress (was: Patch Available) > Add metric to measure lock held time in FSDataSetImpl >

[jira] [Updated] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Attachment: HDFS-10682.002.patch > Add metric to measure lock held time in FSDataSetImpl >

[jira] [Updated] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10688: -- Status: Patch Available (was: In Progress) > BPServiceActor may run into a tight loop for sending

[jira] [Updated] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-07-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10609: --- Status: Patch Available (was: Open) > Uncaught InvalidEncryptionKeyException during pipeline

[jira] [Updated] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10688: -- Status: In Progress (was: Patch Available) > BPServiceActor may run into a tight loop for sending

[jira] [Commented] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392608#comment-15392608 ] Chen Liang commented on HDFS-10688: --- Thanks for the review and suggestion! Just submitted an updated

[jira] [Updated] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-07-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10609: --- Attachment: HDFS-10609.001.patch Patch v01. A simple fix and a test case. The test case

[jira] [Updated] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10688: -- Status: Patch Available (was: In Progress) > BPServiceActor may run into a tight loop for sending

[jira] [Updated] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10688: -- Attachment: HDFS-10688.002.patch > BPServiceActor may run into a tight loop for sending block report

[jira] [Updated] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10688: -- Status: In Progress (was: Patch Available) > BPServiceActor may run into a tight loop for sending

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10301: --- Status: Patch Available (was: Open) > BlockReport retransmissions may lead to

[jira] [Updated] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Attachment: (was: HDFS-10682.002.patch) > Add metric to measure lock held time in FSDataSetImpl >

[jira] [Issue Comment Deleted] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Comment: was deleted (was: removed an unnecessary instrumentation call.) > Add metric to measure lock

[jira] [Commented] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392587#comment-15392587 ] Jing Zhao commented on HDFS-10688: -- Thanks for the fix, [~vagarychen]! Maybe we can rename the new

[jira] [Updated] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: Patch Available (was: In Progress) > Add metric to measure lock held time in FSDataSetImpl >

[jira] [Work started] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10682 started by Chen Liang. - > Add metric to measure lock held time in FSDataSetImpl >

[jira] [Commented] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392583#comment-15392583 ] Chen Liang commented on HDFS-10682: --- removed an unnecessary instrumentation call. > Add metric to

[jira] [Updated] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Attachment: HDFS-10682.002.patch > Add metric to measure lock held time in FSDataSetImpl >

[jira] [Updated] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10688: - Status: Patch Available (was: Open) > BPServiceActor may run into a tight loop for sending block report

[jira] [Commented] (HDFS-10684) WebHDFS calls fail when boolean parameters not provided

2016-07-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392575#comment-15392575 ] John Zhuge commented on HDFS-10684: --- [~loungerdork], I was not able to reproduce on 2.7.1 pseudo

[jira] [Updated] (HDFS-10684) WebHDFS calls fail when boolean parameters not provided

2016-07-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Labels: (was: newbie) > WebHDFS calls fail when boolean parameters not provided >

[jira] [Updated] (HDFS-10676) Add namenode metric to measure time spent in generating EDEKs

2016-07-25 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10676: -- Status: In Progress (was: Patch Available) > Add namenode metric to measure time spent in

[jira] [Assigned] (HDFS-10684) WebHDFS calls fail when boolean parameters not provided

2016-07-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-10684: - Assignee: John Zhuge > WebHDFS calls fail when boolean parameters not provided >

[jira] [Commented] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392455#comment-15392455 ] Chen Liang commented on HDFS-10688: --- Added a simple patch to fix this by sleeping for a while before

[jira] [Updated] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10688: -- Attachment: HDFS-10688.001.patch > BPServiceActor may run into a tight loop for sending block report

[jira] [Commented] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392418#comment-15392418 ] Arpit Agarwal commented on HDFS-10688: -- Nice find [~jingzhao]! > BPServiceActor may run into a tight

[jira] [Comment Edited] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392376#comment-15392376 ] Jing Zhao edited comment on HDFS-10688 at 7/25/16 5:54 PM: --- We can follow the

[jira] [Commented] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392376#comment-15392376 ] Jing Zhao commented on HDFS-10688: -- We can following the same sleep logic as RemoteException when

[jira] [Created] (HDFS-10688) BPServiceActor may run into a tight loop for sending block report when hitting IOException

2016-07-25 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-10688: Summary: BPServiceActor may run into a tight loop for sending block report when hitting IOException Key: HDFS-10688 URL: https://issues.apache.org/jira/browse/HDFS-10688

[jira] [Updated] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Attachment: HDFS-10682.001.patch > Add metric to measure lock held time in FSDataSetImpl >

[jira] [Updated] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Attachment: (was: HDFS-10682.001.patch) > Add metric to measure lock held time in FSDataSetImpl >

  1   2   >