[jira] [Updated] (HDFS-10922) Adding additional unit tests for Trash (II)

2016-10-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-10922: --- Attachment: HDFS-10922.07.patch > Adding additional unit tests for Trash (II) > --

[jira] [Updated] (HDFS-10801) [SPS]: Protocol buffer changes for sending storage movement commands from NN to DN

2016-10-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10801: Hadoop Flags: Reviewed > [SPS]: Protocol buffer changes for sending storage movement commands from NN > to

[jira] [Updated] (HDFS-10801) [SPS]: Protocol buffer changes for sending storage movement commands from NN to DN

2016-10-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10801: Target Version/s: (was: HDFS-10285) > [SPS]: Protocol buffer changes for sending storage movement commands

[jira] [Updated] (HDFS-10801) [SPS]: Protocol buffer changes for sending storage movement commands from NN to DN

2016-10-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10801: Resolution: Fixed Fix Version/s: HDFS-10285 Status: Resolved (was: Patch Available) > [SP

[jira] [Commented] (HDFS-10801) [SPS]: Protocol buffer changes for sending storage movement commands from NN to DN

2016-10-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564637#comment-15564637 ] Rakesh R commented on HDFS-10801: - Thanks [~umamaheswararao] for the reviews. Committed to

[jira] [Commented] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564335#comment-15564335 ] Hadoop QA commented on HDFS-10906: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-10994) Support "XOR-2-1-64k" policy in "hdfs erasurecode" command

2016-10-10 Thread SammiChen (JIRA)
SammiChen created HDFS-10994: Summary: Support "XOR-2-1-64k" policy in "hdfs erasurecode" command Key: HDFS-10994 URL: https://issues.apache.org/jira/browse/HDFS-10994 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564257#comment-15564257 ] Hadoop QA commented on HDFS-10986: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10991) libhdfs : Client compilation is failing for hdfsTruncateFile API

2016-10-10 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564190#comment-15564190 ] Surendra Singh Lilhore commented on HDFS-10991: --- Thanks [~James C] for revie

[jira] [Updated] (HDFS-10991) libhdfs : Client compilation is failing for hdfsTruncateFile API

2016-10-10 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-10991: -- Affects Version/s: 2.7.0 > libhdfs : Client compilation is failing for hdfsTrun

[jira] [Commented] (HDFS-10988) Refactor TestBalancerBandwidth

2016-10-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564168#comment-15564168 ] Brahma Reddy Battula commented on HDFS-10988: - [~liuml07] thanks for review an

[jira] [Commented] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564161#comment-15564161 ] Hadoop QA commented on HDFS-10986: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-10-10 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564152#comment-15564152 ] Hanisha Koneru commented on HDFS-10906: --- Thank you [~xyao]. I have added two tests t

[jira] [Updated] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-10-10 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10906: -- Status: Patch Available (was: Open) > Add unit tests for Trash with HDFS encryption zones > ---

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-10-10 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564153#comment-15564153 ] Jingcheng Du commented on HDFS-9668: Thanks [~eddyxu]! I will update the patch after HA

[jira] [Updated] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-10-10 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10906: -- Attachment: HDFS-10906.000.patch > Add unit tests for Trash with HDFS encryption zones > ---

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Attachment: HDFS-10986-branch-2.8.002.patch > DFSAdmin should log detailed error message if any >

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Attachment: HDFS-10986.002.patch > DFSAdmin should log detailed error message if any > ---

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Target Version/s: 2.8.0 (was: 3.0.0-alpha2) > DFSAdmin should log detailed error message if any >

[jira] [Updated] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10972: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolv

[jira] [Commented] (HDFS-10933) Refactor TestFsck

2016-10-10 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564047#comment-15564047 ] Takanobu Asanuma commented on HDFS-10933: - Thank you for reviewing and committing,

[jira] [Comment Edited] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563889#comment-15563889 ] Mingliang Liu edited comment on HDFS-10965 at 10/11/16 12:43 AM: ---

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Attachment: HDFS-10986.001.patch Thanks for your review, [~brahmareddy]. The v1 patch is to addres

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564009#comment-15564009 ] Mingliang Liu commented on HDFS-10903: -- {{ipc.client.connect.max.retries}} is used in

[jira] [Commented] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

2016-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563986#comment-15563986 ] Hadoop QA commented on HDFS-10965: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563969#comment-15563969 ] Hadoop QA commented on HDFS-10967: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563946#comment-15563946 ] Hadoop QA commented on HDFS-10972: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Description: There are some subcommands in {{DFSAdmin}} that swallow IOException and give very li

[jira] [Commented] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563889#comment-15563889 ] Mingliang Liu commented on HDFS-10965: -- {code} 384 /* init reused vars */ 3

[jira] [Commented] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563882#comment-15563882 ] Konstantin Shvachko commented on HDFS-10967: This could be good optimization o

[jira] [Commented] (HDFS-10977) Balancer should query NameNode with a timeout

2016-10-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563883#comment-15563883 ] Zhe Zhang commented on HDFS-10977: -- Thanks [~senthilec566] for reporting the similar issu

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Description: {{TestZKFailoverController#testGracefulFailoverMultipleZKfcs}} uses fixed time sleep

[jira] [Comment Edited] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563835#comment-15563835 ] Zhe Zhang edited comment on HDFS-10967 at 10/10/16 11:07 PM: -

[jira] [Commented] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563835#comment-15563835 ] Zhe Zhang commented on HDFS-10967: -- I verified reported test failures and could only repr

[jira] [Commented] (HDFS-10629) Federation Router

2016-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563827#comment-15563827 ] Hadoop QA commented on HDFS-10629: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563816#comment-15563816 ] Hadoop QA commented on HDFS-10984: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563810#comment-15563810 ] Hadoop QA commented on HDFS-10967: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-10-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563788#comment-15563788 ] Hudson commented on HDFS-10637: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-10-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10637: - Resolution: Fixed Hadoop Flags: Incompatible change Fix Version/s: 3.0.0-alpha

[jira] [Commented] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

2016-10-10 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563675#comment-15563675 ] Xiaobing Zhou commented on HDFS-10965: -- v004 is posted, which is based on some work c

[jira] [Updated] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

2016-10-10 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10965: - Attachment: HDFS-10965.004.patch > Add unit test for HDFS command 'dfsadmin -printTopology' >

[jira] [Comment Edited] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563541#comment-15563541 ] Zhe Zhang edited comment on HDFS-10967 at 10/10/16 9:48 PM: Th

[jira] [Updated] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10967: - Attachment: HDFS-10967.03.patch Attaching v3 patch to include remote writer and {{BlockPlacementPolicyRac

[jira] [Commented] (HDFS-10991) libhdfs : Client compilation is failing for hdfsTruncateFile API

2016-10-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563615#comment-15563615 ] James Clampffer commented on HDFS-10991: I normally stick to the HDFS-8707 branch

[jira] [Updated] (HDFS-10629) Federation Router

2016-10-10 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10629: -- Attachment: HDFS-10629-HDFS-10467-007.patch Updating patch to include: 1) Releasing router->NN client c

[jira] [Updated] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-10984: --- Status: Patch Available (was: Open) Re-submitting patch for review + tests. > Expose nntop o

[jira] [Updated] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-10984: --- Attachment: HDFS-10984.v3.patch > Expose nntop output as metrics >

[jira] [Updated] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-10984: --- Attachment: (was: HDFS-10984.v3.patch) > Expose nntop output as metrics > -

[jira] [Updated] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-10984: --- Attachment: HDFS-10984.v3.patch Addressed review comments from [~xyao]. > Expose nntop output

[jira] [Updated] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10967: - Attachment: HDFS-10967.02.patch Thanks [~mingma] for the feedback! Attaching v2 patch to add dfsAdmin com

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563538#comment-15563538 ] Mingliang Liu commented on HDFS-10972: -- +1 pending on Jenkins. > Add unit test for H

[jira] [Updated] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-10984: --- Status: Open (was: Patch Available) Cancelling to incorporate review comments. > Expose nnto

[jira] [Commented] (HDFS-10985) o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions

2016-10-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563493#comment-15563493 ] Hudson commented on HDFS-10985: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-10 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563487#comment-15563487 ] Xiaobing Zhou commented on HDFS-10972: -- branch-2.8 patch is posted [~liuml07] thanks.

[jira] [Updated] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-10 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10972: - Attachment: HDFS-10972-branch-2.8.003.patch > Add unit test for HDFS command 'dfsadmin -getDatanod

[jira] [Comment Edited] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563120#comment-15563120 ] Ming Ma edited comment on HDFS-10967 at 10/10/16 8:56 PM: -- Thanks

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10988) Refactor TestBalancerBandwidth

2016-10-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563430#comment-15563430 ] Hudson commented on HDFS-10988: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-10988) Refactor TestBalancerBandwidth

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10988: - Component/s: balancer & mover > Refactor TestBalancerBandwidth > -- >

[jira] [Updated] (HDFS-10988) Refactor TestBalancerBandwidth

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10988: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Comment Edited] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15557062#comment-15557062 ] Siddharth Wagle edited comment on HDFS-10984 at 10/10/16 8:25 PM: --

[jira] [Commented] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563376#comment-15563376 ] Xiaoyu Yao commented on HDFS-10984: --- bq. Confused about point 4. I have linked the two t

[jira] [Commented] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563351#comment-15563351 ] Hadoop QA commented on HDFS-10984: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563326#comment-15563326 ] Hadoop QA commented on HDFS-10967: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563318#comment-15563318 ] Siddharth Wagle commented on HDFS-10984: Thanks [~xyao] for the review comments, I

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563305#comment-15563305 ] Daryn Sharp commented on HDFS-10301: Will take a look this afternoon. > BlockReport r

[jira] [Commented] (HDFS-10985) o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions

2016-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563289#comment-15563289 ] Hadoop QA commented on HDFS-10985: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10985) o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions

2016-10-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563210#comment-15563210 ] Steve Loughran commented on HDFS-10985: --- +1 > o.a.h.ha.TestZKFailoverController sho

[jira] [Comment Edited] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563190#comment-15563190 ] Xiaoyu Yao edited comment on HDFS-10984 at 10/10/16 7:16 PM: -

[jira] [Commented] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563190#comment-15563190 ] Xiaoyu Yao commented on HDFS-10984: --- Thanks [~swagle] for reporting the issue and postin

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563164#comment-15563164 ] Hudson commented on HDFS-10972: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10972: - Fix Version/s: 3.0.0-alpha2 > Add unit test for HDFS command 'dfsadmin -getDatanodeInfo' > ---

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563140#comment-15563140 ] Mingliang Liu commented on HDFS-10972: -- Committed to {{trunk}} and {{branch-2}}. Can

[jira] [Commented] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563120#comment-15563120 ] Ming Ma commented on HDFS-10967: Thanks [~zhz]. Indeed that is an issue when the cluster h

[jira] [Commented] (HDFS-10988) Refactor TestBalancerBandwidth

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563109#comment-15563109 ] Mingliang Liu commented on HDFS-10988: -- Test failure is not related. > Refactor Test

[jira] [Commented] (HDFS-10988) Refactor TestBalancerBandwidth

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563108#comment-15563108 ] Mingliang Liu commented on HDFS-10988: -- +1 Will commit shortly. > Refactor TestBalan

[jira] [Updated] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-10984: --- Status: Patch Available (was: Open) > Expose nntop output as metrics > ---

[jira] [Updated] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-10984: --- Attachment: HDFS-10984.v2.patch > Expose nntop output as metrics >

[jira] [Commented] (HDFS-10985) o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions

2016-10-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563096#comment-15563096 ] Hadoop QA commented on HDFS-10985: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Updated] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-10984: --- Attachment: (was: HDFS-10984.v2.patch) > Expose nntop output as metrics > -

[jira] [Updated] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-10984: --- Status: Open (was: Patch Available) > Expose nntop output as metrics > ---

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563086#comment-15563086 ] Mingliang Liu commented on HDFS-10972: -- Test failures are not related. > Add unit te

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563084#comment-15563084 ] Mingliang Liu commented on HDFS-10972: -- +1 Will commit shortly. > Add unit test for

[jira] [Updated] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10967: - Attachment: HDFS-10967.01.patch Updating patch to include a unit test. Since the new config knob is meant

[jira] [Updated] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10967: - Attachment: (was: HDFS-10967.poc.patch) > Add configuration for BlockPlacementPolicy to avoid near-ful

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563049#comment-15563049 ] Arpit Agarwal commented on HDFS-10301: -- Hi [~shv], the v15 patch lgtm. Thank you for

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Attachment: HDFS-10985-branch-2.8.001.patch Thank you [~ste...@apache.org] for your review. Can yo

[jira] [Updated] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-10984: --- Status: Patch Available (was: Open) Fixed JMXGet issue, verified that it works locally with s

[jira] [Updated] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-10984: --- Status: Open (was: Patch Available) > Expose nntop output as metrics > ---

[jira] [Updated] (HDFS-10984) Expose nntop output as metrics

2016-10-10 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-10984: --- Attachment: HDFS-10984.v2.patch > Expose nntop output as metrics >

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Description: {{TestZKFailoverController#testGracefulFailoverMultipleZKfcs}} uses fixed time sleep

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-10-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563010#comment-15563010 ] Lei (Eddy) Xu commented on HDFS-9668: - Hi, [~jingcheng...@intel.com] Thanks for the up

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertsions

2016-10-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Attachment: HDFS-10985.001.patch The v1 patch also fixed the {{testGracefulFailover}} test case.

[jira] [Assigned] (HDFS-10993) rename may fail without a clear message indicating the failure reason.

2016-10-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-10993: - Assignee: John Zhuge > rename may fail without a clear message indicating the failure reason. > -

[jira] [Created] (HDFS-10993) rename may fail without a clear message indicating the failure reason.

2016-10-10 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10993: Summary: rename may fail without a clear message indicating the failure reason. Key: HDFS-10993 URL: https://issues.apache.org/jira/browse/HDFS-10993 Project: Hadoop

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15562891#comment-15562891 ] Wei-Chiu Chuang commented on HDFS-10971: I think it makes sense to me to add a Cre

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15562859#comment-15562859 ] Andrew Wang commented on HDFS-10971: I wonder what the right distcp behavior is in thi

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

2016-10-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15562723#comment-15562723 ] Brahma Reddy Battula commented on HDFS-10987: - Thanks [~kihwal] for taking loo

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

2016-10-10 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15562642#comment-15562642 ] Kihwal Lee commented on HDFS-10987: --- We've seen this also. We don't have that many block

[jira] [Commented] (HDFS-10992) file is under construction but no leases found

2016-10-10 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15562569#comment-15562569 ] Rushabh S Shah commented on HDFS-10992: --- Is this a dupe of HDFS-10763 ? > file is u

  1   2   >