[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814258#comment-15814258 ] Hadoop QA commented on HDFS-11072: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11284) [SPS]: fix issue of moving blocks with satisfier while changing replication factor

2017-01-10 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814306#comment-15814306 ] Yuanbo Liu commented on HDFS-11284: --- [~umamaheswararao] Thanks for your response. {quote

[jira] [Commented] (HDFS-11285) Dead DataNodes keep a long time in (Dead, DECOMMISSION_INPROGRESS), and never transition to (Dead, DECOMMISSIONED)

2017-01-10 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814361#comment-15814361 ] Lantao Jin commented on HDFS-11285: --- Yes, you are right. The block is open for write. [~

[jira] [Updated] (HDFS-11307) The rpc to portmap service for NFS has hardcoded timeout.

2017-01-10 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11307: - Status: Patch Available (was: Open) > The rpc to portmap service for NFS has hardcoded ti

[jira] [Updated] (HDFS-11307) The rpc to portmap service for NFS has hardcoded timeout.

2017-01-10 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11307: - Attachment: HDFS-11307.001.patch This patch adds a new configuration key for portmap conne

[jira] [Commented] (HDFS-7343) HDFS smart storage management

2017-01-10 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814478#comment-15814478 ] Wei Zhou commented on HDFS-7343: Thanks [~anu] for these insightful questions! {quote} Woul

[jira] [Updated] (HDFS-11191) Datanode Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

2017-01-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11191: --- Attachment: HDFS-11191.06.patch > Datanode Capacity is misleading if the dfs.datanode.data.dir is conf

[jira] [Commented] (HDFS-11307) The rpc to portmap service for NFS has hardcoded timeout.

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814525#comment-15814525 ] Hadoop QA commented on HDFS-11307: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814575#comment-15814575 ] Hadoop QA commented on HDFS-11150: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11259) Update fsck to display maintenance state info

2017-01-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11259: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch Avail

[jira] [Commented] (HDFS-11191) Datanode Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814759#comment-15814759 ] Hadoop QA commented on HDFS-11191: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11259) Update fsck to display maintenance state info

2017-01-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814815#comment-15814815 ] Hudson commented on HDFS-11259: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-11191) Datanode Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

2017-01-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11191: --- Attachment: HDFS-11191.07.patch > Datanode Capacity is misleading if the dfs.datanode.data.dir is conf

[jira] [Commented] (HDFS-11191) Datanode Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

2017-01-10 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815074#comment-15815074 ] Ajith S commented on HDFS-11191: Similar to HDFS-8610 ? > Datanode Capacity is misleading

[jira] [Commented] (HDFS-11191) Datanode Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

2017-01-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815129#comment-15815129 ] Weiwei Yang commented on HDFS-11191: Hi [~ajithshetty] Yes, I believe this one is add

[jira] [Commented] (HDFS-8610) if set several dirs which belongs to one disk in "dfs.datanode.data.dir", NN calculate capacity wrong

2017-01-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815182#comment-15815182 ] Weiwei Yang commented on HDFS-8610: --- Hi [~szetszwo] HDFS-11191 seems to be duplicated wi

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-10 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815227#comment-15815227 ] Kihwal Lee commented on HDFS-7967: -- I have reviewed the patch and am fine with it. We have

[jira] [Created] (HDFS-11310) Reduce the performance impact of the balancer (trunk port)

2017-01-10 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-11310: -- Summary: Reduce the performance impact of the balancer (trunk port) Key: HDFS-11310 URL: https://issues.apache.org/jira/browse/HDFS-11310 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-11191) Datanode Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815369#comment-15815369 ] Hadoop QA commented on HDFS-11191: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11305) libhdfs++: Log Datanode information when reading an HDFS block

2017-01-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11305: --- Resolution: Fixed Status: Resolved (was: Patch Available) +1, committed to HDFS-8707.

[jira] [Commented] (HDFS-11304) Namenode fails to start, even edit log available in the journal node

2017-01-10 Thread Clay B. (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815501#comment-15815501 ] Clay B. commented on HDFS-11304: Hi [~jojochuang] when I hit this it was not just a crash,

[jira] [Created] (HDFS-11311) HDFS fsck continues to report all blocks present when DataNode is restarted with empty data directories

2017-01-10 Thread JIRA
André Frimberger created HDFS-11311: --- Summary: HDFS fsck continues to report all blocks present when DataNode is restarted with empty data directories Key: HDFS-11311 URL: https://issues.apache.org/jira/browse/H

[jira] [Commented] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

2017-01-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815597#comment-15815597 ] John Zhuge commented on HDFS-10860: --- Patch 005 does not suffer from the issue of HADOOP-

[jira] [Commented] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2017-01-10 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815798#comment-15815798 ] Hanisha Koneru commented on HDFS-11273: --- Thank you [~jingzhao] for the reviews and f

[jira] [Updated] (HDFS-11299) Support multiple Datanode File IO hooks

2017-01-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11299: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Commented] (HDFS-11299) Support multiple Datanode File IO hooks

2017-01-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815844#comment-15815844 ] Arpit Agarwal commented on HDFS-11299: -- The test case failure is unrelated and the ch

[jira] [Comment Edited] (HDFS-11299) Support multiple Datanode File IO hooks

2017-01-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815844#comment-15815844 ] Arpit Agarwal edited comment on HDFS-11299 at 1/10/17 6:54 PM: -

[jira] [Commented] (HDFS-11299) Support multiple Datanode File IO hooks

2017-01-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815890#comment-15815890 ] Hudson commented on HDFS-11299: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

2017-01-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815889#comment-15815889 ] Daryn Sharp commented on HDFS-9260: --- I'd like to propose this patch be reverted on the NN

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815899#comment-15815899 ] Daryn Sharp commented on HDFS-7967: --- I commented on HDFS-9260 with my opinion and reasons

[jira] [Updated] (HDFS-10685) libhdfs++: return explicit error when non-secured client connects to secured server

2017-01-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10685: --- Attachment: HDFS-10685.HDFS-8707.000.patch I just took the diff posted by [~vectorijk] and tur

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11072: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch Available

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2017-01-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815949#comment-15815949 ] Chris Nauroth commented on HDFS-11163: -- bq. we can add one API to get default policy

[jira] [Commented] (HDFS-10685) libhdfs++: return explicit error when non-secured client connects to secured server

2017-01-10 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815959#comment-15815959 ] Xiaowei Zhu commented on HDFS-10685: Looks good. Just one word change in this message:

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816035#comment-15816035 ] Hudson commented on HDFS-11072: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-10702) Add a Client API and Proxy Provider to enable stale read from Standby

2017-01-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-10702: - Attachment: HDFS-10702.007.patch Attaching a patch that I believe wraps up everyone's feedback so

[jira] [Comment Edited] (HDFS-10702) Add a Client API and Proxy Provider to enable stale read from Standby

2017-01-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816062#comment-15816062 ] Sean Mackrory edited comment on HDFS-10702 at 1/10/17 8:25 PM: -

[jira] [Updated] (HDFS-10685) libhdfs++: return explicit error when non-secured client connects to secured server

2017-01-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10685: --- Attachment: HDFS-10685.HDFS-8707.001.patch Nice catch [~xiaowei.zhu], made the change you sugg

[jira] [Updated] (HDFS-10685) libhdfs++: return explicit error when non-secured client connects to secured server

2017-01-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10685: --- Status: Patch Available (was: Open) > libhdfs++: return explicit error when non-secured clien

[jira] [Commented] (HDFS-3618) SSH fencing option may incorrectly succeed if nc (netcat) command not present

2017-01-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816079#comment-15816079 ] Wei-Chiu Chuang commented on HDFS-3618: --- I like the idea of making ssh fencing comman

[jira] [Commented] (HDFS-11308) NameNode doFence state judgment problem

2017-01-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816084#comment-15816084 ] Wei-Chiu Chuang commented on HDFS-11308: Thanks [~brahmareddy]. I didn't realize t

[jira] [Commented] (HDFS-10685) libhdfs++: return explicit error when non-secured client connects to secured server

2017-01-10 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816089#comment-15816089 ] Xiaowei Zhu commented on HDFS-10685: +1 > libhdfs++: return explicit error when non-s

[jira] [Comment Edited] (HDFS-3618) SSH fencing option may incorrectly succeed if nc (netcat) command not present

2017-01-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816079#comment-15816079 ] Wei-Chiu Chuang edited comment on HDFS-3618 at 1/10/17 8:35 PM: -

[jira] [Resolved] (HDFS-11308) NameNode doFence state judgment problem

2017-01-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11308. Resolution: Duplicate Thanks [~tangshangwen] and [~iwasakims] for filing the jira and commen

[jira] [Comment Edited] (HDFS-3618) SSH fencing option may incorrectly succeed if nc (netcat) command not present

2017-01-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816079#comment-15816079 ] Wei-Chiu Chuang edited comment on HDFS-3618 at 1/10/17 8:43 PM: -

[jira] [Updated] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2017-01-10 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-4025: - Attachment: HDFS-4025.006.patch Patch v06 re-uses the #doGetUrl code from TransferFsImage (now in U

[jira] [Commented] (HDFS-11100) Recursively deleting file protected by sticky bit should fail

2017-01-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816196#comment-15816196 ] Wei-Chiu Chuang commented on HDFS-11100: Let's push this back to the next 3.0 rele

[jira] [Updated] (HDFS-11100) Recursively deleting file protected by sticky bit should fail

2017-01-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11100: --- Target Version/s: 3.0.0-beta1 (was: 3.0.0-alpha2) > Recursively deleting file protected by st

[jira] [Commented] (HDFS-3618) SSH fencing option may incorrectly succeed if nc (netcat) command not present

2017-01-10 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816250#comment-15816250 ] Kihwal Lee commented on HDFS-3618: -- The "-z" option is supported by the plain old BSD impl

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11303: --- Assignee: Chen Zhang > Hedged read might hang infinitely if read data from all DN failed > --

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11303: --- Status: Patch Available (was: Open) > Hedged read might hang infinitely if read data from all DN fail

[jira] [Commented] (HDFS-8498) Blocks can be committed with wrong size

2017-01-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816262#comment-15816262 ] Jing Zhao commented on HDFS-8498: - We also saw the same scenario as described by [~vinayrpe

[jira] [Reopened] (HDFS-8498) Blocks can be committed with wrong size

2017-01-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reopened HDFS-8498: - > Blocks can be committed with wrong size > --- > > Key: HD

[jira] [Commented] (HDFS-10685) libhdfs++: return explicit error when non-secured client connects to secured server

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816265#comment-15816265 ] Hadoop QA commented on HDFS-10685: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-8498) Blocks can be committed with wrong size

2017-01-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8498: Target Version/s: 2.9.0, 3.0.0-alpha2 (was: 2.7.3) > Blocks can be committed with wrong size > -

[jira] [Updated] (HDFS-11259) Update fsck to display maintenance state info

2017-01-10 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11259: -- Attachment: HDFS-11259-branch-2.01.patch [~eddyxu] Attached branch-2 patch. Can you plea

[jira] [Commented] (HDFS-11306) Print remaining edit logs from buffer if edit log can't be rolled.

2017-01-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816304#comment-15816304 ] Wei-Chiu Chuang commented on HDFS-11306: Thanks [~yzhangal] for the review {quote

[jira] [Updated] (HDFS-11309) [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target

2017-01-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11309: --- Summary: [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseSt

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-01-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816405#comment-15816405 ] Sean Mackrory commented on HDFS-11096: -- After looking at where SortedMapWritable is u

[jira] [Commented] (HDFS-10733) NameNode terminated after full GC thinking QJM is unresponsive.

2017-01-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816414#comment-15816414 ] Konstantin Shvachko commented on HDFS-10733: This looks reasonable to me. Simi

[jira] [Comment Edited] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-01-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816405#comment-15816405 ] Sean Mackrory edited comment on HDFS-11096 at 1/10/17 10:46 PM:

[jira] [Updated] (HDFS-11302) Improve Logging for SSLHostnameVerifier

2017-01-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11302: -- Attachment: HDFS-11302.001.patch > Improve Logging for SSLHostnameVerifier > ---

[jira] [Updated] (HDFS-11302) Improve Logging for SSLHostnameVerifier

2017-01-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11302: -- Status: Patch Available (was: Open) > Improve Logging for SSLHostnameVerifier > ---

[jira] [Commented] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816428#comment-15816428 ] Hadoop QA commented on HDFS-4025: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2017-01-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10930: - Fix Version/s: 2.9.0 Committed to branch-2, along with HDFS-11253. > Refactor: Wrap Datanode IO r

[jira] [Updated] (HDFS-11253) FileInputStream leak on failure path in BlockSender

2017-01-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11253: - Fix Version/s: 2.9.0 Committed to branch-2. > FileInputStream leak on failure path in BlockSender

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816464#comment-15816464 ] Ming Ma commented on HDFS-9391: --- Thanks [~manojg]. It seems there is a typo in branch-2 patch

[jira] [Commented] (HDFS-3618) SSH fencing option may incorrectly succeed if nc (netcat) command not present

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816463#comment-15816463 ] Hadoop QA commented on HDFS-3618: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-10 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816470#comment-15816470 ] Manoj Govindassamy commented on HDFS-9391: -- Yes, [~mingma]. After looking at jenki

[jira] [Updated] (HDFS-11028) libhdfs++: FileHandleImpl::CancelOperations needs to be able to cancel pending connections

2017-01-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11028: --- Attachment: HDFS-11028.HDFS-8707.003.patch New patch: -minor cleanup like capture lists pickin

[jira] [Created] (HDFS-11312) Discrepancy in nonDfsUsed index in protobuf

2017-01-10 Thread Sean Mackrory (JIRA)
Sean Mackrory created HDFS-11312: Summary: Discrepancy in nonDfsUsed index in protobuf Key: HDFS-11312 URL: https://issues.apache.org/jira/browse/HDFS-11312 Project: Hadoop HDFS Issue Type: B

[jira] [Updated] (HDFS-11312) Discrepancy in nonDfsUsed index in protobuf

2017-01-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-11312: - Attachment: HDFS-11312.001.patch > Discrepancy in nonDfsUsed index in protobuf > -

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-01-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816505#comment-15816505 ] Sean Mackrory commented on HDFS-11096: -- The getHdfsBlockLocations removal is document

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2017-01-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816508#comment-15816508 ] Uma Maheswara Rao G commented on HDFS-11150: Latest patch almost looks good to

[jira] [Commented] (HDFS-10702) Add a Client API and Proxy Provider to enable stale read from Standby

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816514#comment-15816514 ] Hadoop QA commented on HDFS-10702: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11312) Discrepancy in nonDfsUsed index in protobuf

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11312: --- Affects Version/s: 2.8.0 3.0.0-alpha1 Target Version/s: 2.8.0, 3.0.0-alpha2

[jira] [Commented] (HDFS-11312) Discrepancy in nonDfsUsed index in protobuf

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816546#comment-15816546 ] Andrew Wang commented on HDFS-11312: It looks like this discrepancy exists between 2.8

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816550#comment-15816550 ] Hadoop QA commented on HDFS-11303: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

2017-01-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816608#comment-15816608 ] Xiaoyu Yao edited comment on HDFS-11209 at 1/11/17 12:07 AM: -

[jira] [Updated] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

2017-01-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11209: -- Attachment: HDFS-11209.03.patch Update patch for HDFS-11209.03.patch. Diff from prev: consolidate the N

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816623#comment-15816623 ] Andrew Wang commented on HDFS-11096: Thanks for checking all this Sean, a couple repli

[jira] [Commented] (HDFS-11302) Improve Logging for SSLHostnameVerifier

2017-01-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816640#comment-15816640 ] Xiaoyu Yao commented on HDFS-11302: --- Thanks [~vagarychen] for working on this. Patch loo

[jira] [Resolved] (HDFS-7674) [umbrella] Adding metrics for Erasure Coding

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-7674. --- Resolution: Done I think we can close this since the subtasks are resolved. Thanks everyone for the ha

[jira] [Updated] (HDFS-8672) Erasure Coding: Add EC-related Metrics to NN (seperate striped blocks count from UnderReplicatedBlocks count)

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8672: -- Labels: hdfs-ec-3.0-nice-to-have (was: ) > Erasure Coding: Add EC-related Metrics to NN (seperate stripe

[jira] [Updated] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10999: --- Labels: hdfs-ec-3.0-nice-to-have supportability (was: supportability) > Use more generic "low redunda

[jira] [Commented] (HDFS-11028) libhdfs++: FileHandleImpl::CancelOperations needs to be able to cancel pending connections

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816662#comment-15816662 ] Hadoop QA commented on HDFS-11028: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7337: -- Target Version/s: 3.0.0-alpha2 (was: HDFS-7285) > Configurable and pluggable Erasure Codec and schema >

[jira] [Commented] (HDFS-11302) Improve Logging for SSLHostnameVerifier

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1581#comment-1581 ] Hadoop QA commented on HDFS-11302: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7337: -- Labels: hdfs-ec-3.0-nice-to-have (was: ) > Configurable and pluggable Erasure Codec and schema > ---

[jira] [Updated] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-10 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9391: - Attachment: HDFS-9391-branch-2.02.patch HDFS-9391-branch-2-MaintenanceMode-W

[jira] [Updated] (HDFS-7786) Handle slow writers for DFSStripedOutputStream

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7786: -- Labels: hdfs-ec-3.0-nice-to-have (was: ) > Handle slow writers for DFSStripedOutputStream >

[jira] [Updated] (HDFS-7619) Erasure Coding: Handling truncated files in snapshots

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7619: -- Summary: Erasure Coding: Handling truncated files in snapshots (was: Erasure Coding: Handling files in

[jira] [Updated] (HDFS-8140) ECSchema supports for offline EditsVistor over an OEV XML file

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8140: -- Target Version/s: 3.0.0-alpha2 (was: HDFS-7285) > ECSchema supports for offline EditsVistor over an OEV

[jira] [Updated] (HDFS-8140) ECSchema supports for offline EditsVisitor over an OEV XML file

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8140: -- Summary: ECSchema supports for offline EditsVisitor over an OEV XML file (was: ECSchema supports for off

[jira] [Updated] (HDFS-8140) ECSchema supports for offline EditsVistor over an OEV XML file

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8140: -- Labels: hdfs-ec-3.0-nice-to-have (was: ) > ECSchema supports for offline EditsVistor over an OEV XML fil

[jira] [Commented] (HDFS-8095) Allow to configure the system default EC schema

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816691#comment-15816691 ] Andrew Wang commented on HDFS-8095: --- Is this JIRA superceded by HDFS-7859? Also like [Vin

[jira] [Updated] (HDFS-8095) Allow to configure the system default EC schema

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8095: -- Labels: hdfs-ec-3.0-nice-to-have (was: ) > Allow to configure the system default EC schema > ---

[jira] [Updated] (HDFS-11296) Maintenance state expiry should be an epoch time and not jvm monotonic

2017-01-10 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11296: -- Attachment: HDFS-11296-branch-2.01.patch > Maintenance state expiry should be an epoch t

[jira] [Updated] (HDFS-8196) Erasure Coding related information on NameNode UI

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8196: -- Labels: NameNode WebUI hdfs-ec-3.0-nice-to-have (was: NameNode WebUI) > Erasure Coding related informati

[jira] [Commented] (HDFS-8095) Allow to configure the system default EC schema

2017-01-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816693#comment-15816693 ] Andrew Wang commented on HDFS-8095: --- Adding the "nice-to-have" label, since I think it's

  1   2   >