[jira] [Commented] (HDFS-10959) Adding per disk IO statistics in DataNode.

[ https://issues.apache.org/jira/browse/HDFS-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15756475#comment-15756475 ] Hadoop QA commented on HDFS-10959: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15756442#comment-15756442 ] Hadoop QA commented on HDFS-10860: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15756391#comment-15756391 ] Hadoop QA commented on HDFS-9391: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15756345#comment-15756345 ] Ming Ma commented on HDFS-9391: --- Thanks [~manojg]. Some minor questions: * {{.put("inMainten

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15756346#comment-15756346 ] Ming Ma commented on HDFS-9391: --- Thanks [~manojg]. Some minor questions: * {{.put("inMainten

[jira] [Issue Comment Deleted] (HDFS-9391) Update webUI/JMX to display maintenance state info

[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9391: -- Comment: was deleted (was: Thanks [~manojg]. Some minor questions: * {{.put("inMaintenance", node.isInMaintenanc

[jira] [Updated] (HDFS-10959) Adding per disk IO statistics in DataNode.

[ https://issues.apache.org/jira/browse/HDFS-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10959: -- Attachment: HDFS-10959.01.patch Thanks [~arpitagarwal] for the review. Update patch to address the feedb

[jira] [Comment Edited] (HDFS-11222) Document application/octet-stream as required content type for data upload requests in HTTPFS

[ https://issues.apache.org/jira/browse/HDFS-11222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15756199#comment-15756199 ] Yiqun Lin edited comment on HDFS-11222 at 12/17/16 4:13 AM: Th

[jira] [Comment Edited] (HDFS-11222) Document application/octet-stream as required content type for data upload requests in HTTPFS

[ https://issues.apache.org/jira/browse/HDFS-11222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15756199#comment-15756199 ] Yiqun Lin edited comment on HDFS-11222 at 12/17/16 4:12 AM: Th

[jira] [Updated] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10860: -- Status: Patch Available (was: In Progress) > Switch HttpFS from Tomcat to Jetty > -

[jira] [Updated] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10860: -- Attachment: HDFS-10860.002.patch Patch 002 - Update doc index.md, ServerSetup.md.vm, and HDFSCommands.md

[jira] [Commented] (HDFS-11222) Document application/octet-stream as required content type for data upload requests in HTTPFS

[ https://issues.apache.org/jira/browse/HDFS-11222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15756199#comment-15756199 ] Yiqun Lin commented on HDFS-11222: -- Thanks [~jojochuang] for the review and comments. {qu

[jira] [Comment Edited] (HDFS-9391) Update webUI/JMX to display maintenance state info

[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15756191#comment-15756191 ] Manoj Govindassamy edited comment on HDFS-9391 at 12/17/16 3:19 AM: -

[jira] [Updated] (HDFS-9391) Update webUI/JMX to display maintenance state info

[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9391: - Affects Version/s: 3.0.0-alpha1 Target Version/s: 3.0.0-alpha2 Status: P

[jira] [Updated] (HDFS-9391) Update webUI/JMX to display maintenance state info

[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9391: - Attachment: HDFS-9391.01.patch > Update webUI/JMX to display maintenance state info > -

[jira] [Created] (HDFS-11259) Update fsck to display maintenance state info

Manoj Govindassamy created HDFS-11259: - Summary: Update fsck to display maintenance state info Key: HDFS-11259 URL: https://issues.apache.org/jira/browse/HDFS-11259 Project: Hadoop HDFS I

[jira] [Updated] (HDFS-9391) Update webUI/JMX to display maintenance state info

[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9391: - Attachment: HDFS-9391-MaintenanceMode-WebUI.pdf Attaching the WebUI proposal for Maintenanc

[jira] [Updated] (HDFS-9391) Update webUI/JMX to display maintenance state info

[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9391: - Summary: Update webUI/JMX to display maintenance state info (was: Update webUI/JMX/fsck to

[jira] [Commented] (HDFS-9911) TestDataNodeLifeline Fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15756151#comment-15756151 ] Yiqun Lin commented on HDFS-9911: - Thanks [~anu] for the commit and thanks every one! > Te

[jira] [Commented] (HDFS-10959) Adding per disk IO statistics in DataNode.

[ https://issues.apache.org/jira/browse/HDFS-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15756117#comment-15756117 ] Arpit Agarwal commented on HDFS-10959: -- Thanks Xiaoyu. The patch looks good. Minor

[jira] [Commented] (HDFS-11258) File mtime change could not save to editlog

[ https://issues.apache.org/jira/browse/HDFS-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15756055#comment-15756055 ] Hadoop QA commented on HDFS-11258: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-10959) Adding per disk IO statistics in DataNode.

[ https://issues.apache.org/jira/browse/HDFS-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755526#comment-15755526 ] Xiaoyu Yao edited comment on HDFS-10959 at 12/17/16 12:07 AM: --

[jira] [Commented] (HDFS-11258) File mtime change could not save to editlog

[ https://issues.apache.org/jira/browse/HDFS-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755818#comment-15755818 ] Haohui Mai commented on HDFS-11258: --- Thanks [~jxiang] for reporting the issue! Can you p

[jira] [Updated] (HDFS-11258) File mtime change could not save to editlog

[ https://issues.apache.org/jira/browse/HDFS-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HDFS-11258: --- Status: Patch Available (was: Open) > File mtime change could not save to editlog > -

[jira] [Updated] (HDFS-11258) File mtime change could not save to editlog

[ https://issues.apache.org/jira/browse/HDFS-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HDFS-11258: --- Attachment: hdfs-11258.1.patch > File mtime change could not save to editlog > ---

[jira] [Created] (HDFS-11258) File mtime change could not save to editlog

Jimmy Xiang created HDFS-11258: -- Summary: File mtime change could not save to editlog Key: HDFS-11258 URL: https://issues.apache.org/jira/browse/HDFS-11258 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9901) Move disk IO out of the heartbeat thread

[ https://issues.apache.org/jira/browse/HDFS-9901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755768#comment-15755768 ] Hadoop QA commented on HDFS-9901: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Resolved] (HDFS-11254) Standby NameNode may crash during failover if loading edits takes too long

[ https://issues.apache.org/jira/browse/HDFS-11254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11254. Resolution: Duplicate I'm going to close it as HDFS-8865 can help eliminate this issue. > S

[jira] [Comment Edited] (HDFS-9901) Move disk IO out of the heartbeat thread

[ https://issues.apache.org/jira/browse/HDFS-9901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755754#comment-15755754 ] Wei-Chiu Chuang edited comment on HDFS-9901 at 12/16/16 11:12 PM: ---

[jira] [Commented] (HDFS-9901) Move disk IO out of the heartbeat thread

[ https://issues.apache.org/jira/browse/HDFS-9901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755754#comment-15755754 ] Wei-Chiu Chuang commented on HDFS-9901: --- FsDatasetImpl#checkBlock does not perform an

[jira] [Commented] (HDFS-10959) Adding per disk IO statistics in DataNode.

[ https://issues.apache.org/jira/browse/HDFS-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755740#comment-15755740 ] Hadoop QA commented on HDFS-10959: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11160: --- Release Note: Fixed a race condition that caused VolumeScanner to recognize a good replica as

[jira] [Updated] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11160: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755580#comment-15755580 ] Yishan Yang commented on HDFS-10453: Any update? Whether community wanna accept this f

[jira] [Updated] (HDFS-10959) Adding per disk IO statistics in DataNode.

[ https://issues.apache.org/jira/browse/HDFS-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10959: -- Status: Patch Available (was: Open) > Adding per disk IO statistics in DataNode. >

[jira] [Updated] (HDFS-10959) Adding per disk IO statistics in DataNode.

[ https://issues.apache.org/jira/browse/HDFS-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10959: -- Attachment: HDFS-10959.00.patch Attach a patch that add per volume io stats and metrics based on Profil

[jira] [Commented] (HDFS-11192) OOM during Quota Initialization lead to Namenode hang

[ https://issues.apache.org/jira/browse/HDFS-11192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755493#comment-15755493 ] Wei-Chiu Chuang commented on HDFS-11192: Ping. Any progress? > OOM during Quota

[jira] [Commented] (HDFS-11257) Evacuate DN when the remaining is negative

[ https://issues.apache.org/jira/browse/HDFS-11257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755365#comment-15755365 ] Inigo Goiri commented on HDFS-11257: The proposal would be for the {{BlockManager}} to

[jira] [Created] (HDFS-11257) Evacuate DN when the remaining is negative

Inigo Goiri created HDFS-11257: -- Summary: Evacuate DN when the remaining is negative Key: HDFS-11257 URL: https://issues.apache.org/jira/browse/HDFS-11257 Project: Hadoop HDFS Issue Type: Improv

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755358#comment-15755358 ] Chris Douglas commented on HDFS-6984: - bq. So for the Hive usecase, they would have to

[jira] [Commented] (HDFS-11114) Support for running async disk checks in DataNode

[ https://issues.apache.org/jira/browse/HDFS-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755260#comment-15755260 ] ASF GitHub Bot commented on HDFS-4: --- Github user arp7 closed the pull request at

[jira] [Commented] (HDFS-9911) TestDataNodeLifeline Fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755252#comment-15755252 ] Chris Nauroth commented on HDFS-9911: - [~linyiqun], thank you for the patch! > TestDat

[jira] [Commented] (HDFS-9911) TestDataNodeLifeline Fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755179#comment-15755179 ] Hudson commented on HDFS-9911: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1100

[jira] [Updated] (HDFS-9911) TestDataNodeLifeline Fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9911: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: (was: 2.8.0)

[jira] [Commented] (HDFS-9911) TestDataNodeLifeline Fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755091#comment-15755091 ] Anu Engineer commented on HDFS-9911: +1 on patch 2. > TestDataNodeLifeline Fails inte

[jira] [Commented] (HDFS-11215) Log Namenode thread dump on unexpected exits

[ https://issues.apache.org/jira/browse/HDFS-11215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15754869#comment-15754869 ] Stephen O'Donnell commented on HDFS-11215: -- Hey [~apurtell] - I wasn't particular

[jira] [Commented] (HDFS-11254) Standby NameNode may crash during failover if loading edits takes too long

[ https://issues.apache.org/jira/browse/HDFS-11254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15754689#comment-15754689 ] Wei-Chiu Chuang commented on HDFS-11254: On the other hand, maybe a dedicated Name

[jira] [Commented] (HDFS-11222) Document application/octet-stream as required content type for data upload requests in HTTPFS

[ https://issues.apache.org/jira/browse/HDFS-11222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15754657#comment-15754657 ] Wei-Chiu Chuang commented on HDFS-11222: [~linyiqun] thanks for the updated patch,

[jira] [Issue Comment Deleted] (HDFS-11254) Standby NameNode may crash during failover if loading edits takes too long

[ https://issues.apache.org/jira/browse/HDFS-11254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11254: --- Comment: was deleted (was: Looking at code again, the more relevant one is HDFS-8865 which use

[jira] [Commented] (HDFS-11254) Standby NameNode may crash during failover if loading edits takes too long

[ https://issues.apache.org/jira/browse/HDFS-11254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15754366#comment-15754366 ] Wei-Chiu Chuang commented on HDFS-11254: Looking at code again, the more relevant

[jira] [Commented] (HDFS-11254) Standby NameNode may crash during failover if loading edits takes too long

[ https://issues.apache.org/jira/browse/HDFS-11254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15754367#comment-15754367 ] Wei-Chiu Chuang commented on HDFS-11254: Looking at code again, the more relevant

[jira] [Commented] (HDFS-11254) Standby NameNode may crash during failover if loading edits takes too long

[ https://issues.apache.org/jira/browse/HDFS-11254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15754339#comment-15754339 ] Wei-Chiu Chuang commented on HDFS-11254: [~linyiqun] yeah code-wise looks that way

[jira] [Commented] (HDFS-9911) TestDataNodeLifeline Fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15754110#comment-15754110 ] Yiqun Lin commented on HDFS-9911: - Hi [~anu], [~cnauroth], could you please help do the fin

[jira] [Updated] (HDFS-11256) Rebalance specific directory

[ https://issues.apache.org/jira/browse/HDFS-11256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11256: Target Version/s: (was: 3.0.0-alpha1) > Rebalance specific directory > ---

[jira] [Updated] (HDFS-11256) Rebalance specific directory

[ https://issues.apache.org/jira/browse/HDFS-11256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11256: Fix Version/s: (was: 3.0.0-alpha1) > Rebalance specific directory >

[jira] [Created] (HDFS-11256) Rebalance specific directory

Amos Bird created HDFS-11256: Summary: Rebalance specific directory Key: HDFS-11256 URL: https://issues.apache.org/jira/browse/HDFS-11256 Project: Hadoop HDFS Issue Type: New Feature Co