[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12914: --- Attachment: HDFS-12914.006.patch > Block report leases cause missing blocks until next report > -

[jira] [Commented] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-06-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858383#comment-16858383 ] He Xiaoqiao commented on HDFS-14513: [^HDFS-14513.006.patch] catch IOException in #sa

[jira] [Updated] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-06-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14513: --- Attachment: HDFS-14513.007.patch > FSImage which is saving should be clean while NameNode shutdown >

[jira] [Commented] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-06-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857975#comment-16857975 ] He Xiaoqiao commented on HDFS-14513: upload [^HDFS-14513.006.patch] and fix Logger st

[jira] [Updated] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-06-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14513: --- Attachment: HDFS-14513.006.patch > FSImage which is saving should be clean while NameNode shutdown >

[jira] [Commented] (HDFS-14550) RBF: Failed to get statistics from NameNodes before 2.9.0

2019-06-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857943#comment-16857943 ] He Xiaoqiao commented on HDFS-14550: Thanks [~elgoiri],[~ayushtkn] for your quick res

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857935#comment-16857935 ] He Xiaoqiao commented on HDFS-12914: hi watchers, [^HDFS-12914.005.patch] try to fix

[jira] [Updated] (HDFS-12914) Block report leases cause missing blocks until next report

2019-06-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12914: --- Attachment: HDFS-12914.005.patch > Block report leases cause missing blocks until next report > -

[jira] [Commented] (HDFS-14527) Stop all DataNodes may result in NN terminate

2019-06-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857931#comment-16857931 ] He Xiaoqiao commented on HDFS-14527: Thanks [~elgoiri], [~ayushtkn] for the reviews a

[jira] [Commented] (HDFS-14550) RBF: Failed to get statistics from NameNodes before 2.9.0

2019-06-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857928#comment-16857928 ] He Xiaoqiao commented on HDFS-14550: Thanks [~crh], [^HDFS-14550-HDFS-13891.001.patch

[jira] [Updated] (HDFS-14550) RBF: Failed to get statistics from NameNodes before 2.9.0

2019-06-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14550: --- Attachment: HDFS-14550-HDFS-13891.001.patch > RBF: Failed to get statistics from NameNodes before 2.9

[jira] [Commented] (HDFS-14550) RBF: Failed to get statistics from NameNodes before 2.9.0

2019-06-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857486#comment-16857486 ] He Xiaoqiao commented on HDFS-14550: no problem, I would like to resolve it later. >

[jira] [Assigned] (HDFS-14550) RBF: Failed to get statistics from NameNodes before 2.9.0

2019-06-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao reassigned HDFS-14550: -- Assignee: He Xiaoqiao > RBF: Failed to get statistics from NameNodes before 2.9.0 > --

[jira] [Commented] (HDFS-14550) RBF: Failed to get statistics from NameNodes before 2.9.0

2019-06-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857413#comment-16857413 ] He Xiaoqiao commented on HDFS-14550: [~aajisaka], I meet this exception also, and we

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2019-06-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857346#comment-16857346 ] He Xiaoqiao commented on HDFS-12733: Thanks [~ayushtkn], It seems that there are diff

[jira] [Commented] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-06-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857267#comment-16857267 ] He Xiaoqiao commented on HDFS-14513: upload [^HDFS-14513.005.patch] and remove unit t

[jira] [Updated] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-06-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14513: --- Attachment: HDFS-14513.005.patch > FSImage which is saving should be clean while NameNode shutdown >

[jira] [Commented] (HDFS-14527) Stop all DataNodes may result in NN terminate

2019-06-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857262#comment-16857262 ] He Xiaoqiao commented on HDFS-14527: Thanks [~elgoiri], checked failed unit tests and

[jira] [Commented] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-06-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856323#comment-16856323 ] He Xiaoqiao commented on HDFS-14513: Thanks [~elgoiri], by seeking junit and shutdown

[jira] [Commented] (HDFS-14527) Stop all DataNodes may result in NN terminate

2019-06-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856309#comment-16856309 ] He Xiaoqiao commented on HDFS-14527: [^HDFS-14527.005.patch] fix checkstyle and renam

[jira] [Updated] (HDFS-14527) Stop all DataNodes may result in NN terminate

2019-06-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14527: --- Attachment: HDFS-14527.005.patch > Stop all DataNodes may result in NN terminate > --

[jira] [Updated] (HDFS-14527) Stop all DataNodes may result in NN terminate

2019-06-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14527: --- Attachment: (was: HDFS-14527.005.patch) > Stop all DataNodes may result in NN terminate > ---

[jira] [Updated] (HDFS-14527) Stop all DataNodes may result in NN terminate

2019-06-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14527: --- Attachment: HDFS-14527.005.patch > Stop all DataNodes may result in NN terminate > --

[jira] [Commented] (HDFS-14527) Stop all DataNodes may result in NN terminate

2019-06-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856027#comment-16856027 ] He Xiaoqiao commented on HDFS-14527: [~elgoiri],[~ayushtkn] Thanks for your quick rev

[jira] [Updated] (HDFS-14527) Stop all DataNodes may result in NN terminate

2019-06-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14527: --- Attachment: HDFS-14527.004.patch > Stop all DataNodes may result in NN terminate > --

[jira] [Commented] (HDFS-14303) chek block directory logic not correct when there is only meta file, print no meaning warn log

2019-06-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855839#comment-16855839 ] He Xiaoqiao commented on HDFS-14303: [~iamgd67] Thanks for your pings. some minor com

[jira] [Commented] (HDFS-14527) Stop all DataNodes may result in NN terminate

2019-06-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855822#comment-16855822 ] He Xiaoqiao commented on HDFS-14527: Thanks [~elgoiri] for your detailed reviews. upl

[jira] [Updated] (HDFS-14527) Stop all DataNodes may result in NN terminate

2019-06-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14527: --- Attachment: HDFS-14527.003.patch > Stop all DataNodes may result in NN terminate > --

[jira] [Commented] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-06-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855748#comment-16855748 ] He Xiaoqiao commented on HDFS-14513: Sorry I am not familiar with mechanism of junit

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2019-06-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855738#comment-16855738 ] He Xiaoqiao commented on HDFS-12733: Thanks [~brahmareddy] for your suggestion. {quot

[jira] [Commented] (HDFS-14511) FSEditlog write both Quorum Journal and Local disk by default in HA using QJM scenario

2019-06-03 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855313#comment-16855313 ] He Xiaoqiao commented on HDFS-14511: Thanks [~brahmareddy], close this issue since it

[jira] [Resolved] (HDFS-14511) FSEditlog write both Quorum Journal and Local disk by default in HA using QJM scenario

2019-06-03 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao resolved HDFS-14511. Resolution: Duplicate > FSEditlog write both Quorum Journal and Local disk by default in HA using Q

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2019-06-03 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854652#comment-16854652 ] He Xiaoqiao commented on HDFS-12733: [~shv], Thanks for your suggestions. {quote}I wo

[jira] [Commented] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-06-03 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854639#comment-16854639 ] He Xiaoqiao commented on HDFS-14513: [~elgoiri], Thanks for your suggestion. [^HDFS-

[jira] [Updated] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-06-03 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14513: --- Attachment: HDFS-14513.004.patch > FSImage which is saving should be clean while NameNode shutdown >

[jira] [Comment Edited] (HDFS-14527) Stop all DataNodes may result in NN terminate

2019-06-03 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854629#comment-16854629 ] He Xiaoqiao edited comment on HDFS-14527 at 6/3/19 2:09 PM: [

[jira] [Commented] (HDFS-14527) Stop all DataNodes may result in NN terminate

2019-06-03 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854629#comment-16854629 ] He Xiaoqiao commented on HDFS-14527: [~elgoiri], [^HDFS-14527.002.patch] add a unit

[jira] [Updated] (HDFS-14527) Stop all DataNodes may result in NN terminate

2019-06-03 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14527: --- Attachment: HDFS-14527.002.patch > Stop all DataNodes may result in NN terminate > --

[jira] [Commented] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-05-31 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16852826#comment-16852826 ] He Xiaoqiao commented on HDFS-14513: [~elgoiri], Thanks for your reviews. a. it makes

[jira] [Commented] (HDFS-14497) Write lock held by metasave impact following RPC processing

2019-05-31 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16852823#comment-16852823 ] He Xiaoqiao commented on HDFS-14497: [~jojochuang],Thanks for your reviews and helps,

[jira] [Updated] (HDFS-14527) Stop all DataNodes may result in NN terminate

2019-05-31 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14527: --- Attachment: HDFS-14527.001.patch Status: Patch Available (was: Open) submit quick-fix patch

[jira] [Created] (HDFS-14527) Stop all DataNodes may result in NN terminate

2019-05-31 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14527: -- Summary: Stop all DataNodes may result in NN terminate Key: HDFS-14527 URL: https://issues.apache.org/jira/browse/HDFS-14527 Project: Hadoop HDFS Issue Type: Bug

[jira] [Comment Edited] (HDFS-12733) Option to disable to namenode local edits

2019-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851186#comment-16851186 ] He Xiaoqiao edited comment on HDFS-12733 at 5/29/19 6:36 PM: -

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2019-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851186#comment-16851186 ] He Xiaoqiao commented on HDFS-12733: To [~elgoiri], Thanks for taking a look. {quote}

[jira] [Commented] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851172#comment-16851172 ] He Xiaoqiao commented on HDFS-14513: [~elgoiri], Thanks for your comments. [^HDFS-14

[jira] [Updated] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14513: --- Description: Checkpointer/FSImageSaver is regular tasks and dump NameNode meta to disk, at most per

[jira] [Updated] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14513: --- Attachment: HDFS-14513.003.patch > FSImage which is saving should be clean while NameNode shutdown >

[jira] [Comment Edited] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850707#comment-16850707 ] He Xiaoqiao edited comment on HDFS-14513 at 5/29/19 4:40 PM: -

[jira] [Updated] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14513: --- Attachment: HDFS-14513.002.patch > FSImage which is saving should be clean while NameNode shutdown >

[jira] [Updated] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14513: --- Attachment: (was: HDFS-14351.002.patch) > FSImage which is saving should be clean while NameNode

[jira] [Comment Edited] (HDFS-12733) Option to disable to namenode local edits

2019-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850713#comment-16850713 ] He Xiaoqiao edited comment on HDFS-12733 at 5/29/19 9:53 AM: -

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2019-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850713#comment-16850713 ] He Xiaoqiao commented on HDFS-12733: Ping [~brahmareddy],[~elgoiri],[~shv] do you min

[jira] [Commented] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850707#comment-16850707 ] He Xiaoqiao commented on HDFS-14513: [~elgoiri] Thanks for taking a look. I would lik

[jira] [Updated] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14513: --- Attachment: HDFS-14351.002.patch > FSImage which is saving should be clean while NameNode shutdown >

[jira] [Updated] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-05-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14513: --- Attachment: HDFS-14513.001.patch Status: Patch Available (was: Open) > FSImage which is savi

[jira] [Updated] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-05-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14513: --- Attachment: (was: HDFS-14513.001.patch) > FSImage which is saving should be clean while NameNode

[jira] [Commented] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-05-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16848392#comment-16848392 ] He Xiaoqiao commented on HDFS-14513: [^HDFS-14513.001.patch] Add hook for FSImageSave

[jira] [Updated] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-05-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14513: --- Attachment: HDFS-14513.001.patch > FSImage which is saving should be clean while NameNode shutdown >

[jira] [Created] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-05-26 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14513: -- Summary: FSImage which is saving should be clean while NameNode shutdown Key: HDFS-14513 URL: https://issues.apache.org/jira/browse/HDFS-14513 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2019-05-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16848111#comment-16848111 ] He Xiaoqiao commented on HDFS-12733: upload patch [^HDFS-12733.005.patch] with NameNo

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2019-05-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12733: --- Attachment: HDFS-12733.005.patch > Option to disable to namenode local edits > --

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2019-05-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16848084#comment-16848084 ] He Xiaoqiao commented on HDFS-12733: Thanks [~lindongdong], {quote}Pls think about t

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847553#comment-16847553 ] He Xiaoqiao commented on HDFS-14186: ping [~kihwal],[~elgoiri],[~xkrogen],[~daryn], d

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2019-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847461#comment-16847461 ] He Xiaoqiao commented on HDFS-12733: I check test results and 10 failures, all about

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2019-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847382#comment-16847382 ] He Xiaoqiao commented on HDFS-12733: [~lindongdong] could you like to share any exper

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2019-05-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847282#comment-16847282 ] He Xiaoqiao commented on HDFS-12733: rebase original patch to branch trunk and upload

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2019-05-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12733: --- Attachment: HDFS-12733.004.patch > Option to disable to namenode local edits > --

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2019-05-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847276#comment-16847276 ] He Xiaoqiao commented on HDFS-12733: [~brahmareddy], any plan to push forward this is

[jira] [Commented] (HDFS-14511) FSEditlog write both Quorum Journal and Local disk by default in HA using QJM scenario

2019-05-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847261#comment-16847261 ] He Xiaoqiao commented on HDFS-14511: Thanks [~ayushtkn] for your quick comment, I bel

[jira] [Commented] (HDFS-14511) FSEditlog write both Quorum Journal and Local disk by default in HA using QJM scenario

2019-05-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847249#comment-16847249 ] He Xiaoqiao commented on HDFS-14511: [~shv] offer one valid solution that set 'dfs.na

[jira] [Created] (HDFS-14511) FSEditlog write both Quorum Journal and Local disk by default in HA using QJM scenario

2019-05-23 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14511: -- Summary: FSEditlog write both Quorum Journal and Local disk by default in HA using QJM scenario Key: HDFS-14511 URL: https://issues.apache.org/jira/browse/HDFS-14511 Proj

[jira] [Comment Edited] (HDFS-12914) Block report leases cause missing blocks until next report

2019-05-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845764#comment-16845764 ] He Xiaoqiao edited comment on HDFS-12914 at 5/22/19 10:48 AM: -

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-05-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845764#comment-16845764 ] He Xiaoqiao commented on HDFS-12914: [~smarella], some minor comments about [^HDFS-1

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-05-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844559#comment-16844559 ] He Xiaoqiao commented on HDFS-12914: Thanks [~jojochuang] helps. [~smarella], just qu

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2019-05-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844492#comment-16844492 ] He Xiaoqiao commented on HDFS-14498: Thanks [~sershe], please offer the necessary inf

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-05-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844497#comment-16844497 ] He Xiaoqiao commented on HDFS-12914: [~smarella], please click `Submit Patch` under t

[jira] [Comment Edited] (HDFS-12914) Block report leases cause missing blocks until next report

2019-05-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16843936#comment-16843936 ] He Xiaoqiao edited comment on HDFS-12914 at 5/20/19 12:58 PM: -

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-05-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16843936#comment-16843936 ] He Xiaoqiao commented on HDFS-12914: [~smarella] Thanks for your report, I think you

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2019-05-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16843107#comment-16843107 ] He Xiaoqiao commented on HDFS-14498: Thanks [~sershe], it is very interesting report.

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-05-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16843106#comment-16843106 ] He Xiaoqiao commented on HDFS-14186: hi [~kihwal], Thanks for your valuable comments.

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-05-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842097#comment-16842097 ] He Xiaoqiao commented on HDFS-14186: [~xuzq_zander], Thanks for your suggestion, it i

[jira] [Commented] (HDFS-14303) chek block directory logic not correct when there is only meta file, print no meaning warn log

2019-05-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16841423#comment-16841423 ] He Xiaoqiao commented on HDFS-14303: thanks [~iamgd67] for your report, quick review

[jira] [Updated] (HDFS-14497) Write lock hold by metasave impact following RPC processing

2019-05-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14497: --- Attachment: HDFS-14497.001.patch Status: Patch Available (was: Open) submit quick-and-dirty

[jira] [Comment Edited] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-05-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16841310#comment-16841310 ] He Xiaoqiao edited comment on HDFS-14186 at 5/16/19 1:05 PM: -

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-05-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16841310#comment-16841310 ] He Xiaoqiao commented on HDFS-14186: Hi wathers, Sorry for reopen this issue again. A

[jira] [Reopened] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-05-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao reopened HDFS-14186: > blockreport storm slow down namenode restart seriously in large cluster > ---

[jira] [Commented] (HDFS-14497) Write lock hold by metasave impact following RPC processing

2019-05-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16841164#comment-16841164 ] He Xiaoqiao commented on HDFS-14497: [~jojochuang] Thanks for your quick response. {q

[jira] [Created] (HDFS-14497) Write lock hold by metasave impact following RPC processing

2019-05-16 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14497: -- Summary: Write lock hold by metasave impact following RPC processing Key: HDFS-14497 URL: https://issues.apache.org/jira/browse/HDFS-14497 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14303) chek block directory logic not correct when there is only meta file, print no meaning warn log

2019-05-15 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16840519#comment-16840519 ] He Xiaoqiao commented on HDFS-14303: [~iamgd67] Thanks for your ping, IIRC #Directory

[jira] [Commented] (HDFS-14201) Ability to disallow safemode NN to become active

2019-05-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834468#comment-16834468 ] He Xiaoqiao commented on HDFS-14201: Hi [~surmountian] [~elgoiri], It is true that lo

[jira] [Updated] (HDFS-14201) Ability to disallow safemode NN to become active

2019-05-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14201: --- Attachment: HDFS-14201.005.patch > Ability to disallow safemode NN to become active > ---

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16823774#comment-16823774 ] He Xiaoqiao commented on HDFS-14437: [~angerszhuuu] I would like to connect with you

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16823660#comment-16823660 ] He Xiaoqiao commented on HDFS-14437: Thanks [~angerszhuuu] for your more information.

[jira] [Commented] (HDFS-14374) Expose total number of delegation tokens in AbstractDelegationTokenSecretManager

2019-04-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16823658#comment-16823658 ] He Xiaoqiao commented on HDFS-14374: Thanks [~crh] and [~elgoiri] working on this, an

[jira] [Commented] (HDFS-14405) RBF: Client should be able to renew DT immediately after it fetched the DT

2019-04-21 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16822893#comment-16822893 ] He Xiaoqiao commented on HDFS-14405: [~fengnanli] Thanks for your clarification espec

[jira] [Comment Edited] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-21 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16822856#comment-16822856 ] He Xiaoqiao edited comment on HDFS-14437 at 4/22/19 4:05 AM: -

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-21 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16822856#comment-16822856 ] He Xiaoqiao commented on HDFS-14437: [~angerszhuuu] sorry for my late response. I bel

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821767#comment-16821767 ] He Xiaoqiao commented on HDFS-14437: [~angerszhuuu], would you like to supply detaile

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821755#comment-16821755 ] He Xiaoqiao commented on HDFS-14437: [~angerszhuuu], I try to run unit test local and

[jira] [Commented] (HDFS-14405) RBF: Client should be able to renew DT immediately after it fetched the DT

2019-04-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821676#comment-16821676 ] He Xiaoqiao commented on HDFS-14405: Thanks [~crh] for the ping, IIUC, for ZKDelegati

<    1   2   3   4   5   6   7   8   9   >