[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821040#comment-16821040 ] He Xiaoqiao commented on HDFS-14437: [~angerszhuuu],Thanks for your correction, I will check it

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820974#comment-16820974 ] He Xiaoqiao commented on HDFS-14437: Thanks [~starphin]. {quote}But the table you presented will

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820953#comment-16820953 ] He Xiaoqiao commented on HDFS-14437: [~angerszhuuu],[~starphin] please help to double check.

[jira] [Comment Edited] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820942#comment-16820942 ] He Xiaoqiao edited comment on HDFS-14437 at 4/18/19 10:30 AM: -- Thanks

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820942#comment-16820942 ] He Xiaoqiao commented on HDFS-14437: Thanks [~angerszhuuu],[~starphin], It looks that root cause is

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820750#comment-16820750 ] He Xiaoqiao commented on HDFS-14437: [~angerszhuuu], tracking code logic again, and do you mean the

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820742#comment-16820742 ] He Xiaoqiao commented on HDFS-14437: [~angerszhuuu], Thanks for the ping. It is interesting dig. I

[jira] [Commented] (HDFS-14430) RBF: Fix MockNamenode bug about mocking RPC getListing and mkdir

2019-04-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819724#comment-16819724 ] He Xiaoqiao commented on HDFS-14430: [~elgoiri],[~ayushtkn] Thanks for point out that, it makes sense

[jira] [Commented] (HDFS-14430) RBF: Fix MockNamenode bug about mocking RPC getListing and mkdir

2019-04-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819107#comment-16819107 ] He Xiaoqiao commented on HDFS-14430: Thanks [~ayushtkn] for your quick response, I just check

[jira] [Updated] (HDFS-14430) RBF: Fix MockNamenode bug about mocking RPC getListing and mkdir

2019-04-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14430: --- Attachment: HDFS-14430-HDFS-13891.001.patch Status: Patch Available (was: Open) upload v001

[jira] [Created] (HDFS-14430) RBF: Fix MockNamenode bug about mocking RPC getListing and mkdir

2019-04-16 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14430: -- Summary: RBF: Fix MockNamenode bug about mocking RPC getListing and mkdir Key: HDFS-14430 URL: https://issues.apache.org/jira/browse/HDFS-14430 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14421) HDFS block two replicas exist in one DataNode

2019-04-15 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818000#comment-16818000 ] He Xiaoqiao commented on HDFS-14421: [~yuanbo], thanks for your comments, I am still confused that

[jira] [Commented] (HDFS-14421) HDFS block two replicas exist in one DataNode

2019-04-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815307#comment-16815307 ] He Xiaoqiao commented on HDFS-14421: [~yuanbo] I don't think we can find the root cause only

[jira] [Commented] (HDFS-14421) HDFS block two replicas exist in one DataNode

2019-04-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815123#comment-16815123 ] He Xiaoqiao commented on HDFS-14421: Thanks [~yuanbo] for your report, it's very interesting issue,

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2019-04-10 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815088#comment-16815088 ] He Xiaoqiao commented on HDFS-13248: Thanks [~elgoiri], I just send mail to hdfs-dev and common-dev

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2019-04-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813539#comment-16813539 ] He Xiaoqiao commented on HDFS-13248: Thanks [~elgoiri] and [~ayushtkn] {quote}Fake client hostname: I

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2019-04-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812173#comment-16812173 ] He Xiaoqiao commented on HDFS-13248: Thanks [~elgoiri], {quote}My main concern with modifying

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2019-04-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811521#comment-16811521 ] He Xiaoqiao commented on HDFS-13248: [~elgoiri],[~ayushtkn] Thanks for the document. I draft another

[jira] [Updated] (HDFS-13248) RBF: Namenode need to choose block location for the client

2019-04-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13248: --- Attachment: RBF Data Locality Design.pdf > RBF: Namenode need to choose block location for the

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2019-04-03 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809478#comment-16809478 ] He Xiaoqiao commented on HDFS-13248: Thanks [~elgoiri], [~ayushtkn] To [~elgoiri], {quote}we need a

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2019-04-03 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808863#comment-16808863 ] He Xiaoqiao commented on HDFS-13248: Overall, we need to extend three method in #ClientProtocol:

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2019-04-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806803#comment-16806803 ] He Xiaoqiao commented on HDFS-13248: {quote}In any case, the proper approach as discussed earlier

[jira] [Updated] (HDFS-14385) RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster

2019-04-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14385: --- Attachment: HDFS-14385-HDFS-13891.001.patch Status: Patch Available (was: Open) Sorry for

[jira] [Commented] (HDFS-14316) RBF: Support unavailable subclusters for mount points with multiple destinations

2019-03-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800723#comment-16800723 ] He Xiaoqiao commented on HDFS-14316: {quote}In HDFS-14316-HDFS-13891.010.patch I added a separate

[jira] [Commented] (HDFS-14385) RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster

2019-03-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800718#comment-16800718 ] He Xiaoqiao commented on HDFS-14385: Thanks [~elgoiri] for more comments, I will work on this jira

[jira] [Created] (HDFS-14385) RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster

2019-03-20 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14385: -- Summary: RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster Key: HDFS-14385 URL: https://issues.apache.org/jira/browse/HDFS-14385 Project:

[jira] [Commented] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797013#comment-16797013 ] He Xiaoqiao commented on HDFS-14351: ThanksĀ [~elgoiri] and [~ayushtkn] for the reviews and commit.

[jira] [Commented] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796792#comment-16796792 ] He Xiaoqiao commented on HDFS-14351: Pull [^HDFS-14351-HDFS-13891.006.patch] and test pass locally,

[jira] [Commented] (HDFS-14374) Expose total number of delegation tokens in AbstractDelegationTokenSecretManager

2019-03-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794154#comment-16794154 ] He Xiaoqiao commented on HDFS-14374: [~crh] Thanks for working on this. just one suggestion, we could

[jira] [Commented] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793280#comment-16793280 ] He Xiaoqiao commented on HDFS-14351: +1, [^HDFS-14351-HDFS-13891.005.patch]. Thanks, it's good work

[jira] [Commented] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792641#comment-16792641 ] He Xiaoqiao commented on HDFS-14351: fix checkstyle warn in [^HDFS-14351-HDFS-13891.004.patch] >

[jira] [Updated] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14351: --- Attachment: HDFS-14351-HDFS-13891.004.patch > RBF: Optimize configuration item resolving for monitor

[jira] [Commented] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792563#comment-16792563 ] He Xiaoqiao commented on HDFS-14351: [~elgoiri] Thanks, upload [^HDFS-14351-HDFS-13891.003.patch] to

[jira] [Updated] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14351: --- Attachment: HDFS-14351-HDFS-13891.003.patch > RBF: Optimize configuration item resolving for monitor

[jira] [Commented] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791494#comment-16791494 ] He Xiaoqiao commented on HDFS-14351: Attached [^HDFS-14351-HDFS-13891.002.patch] following comments.

[jira] [Updated] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14351: --- Attachment: HDFS-14351-HDFS-13891.002.patch > RBF: Optimize configuration item resolving for monitor

[jira] [Commented] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791344#comment-16791344 ] He Xiaoqiao commented on HDFS-14351: I will add new test to for RouterNamenodeMonitoringConfig later.

[jira] [Commented] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790332#comment-16790332 ] He Xiaoqiao commented on HDFS-14351: Thanks [~elgoiri] for reviewing.

[jira] [Updated] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14351: --- Attachment: HDFS-14351-HDFS-13891.001.patch > RBF: Optimize configuration item resolving for monitor

[jira] [Updated] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14351: --- Attachment: HDFS-14351.002.patch > RBF: Optimize configuration item resolving for monitor namenode >

[jira] [Updated] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14351: --- Attachment: (was: HDFS-14351.002.patch) > RBF: Optimize configuration item resolving for monitor

[jira] [Commented] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789470#comment-16789470 ] He Xiaoqiao commented on HDFS-14351: attach another patch [^HDFS-14351.002.patch] based on branch

[jira] [Updated] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14351: --- Attachment: HDFS-14351.002.patch > RBF: Optimize configuration item resolving for monitor namenode >

[jira] [Updated] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-10 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14351: --- Summary: RBF: Optimize configuration item resolving for monitor namenode (was: Optimize

[jira] [Created] (HDFS-14351) Optimize configuration item resolving for monitor namenode

2019-03-10 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14351: -- Summary: Optimize configuration item resolving for monitor namenode Key: HDFS-14351 URL: https://issues.apache.org/jira/browse/HDFS-14351 Project: Hadoop HDFS

[jira] [Updated] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2019-03-10 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14351: --- Attachment: HDFS-14351.001.patch Status: Patch Available (was: Open) I attached a

[jira] [Commented] (HDFS-13532) RBF: Adding security

2019-03-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787509#comment-16787509 ] He Xiaoqiao commented on HDFS-13532: [~elgoiri], [~crh]. Thanks for very helpful suggestions. The

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2019-03-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786417#comment-16786417 ] He Xiaoqiao commented on HDFS-13248: Thanks [~elgoiri], [^HDFS-13248.005.patch] seems a trick but

[jira] [Commented] (HDFS-13532) RBF: Adding security

2019-03-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786382#comment-16786382 ] He Xiaoqiao commented on HDFS-13532: [~crh],[~elgoiri],[~brahmareddy], really appreciate your

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2019-03-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785674#comment-16785674 ] He Xiaoqiao commented on HDFS-13248: [~elgoiri] I think this is also issue about read operation,

[jira] [Commented] (HDFS-13532) RBF: Adding security

2019-03-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784726#comment-16784726 ] He Xiaoqiao commented on HDFS-13532: Thanks [~brahmareddy] and [~elgoiri] for your detailed comments.

[jira] [Commented] (HDFS-13532) RBF: Adding security

2019-03-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784327#comment-16784327 ] He Xiaoqiao commented on HDFS-13532: Thanks for the great works here, I have followed RBF recently

[jira] [Created] (HDFS-14332) NetworkTopology#getWeightUsingNetworkLocation return unexpected result

2019-03-04 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14332: -- Summary: NetworkTopology#getWeightUsingNetworkLocation return unexpected result Key: HDFS-14332 URL: https://issues.apache.org/jira/browse/HDFS-14332 Project: Hadoop

[jira] [Updated] (HDFS-14332) NetworkTopology#getWeightUsingNetworkLocation return unexpected result

2019-03-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14332: --- Attachment: HDFS-14332.001.patch Status: Patch Available (was: Open) >

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781343#comment-16781343 ] He Xiaoqiao commented on HDFS-14305: [~xkrogen],[~csun] After check all dev branches containing

[jira] [Commented] (HDFS-14314) fullBlockReportLeaseId should be reset after registering to NN

2019-02-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781326#comment-16781326 ] He Xiaoqiao commented on HDFS-14314: Thanks [~starphin], +1, [^HDFS-14314-trunk.005.patch] LGTM. I

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781274#comment-16781274 ] He Xiaoqiao commented on HDFS-14305: Thanks [~arpitagarwal], {quote}Is this a compatible change and

[jira] [Commented] (HDFS-14201) Ability to disallow safemode NN to become active

2019-02-27 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780169#comment-16780169 ] He Xiaoqiao commented on HDFS-14201: +1 LGTM, Thanks [~surmountian]. > Ability to disallow safemode

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-27 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780050#comment-16780050 ] He Xiaoqiao commented on HDFS-14305: Thanks [~xkrogen]. +1, LGTM. Is it necessary to mark that 64

[jira] [Commented] (HDFS-14201) Ability to disallow safemode NN to become active

2019-02-27 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779063#comment-16779063 ] He Xiaoqiao commented on HDFS-14201: Thanks [~surmountian], [^HDFS-14201.004.patch] looks fine to

[jira] [Commented] (HDFS-14314) fullBlockReportLeaseId should be reset after registering to NN

2019-02-27 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779013#comment-16779013 ] He Xiaoqiao commented on HDFS-14314: Thanks [~starphin] for your contribution, it seems to be getting

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779006#comment-16779006 ] He Xiaoqiao commented on HDFS-14305: [^HDFS-14305.006.patch] fix code style, I try to run fail test

[jira] [Updated] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14305: --- Attachment: HDFS-14305.006.patch > Serial number in BlockTokenSecretManager could overlap between

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16778835#comment-16778835 ] He Xiaoqiao commented on HDFS-14305: Thanks [~vagarychen],[~csun],[~xkrogen] for your comments,

[jira] [Updated] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14305: --- Attachment: HDFS-14305.005.patch > Serial number in BlockTokenSecretManager could overlap between

[jira] [Commented] (HDFS-14314) fullBlockReportLeaseId should be reset after registering to NN

2019-02-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16778046#comment-16778046 ] He Xiaoqiao commented on HDFS-14314: Hi [~starphin], 1. build failed since missing import

[jira] [Commented] (HDFS-14314) fullBlockReportLeaseId should be reset after registering to NN

2019-02-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1672#comment-1672 ] He Xiaoqiao commented on HDFS-14314: To [~jojochuang], please help to add [~starphin] as contributor,

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777652#comment-16777652 ] He Xiaoqiao commented on HDFS-14305: Hi [~csun],[~xkrogen],[~jojochuang], update

[jira] [Updated] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14305: --- Attachment: HDFS-14305.004.patch > Serial number in BlockTokenSecretManager could overlap between

[jira] [Commented] (HDFS-14314) fullBlockReportLeaseId should be reset after registering to NN

2019-02-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777640#comment-16777640 ] He Xiaoqiao commented on HDFS-14314: [~starphin], Thanks for your contribution, some minor comment,

[jira] [Commented] (HDFS-14201) Ability to disallow safemode NN to become active

2019-02-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777624#comment-16777624 ] He Xiaoqiao commented on HDFS-14201: Thanks [~surmountian] to push forward this issue. {quote} I

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777091#comment-16777091 ] He Xiaoqiao commented on HDFS-14305: Thanks [~xkrogen]. I will update code style and add some comment

[jira] [Commented] (HDFS-14201) Ability to disallow safemode NN to become active

2019-02-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776513#comment-16776513 ] He Xiaoqiao commented on HDFS-14201: Thanks [~surmountian] for quick response,

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776511#comment-16776511 ] He Xiaoqiao commented on HDFS-14305: Fix bug about bit-shift and add new unit test

[jira] [Updated] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14305: --- Attachment: HDFS-14305.003.patch > Serial number in BlockTokenSecretManager could overlap between

[jira] [Commented] (HDFS-14314) fullBlockReportLeaseId should be reset after registering to NN

2019-02-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776238#comment-16776238 ] He Xiaoqiao commented on HDFS-14314: [~starphin], I do not think fail tests (TestJournalNodeSync) is

[jira] [Commented] (HDFS-14201) Ability to disallow safemode NN to become active

2019-02-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776235#comment-16776235 ] He Xiaoqiao commented on HDFS-14201: [^HDFS-14201.002.patch] add new configuration element for

[jira] [Updated] (HDFS-14201) Ability to disallow safemode NN to become active

2019-02-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14201: --- Attachment: HDFS-14201.002.patch > Ability to disallow safemode NN to become active >

[jira] [Updated] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14305: --- Attachment: HDFS-14305.002.patch Status: Patch Available (was: Open) [~csun],[~xkrogen],

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776199#comment-16776199 ] He Xiaoqiao commented on HDFS-14305: Thanks [~csun],[~xkrogen] for your quick response. {quote}One

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774944#comment-16774944 ] He Xiaoqiao commented on HDFS-14305: [~csun],[~jojochuang] I attached a quick-and-dirty demonstration

[jira] [Updated] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14305: --- Attachment: HDFS-14305.001.patch > Serial number in BlockTokenSecretManager could overlap between

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-02-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774934#comment-16774934 ] He Xiaoqiao commented on HDFS-14305: hi [~csun], I think this issue triggered only after HDFS-6440.

[jira] [Commented] (HDFS-14309) name node fail over failed with ssh fence failed because of jsch login failed with key check

2019-02-21 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774825#comment-16774825 ] He Xiaoqiao commented on HDFS-14309: Hi [~iamgd67], Thanks to report this issue. HADOOP-14100 has

[jira] [Commented] (HDFS-14201) Ability to disallow safemode NN to become active

2019-02-21 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774799#comment-16774799 ] He Xiaoqiao commented on HDFS-14201: Hi [~surmountian], [^HDFS-14201.001.patch] is my improvement for

[jira] [Updated] (HDFS-14201) Ability to disallow safemode NN to become active

2019-02-21 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14201: --- Attachment: HDFS-14201.001.patch > Ability to disallow safemode NN to become active >

[jira] [Resolved] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-02-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao resolved HDFS-14186. Resolution: Won't Fix Thanks all for your helps, this issue has resolved with HADOOP-12173 +

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752055#comment-16752055 ] He Xiaoqiao commented on HDFS-14186: The issue about namenode restart time-consume seriously have

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750718#comment-16750718 ] He Xiaoqiao commented on HDFS-14186: Thanks [~daryn],[~kihwal] for your help, this issue is based on

[jira] [Updated] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14186: --- Affects Version/s: 2.7.1 > blockreport storm slow down namenode restart seriously in large cluster >

[jira] [Commented] (HDFS-14211) [Consistent Observer Reads] Allow for configurable "always msync" mode

2019-01-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745811#comment-16745811 ] He Xiaoqiao commented on HDFS-14211: [~xkrogen] Thanks for pushing this important phase forward. As

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-15 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743589#comment-16743589 ] He Xiaoqiao commented on HDFS-14186: [~elgoiri], thanks for your comments. {quote}In any case, I

[jira] [Commented] (HDFS-13688) Introduce msync API call

2019-01-15 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742910#comment-16742910 ] He Xiaoqiao commented on HDFS-13688: Thanks all for great work here. I am confused about the new API

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742816#comment-16742816 ] He Xiaoqiao commented on HDFS-14186: [~elgoiri] Thanks for your comments. sorry for missing

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742740#comment-16742740 ] He Xiaoqiao commented on HDFS-14186: some more information, when I try to set

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742738#comment-16742738 ] He Xiaoqiao commented on HDFS-14186: Thanks further discussing. I would like to answer some doubts

[jira] [Updated] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2019-01-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13473: --- Attachment: HDFS-13473-trunk.007.patch > DataNode update BlockKeys using mode PULL rather than PUSH

[jira] [Commented] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2019-01-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741743#comment-16741743 ] He Xiaoqiao commented on HDFS-13473: v007 fix checkstyle, check fail unit test and it passed at local

[jira] [Commented] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2019-01-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741584#comment-16741584 ] He Xiaoqiao commented on HDFS-13473: [^HDFS-13473-trunk.006.patch] rebase branch trunk and trigger

[jira] [Updated] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2019-01-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13473: --- Attachment: HDFS-13473-trunk.006.patch > DataNode update BlockKeys using mode PULL rather than PUSH

<    1   2   3   4   5   6   7   8   9   >