[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-01 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16897988#comment-16897988 ] Lisheng Sun commented on HDFS-14313: Thanx for [~linyiqun] for deep review.  I have updated this

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-08-01 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.010.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Commented] (HDFS-14290) Unexpected message type: PooledUnsafeDirectByteBuf when get datanode info by DatanodeWebHdfsMethods

2019-07-30 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896754#comment-16896754 ] Lisheng Sun commented on HDFS-14290: Yeah. Sorry. It's not a problem. I have closed it.  >

[jira] [Updated] (HDFS-14290) Unexpected message type: PooledUnsafeDirectByteBuf when get datanode info by DatanodeWebHdfsMethods

2019-07-30 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14290: --- Resolution: Not A Problem Status: Resolved (was: Patch Available) > Unexpected message

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-30 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896696#comment-16896696 ] Lisheng Sun commented on HDFS-14313: hi [~linyiqun]  Could you have time to continue review ? Thank

[jira] [Assigned] (HDFS-14644) That replication of block failed leads to decommission is blocked when the number of replicas of block is greater than the number of datanode

2019-07-30 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-14644: -- Assignee: Lisheng Sun > That replication of block failed leads to decommission is blocked

[jira] [Commented] (HDFS-14644) That replication of block failed leads to decommission is blocked when the number of replicas of block is greater than the number of datanode

2019-07-30 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896099#comment-16896099 ] Lisheng Sun commented on HDFS-14644: Thanx [~sodonnell] [~jojochuang] for your suggestions. I intend

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-28 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894898#comment-16894898 ] Lisheng Sun commented on HDFS-14313: Updated patch according the review comments and uploaded the v9

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-28 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.009.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-28 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894893#comment-16894893 ] Lisheng Sun commented on HDFS-14313: Thanx [~linyiqun] for your review. *FSCachingGetSpaceUsed*

[jira] [Comment Edited] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-28 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894893#comment-16894893 ] Lisheng Sun edited comment on HDFS-14313 at 7/29/19 3:11 AM: - Thanx

[jira] [Assigned] (HDFS-7868) Use proper blocksize to choose target for blocks

2019-07-27 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-7868: - Assignee: Lisheng Sun (was: zhouyingchao) > Use proper blocksize to choose target for blocks >

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-27 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894465#comment-16894465 ] Lisheng Sun commented on HDFS-14313: hi [~linyiqun] [~jojochuang] Could you have time to review this

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-25 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892921#comment-16892921 ] Lisheng Sun commented on HDFS-14313: Thank [~linyiqun] for your review. I have update the patch as

[jira] [Comment Edited] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-25 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892921#comment-16892921 ] Lisheng Sun edited comment on HDFS-14313 at 7/25/19 4:24 PM: - Thank

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-25 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.008.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Assigned] (HDFS-13564) PreAllocator for DfsClientShm

2019-07-24 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-13564: -- Assignee: Lisheng Sun > PreAllocator for DfsClientShm > - > >

[jira] [Assigned] (HDFS-13594) the lock of ShortCircuitCache is hold while close the ShortCircuitReplica

2019-07-24 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-13594: -- Assignee: Lisheng Sun > the lock of ShortCircuitCache is hold while close the

[jira] [Comment Edited] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-23 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890943#comment-16890943 ] Lisheng Sun edited comment on HDFS-13693 at 7/23/19 12:19 PM: --   {code:java}

[jira] [Commented] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-23 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890943#comment-16890943 ] Lisheng Sun commented on HDFS-13693:   {code:java} [ERROR] Failed to execute goal

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-22 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890237#comment-16890237 ] Lisheng Sun commented on HDFS-14313: hi [~linyiqun], could you mind continuing to reiview this patch?

[jira] [Commented] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-22 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890228#comment-16890228 ] Lisheng Sun commented on HDFS-13693: hi [~ayushtkn]  If you think this patch no problem, could you

[jira] [Commented] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-21 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889701#comment-16889701 ] Lisheng Sun commented on HDFS-13693: Thank [~ayushtkn] for your suggestion. I must pay attention to

[jira] [Commented] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-21 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889696#comment-16889696 ] Lisheng Sun commented on HDFS-13693: Thank [~ayushtkn] for your review.  I have delete related PR,

[jira] [Commented] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-21 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889669#comment-16889669 ] Lisheng Sun commented on HDFS-13693: [~hexiaoqiao] has +1 for patch in Jira  and [~jojochuang] has +1

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-21 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889667#comment-16889667 ] Lisheng Sun commented on HDFS-14313: Thank [~linyiqun] for your review carefully. I have a few

[jira] [Commented] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-18 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888483#comment-16888483 ] Lisheng Sun commented on HDFS-13693: [~jojochuang] [~hexiaoqiao] I have updated this patch with

[jira] [Updated] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-18 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13693: --- Attachment: HDFS-13693-004.patch > Remove unnecessary search in INodeDirectory.addChild during image

[jira] [Updated] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-18 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13693: --- Attachment: (was: HDFS-13693-004.patch) > Remove unnecessary search in INodeDirectory.addChild

[jira] [Updated] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-18 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13693: --- Attachment: HDFS-13693-005.patch > Remove unnecessary search in INodeDirectory.addChild during image

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-18 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.007.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-18 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: (was: HDFS-14313.007.patch) > Get hdfs used space from

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-18 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.007.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-18 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887859#comment-16887859 ] Lisheng Sun commented on HDFS-14313: Thank [~linyiqun] for your suggestions.   {quote} why not use

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-17 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887541#comment-16887541 ] Lisheng Sun commented on HDFS-14313: Hi [~jojochuang] [~linyiqun] [~stack]  I have update this patch

[jira] [Commented] (HDFS-13571) Dead DataNode Detector

2019-07-15 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885246#comment-16885246 ] Lisheng Sun commented on HDFS-13571: Thank [~linyiqun] [~hexiaoqiao] for your suggestions. I have

[jira] [Updated] (HDFS-14650) DeadNodeDetector redetects Suspicious Node

2019-07-15 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14650: --- Summary: DeadNodeDetector redetects Suspicious Node (was: redetect Suspicious Node) >

[jira] [Assigned] (HDFS-14651) DeadNodeDetector periodically detects Dead Node

2019-07-15 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-14651: -- Assignee: Lisheng Sun > DeadNodeDetector periodically detects Dead Node >

[jira] [Updated] (HDFS-14650) redetect Suspicious Node

2019-07-15 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14650: --- Summary: redetect Suspicious Node (was: Re-probing Suspicious Node) > redetect Suspicious Node >

[jira] [Created] (HDFS-14651) DeadNodeDetector periodically detects Dead Node

2019-07-15 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14651: -- Summary: DeadNodeDetector periodically detects Dead Node Key: HDFS-14651 URL: https://issues.apache.org/jira/browse/HDFS-14651 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-14650) Re-probing Suspicious Node

2019-07-15 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-14650: -- Assignee: Lisheng Sun > Re-probing Suspicious Node > -- > >

[jira] [Created] (HDFS-14650) Re-probing Suspicious Node

2019-07-15 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14650: -- Summary: Re-probing Suspicious Node Key: HDFS-14650 URL: https://issues.apache.org/jira/browse/HDFS-14650 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-14649) DataNode will be placed in DeadNodeDetector#SuspiciousNode when InputStream which access it occurs an error

2019-07-15 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14649: -- Summary: DataNode will be placed in DeadNodeDetector#SuspiciousNode when InputStream which access it occurs an error Key: HDFS-14649 URL:

[jira] [Created] (HDFS-14648) Create DeadNodeDetector state machine model

2019-07-15 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14648: -- Summary: Create DeadNodeDetector state machine model Key: HDFS-14648 URL: https://issues.apache.org/jira/browse/HDFS-14648 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-15 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885124#comment-16885124 ] Lisheng Sun commented on HDFS-13693: Thank [~hexiaoqiao]  for your suggestion. I think we can  add

[jira] [Commented] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-15 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884911#comment-16884911 ] Lisheng Sun commented on HDFS-13693: [~hexiaoqiao] Thank you for consideraion.  That INodes

[jira] [Comment Edited] (HDFS-13571) Dead DataNode Detector

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884556#comment-16884556 ] Lisheng Sun edited comment on HDFS-13571 at 7/14/19 5:04 AM: - Thank

[jira] [Commented] (HDFS-13571) Dead DataNode Detector

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884556#comment-16884556 ] Lisheng Sun commented on HDFS-13571: Thank [~linyiqun] [~jojochuang] for good suggestion. This idea

[jira] [Updated] (HDFS-13571) Dead DataNode Detector

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13571: --- Attachment: node status machine.png > Dead DataNode Detector > -- > >

[jira] [Updated] (HDFS-13571) Dead DataNode Detector

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13571: --- Attachment: 屏幕快照 2019-07-14 下午12.27.22.png > Dead DataNode Detector > -- > >

[jira] [Updated] (HDFS-13571) Dead DataNode Detector

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13571: --- Attachment: (was: 屏幕快照 2019-07-14 下午12.27.22.png) > Dead DataNode Detector >

[jira] [Commented] (HDFS-14614) Add Secure Flag for DataNode Web UI Cookies

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884381#comment-16884381 ] Lisheng Sun commented on HDFS-14614: hi [~jojochuang],I would like do this issue, could you assign

[jira] [Comment Edited] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883490#comment-16883490 ] Lisheng Sun edited comment on HDFS-14313 at 7/13/19 2:04 PM: - hi

[jira] [Commented] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884379#comment-16884379 ] Lisheng Sun commented on HDFS-13693: Thank [~hexiaoqiao] for your suggestion. {quote}  It seems to

[jira] [Updated] (HDFS-13571) Dead DataNode Detector

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13571: --- Fix Version/s: (was: 3.0.2) > Dead DataNode Detector > -- > >

[jira] [Comment Edited] (HDFS-13571) Dead DataNode Detector

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884305#comment-16884305 ] Lisheng Sun edited comment on HDFS-13571 at 7/13/19 1:16 PM: - Hi

[jira] [Comment Edited] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884365#comment-16884365 ] Lisheng Sun edited comment on HDFS-13693 at 7/13/19 1:15 PM: - I have updated

[jira] [Commented] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884365#comment-16884365 ] Lisheng Sun commented on HDFS-13693: I have updated the patch-004 for trunk. Could you have time to

[jira] [Updated] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13693: --- Attachment: HDFS-13693-004.patch > Remove unnecessary search in INodeDirectory.addChild during image

[jira] [Commented] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884329#comment-16884329 ] Lisheng Sun commented on HDFS-13693: Thank [~hunhun] for your comments. {quote}If load fsimage in

[jira] [Comment Edited] (HDFS-13571) Dead DataNode Detector

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884305#comment-16884305 ] Lisheng Sun edited comment on HDFS-13571 at 7/13/19 6:36 AM: - Hi

[jira] [Updated] (HDFS-13571) Dead DataNode Detector

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13571: --- Summary: Dead DataNode Detector (was: Dead datanode detector) > Dead DataNode Detector >

[jira] [Commented] (HDFS-13571) Dead DataNode Detector

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884305#comment-16884305 ] Lisheng Sun commented on HDFS-13571: Hi [~jojochuang] [~sodonnell]  [~elgoiri] [~xkrogen] Could you

[jira] [Commented] (HDFS-14644) That replication of block failed leads to decommission is blocked when the number of replicas of block is greater than the number of datanode

2019-07-13 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884303#comment-16884303 ] Lisheng Sun commented on HDFS-14644: Thank [~jojochuang] [~sodonnell] for paying close attention to

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-11 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883490#comment-16883490 ] Lisheng Sun commented on HDFS-14313: Ping [~jojochuang]:) Could you continue to help review it? Thank

[jira] [Updated] (HDFS-14644) That replication of block failed leads to decommission is blocked when the number of replicas of block is greater than the number of datanode

2019-07-10 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14644: --- Component/s: namenode > That replication of block failed leads to decommission is blocked when the

[jira] [Updated] (HDFS-14644) That replication of block failed leads to decommission is blocked when the number of replicas of block is greater than the number of datanode

2019-07-10 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14644: --- Issue Type: Bug (was: Improvement) > That replication of block failed leads to decommission is

[jira] [Updated] (HDFS-14644) That replication of block failed leads to decommission is blocked when the number of replicas of block is greater than the number of datanode

2019-07-10 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14644: --- Issue Type: Improvement (was: Bug) > That replication of block failed leads to decommission is

[jira] [Created] (HDFS-14644) That replication of block failed leads to decommission is blocked when the number of replicas of block is greater than the number of datanode

2019-07-10 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14644: -- Summary: That replication of block failed leads to decommission is blocked when the number of replicas of block is greater than the number of datanode Key: HDFS-14644 URL:

[jira] [Updated] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-09 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14483: --- Description: Provide a positioned ByteBuffer-based read, that is  particularly useful for HBase which

[jira] [Commented] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-09 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881656#comment-16881656 ] Lisheng Sun commented on HDFS-14483: Thank [~stack] for working for this patch. I  am willing to fill

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-08 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880257#comment-16880257 ] Lisheng Sun commented on HDFS-14313: Thank [~jojochuang] [~hexiaoqiao] for reviewing.  I have update

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-08 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.006.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-08 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: (was: HDFS-14313.006.patch) > Get hdfs used space from

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-08 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.006.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Commented] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-07 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880009#comment-16880009 ] Lisheng Sun commented on HDFS-14483:   Hi [~stack] I confirm again UT is ok with this patch in 

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-07 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.005.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Commented] (HDFS-13694) Making md5 computing being in parallel with image loading

2019-07-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879783#comment-16879783 ] Lisheng Sun commented on HDFS-13694: [~elgoiri] I think it should cherry-pick to branch-3.2,

[jira] [Commented] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879698#comment-16879698 ] Lisheng Sun commented on HDFS-14483:     I also confirm UT is ok in TestNameNodeHttpServerXFrame

[jira] [Commented] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879664#comment-16879664 ] Lisheng Sun commented on HDFS-14483: Sorry [~stack], I find this problem. There is a error in UT of

[jira] [Updated] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14483: --- Attachment: HDFS-14585.branch-2.9.v3.patch > Backport HDFS-14111,HDFS-3246 ByteBuffer pread

[jira] [Assigned] (HDFS-13571) Dead datanode detector

2019-07-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-13571: -- Assignee: Lisheng Sun > Dead datanode detector > -- > >

[jira] [Assigned] (HDFS-13639) SlotReleaser is not fast enough

2019-07-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-13639: -- Assignee: Lisheng Sun > SlotReleaser is not fast enough > --- > >

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-05 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879582#comment-16879582 ] Lisheng Sun commented on HDFS-14313: Hi [~elgoiri] [~jojochuang] [~zvenczel] [~hexiaoqiao] Could you

[jira] [Commented] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-05 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879581#comment-16879581 ] Lisheng Sun commented on HDFS-14483: Hi [~stack]  Could you have time to continue reviewing this

[jira] [Commented] (HDFS-13694) Making md5 computing being in parallel with image loading

2019-07-05 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879580#comment-16879580 ] Lisheng Sun commented on HDFS-13694: Thank [~elgoiri]  for merging this patch.  I think we need to

[jira] [Commented] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-04 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16878537#comment-16878537 ] Lisheng Sun commented on HDFS-14483: Thank [~stack] for doing thing for this patch. I  confirmed

[jira] [Commented] (HDFS-14290) Unexpected message type: PooledUnsafeDirectByteBuf when get datanode info by DatanodeWebHdfsMethods

2019-07-02 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877409#comment-16877409 ] Lisheng Sun commented on HDFS-14290: Sorry, I don't reproduce it when update new netty. The problem

[jira] [Commented] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-02 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877403#comment-16877403 ] Lisheng Sun commented on HDFS-14483: Hi [~stack] test failures is unrelated to this patch. Thank you.

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-02 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877400#comment-16877400 ] Lisheng Sun commented on HDFS-14313: ping [~jojochuang] Could you have time to review this patch?

[jira] [Commented] (HDFS-14615) NPE writing edit logs

2019-07-02 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877398#comment-16877398 ] Lisheng Sun commented on HDFS-14615: Hi [~jojochuang] I work on this problem and assign to me

[jira] [Assigned] (HDFS-14615) NPE writing edit logs

2019-07-02 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-14615: -- Assignee: Lisheng Sun > NPE writing edit logs > - > >

[jira] [Commented] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-02 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877390#comment-16877390 ] Lisheng Sun commented on HDFS-14483: Thank [~stack] for your comments. {quote}Comparing the BB-based

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-02 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.004.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Commented] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-02 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876813#comment-16876813 ] Lisheng Sun commented on HDFS-14483: I fix the whitespace warnings and  update patch v2 for

[jira] [Updated] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-02 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14483: --- Attachment: HDFS-14483.branch-2.9.v2.patch > Backport HDFS-14111,HDFS-3246 ByteBuffer pread

[jira] [Updated] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-01 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14483: --- Summary: Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9 (was: Backport

[jira] [Updated] (HDFS-14483) Backport HDFS-3246,HDFS-14111 ByteBuffer pread interface to branch-2.9

2019-07-01 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14483: --- Attachment: HDFS-14483.branch-2.9.v1.patch > Backport HDFS-3246,HDFS-14111 ByteBuffer pread

[jira] [Updated] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-01 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13693: --- Attachment: HDFS-13693-002.patch > Remove unnecessary search in INodeDirectory.addChild during image

[jira] [Commented] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-01 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875987#comment-16875987 ] Lisheng Sun commented on HDFS-13693: Thank [~jojochuang] for your comments.   {quote}I am not a

<    3   4   5   6   7   8   9   10   >