[jira] [Commented] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

[ https://issues.apache.org/jira/browse/HDFS-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196090#comment-17196090 ] Zhao Yi Ming commented on HDFS-15237: - [~zhengchenyu] Thanks! We will port those 2 is

[jira] [Comment Edited] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

[ https://issues.apache.org/jira/browse/HDFS-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196087#comment-17196087 ] Zhao Yi Ming edited comment on HDFS-15237 at 9/15/20, 11:59 AM: ---

[jira] [Comment Edited] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

[ https://issues.apache.org/jira/browse/HDFS-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196087#comment-17196087 ] Zhao Yi Ming edited comment on HDFS-15237 at 9/15/20, 11:53 AM: ---

[jira] [Commented] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

[ https://issues.apache.org/jira/browse/HDFS-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196087#comment-17196087 ] Zhao Yi Ming commented on HDFS-15237: - zhengchenyu  Thanks for your patch! It can fix

[jira] [Comment Edited] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

[ https://issues.apache.org/jira/browse/HDFS-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196087#comment-17196087 ] Zhao Yi Ming edited comment on HDFS-15237 at 9/15/20, 11:52 AM: ---

[jira] [Commented] (HDFS-15371) Nonstandard characters exist in NameNode.java

[ https://issues.apache.org/jira/browse/HDFS-15371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151702#comment-17151702 ] Zhao Yi Ming commented on HDFS-15371: - [~jianghuazhu]  already submitted a PR [GitHub

[jira] [Comment Edited] (HDFS-14773) SWEBHDFS closes the connection before a client can read the error response for a DSQuotaExceededException

[ https://issues.apache.org/jira/browse/HDFS-14773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17118518#comment-17118518 ] Zhao Yi Ming edited comment on HDFS-14773 at 5/28/20, 10:05 AM: ---

[jira] [Commented] (HDFS-14773) SWEBHDFS closes the connection before a client can read the error response for a DSQuotaExceededException

[ https://issues.apache.org/jira/browse/HDFS-14773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17118518#comment-17118518 ] Zhao Yi Ming commented on HDFS-14773: - [~simbadzina] I tried the recreate steps(hadoo

[jira] [Commented] (HDFS-14984) HDFS setQuota: Error message should be added for invalid input max range value to hdfs dfsadmin -setQuota command

[ https://issues.apache.org/jira/browse/HDFS-14984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17118413#comment-17118413 ] Zhao Yi Ming commented on HDFS-14984: - After some deeply investigation, I found DFSCl

[jira] [Work started] (HDFS-14984) HDFS setQuota: Error message should be added for invalid input max range value to hdfs dfsadmin -setQuota command

[ https://issues.apache.org/jira/browse/HDFS-14984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-14984 started by Zhao Yi Ming. --- > HDFS setQuota: Error message should be added for invalid input max range > valu

[jira] [Commented] (HDFS-14984) HDFS setQuota: Error message should be added for invalid input max range value to hdfs dfsadmin -setQuota command

[ https://issues.apache.org/jira/browse/HDFS-14984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116519#comment-17116519 ] Zhao Yi Ming commented on HDFS-14984: - Thanks [~hemanthboyina] ! Assign to me to work

[jira] [Assigned] (HDFS-14984) HDFS setQuota: Error message should be added for invalid input max range value to hdfs dfsadmin -setQuota command

[ https://issues.apache.org/jira/browse/HDFS-14984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming reassigned HDFS-14984: --- Assignee: Zhao Yi Ming > HDFS setQuota: Error message should be added for invalid input max

[jira] [Commented] (HDFS-14984) HDFS setQuota: Error message should be added for invalid input max range value to hdfs dfsadmin -setQuota command

[ https://issues.apache.org/jira/browse/HDFS-14984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116383#comment-17116383 ] Zhao Yi Ming commented on HDFS-14984: -   [~hemanthboyina]  I think [~SouryakantaDwiv

[jira] [Commented] (HDFS-15371) Nonstandard characters exist in NameNode.java

[ https://issues.apache.org/jira/browse/HDFS-15371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115897#comment-17115897 ] Zhao Yi Ming commented on HDFS-15371: - Based on the comments create a new pr 2032 for

[jira] [Work started] (HDFS-15371) Nonstandard characters exist in NameNode.java

[ https://issues.apache.org/jira/browse/HDFS-15371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15371 started by Zhao Yi Ming. --- > Nonstandard characters exist in NameNode.java >

[jira] [Commented] (HDFS-15371) Nonstandard characters exist in NameNode.java

[ https://issues.apache.org/jira/browse/HDFS-15371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17113901#comment-17113901 ] Zhao Yi Ming commented on HDFS-15371: - Assign to me and fixed by hand. > Nonstandard

[jira] [Assigned] (HDFS-15371) Nonstandard characters exist in NameNode.java

[ https://issues.apache.org/jira/browse/HDFS-15371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming reassigned HDFS-15371: --- Assignee: Zhao Yi Ming > Nonstandard characters exist in NameNode.java > ---

[jira] [Comment Edited] (HDFS-15315) IOException on close() when using Erasure Coding

[ https://issues.apache.org/jira/browse/HDFS-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17113812#comment-17113812 ] Zhao Yi Ming edited comment on HDFS-15315 at 5/22/20, 7:22 AM:

[jira] [Commented] (HDFS-15315) IOException on close() when using Erasure Coding

[ https://issues.apache.org/jira/browse/HDFS-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17113812#comment-17113812 ] Zhao Yi Ming commented on HDFS-15315: - [~graypacket] which solr version will you use?

[jira] [Commented] (HDFS-15315) IOException on close() when using Erasure Coding

[ https://issues.apache.org/jira/browse/HDFS-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112777#comment-17112777 ] Zhao Yi Ming commented on HDFS-15315: - Assign to me. > IOException on close() when u

[jira] [Comment Edited] (HDFS-15315) IOException on close() when using Erasure Coding

[ https://issues.apache.org/jira/browse/HDFS-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112777#comment-17112777 ] Zhao Yi Ming edited comment on HDFS-15315 at 5/21/20, 3:51 AM:

[jira] [Assigned] (HDFS-15315) IOException on close() when using Erasure Coding

[ https://issues.apache.org/jira/browse/HDFS-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming reassigned HDFS-15315: --- Assignee: Zhao Yi Ming > IOException on close() when using Erasure Coding >

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969121#comment-16969121 ] Zhao Yi Ming commented on HDFS-14699: - [~gjhkael] Sorry for response late!  set the p

[jira] [Commented] (HDFS-14308) DFSStripedInputStream curStripeBuf is not freed by unbuffer()

[ https://issues.apache.org/jira/browse/HDFS-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16960725#comment-16960725 ] Zhao Yi Ming commented on HDFS-14308: - [~joemcdonnell] [~weichiu] [~lindongdong] [~an

[jira] [Commented] (HDFS-14308) DFSStripedInputStream curStripeBuf is not freed by unbuffer()

[ https://issues.apache.org/jira/browse/HDFS-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959599#comment-16959599 ] Zhao Yi Ming commented on HDFS-14308: - [~lindongdong] Thanks for your review! Yes, yo

[jira] [Work started] (HDFS-14308) DFSStripedInputStream curStripeBuf is not freed by unbuffer()

[ https://issues.apache.org/jira/browse/HDFS-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-14308 started by Zhao Yi Ming. --- > DFSStripedInputStream curStripeBuf is not freed by unbuffer() >

[jira] [Commented] (HDFS-14308) DFSStripedInputStream curStripeBuf is not freed by unbuffer()

[ https://issues.apache.org/jira/browse/HDFS-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16957175#comment-16957175 ] Zhao Yi Ming commented on HDFS-14308: - The DFSStripedInputStream use the parent class

[jira] [Commented] (HDFS-14308) DFSStripedInputStream curStripeBuf is not freed by unbuffer()

[ https://issues.apache.org/jira/browse/HDFS-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955706#comment-16955706 ] Zhao Yi Ming commented on HDFS-14308: - I found a easy way to reproduce this issue thr

[jira] [Commented] (HDFS-14308) DFSStripedInputStream curStripeBuf is not freed by unbuffer()

[ https://issues.apache.org/jira/browse/HDFS-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16936632#comment-16936632 ] Zhao Yi Ming commented on HDFS-14308: - [~joemcdonnell] Thanks for your help! I will h

[jira] [Commented] (HDFS-14308) DFSStripedInputStream curStripeBuf is not freed by unbuffer()

[ https://issues.apache.org/jira/browse/HDFS-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935657#comment-16935657 ] Zhao Yi Ming commented on HDFS-14308: - [~joemcdonnell] Do you have a simple steps to

[jira] [Assigned] (HDFS-14308) DFSStripedInputStream curStripeBuf is not freed by unbuffer()

[ https://issues.apache.org/jira/browse/HDFS-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming reassigned HDFS-14308: --- Assignee: Zhao Yi Ming > DFSStripedInputStream curStripeBuf is not freed by unbuffer() > ---

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16932184#comment-16932184 ] Zhao Yi Ming commented on HDFS-14768: - [~gjhkael] Do you means you hit the same probl

[jira] [Commented] (HDFS-14308) DFSStripedInputStream curStripeBuf is not freed by unbuffer()

[ https://issues.apache.org/jira/browse/HDFS-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16932008#comment-16932008 ] Zhao Yi Ming commented on HDFS-14308: - We hit the direct buffer memory OOM when use H

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16931269#comment-16931269 ] Zhao Yi Ming commented on HDFS-14768: - [~gjhkael] Thanks for your new patch! Now, onl

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14768: Attachment: (was: HDFS-14768.jpg) > In some cases, erasure blocks are corruption when they are

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14768: Attachment: HDFS-14768.jpg > In some cases, erasure blocks are corruption when they are reconstruc

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16931139#comment-16931139 ] Zhao Yi Ming commented on HDFS-14768: - [~gjhkael] The checkstyle is not passed, pleas

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14768: Attachment: HDFS-14768.jpg > In some cases, erasure blocks are corruption when they are reconstruc

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14768: Attachment: (was: image-2019-09-17-15-08-44-119.png) > In some cases, erasure blocks are corrup

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14768: Attachment: image-2019-09-17-15-08-44-119.png > In some cases, erasure blocks are corruption when

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930263#comment-16930263 ] Zhao Yi Ming commented on HDFS-14768: - [~gjhkael] Thanks for response! I know the ori

[jira] [Comment Edited] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930251#comment-16930251 ] Zhao Yi Ming edited comment on HDFS-14768 at 9/16/19 6:19 AM: -

[jira] [Comment Edited] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930251#comment-16930251 ] Zhao Yi Ming edited comment on HDFS-14768 at 9/16/19 6:18 AM: -

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930251#comment-16930251 ] Zhao Yi Ming commented on HDFS-14768: - [~gjhkael] Thanks for your reply! Here I am NO

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928701#comment-16928701 ] Zhao Yi Ming commented on HDFS-14768: - [~janick] Thanks for your information! I will

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928575#comment-16928575 ] Zhao Yi Ming commented on HDFS-14699: - Thanks [~surendrasingh] [~ayushtkn] [~marvelro

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14768: Attachment: zhaoyiming_UT_after_deomission.txt zhaoyiming_UT_beofre_deomission.txt

[jira] [Comment Edited] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928172#comment-16928172 ] Zhao Yi Ming edited comment on HDFS-14768 at 9/12/19 3:45 AM: -

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14768: Attachment: guojh_UT_after_deomission.txt guojh_UT_before_deomission.txt > In some

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14768: Attachment: (was: zhaoyiming_changes_beofre_deomission.txt) > In some cases, erasure blocks are

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14768: Attachment: (was: zhaoyiming_changes_after_deomission.txt) > In some cases, erasure blocks are

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14768: Attachment: (was: guojh_changes_before_deomission.txt) > In some cases, erasure blocks are corr

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14768: Attachment: (was: guojh_changes_after_deomission.txt) > In some cases, erasure blocks are corru

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928172#comment-16928172 ] Zhao Yi Ming commented on HDFS-14768: - One more information, hope it can give help. T

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14768: Attachment: guojh_changes_after_deomission.txt guojh_changes_before_deomission.txt

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928167#comment-16928167 ] Zhao Yi Ming commented on HDFS-14768: - [~gjhkael] Thanks for your update!  Here is on

[jira] [Comment Edited] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928167#comment-16928167 ] Zhao Yi Ming edited comment on HDFS-14768 at 9/12/19 3:34 AM: -

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927634#comment-16927634 ] Zhao Yi Ming commented on HDFS-14699: - [~surendrasingh] I saw +1 for this patch, can

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14768: Attachment: (was: image-2019-09-11-22-20-50-091.png) > In some cases, erasure blocks are corrup

[jira] [Comment Edited] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927610#comment-16927610 ] Zhao Yi Ming edited comment on HDFS-14768 at 9/11/19 2:24 PM: -

[jira] [Comment Edited] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927610#comment-16927610 ] Zhao Yi Ming edited comment on HDFS-14768 at 9/11/19 2:21 PM: -

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14768: Attachment: (was: image-2019-09-11-22-18-36-154.png) > In some cases, erasure blocks are corrup

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927610#comment-16927610 ] Zhao Yi Ming commented on HDFS-14768: - [~gjhkael] I tried the following code(which yo

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14768: Attachment: image-2019-09-11-22-18-36-154.png > In some cases, erasure blocks are corruption when

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927280#comment-16927280 ] Zhao Yi Ming commented on HDFS-14699: - [~marvelrock] This fix only make sure the numR

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926597#comment-16926597 ] Zhao Yi Ming commented on HDFS-14699: - [~surendrasingh] Yes, I also look into the iss

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926596#comment-16926596 ] Zhao Yi Ming commented on HDFS-14768: - [~gjhkael] Also following steps I am not very

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926590#comment-16926590 ] Zhao Yi Ming commented on HDFS-14768: - [~gjhkael] I applied your UT in my env and fou

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926536#comment-16926536 ] Zhao Yi Ming commented on HDFS-14699: - [~marvelrock] Thanks for your testing and comm

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925775#comment-16925775 ] Zhao Yi Ming commented on HDFS-14699: - [~surendrasingh]  Good Point!  You are right!

[jira] [Commented] (HDFS-14373) EC : Decoding is failing when block group last incomplete cell fall in to AlignedStripe

[ https://issues.apache.org/jira/browse/HDFS-14373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925376#comment-16925376 ] Zhao Yi Ming commented on HDFS-14373: - [~surendrasingh] Thanks for your steps! It hel

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925373#comment-16925373 ] Zhao Yi Ming commented on HDFS-14699: - [~ayushtkn] [~surendrasingh] Thanks for your r

[jira] [Updated] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14699: Summary: Erasure Coding: Storage not considered in live replica when replication streams hard limit

[jira] [Commented] (HDFS-14373) EC : Decoding is failing when block group last incomplete cell fall in to AlignedStripe

[ https://issues.apache.org/jira/browse/HDFS-14373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16923931#comment-16923931 ] Zhao Yi Ming commented on HDFS-14373: - [~surendrasingh]  Can you provide the reproduc

[jira] [Comment Edited] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920940#comment-16920940 ] Zhao Yi Ming edited comment on HDFS-14699 at 9/2/19 3:47 PM: -

[jira] [Updated] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14699: Attachment: HDFS-14699.05.patch Status: Patch Available (was: Open) [~ayushtkn]   Sorry fo

[jira] [Issue Comment Deleted] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14699: Comment: was deleted (was:    ) > Erasure Coding: Can NOT trigger the reconstruction when have th

[jira] [Updated] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14699: Status: Open (was: Patch Available)     > Erasure Coding: Can NOT trigger the reconstruction whe

[jira] [Comment Edited] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920846#comment-16920846 ] Zhao Yi Ming edited comment on HDFS-14699 at 9/2/19 1:16 PM: -

[jira] [Comment Edited] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920846#comment-16920846 ] Zhao Yi Ming edited comment on HDFS-14699 at 9/2/19 1:16 PM: -

[jira] [Comment Edited] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920846#comment-16920846 ] Zhao Yi Ming edited comment on HDFS-14699 at 9/2/19 1:15 PM: -

[jira] [Comment Edited] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920846#comment-16920846 ] Zhao Yi Ming edited comment on HDFS-14699 at 9/2/19 1:15 PM: -

[jira] [Comment Edited] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920846#comment-16920846 ] Zhao Yi Ming edited comment on HDFS-14699 at 9/2/19 1:13 PM: -

[jira] [Commented] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920846#comment-16920846 ] Zhao Yi Ming commented on HDFS-14699: - [~ayushtkn] For The UT part, because I added t

[jira] [Updated] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14699: Attachment: (was: image-2019-09-02-17-49-24-286.png) > Erasure Coding: Can NOT trigger the reco

[jira] [Comment Edited] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920737#comment-16920737 ] Zhao Yi Ming edited comment on HDFS-14699 at 9/2/19 9:51 AM: -

[jira] [Comment Edited] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920737#comment-16920737 ] Zhao Yi Ming edited comment on HDFS-14699 at 9/2/19 9:51 AM: -

[jira] [Comment Edited] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920737#comment-16920737 ] Zhao Yi Ming edited comment on HDFS-14699 at 9/2/19 9:50 AM: -

[jira] [Comment Edited] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920737#comment-16920737 ] Zhao Yi Ming edited comment on HDFS-14699 at 9/2/19 9:50 AM: -

[jira] [Updated] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14699: Attachment: image-2019-09-02-17-49-24-286.png > Erasure Coding: Can NOT trigger the reconstruction

[jira] [Commented] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920737#comment-16920737 ] Zhao Yi Ming commented on HDFS-14699: - [~ayushtkn] Thanks for your comments! And I am

[jira] [Updated] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14699: Attachment: HDFS-14699.04.patch Status: Patch Available (was: Open) Create a new patch 04,

[jira] [Updated] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14699: Status: Open (was: Patch Available) > Erasure Coding: Can NOT trigger the reconstruction when have

[jira] [Commented] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918221#comment-16918221 ] Zhao Yi Ming commented on HDFS-14699: - [~ayushtkn] [~jojochuang] any updates on the c

[jira] [Commented] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16914963#comment-16914963 ] Zhao Yi Ming commented on HDFS-14699: - [~ayushtkn] Thanks for your review and comment

[jira] [Updated] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14699: Attachment: HDFS-14699.03.patch Status: Patch Available (was: Open) Fix some typo > Erasu

[jira] [Updated] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14699: Status: Open (was: Patch Available) will fix some typo in 03 > Erasure Coding: Can NOT trigger th

[jira] [Commented] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16913866#comment-16913866 ] Zhao Yi Ming commented on HDFS-14699: - [~jojochuang] could you have time to have a re

[jira] [Updated] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Yi Ming updated HDFS-14699: Affects Version/s: 3.3.0 3.2.0 > Erasure Coding: Can NOT trigger the reconst

[jira] [Commented] (HDFS-14699) Erasure Coding: Can NOT trigger the reconstruction when have the dup internal blocks and missing one internal block

[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16913191#comment-16913191 ] Zhao Yi Ming commented on HDFS-14699: - style check passed. Submit PR: [https://github

  1   2   >