[ https://issues.apache.org/jira/browse/HDFS-17808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007732#comment-18007732 ]
ASF GitHub Bot commented on HDFS-17808: --------------------------------------- hfutatzhanghb opened a new pull request, #7810: URL: https://github.com/apache/hadoop/pull/7810 ### Description of PR Refer to HDFS-17808. Recently, we met an EC problem in our production. User creates an output stream to write ec files. That output stream writes some bytes and will be idle for a long time until data is ready. If we restart our cluster's datanodes to version up, those applications will finally fail due to not have enough healthy streamers. This PR try to solve above problem by end block group in advance when we already have failed streamers but less than parity number. > EC: End block group in advance to prevent write failure for long-time running > OutputStream > ------------------------------------------------------------------------------------------ > > Key: HDFS-17808 > URL: https://issues.apache.org/jira/browse/HDFS-17808 > Project: Hadoop HDFS > Issue Type: Improvement > Components: ec, erasure-coding > Reporter: farmmamba > Assignee: farmmamba > Priority: Major > > Recently, we met an EC problem in our production. > User creates an output stream to write ec files. That output stream writes > some bytes and will be idle for a long time until data is ready. If we > restart our cluster's datanodes to version up, those applications will > finally fail due to not have enough healthy streamers. > > This Jira try to solve above problem by end block group in advance when we > already have failed streamers but less than parity number. > -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org