[ https://issues.apache.org/jira/browse/HDFS-17808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
farmmamba updated HDFS-17808: ----------------------------- Description: Recently, we met an EC problem in our production. User creates an output stream to write ec files. That output stream writes some bytes and will be idle for a long time until data is ready. If we restart our cluster's datanodes to version up, those applications will finally fail due to not have enough healthy streamers. This Jira try to solve above problem by end block group in advance when we already have failed streamers but less than parity number. was: Recently, we met an EC problem in our production. We have some long run > EC: End block group in advance to prevent write failure for long-time running > OutputStream > ------------------------------------------------------------------------------------------ > > Key: HDFS-17808 > URL: https://issues.apache.org/jira/browse/HDFS-17808 > Project: Hadoop HDFS > Issue Type: Improvement > Components: ec, erasure-coding > Reporter: farmmamba > Assignee: farmmamba > Priority: Major > > Recently, we met an EC problem in our production. > User creates an output stream to write ec files. That output stream writes > some bytes and will be idle for a long time until data is ready. If we > restart our cluster's datanodes to version up, those applications will > finally fail due to not have enough healthy streamers. > > This Jira try to solve above problem by end block group in advance when we > already have failed streamers but less than parity number. > -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org