Re: [I] [SUPPORT] StreamWriteFunction support Exectly-Once in Flink ? [hudi]

2024-05-31 Thread via GitHub
seekforshell closed issue #11004: [SUPPORT] StreamWriteFunction support Exectly-Once in Flink ? URL: https://github.com/apache/hudi/issues/11004 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [I] [SUPPORT] StreamWriteFunction support Exectly-Once in Flink ? [hudi]

2024-05-08 Thread via GitHub
ad1happy2go commented on issue #11004: URL: https://github.com/apache/hudi/issues/11004#issuecomment-2100321796 @seekforshell Do you need any other help here. Feel free to close if you have all your doubts resolved on this. Thanks. -- This is an automated message from the Apache Git

Re: [I] [SUPPORT] StreamWriteFunction support Exectly-Once in Flink ? [hudi]

2024-04-15 Thread via GitHub
danny0405 commented on issue #11004: URL: https://github.com/apache/hudi/issues/11004#issuecomment-2056307205 The write task holds the write statuses in the state which would be resubmitted to the driver for committing to Hudi. -- This is an automated message from the Apache Git Service.

Re: [I] [SUPPORT] StreamWriteFunction support Exectly-Once in Flink ? [hudi]

2024-04-15 Thread via GitHub
seekforshell commented on issue #11004: URL: https://github.com/apache/hudi/issues/11004#issuecomment-2056108890 eg. flink stream job like kafka_source -> window -> bucket_write, when bucket_write operator failed, the buffer data lost, although checkpoint failed for the first time, but

Re: [I] [SUPPORT] StreamWriteFunction support Exectly-Once in Flink ? [hudi]

2024-04-12 Thread via GitHub
danny0405 commented on issue #11004: URL: https://github.com/apache/hudi/issues/11004#issuecomment-2052723145 The checkpoint would trigger commit to hudi table. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[I] [SUPPORT] StreamWriteFunction support Exectly-Once in Flink ? [hudi]

2024-04-12 Thread via GitHub
seekforshell opened a new issue, #11004: URL: https://github.com/apache/hudi/issues/11004 **Describe the problem you faced** flink1.14.3 + hudi 0.12.1 when i use org.apache.hudi.sink.StreamWriteFunction in flink stream job, if jobmanager.execution.failover-strategy, region is