je-ik commented on issue #29558: URL: https://github.com/apache/beam/issues/29558#issuecomment-1831623518
@becketqin Hi, this seems to be related to #25525, I wonder what is the best fix path would be. I think it would make sense to use `FlinkBoundedSource` only for bounded Pipelines and `FlinkUnboundedSource` for all other cases. This will need tweaking the source to be able to accept `BoundedSource`. Or would you see some other option? I tried to fix `FlinkBoundedSource` to emit MAX_WATERMARK when there is no more splits, but there is still issue with checkpointing and resending the data (if the fail occurs before the source is shutdown). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
