chamikaramj commented on pull request #16366: URL: https://github.com/apache/beam/pull/16366#issuecomment-1062198173
I think the main point here is that this feature will not be available to Dataflow by default since Dataflow overrides the Beam Pub/Sub I/O with a native connector. So additional work will need be to be done by the Dataflow team to fully enable this feature to all runners. I think vast majority of Beam Pub/Sub I/O users use Dataflow, hence if this PR is merged without additional Dataflow changes (or at least a timeline for such changes) many Beam Pub/Sub IO users will end up with a connector that is in an inconsistent state. Also noting that Dataflow users can choose to use the Beam Pub/Sub I/O connector by using the experiment "enable_custom_pubsub_source" but this has known limitations for Dataflow and currently not supported by that runner. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
