Hello.  I was looking at how to use the KafkaIO from a Dataflow Template,
which requires all configuration options to be ValueProviders, which
KafkaIO doesn't support currently.  I saw this old PR:
https://github.com/apache/beam/pull/6636/files

I believe the reason this was never merged was there wasn't a good way to
determine the number of splits to fire up in the UnboundedSource for
KafkaIO.  However, now that KafkaIO is based on SplittableDoFn which
handles splitting in a dynamic fashion, are there still any blockers to
this?

Could we change all the KafkaIO parameters to ValueProviders now?

*~Vincent*

Reply via email to