Hi Himanshu, I would suggest taking a look at this:
https://cloud.google.com/dataflow/docs/guides/templates/using-flex-templates When you create a regular template, it’s pre-configured pipeline. That’s useful if you always want to apply the same data processes logic. However, that doesn’t seem to be the case for you. Flex templates, on the other hand, are an extension that offers flexibility to parameterize the pipeline code. For the topic, for instance, you can simply use Strings, and there’s no need for ValueProviders Best, Ferran El El sáb, 5 ago 2023 a las 7:55, himanshu singhal < singhal.himansh...@gmail.com> escribió: > Hello Beam Team, > > I am using apache beam for reading from Kafka using KafkaIO in Dataflow > Runner. Here I am facing an issue to make KafkaIO Parameters (like -> > Config, topics) dynamic. I mean, when I am making these parameters as a > PipelineOptions using RuntimeValueProvider My Dataflow Template is not > getting created and getting errors that KafkaIO does not support > RuntimeValueProvider. So in this case can you please suggest or give any > sample code to make these parameters as PipelineOptions. > > > > Thanks & Regards > *Himanshu Singhal* > M:- +917821076244 > E:- singhal.himansh...@gmail.com >
