Re: Launch Dataflow Flex Templates from Go

2023-02-17 Thread Damon Douglas
Good day, Ashok, I was able to submit a Dataflow job using this code snippet. Change the bracketed <> values with what makes sense to your Google Cloud environment. Could you let me know if this works for you? Best, Damon params := &dataflow.LaunchTemplateParameters{ Environment: &dataflow

Re: Go + Apache Beam GCP Dataflow: Could not find the sink for pubsub, Check that the sink library specifies alwayslink = 1

2023-02-17 Thread Robert Burke
Hello Again! So, the External stuff is how the "built in" implementation in runners is being triggered. That ends up adding a Transform in the raw Pipeline proto [0] that has the PubSub Write URN [1] which is how the Runner (Dataflow) knows that it should be doing something more for this. As

Re: [ANNOUNCE] New PMC Member: Jan Lukavský

2023-02-17 Thread Jan Lukavský
Thanks everyone! This is great honor, I'm grateful for the support of the Apache Beam community. Best,  Jan On 2/17/23 11:15, Shivam Singhal wrote: Congratulations Jan! On Fri, 17 Feb 2023 at 14:26, Moritz Mack wrote: Congrats, Jan! On 16.02.23, 23:28, "Luke Cwik via dev" wrote

Re: [ANNOUNCE] New PMC Member: Jan Lukavský

2023-02-17 Thread Shivam Singhal
Congratulations Jan! On Fri, 17 Feb 2023 at 14:26, Moritz Mack wrote: > Congrats, Jan! > > > > On 16.02.23, 23:28, "Luke Cwik via dev" wrote: > > > > Congrats, well deserved. On Thu, Feb 16, 2023 at 10: 32 AM Anand Inguva > via dev wrote: Congratulations!! On Thu, Feb 16, > 2023 at 12: 42 PM C

Re: Go + Apache Beam GCP Dataflow: Could not find the sink for pubsub, Check that the sink library specifies alwayslink = 1

2023-02-17 Thread Shivam Singhal
Hi folks, Finding it a little hard to figure out the starting point. If someone from the community can pair with me on this for 30-45 mins, that would be great. I have read the code in the pubsubio package and drilled down into the `beam.External` function as well but couldn't make much sense. T

Re: [ANNOUNCE] New PMC Member: Jan Lukavský

2023-02-17 Thread Moritz Mack
Congrats, Jan! On 16.02.23, 23:28, "Luke Cwik via dev" wrote: Congrats, well deserved. On Thu, Feb 16, 2023 at 10: 32 AM Anand Inguva via dev wrote: Congratulations!! On Thu, Feb 16, 2023 at 12:  42 PM Chamikara Jayalath via dev wrote: Congrats Jan!On Congrats, well deserved. On Thu, Feb 16