Re: Seeking Assistance to Resolve Issues/bug with Flink Runner on Kubernetes

2023-08-15 Thread Jan Lukavský
Hi Kapil, if you don't have a special reason for running the jobserver manually, you can let Beam Python SDK to run it for you (and let it configure accordingly). You just need to pass `--runner=flink` (and --flink_master) to your flink_options (or via command-line). As Sam suggested, it woul

Re: Seeking Assistance to Resolve Issues/bug with Flink Runner on Kubernetes

2023-08-14 Thread Sam Bourne
Hey Kapil, I grappled with a similar deployment and created this repo [1] to attempt to provide others with some nuggets of useful information. We were running cross language pipelines on flink connecting PubsubIO

Re: Seeking Assistance to Resolve Issues/bug with Flink Runner on Kubernetes

2023-08-14 Thread Daniel Chen via user
Not the OP, but is it possible to join the slack channel without an apache.org email address? I tried joining slack previously for support and gave up because it looked like it wasn't. On Mon, Aug 14, 2023 at 10:58 AM Kenneth Knowles wrote: > There is a slack channel linked from > https://beam.a

Re: Seeking Assistance to Resolve Issues/bug with Flink Runner on Kubernetes

2023-08-14 Thread Kenneth Knowles
There is a slack channel linked from https://beam.apache.org/community/contact-us/ it is #beam on the-asf.slack.com (you find this via beam.apache.org -> Community -> Contact Us) It sounds like an issue with running a multi-language pipeline on the portable flink runner. (something which I am not