Hi Nir, I have a simple repo where I have a proof of concept deployment setup for doing this.
https://github.com/sambvfx/beam-flink-k8s Depending on the type of runner you're using there are a few explanations. That repo should hopefully point you in the right direction. On Thu, Jan 14, 2021 at 6:16 AM Nir Gazit <nir....@gmail.com> wrote: > Hi, > I'm trying to deploy the word count job on a Flink cluster in Kubernetes. > However, when trying to run the job (with python workers as a side car to > the Flink task masters), I get the following error: > > 2021/01/14 14:11:36 Initializing python harness: /opt/apache/beam/boot > --id=1-1 --logging_endpoint=localhost:39233 > --artifact_endpoint=localhost:34123 --provision_endpoint=localhost:33519 > --control_endpoint=localhost:44987 > 2021/01/14 14:11:45 Failed to retrieve staged files: failed to retrieve > /tmp/staged in 3 attempts: failed to retrieve chunk for > /tmp/staged/pickled_main_session > caused by: > rpc error: code = Unknown desc = ; failed to retrieve chunk for > /tmp/staged/pickled_main_session > caused by: > rpc error: code = Unknown desc = ; failed to retrieve chunk for > /tmp/staged/pickled_main_session > caused by: > rpc error: code = Unknown desc = ; failed to retrieve chunk for > /tmp/staged/pickled_main_session > caused by: > rpc error: code = Unknown desc = > > Anyone knows what could be the reason? >
