Thanks! I actually managed to have my own deployment for running it locally and it works well for local file, but I get this weird error while trying to run the word count example and I'm trying to understand what can be the cause of it?
On Thu, Jan 14, 2021 at 7:29 PM Sam Bourne <[email protected]> wrote: > Hi Nir, > > I have a simple repo where I have a proof of concept deployment setup for > doing this. > > https://github.com/sambvfx/beam-flink-k8s > > Depending on the type of runner you're using there are a few explanations. > That repo should hopefully point you in the right direction. > > On Thu, Jan 14, 2021 at 6:16 AM Nir Gazit <[email protected]> wrote: > >> Hi, >> I'm trying to deploy the word count job on a Flink cluster in Kubernetes. >> However, when trying to run the job (with python workers as a side car to >> the Flink task masters), I get the following error: >> >> 2021/01/14 14:11:36 Initializing python harness: /opt/apache/beam/boot >> --id=1-1 --logging_endpoint=localhost:39233 >> --artifact_endpoint=localhost:34123 --provision_endpoint=localhost:33519 >> --control_endpoint=localhost:44987 >> 2021/01/14 14:11:45 Failed to retrieve staged files: failed to retrieve >> /tmp/staged in 3 attempts: failed to retrieve chunk for >> /tmp/staged/pickled_main_session >> caused by: >> rpc error: code = Unknown desc = ; failed to retrieve chunk for >> /tmp/staged/pickled_main_session >> caused by: >> rpc error: code = Unknown desc = ; failed to retrieve chunk for >> /tmp/staged/pickled_main_session >> caused by: >> rpc error: code = Unknown desc = ; failed to retrieve chunk for >> /tmp/staged/pickled_main_session >> caused by: >> rpc error: code = Unknown desc = >> >> Anyone knows what could be the reason? >> >
