Hi Eugene,
Glad that helped you out and thanks for the PR tweaking it for GCP.
To fetch the containers from GCR, I had to log into Docker inside the Flink
nodes, specifically inside the taskmanager container, using something like
“kubectl exec pod/flink-taskmanager-blahblah -c taskmanager — docke
Woohoo thanks Kyle, adding --save_main_session made it work!!!
On Fri, Aug 28, 2020 at 5:02 PM Kyle Weaver wrote:
> > rpc error: code = Unimplemented desc = Method not found:
> org.apache.beam.model.job_management.v1.LegacyArtifactRetrievalService/GetManifest
>
> This is a known issue: https://i
> rpc error: code = Unimplemented desc = Method not found:
org.apache.beam.model.job_management.v1.LegacyArtifactRetrievalService/GetManifest
This is a known issue: https://issues.apache.org/jira/browse/BEAM-10762
On Fri, Aug 28, 2020 at 4:57 PM Eugene Kirpichov
wrote:
> P.S. Ironic how back in
P.S. Ironic how back in 2018 I was TL-ing the portable runners effort for a
few months on Google side, and now I need community help to get it to work
at all.
Still pretty miraculous how far Beam's portability has come since
then, even if it has a steep learning curve.
On Fri, Aug 28, 2020 at 4:54
Hi Sam,
You're a wizard - this got me *way* farther than my previous attempts.
Here's a PR https://github.com/sambvfx/beam-flink-k8s/pull/1 with a couple
of changes I had to make.
I had to make some additional changes that do not make sense to share, but
here they are for the record:
- Because I'
Hey!
First time posting to a mailing list, hope I did it correctly :)
I'm writing a master thesis at the University of Oslo and right now I'm
looking at the performance overhead of using Beam with the Flink runnner
versus plain Flink.
I've written a simple program, a custom source outputing
Holy shit, thanks Sam, this is more help than I could have asked for!!
I'll give this a shot later today and report back.
On Thu, Aug 27, 2020 at 10:27 PM Sam Bourne wrote:
> Hi Eugene!
>
> I’m struggling to find complete documentation on how to do this. There
> seems to be lots of conflicting o
