Hi, Trying to restart this thread from last November [1]. Packaging an end-2-end Beam example for k8s environment, similar to the one from the TensorFlow team [2], may be interesting to look at. The logical progression is:
- Start with an example using the local (java) runner - Build the next one for Spark; k8s repo already has Spark v1.5.x as an example [3] that can be updated/ modified - Other runners to follow using Spark as a template Let me know if there is interest in pursuing/ collaborating on this. Thanks, Nitin [1] https://www.mail-archive.com/[email protected]/msg00881.html [2] https://tensorflow.github.io/serving/serving_inception [3] https://github.com/kubernetes/kubernetes/tree/master/examples/spark
