Re: Industrializing batch ML algorithm using Apache Beam/Dataflow (on Google Cloud Platform)

Hello Massy, I just answer on reddit, I copy/paste answer here in case someone is interested too. Dataflow support python 3.5. In my company we do use apache-beam/dataflow in prod with a setup.py to initialize dependencies,

[Python] Accessing the DAG object from my apache beam pipeline?

Hello, I would like to access the graph object of my Apache Beam pipeline to traverse it myself and also print it locally before running. I thought I could find the starting point of my DAG from the pipeline or runner instantiation