Re: [Python] Accessing the DAG object from my apache beam pipeline?

2019-06-24 Thread Robert Bradshaw
Probably the easiest thing to do here would be to implement your own runner that wraps another runner, and overrides https://github.com/apache/beam/blob/master/sdks/python/apache_beam/runners/runner.py#L154 to do whatever inspection you want of the graph before passing it on. (You would also want t

[Python] Accessing the DAG object from my apache beam pipeline?

2019-06-24 Thread Germain TANGUY
Hello, I would like to access the graph object of my Apache Beam pipeline to traverse it myself and also print it locally before running. I thought I could find the starting point of my DAG from the pipeline or runner instantiation (https://github.com/apache/beam/blob/master/sdks/python/apache_