Re:

I tried your example and found the same exception on direct runner. I think MAP with Row as value types is not well supported in SQL so file https://jira.apache.org/jira/browse/BEAM-7623 to improve it. -Rui On Mon, Jun 24, 2019 at 4:41 AM Vishwas Bm wrote: > Hi Rui, > > I was trying out a use

Re:

Hi Rui, I was trying out a use case where we have a map with key as string and value as Row. When we try to access the primitive field in the Row we are getting below exception. Caused by: java.lang.NoSuchFieldException: color at java.lang.Class.getDeclaredField(Class.java:2070) at org.apache.bea

Re: [Python] Accessing the DAG object from my apache beam pipeline?

Probably the easiest thing to do here would be to implement your own runner that wraps another runner, and overrides https://github.com/apache/beam/blob/master/sdks/python/apache_beam/runners/runner.py#L154 to do whatever inspection you want of the graph before passing it on. (You would also want t

[Python] Accessing the DAG object from my apache beam pipeline?

Hello, I would like to access the graph object of my Apache Beam pipeline to traverse it myself and also print it locally before running. I thought I could find the starting point of my DAG from the pipeline or runner instantiation (https://github.com/apache/beam/blob/master/sdks/python/apache_