[ https://issues.apache.org/jira/browse/BEAM-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17268918#comment-17268918 ]
Ning Kang commented on BEAM-10708: ---------------------------------- Thanks for the comments, Cham and Brian! If `from_runner_api` is not a possible solution to copy pipelines, the InteractiveRunner has to either copy the pipeline objects explicitly or make changes directly on the proto before each iteration of execution. > InteractiveRunner cannot execute pipeline with cross-language transform > ----------------------------------------------------------------------- > > Key: BEAM-10708 > URL: https://issues.apache.org/jira/browse/BEAM-10708 > Project: Beam > Issue Type: Bug > Components: cross-language > Reporter: Brian Hulette > Assignee: Ning Kang > Priority: P2 > > The InteractiveRunner crashes when given a pipeline that includes a > cross-language transform. > Here's the example I tried to run in a jupyter notebook: > {code:python} > p = beam.Pipeline(InteractiveRunner()) > pc = (p | SqlTransform("""SELECT > CAST(1 AS INT) AS `id`, > CAST('foo' AS VARCHAR) AS `str`, > CAST(3.14 AS DOUBLE) AS `flt`""")) > df = interactive_beam.collect(pc) > {code} > The problem occurs when > [pipeline_fragment.py|https://github.com/apache/beam/blob/dce1eb83b8d5137c56ac58568820c24bd8fda526/sdks/python/apache_beam/runners/interactive/pipeline_fragment.py#L66] > creates a copy of the pipeline by [writing it to proto and reading it > back|https://github.com/apache/beam/blob/dce1eb83b8d5137c56ac58568820c24bd8fda526/sdks/python/apache_beam/runners/interactive/pipeline_fragment.py#L120]. > Reading it back fails because some of the pipeline is not written in Python. -- This message was sent by Atlassian Jira (v8.3.4#803005)