KevinGG commented on issue #20874:
URL: https://github.com/apache/beam/issues/20874#issuecomment-1164624112
This is intended behavior.
When a pipeline is not defined in the `__main__` module, it's not known by
Beam to do any magic for it because it's local.
To make it work inside non-main modules/scopes, add `ib.watch(locals())` or
`ib.watch({'pipeline_name': pipeline, 'pcoll_name': pcoll})` to notify Beam to
watch them.
And use `ib.collect` and `ib.show` instead of the `result = p.run()` +
`result.get(pcoll)` pattern because you don't need to run the whole pipeline to
materialize a single pcollection.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
