[ https://issues.apache.org/jira/browse/BEAM-5187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16637273#comment-16637273 ]
Thomas Weise commented on BEAM-5187: ------------------------------------ We implemented a custom environment factory for Python that uses the process manager here: [https://github.com/lyft/beam/blob/ae99b34ed46c5594aaf2a65c6c910f10c3d1a7cc/runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/environment/LyftPythonEnvironmentFactory.java#L90] It does not (need to) support artifact retrieval, you would need to add that if artifact staging was needed. > Create a ProcessJobBundleFactory for non-dockerized SDK harness > --------------------------------------------------------------- > > Key: BEAM-5187 > URL: https://issues.apache.org/jira/browse/BEAM-5187 > Project: Beam > Issue Type: New Feature > Components: runner-core > Reporter: Maximilian Michels > Assignee: Maximilian Michels > Priority: Minor > Fix For: 2.7.0 > > Time Spent: 6h 40m > Remaining Estimate: 0h > > As discussed on the mailing list [1], we want to giver users an option to > execute portable pipelines without Docker. Analog to the > {{DockerJobBundleFactory}}, a {{ProcessJobBundleFactory}} could be added to > directly fork SDK harness processes. > Artifacts will be provided by an artifact directory or could be setup similar > to the existing bootstrapping code ("boot.go") which we use for containers. > The process-based execution can optionally be configured via the pipeline > options. > [1] > [https://lists.apache.org/thread.html/d8b81e9f74f77d74c8b883cda80fa48efdcaf6ac2ad313c4fe68795a@%3Cdev.beam.apache.org%3E] -- This message was sent by Atlassian JIRA (v7.6.3#76005)