This is an automated email from the ASF dual-hosted git repository.
chamikara pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from ddeab8b Merge pull request #11752 from ibzib/py-container-518
add 84c12eb [BEAM-9383] Staging Dataflow artifacts from environment
(#11039)
No new revisions were added by this update.
Summary of changes:
.../runners/core/construction/Environments.java | 70 +++----
.../dataflow/DataflowPipelineTranslator.java | 25 +--
.../beam/runners/dataflow/DataflowRunner.java | 95 ++++++++-
.../beam/runners/dataflow/util/GcsStager.java | 33 +--
.../beam/runners/dataflow/util/PackageUtil.java | 171 +++++----------
.../apache/beam/runners/dataflow/util/Stager.java | 14 +-
.../dataflow/DataflowPipelineTranslatorTest.java | 229 ++++++++++++++++++---
.../beam/runners/dataflow/DataflowRunnerTest.java | 30 ++-
.../beam/runners/dataflow/util/GCSUploadMain.java | 20 +-
.../runners/dataflow/util/PackageUtilTest.java | 99 ++++++---
.../dataflow/worker/WorkerCustomSourcesTest.java | 16 +-
.../java/org/apache/beam/sdk/util/ZipFiles.java | 2 +-
.../runners/dataflow/dataflow_runner.py | 3 +-
.../runners/dataflow/dataflow_runner_test.py | 3 +-
.../runners/dataflow/internal/apiclient.py | 28 ++-
.../runners/dataflow/internal/apiclient_test.py | 62 ++++++
16 files changed, 604 insertions(+), 296 deletions(-)
