This closes #3334: [BEAM-2333] Go to proto and back before running a pipeline in Java DirectRunner
Dehydrate then rehydrate Pipeline before DirectRunner.run() Add Pipeline rehydration from proto Fix tests that passed invalid input to DynamicDestinations Add stub DisplayDataTranslation Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/01408c86 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/01408c86 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/01408c86 Branch: refs/heads/master Commit: 01408c864e9d844f4ffb74cc3f18276ff6a5c447 Parents: 0064fb3 8ca4591 Author: Kenneth Knowles <k...@google.com> Authored: Mon Jul 24 18:59:57 2017 -0700 Committer: Kenneth Knowles <k...@google.com> Committed: Mon Jul 24 18:59:57 2017 -0700 ---------------------------------------------------------------------- .../construction/DisplayDataTranslation.java | 39 +++ .../construction/PTransformTranslation.java | 12 +- .../core/construction/PipelineTranslation.java | 280 +++++++++++++++++++ .../core/construction/RehydratedComponents.java | 3 +- .../core/construction/SdkComponents.java | 52 ---- .../construction/PTransformMatchersTest.java | 25 +- .../construction/PipelineTranslationTest.java | 199 +++++++++++++ .../core/construction/SdkComponentsTest.java | 107 ------- .../beam/runners/direct/DirectRunner.java | 11 +- .../runners/direct/ViewOverrideFactoryTest.java | 41 --- .../direct/WriteWithShardingFactoryTest.java | 27 +- .../runners/dataflow/DataflowRunnerTest.java | 24 +- .../src/main/proto/beam_runner_api.proto | 4 +- .../main/java/org/apache/beam/sdk/Pipeline.java | 15 +- .../beam/sdk/io/DynamicFileDestinations.java | 6 +- .../beam/sdk/runners/TransformHierarchy.java | 69 +++++ 16 files changed, 704 insertions(+), 210 deletions(-) ----------------------------------------------------------------------
