[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=362584&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-362584
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 23/Dec/19 16:27
Start Date: 23/Dec/19 16:27
Worklog Time Spent: 10m
Work Description: ibzib commented on issue #10284: [BEAM-8512] Add
integration tests for flink_runner.py.
URL: https://github.com/apache/beam/pull/10284#issuecomment-568518884
Looks have been intermittent timeouts since this PR. Filed
https://issues.apache.org/jira/browse/BEAM-9021
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 362584)
Time Spent: 4h 10m (was: 4h)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Fix For: 2.19.0
>
> Time Spent: 4h 10m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=361009&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-361009
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 17/Dec/19 17:53
Start Date: 17/Dec/19 17:53
Worklog Time Spent: 10m
Work Description: ibzib commented on issue #10284: [BEAM-8512] Add
integration tests for flink_runner.py.
URL: https://github.com/apache/beam/pull/10284#issuecomment-566675356
Run PortableJar_Flink PostCommit
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 361009)
Time Spent: 4h (was: 3h 50m)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Fix For: Not applicable
>
> Time Spent: 4h
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=360528&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-360528
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 16/Dec/19 22:23
Start Date: 16/Dec/19 22:23
Worklog Time Spent: 10m
Work Description: ibzib commented on issue #10284: [BEAM-8512] Add
integration tests for flink_runner.py.
URL: https://github.com/apache/beam/pull/10284#issuecomment-566273164
Run Seed Job
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 360528)
Time Spent: 3h 50m (was: 3h 40m)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Fix For: Not applicable
>
> Time Spent: 3h 50m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=357318&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-357318
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 10/Dec/19 18:28
Start Date: 10/Dec/19 18:28
Worklog Time Spent: 10m
Work Description: ibzib commented on issue #10284: [BEAM-8512] Add
integration tests for flink_runner.py.
URL: https://github.com/apache/beam/pull/10284#issuecomment-564168598
Run Seed Job
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 357318)
Time Spent: 3h 40m (was: 3.5h)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Fix For: Not applicable
>
> Time Spent: 3h 40m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=356767&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-356767
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 10/Dec/19 02:03
Start Date: 10/Dec/19 02:03
Worklog Time Spent: 10m
Work Description: ibzib commented on issue #10284: [BEAM-8512] Add
integration tests for flink_runner.py.
URL: https://github.com/apache/beam/pull/10284#issuecomment-563575173
Run PortableJar_Flink PostCommit
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 356767)
Time Spent: 3.5h (was: 3h 20m)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Fix For: Not applicable
>
> Time Spent: 3.5h
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=356685&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-356685
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 09/Dec/19 23:56
Start Date: 09/Dec/19 23:56
Worklog Time Spent: 10m
Work Description: ibzib commented on pull request #10284: [BEAM-8512] Add
integration tests for flink_runner.py.
URL: https://github.com/apache/beam/pull/10284#discussion_r355749948
##
File path: runners/flink/job-server/flink_job_server.gradle
##
@@ -90,6 +90,7 @@ dependencies {
runtime project(":sdks:java:io:kafka")
runtime library.java.kafka_clients
runtime project(":sdks:java:io:google-cloud-platform")
+ runtime project(path: flinkRunnerProject, configuration: "miniCluster")
Review comment:
Alright, I've updated this PR to build a separate miniCluster jar that
includes/excludes the correct stuff. PTAL
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 356685)
Time Spent: 3h 20m (was: 3h 10m)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Fix For: Not applicable
>
> Time Spent: 3h 20m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=356682&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-356682
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 09/Dec/19 23:53
Start Date: 09/Dec/19 23:53
Worklog Time Spent: 10m
Work Description: ibzib commented on issue #10284: [BEAM-8512] Add
integration tests for flink_runner.py.
URL: https://github.com/apache/beam/pull/10284#issuecomment-563494062
Run PortableJar_Flink PostCommit
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 356682)
Time Spent: 3h 10m (was: 3h)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Fix For: Not applicable
>
> Time Spent: 3h 10m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=356536&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-356536
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 09/Dec/19 20:46
Start Date: 09/Dec/19 20:46
Worklog Time Spent: 10m
Work Description: ibzib commented on pull request #10284: [BEAM-8512] Add
integration tests for flink_runner.py.
URL: https://github.com/apache/beam/pull/10284#discussion_r355674855
##
File path: runners/flink/job-server/flink_job_server.gradle
##
@@ -90,6 +90,7 @@ dependencies {
runtime project(":sdks:java:io:kafka")
runtime library.java.kafka_clients
runtime project(":sdks:java:io:google-cloud-platform")
+ runtime project(path: flinkRunnerProject, configuration: "miniCluster")
Review comment:
Yes. I think I have to make a separate jar anyway because including
`PortablePipelineJarUtils` in the mini cluster jar seems to break the loading
of the pipeline. I haven't yet figured out how to create multiple shadow jars
with different configurations, however.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 356536)
Time Spent: 3h (was: 2h 50m)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Fix For: Not applicable
>
> Time Spent: 3h
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=356052&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-356052
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 09/Dec/19 10:37
Start Date: 09/Dec/19 10:37
Worklog Time Spent: 10m
Work Description: mxm commented on pull request #10284: [BEAM-8512] Add
integration tests for flink_runner.py.
URL: https://github.com/apache/beam/pull/10284#discussion_r355369488
##
File path: runners/flink/job-server/flink_job_server.gradle
##
@@ -90,6 +90,7 @@ dependencies {
runtime project(":sdks:java:io:kafka")
runtime library.java.kafka_clients
runtime project(":sdks:java:io:google-cloud-platform")
+ runtime project(path: flinkRunnerProject, configuration: "miniCluster")
Review comment:
Won't that include `flink-runtime-web` in the release shadow jar? We would
want to avoid that because it is provided by the Flink cluster.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 356052)
Time Spent: 2h 50m (was: 2h 40m)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Fix For: Not applicable
>
> Time Spent: 2h 50m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=353639&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-353639
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 04/Dec/19 18:36
Start Date: 04/Dec/19 18:36
Worklog Time Spent: 10m
Work Description: ibzib commented on issue #10284: [BEAM-8512] Add
integration tests for flink_runner.py.
URL: https://github.com/apache/beam/pull/10284#issuecomment-561780880
Run PortableJar_Flink PostCommit
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 353639)
Time Spent: 2h 40m (was: 2.5h)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Fix For: Not applicable
>
> Time Spent: 2h 40m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[ https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=353625&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-353625 ] ASF GitHub Bot logged work on BEAM-8512: Author: ASF GitHub Bot Created on: 04/Dec/19 18:31 Start Date: 04/Dec/19 18:31 Worklog Time Spent: 10m Work Description: ibzib commented on pull request #10284: [BEAM-8512] Add integration tests for flink_runner.py. URL: https://github.com/apache/beam/pull/10284 These tests will be part of `beam_PostCommit_PortableJar_Flink`. Kind of misleading, since as of #10270, portable jars will not actually be used in these tests (they would be expected to fail because of BEAM-8835) but we can use these tests to verify a fix when we have one. Note that we already have `portableWordCountFlinkRunner` tests, but those start an embedded Flink cluster so they couldn't test `FlinkUberJarJobServer`. Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] [**Choose reviewer(s)**](https://beam.apache.org/contribute/#make-your-change) and mention them in a comment (`R: @username`). - [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). See the [Contributor Guide](https://beam.apache.org/contribute) for more tips on [how to make review process smoother](https://beam.apache.org/contribute/#make-reviewers-job-easier). Post-Commit Tests Status (on master branch) Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark --- | --- | --- | --- | --- | --- | --- | --- Go | [](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/) | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/) | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/) Java | [](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/)[ Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=340775&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-340775
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 08/Nov/19 22:16
Start Date: 08/Nov/19 22:16
Worklog Time Spent: 10m
Work Description: ibzib commented on pull request #9998: [BEAM-8512] Add
integration tests for flink_runner.py
URL: https://github.com/apache/beam/pull/9998
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 340775)
Time Spent: 2h 20m (was: 2h 10m)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=340698&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-340698
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 08/Nov/19 19:19
Start Date: 08/Nov/19 19:19
Worklog Time Spent: 10m
Work Description: ibzib commented on issue #9998: [BEAM-8512] Add
integration tests for flink_runner.py
URL: https://github.com/apache/beam/pull/9998#issuecomment-551956527
Run Python 3.7 PostCommit
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 340698)
Time Spent: 2h 10m (was: 2h)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=340233&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-340233
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 07/Nov/19 23:41
Start Date: 07/Nov/19 23:41
Worklog Time Spent: 10m
Work Description: ibzib commented on issue #9998: [BEAM-8512] Add
integration tests for flink_runner.py
URL: https://github.com/apache/beam/pull/9998#issuecomment-551317048
Run Python 3.7 PostCommit
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 340233)
Time Spent: 2h (was: 1h 50m)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Time Spent: 2h
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=340232&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-340232
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 07/Nov/19 23:41
Start Date: 07/Nov/19 23:41
Worklog Time Spent: 10m
Work Description: ibzib commented on issue #9998: [BEAM-8512] Add
integration tests for flink_runner.py
URL: https://github.com/apache/beam/pull/9998#issuecomment-551317000
Run Portable_Python PreCommit
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 340232)
Time Spent: 1h 50m (was: 1h 40m)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=340230&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-340230
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 07/Nov/19 23:31
Start Date: 07/Nov/19 23:31
Worklog Time Spent: 10m
Work Description: ibzib commented on pull request #9998: [BEAM-8512] Add
integration tests for flink_runner.py
URL: https://github.com/apache/beam/pull/9998#discussion_r343858825
##
File path:
buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
##
@@ -1953,8 +1953,10 @@ class BeamModulePlugin implements Plugin {
}
project.ext.addPortableWordCountTasks = {
->
-addPortableWordCountTask(false)
-addPortableWordCountTask(true)
+addPortableWordCountTask(false, "PortableRunner")
Review comment:
> Theoretically, the PortableRunner is a subset of FlinkRunner, but there
are still things that can go wrong
+1 As long as PortableRunner remains a publicly documented option (and it
will probably have to for at least a little while longer) we should test it.
Also, they are testing slightly different things -- PortableRunner starts a
containerized job server, while FlinkRunner (when local) starts the job server
in a Java subprocess.
> Since these tasks are Flink specific, should they be renamed and possibly
moved out of BeamModulePlugin?
I'm going to add these tasks to Spark
([eventually](https://issues.apache.org/jira/browse/BEAM-7224)).
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 340230)
Time Spent: 1h 40m (was: 1.5h)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=340146&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-340146
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 07/Nov/19 20:34
Start Date: 07/Nov/19 20:34
Worklog Time Spent: 10m
Work Description: ibzib commented on issue #9998: [BEAM-8512] Add
integration tests for flink_runner.py
URL: https://github.com/apache/beam/pull/9998#issuecomment-551251982
Run Python 3.7 PostCommit
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 340146)
Time Spent: 1.5h (was: 1h 20m)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=340139&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-340139
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 07/Nov/19 20:29
Start Date: 07/Nov/19 20:29
Worklog Time Spent: 10m
Work Description: ibzib commented on pull request #9998: [BEAM-8512] Add
integration tests for flink_runner.py
URL: https://github.com/apache/beam/pull/9998#discussion_r343858825
##
File path:
buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
##
@@ -1953,8 +1953,10 @@ class BeamModulePlugin implements Plugin {
}
project.ext.addPortableWordCountTasks = {
->
-addPortableWordCountTask(false)
-addPortableWordCountTask(true)
+addPortableWordCountTask(false, "PortableRunner")
Review comment:
> Theoretically, the PortableRunner is a subset of FlinkRunner, but there
are still things that can go wrong
+1 As long as PortableRunner remains a publicly documented option (and it
will probably have to for at least a little while longer) we should test it.
Also, they are testing slightly different things -- PortableRunner starts a
containerized job server, while FlinkRunner (when local) starts the job server
in a Java subprocess.
> Since these tasks are Flink specific, should they be renamed and possibly
moved out of BeamModulePlugin?
I'm going to add these tasks to Spark (eventually).
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 340139)
Time Spent: 1h 20m (was: 1h 10m)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=339831&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-339831
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 07/Nov/19 09:57
Start Date: 07/Nov/19 09:57
Worklog Time Spent: 10m
Work Description: mxm commented on pull request #9998: [BEAM-8512] Add
integration tests for flink_runner.py
URL: https://github.com/apache/beam/pull/9998#discussion_r343563448
##
File path:
buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
##
@@ -1953,8 +1953,10 @@ class BeamModulePlugin implements Plugin {
}
project.ext.addPortableWordCountTasks = {
->
-addPortableWordCountTask(false)
-addPortableWordCountTask(true)
+addPortableWordCountTask(false, "PortableRunner")
Review comment:
Testing PortableRunner independently is important. Theoretically, the
PortableRunner is a subset of FlinkRunner, but there are still things that can
go wrong with the PortableRunner when it runs without the orchestration support
of the FlinkRunner.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 339831)
Time Spent: 1h 10m (was: 1h)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=339748&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-339748
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 07/Nov/19 04:42
Start Date: 07/Nov/19 04:42
Worklog Time Spent: 10m
Work Description: tweise commented on pull request #9998: [BEAM-8512] Add
integration tests for flink_runner.py
URL: https://github.com/apache/beam/pull/9998#discussion_r343474271
##
File path:
buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
##
@@ -1953,8 +1953,10 @@ class BeamModulePlugin implements Plugin {
}
project.ext.addPortableWordCountTasks = {
->
-addPortableWordCountTask(false)
-addPortableWordCountTask(true)
+addPortableWordCountTask(false, "PortableRunner")
Review comment:
Is there anything that we are testing with PortableRunner that isn't
included in FlinkRunner? If not, perhaps just replace those?
Side question for follow-up: Since these tasks are Flink specific, should
they be renamed and possibly moved out of BeamModulePlugin?
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 339748)
Time Spent: 1h (was: 50m)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Time Spent: 1h
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=339633&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-339633
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 06/Nov/19 23:12
Start Date: 06/Nov/19 23:12
Worklog Time Spent: 10m
Work Description: ibzib commented on issue #9998: [BEAM-8512] Add
integration tests for flink_runner.py
URL: https://github.com/apache/beam/pull/9998#issuecomment-550543641
Run Python 3.7 PostCommit
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 339633)
Time Spent: 50m (was: 40m)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Time Spent: 50m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=339632&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-339632
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 06/Nov/19 23:11
Start Date: 06/Nov/19 23:11
Worklog Time Spent: 10m
Work Description: ibzib commented on issue #9998: [BEAM-8512] Add
integration tests for flink_runner.py
URL: https://github.com/apache/beam/pull/9998#issuecomment-550543546
Run Python 2 PostCommit
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 339632)
Time Spent: 40m (was: 0.5h)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Time Spent: 40m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=339624&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-339624
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 06/Nov/19 22:50
Start Date: 06/Nov/19 22:50
Worklog Time Spent: 10m
Work Description: ibzib commented on issue #9998: [BEAM-8512] Add
integration tests for flink_runner.py
URL: https://github.com/apache/beam/pull/9998#issuecomment-550536929
Run Seed Job
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 339624)
Time Spent: 0.5h (was: 20m)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[
https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=339293&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-339293
]
ASF GitHub Bot logged work on BEAM-8512:
Author: ASF GitHub Bot
Created on: 06/Nov/19 11:03
Start Date: 06/Nov/19 11:03
Worklog Time Spent: 10m
Work Description: mxm commented on issue #9998: [BEAM-8512] Add
integration tests for flink_runner.py
URL: https://github.com/apache/beam/pull/9998#issuecomment-550260950
CC @tweise
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 339293)
Time Spent: 20m (was: 10m)
> Add integration tests for Python "flink_runner.py"
> --
>
> Key: BEAM-8512
> URL: https://issues.apache.org/jira/browse/BEAM-8512
> Project: Beam
> Issue Type: Test
> Components: runner-flink, sdk-py-core
>Reporter: Maximilian Michels
>Assignee: Kyle Weaver
>Priority: Major
> Time Spent: 20m
> Remaining Estimate: 0h
>
> There are currently no integration tests for the Python FlinkRunner. We need
> a set of tests similar to {{flink_runner_test.py}} which currently use the
> PortableRunner and not the FlinkRunner.
> CC [~robertwb] [~ibzib] [~thw]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-8512) Add integration tests for Python "flink_runner.py"
[ https://issues.apache.org/jira/browse/BEAM-8512?focusedWorklogId=338978&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-338978 ] ASF GitHub Bot logged work on BEAM-8512: Author: ASF GitHub Bot Created on: 05/Nov/19 20:08 Start Date: 05/Nov/19 20:08 Worklog Time Spent: 10m Work Description: ibzib commented on pull request #9998: [BEAM-8512] Add integration tests for flink_runner.py URL: https://github.com/apache/beam/pull/9998 This is just a very basic smoke test to ensure that FlinkRunner works as intended with the default settings. This does _not_ test behavior with an actual Flink cluster. Post-Commit Tests Status (on master branch) Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark --- | --- | --- | --- | --- | --- | --- | --- Go | [](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/) | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/) | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/) Java | [](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/) Python | [](https://builds.apache.org/job/beam_PostCommit_Python2/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Python35/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Python36/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Python37/lastCompletedBuild/) | --- | [](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | [](https://builds.apache.or
