If you are interested in portable python pipeline validation, I think
fn_api_runner_test would also help.
Just to note, Ankur mentioned flinkCompatibilityMatrix, that one uses
fn_api_runner_test with some tooling on top to bring up the test cluster.
On 23.04.19 19:23, Boyuan Zhang wrote:
Hi Daniel,
If you are interested in portable python pipeline validation, I think
fn_api_runner_test
<https://github.com/apache/beam/blob/master/sdks/python/apache_beam/runners/portability/fn_api_runner_test.py>
would also help.
On Tue, Apr 23, 2019 at 10:19 AM Pablo Estrada <[email protected]
<mailto:[email protected]>> wrote:
This is cool, Daniel : ) Glad to see the Samza runner moving forward.
Best
-P.
On Tue, Apr 23, 2019 at 2:52 AM Maximilian Michels <[email protected]
<mailto:[email protected]>> wrote:
Hi Daniel,
Note that there is also Portable Validates Runner which runs Java
portability tests. I don't know if you have integrated with that
one
already.
Thanks,
Max
On 23.04.19 02:28, Ankur Goenka wrote:
> Hi Daniel,
>
> We use flinkCompatibilityMatrix [1] to check the Flink
compatibility
> with python. This is python equivalent to validatesRunner
tests in java
> for portable runners.
> I think we can reuse it for Samza Portable runner with minor
refactoring.
>
> [1]
>
https://github.com/apache/beam/blob/bdb1a713a120a887e71e85c77879dc4446a58541/sdks/python/build.gradle#L305
>
> On Mon, Apr 22, 2019 at 3:21 PM Daniel Chen
<[email protected] <mailto:[email protected]>
> <mailto:[email protected] <mailto:[email protected]>>> wrote:
>
> Hi everyone,
>
> I'm working on improving the validation of the Python
portable Samza
> runner. For java, we have the gradle task (
:validatesRunner) that
> runs the runner validation tests.
> I am looking for pointers on how to similarly
integrate/enable the
> portability and Python tests for the Samza runner.
>
> Any help will be greatly appreciated.
>
> Thanks,
> Daniel
>
