Hi Daniel, If you are interested in portable python pipeline validation, I think fn_api_runner_test <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/runners/portability/fn_api_runner_test.py> would also help.
On Tue, Apr 23, 2019 at 10:19 AM Pablo Estrada <[email protected]> wrote: > This is cool, Daniel : ) Glad to see the Samza runner moving forward. > Best > -P. > > On Tue, Apr 23, 2019 at 2:52 AM Maximilian Michels <[email protected]> wrote: > >> Hi Daniel, >> >> Note that there is also Portable Validates Runner which runs Java >> portability tests. I don't know if you have integrated with that one >> already. >> >> Thanks, >> Max >> >> On 23.04.19 02:28, Ankur Goenka wrote: >> > Hi Daniel, >> > >> > We use flinkCompatibilityMatrix [1] to check the Flink compatibility >> > with python. This is python equivalent to validatesRunner tests in java >> > for portable runners. >> > I think we can reuse it for Samza Portable runner with minor >> refactoring. >> > >> > [1] >> > >> https://github.com/apache/beam/blob/bdb1a713a120a887e71e85c77879dc4446a58541/sdks/python/build.gradle#L305 >> > >> > On Mon, Apr 22, 2019 at 3:21 PM Daniel Chen <[email protected] >> > <mailto:[email protected]>> wrote: >> > >> > Hi everyone, >> > >> > I'm working on improving the validation of the Python portable Samza >> > runner. For java, we have the gradle task ( :validatesRunner) that >> > runs the runner validation tests. >> > I am looking for pointers on how to similarly integrate/enable the >> > portability and Python tests for the Samza runner. >> > >> > Any help will be greatly appreciated. >> > >> > Thanks, >> > Daniel >> > >> >
