Re: How to write unit test for stateful operators in Pyflink apps

2021-11-07 Thread Long Nguyễn
Hi Dian, I got it. A few days ago, I also found some test cases implemented with Python here in Flink's official repository. I took a look at them and it seems like many internal functions are used and since those are

Re: How to write unit test for stateful operators in Pyflink apps

2021-11-07 Thread Dian Fu
Hi Long, I agree with Fabian that currently you have to test it with a e2e job. There are still no such test harnesses for PyFlink jobs. Regards, Dian On Fri, Nov 5, 2021 at 5:22 PM Long Nguyễn wrote: > Thanks, Fabian. I'll check it out. > > Hope that Dian can also give me some advice. > > Bes

Re: How to write unit test for stateful operators in Pyflink apps

2021-11-05 Thread Long Nguyễn
Thanks, Fabian. I'll check it out. Hope that Dian can also give me some advice. Best, Long On Fri, Nov 5, 2021 at 3:48 PM Fabian Paul wrote: > Hi, > > Since you want to use Table API you probably can write a more high-level > test around executing the complete program. A good examples are the

Re: How to write unit test for stateful operators in Pyflink apps

2021-11-05 Thread Fabian Paul
Hi, Since you want to use Table API you probably can write a more high-level test around executing the complete program. A good examples are the pyflink example programs [1]. I also could not find something similar to the testing harness from Java. I cced Dian maybe he knows more about it. Be

How to write unit test for stateful operators in Pyflink apps

2021-11-04 Thread Long Nguyễn
Hi. I'm using Pyflink and Table APIs to create a window with Python. I have just read the Unit Testing Stateful or Timely UDFs & Custom Operators secti