UT/IT Table API/SQL streaming job

2020-08-19 Thread narasimha
Hi, I'm checking on how to do UT/IT of streaming job written using Table API/SQL. I found https://stackoverflow.com/questions/54900843/add-a-unit-test-for-flink-sql this to be useful. Are there any other recommended libs/ways to do this. TIA -- A.Narasimha Swamy

Re: UT/IT Table API/SQL streaming job

2020-08-19 Thread Timo Walther
Hi, this might be helpful as well: https://lists.apache.org/thread.html/rfe3b45a10fc58cf19d2f71c6841515eb7175ba731d5055b06f236b3f%40%3Cuser.flink.apache.org%3E First of all, it is important to know if you are interested in end-to-end tests (incl. connectors) or excluding connectors. If you jus

Re: UT/IT Table API/SQL streaming job

2020-08-19 Thread Till Rohrmann
Hi Narasimha, have you taken a look at the testing documentation [1]? This should give you some pointers on how to test Flink jobs. [1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/testing.html Cheers, Till On Wed, Aug 19, 2020 at 12:44 PM narasimha wrote: > Hi, > > I'm c

Re: UT/IT Table API/SQL streaming job

2020-08-19 Thread narasimha
Hi Till, Yes, I have gone through the Flink testing documentation. In Table API/SQL connectors can be abstracted in the query itself, trying to understand how such pipelines can be tested. Looking for resources around it. On Wed, Aug 19, 2020 at 5:15 PM Till Rohrmann wrote: > Hi Narasimha, > >

Re: UT/IT Table API/SQL streaming job

2020-08-19 Thread narasimha
Thanks Timo, I'll check it out. On Wed, Aug 19, 2020 at 5:14 PM Timo Walther wrote: > Hi, > > this might be helpful as well: > > > https://lists.apache.org/thread.html/rfe3b45a10fc58cf19d2f71c6841515eb7175ba731d5055b06f236b3f%40%3Cuser.flink.apache.org%3E > > First of all, it is important to kn