Re: [EXTERNAL] - Re: testing frameworks

2018-05-22 Thread Joel D
We’ve developed our own version of testing framework consisting of different areas of checking, sometimes providing expected data and comparing with the resultant data from the data object. Cheers. On Tue, May 22, 2018 at 1:48 PM Steve Pruitt wrote: > Something more on

RE: [EXTERNAL] - Re: testing frameworks

2018-05-22 Thread Steve Pruitt
Something more on the lines of integration I believe. Run one or more Spark jobs and verify the output results. If this makes sense. I am very new to the world of Spark. We want to include pipeline testing from the get go. I will check out spark-testing-base. Thanks. From: Holden Karau