Re: Need Unit test complete reference for Pyspark

2020-11-19 Thread Sofia’s World
Hey they are good libraries..to get you started. Have used both of them.. unfortunately -as far as i saw when i started to use them - only few people maintains them. But you can get pointers out of them for writing tests. the code below can get you started What you'll need is - a method to

Need Unit test complete reference for Pyspark

2020-11-18 Thread Sachit Murarka
Hi Users, I have to write Unit Test cases for PySpark. I think pytest-spark and "spark testing base" are good test libraries. Can anyone please provide full reference for writing the test cases in Python using these? Kind Regards, Sachit Murarka