Hi group, What solutions are people using to do performance testing and tuning of spark applications? I have been doing a pretty manual technique where I lay out an Excel sheet of various memory settings and caching parameters and then execute each one by hand. It’s pretty tedious though, so I’m wondering what others do, and if you do performance testing at all. Also, is anyone generating test data, or just operating on a static set? Is regression testing for performance a thing?
Andrew --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
