Hi, Happy to announce the availability of Sparklens as open source project. It helps in understanding the scalability limits of spark applications and can be a useful guide on the path towards tuning applications for lower runtime or cost.
Please clone from here: https://github.com/qubole/sparklens Old blogpost: https://www.qubole.com/blog/introducing-quboles-spark- tuning-tool/ thanks, rohitk PS: Thanks for the patience. It took couple of months to get back on this.