Hi. We're thinking about writing a tool that would read Spark logs and output cache contents at some point in time (e.g. if you want to see what data fills the cache and whether some of it may be unpersisted to improve performance).
Are there similar projects that already exist? Is there a list of Spark-related tools? There is Spark debugger/SRD ( https://github.com/mesos/spark/wiki/Spark-Debugger, http://spark-replay-debugger-overview.readthedocs.org/en/latest/) but I couldn't find any links to them on the Spark project site.