Hi.

We're thinking about writing a tool that would read Spark logs and output
cache contents at some point in time (e.g. if you want to see what data
fills the cache and whether some of it may be unpersisted to improve
performance).

Are there similar projects that already exist? Is there a list of
Spark-related tools? There is Spark debugger/SRD (
https://github.com/mesos/spark/wiki/Spark-Debugger,
http://spark-replay-debugger-overview.readthedocs.org/en/latest/) but I
couldn't find any links to them on the Spark project site.

Reply via email to