Yeah thanks, I can now see the memory usage.
Please also verify if bytes read == Combined size of all RDDs ?
Actually, all my RDDs are completely cached in memory. So, Combined size of
my RDDs = Mem used (verified from WebUI)
On Fri, Mar 20, 2015 at 12:07 PM, Akhil Das
You could do a cache and see the memory usage under Storage tab in the
driver UI (runs on port 4040)
Thanks
Best Regards
On Fri, Mar 20, 2015 at 12:02 PM, anu anamika.guo...@gmail.com wrote:
Hi All
I would like to measure Bytes Read and Peak Memory Usage for a Spark SQL
Query.
Please
