Hi all,
I've been doing a bunch of performance measurement of Spark and, as part of
doing this, added metrics that record the average CPU utilization, disk
throughput and utilization for each block device, and network throughput
while each task is running. These metrics are collected by reading
Maybe it's time to create an advanced mode in the ui.
On Wed, Jul 9, 2014 at 12:23 PM, Kay Ousterhout k...@eecs.berkeley.edu
wrote:
Hi all,
I've been doing a bunch of performance measurement of Spark and, as part of
doing this, added metrics that record the average CPU utilization, disk
I think it would be very useful to have this. We could put the ui display
either behind a flag or a url parameter
Shivaram
On Wed, Jul 9, 2014 at 12:25 PM, Reynold Xin r...@databricks.com wrote:
Maybe it's time to create an advanced mode in the ui.
On Wed, Jul 9, 2014 at 12:23 PM, Kay
