Ok it looks like I could reconstruct the logic in the Spark UI from the /jobs resource. Thanks.
https://richardstartin.com/ ________________________________ From: map reduced <k3t.gi...@gmail.com> Sent: 07 December 2016 19:49 To: Richard Startin Cc: user@spark.apache.org Subject: Re: Spark streaming completed batches statistics Have you checked http://spark.apache.org/docs/latest/monitoring.html#rest-api ? KP On Wed, Dec 7, 2016 at 11:43 AM, Richard Startin <richardstar...@outlook.com<mailto:richardstar...@outlook.com>> wrote: Is there any way to get this information as CSV/JSON? https://docs.databricks.com/_images/CompletedBatches.png [https://docs.databricks.com/_images/CompletedBatches.png] https://richardstartin.com/ ________________________________ From: Richard Startin <richardstar...@outlook.com<mailto:richardstar...@outlook.com>> Sent: 05 December 2016 15:55 To: user@spark.apache.org<mailto:user@spark.apache.org> Subject: Spark streaming completed batches statistics Is there any way to get a more computer friendly version of the completes batches section of the streaming page of the application master? I am very interested in the statistics and am currently screen-scraping... https://richardstartin.com --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org<mailto:user-unsubscr...@spark.apache.org>
