Re: Spark streaming completed batches statistics
Just keep in mind that rest-api needs to be called from driver ui endpoint and not from Spark/Master UI. On Wed, Dec 7, 2016 at 12:03 PM, Richard Startin <richardstar...@outlook.com > wrote: > Ok it looks like I could reconstruct the logic in the Spark UI from the > /jobs resource. Thanks. > > > https://richardstartin.com/ > > > -- > *From:* map reduced <k3t.gi...@gmail.com> > *Sent:* 07 December 2016 19:49 > *To:* Richard Startin > *Cc:* user@spark.apache.org > *Subject:* Re: Spark streaming completed batches statistics > > Have you checked http://spark.apache.org/docs/latest/monitoring. > html#rest-api ? > > KP > > On Wed, Dec 7, 2016 at 11:43 AM, Richard Startin < > richardstar...@outlook.com> wrote: > >> Is there any way to get this information as CSV/JSON? >> >> >> https://docs.databricks.com/_images/CompletedBatches.png >> >> >> https://richardstartin.com/ >> >> >> ------ >> *From:* Richard Startin <richardstar...@outlook.com> >> *Sent:* 05 December 2016 15:55 >> *To:* user@spark.apache.org >> *Subject:* Spark streaming completed batches statistics >> >> Is there any way to get a more computer friendly version of the completes >> batches section of the streaming page of the application master? I am very >> interested in the statistics and am currently screen-scraping... >> >> https://richardstartin.com >> - >> To unsubscribe e-mail: user-unsubscr...@spark.apache.org >> >> >
Re: Spark streaming completed batches statistics
Ok it looks like I could reconstruct the logic in the Spark UI from the /jobs resource. Thanks. https://richardstartin.com/ From: map reduced <k3t.gi...@gmail.com> Sent: 07 December 2016 19:49 To: Richard Startin Cc: user@spark.apache.org Subject: Re: Spark streaming completed batches statistics Have you checked http://spark.apache.org/docs/latest/monitoring.html#rest-api ? KP On Wed, Dec 7, 2016 at 11:43 AM, Richard Startin <richardstar...@outlook.com<mailto:richardstar...@outlook.com>> wrote: Is there any way to get this information as CSV/JSON? https://docs.databricks.com/_images/CompletedBatches.png [https://docs.databricks.com/_images/CompletedBatches.png] https://richardstartin.com/ From: Richard Startin <richardstar...@outlook.com<mailto:richardstar...@outlook.com>> Sent: 05 December 2016 15:55 To: user@spark.apache.org<mailto:user@spark.apache.org> Subject: Spark streaming completed batches statistics Is there any way to get a more computer friendly version of the completes batches section of the streaming page of the application master? I am very interested in the statistics and am currently screen-scraping... https://richardstartin.com - To unsubscribe e-mail: user-unsubscr...@spark.apache.org<mailto:user-unsubscr...@spark.apache.org>
Re: Spark streaming completed batches statistics
Have you checked http://spark.apache.org/docs/latest/monitoring.html#rest-api ? KP On Wed, Dec 7, 2016 at 11:43 AM, Richard Startin <richardstar...@outlook.com > wrote: > Is there any way to get this information as CSV/JSON? > > > https://docs.databricks.com/_images/CompletedBatches.png > > > https://richardstartin.com/ > > > -- > *From:* Richard Startin <richardstar...@outlook.com> > *Sent:* 05 December 2016 15:55 > *To:* user@spark.apache.org > *Subject:* Spark streaming completed batches statistics > > Is there any way to get a more computer friendly version of the completes > batches section of the streaming page of the application master? I am very > interested in the statistics and am currently screen-scraping... > > https://richardstartin.com > - > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
Re: Spark streaming completed batches statistics
Is there any way to get this information as CSV/JSON? https://docs.databricks.com/_images/CompletedBatches.png [https://docs.databricks.com/_images/CompletedBatches.png] https://richardstartin.com/ From: Richard Startin <richardstar...@outlook.com> Sent: 05 December 2016 15:55 To: user@spark.apache.org Subject: Spark streaming completed batches statistics Is there any way to get a more computer friendly version of the completes batches section of the streaming page of the application master? I am very interested in the statistics and am currently screen-scraping... https://richardstartin.com - To unsubscribe e-mail: user-unsubscr...@spark.apache.org
Spark streaming completed batches statistics
Is there any way to get a more computer friendly version of the completes batches section of the streaming page of the application master? I am very interested in the statistics and am currently screen-scraping... https://richardstartin.com - To unsubscribe e-mail: user-unsubscr...@spark.apache.org
