For SparkStreaming applications, there is already a tab called "Streaming" which displays the basic statistics.
Thanks Best Regards On Wed, Feb 25, 2015 at 8:55 PM, Josh J <joshjd...@gmail.com> wrote: > Let me ask like this, what would be the easiest way to display the > throughput in the web console? Would I need to create a new tab and add the > metrics? Any good or simple examples showing how this can be done? > > On Wed, Feb 25, 2015 at 12:07 AM, Akhil Das <ak...@sigmoidanalytics.com> > wrote: > >> Did you have a look at >> >> >> https://spark.apache.org/docs/1.0.2/api/scala/index.html#org.apache.spark.scheduler.SparkListener >> >> And for Streaming: >> >> >> https://spark.apache.org/docs/1.0.2/api/scala/index.html#org.apache.spark.streaming.scheduler.StreamingListener >> >> >> >> Thanks >> Best Regards >> >> On Tue, Feb 24, 2015 at 10:29 PM, Josh J <joshjd...@gmail.com> wrote: >> >>> Hi, >>> >>> I plan to run a parameter search varying the number of cores, epoch, and >>> parallelism. The web console provides a way to archive the previous runs, >>> though is there a way to view in the console the throughput? Rather than >>> logging the throughput separately to the log files and correlating the logs >>> files to the web console processing times? >>> >>> Thanks, >>> Josh >>> >> >> >
