Hi Himanshu Mehra, Thanks for reply. I am running spark standalone cluster. I have already set the property regarding logging events in history server as you mentioned. I have also started the history server.
I am running my code with awaitTermination(). So it never going to completed jobs. However, I can see it under incomplete jobs category in history server UI. The problem is History server is not showing the "streaming" tab (streaming statistics like Input rate, Scheduling Delay, Processing Time etc.), which is available in Spark UI while job is running. For this do I need to configure something? Where these statistics related files are stored, when job is running? Thanks, b.bhavesh -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-keep-history-of-streaming-statistics-tp24635p24651.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
