Hi Community, Is there a Rest API for Spark Streaming?
We are looking to monitor and send pager alert notification using rest api json messages when our streaming job Active Batches are getting 'queued' We looked at http://localhost:4040/api/v1/applications/ap-status/stages/ but this info is not there and http://spark.apache.org/docs/latest/monitoring.html has no specific info on Batch Status Any help will be appreciated. Active Batches (11) Batch Time Input Size Scheduling Delay (?) Processing Time (?) Status 2016/02/24 17:56:00 <http://has-dal-0004:4040/streaming/batch?id=1456336560000> 9062 events - - queued 2016/02/24 17:54:00 <http://has-dal-0004:4040/streaming/batch?id=1456336440000> 8522 events - - queued 2016/02/24 17:52:00 <http://has-dal-0004:4040/streaming/batch?id=1456336320000> 7982 events - - queued
