Have you looked at SparkListener ? /** * Called when the driver registers a new executor. */ def onExecutorAdded(executorAdded: SparkListenerExecutorAdded): Unit
/** * Called when the driver removes an executor. */ def onExecutorRemoved(executorRemoved: SparkListenerExecutorRemoved): Unit FYI On Wed, Apr 6, 2016 at 11:50 AM, Cesar Flores <ces...@gmail.com> wrote: > > Hello: > > I wonder if there is a way to query the number of running executors (nor > the number asked executors) inside a spark job? > > > Thanks > -- > Cesar Flores >
