Maybe you have spark listeners that are not processing the events fast
enough?
Do you have spark event logging enabled?
You might have to profile the built in and your custom listeners to see
whats going on.
- Arun
On Wed, 24 Oct 2018 at 16:08, karan alang wrote:
>
> Pls note - Spark version
Pls note - Spark version is 2.2.0
On Wed, Oct 24, 2018 at 3:57 PM karan alang wrote:
> Hello -
> we are running a Spark job, and getting the following error -
>
> "LiveListenerBus: Dropping SparkListenerEvent because no remaining room in
> event queue"
>
> As per the recommendation in the Spark
Hello -
we are running a Spark job, and getting the following error -
"LiveListenerBus: Dropping SparkListenerEvent because no remaining room in
event queue"
As per the recommendation in the Spark Docs -
I've increased the value of property
spark.scheduler.listenerbus.eventqueue.capacity to
