Hi Jodi, I guess, there is no hard limit on number of Spark applications running in parallel. However, you need to ensure that you do not use the same (e.g., default) port numbers for each application.
In your specific case, for example, if you try using default SparkUI port "4040" for more than one Spark applications, the first application you start will bind to port "4040". So, this port becomes unavailable (at this moment). Therefore, all subsequent applications you start will get SparkUI BindException. To solve this issue, simply use non-competing port numbers, e.g., 4040, 4041, 4042... Thanks, Ajay On Fri, Jul 24, 2015 at 6:21 AM, Joji John <jj...@ebates.com> wrote: > *HI,* > > *I am getting this error for some of spark applications. I have multiple > spark applications running in parallel. Is there a limit in the number of > spark applications that I can run in parallel.* > > > > *ERROR SparkUI: Failed to bind SparkUI* > > *java.net.BindException: Address already in use: Service 'SparkUI' failed > after 16 retries!* > > > > > > *Thanks* > > *Joji john* > > >
