Re: Issue with executer

2021-01-20 Thread Vikas Garg
The issue is resolved. Resolution is little weird but it worked. It was due to scala version mismatch with projects in my package. On Wed, 20 Jan 2021 at 18:07, Mich Talebzadeh wrote: > Hi Vikas, > > Are you running this on your local laptop etc or using some IDE etc? > > What is your available

Re: Issue with executer

2021-01-20 Thread Mich Talebzadeh
Hi Vikas, Are you running this on your local laptop etc or using some IDE etc? What is your available memory for Spark? Start with minimum set like below def spark_session_local(appName): return SparkSession.builder \ .master('local[1]') \ .appName(appName) \

Re: Issue with executer

2021-01-20 Thread Vikas Garg
Hi Sachit, I am running it in local. My IP mentioned is the private IP address and therefore it is useless for anyone. On Wed, 20 Jan 2021 at 17:37, Sachit Murarka wrote: > Hi Vikas > > 1. Are you running in local mode? Master has local[*] > 2. Pls mask the ip or confidential info while

Re: Issue with executer

2021-01-20 Thread Sachit Murarka
Hi Vikas 1. Are you running in local mode? Master has local[*] 2. Pls mask the ip or confidential info while sharing logs Thanks Sachit On Wed, 20 Jan 2021, 17:35 Vikas Garg, wrote: > Hi, > > I am facing issue with spark executor. I am struggling with this issue > since last many days and