are you running this in standalone mode? that is one physical host, and the executor will live inside the driver.
Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com On 11 May 2016 at 16:45, شجاع الرحمن بیگ <shujamug...@gmail.com> wrote: > yes, > > On Wed, May 11, 2016 at 5:43 PM, Deepak Sharma <deepakmc...@gmail.com> > wrote: > >> Since you are registering workers from the same node , do you have enough >> cores and RAM(In this case >=9 cores and > = 24 GB ) on this >> node(11.14.224.24)? >> >> Thanks >> Deepak >> >> On Wed, May 11, 2016 at 9:08 PM, شجاع الرحمن بیگ <shujamug...@gmail.com> >> wrote: >> >>> Hi All, >>> >>> I need to set same memory and core for each worker on same machine and >>> for this purpose, I have set the following properties in conf/spark-env.sh >>> >>> export SPARK_EXECUTOR_INSTANCE=3 >>> export SPARK_WORKER_CORES=3 >>> export SPARK_WORKER_MEMORY=8g >>> >>> but only one worker is getting desired memory and cores and other two >>> are not. here is the log of master. >>> >>> ... >>> 6/05/11 17:04:40 INFO Master: I have been elected leader! New state: >>> ALIVE >>> 16/05/11 17:04:43 INFO Master: Registering worker 11.14.224.24:53923 >>> with 3 cores, 8.0 GB RAM >>> 16/05/11 17:04:49 INFO Master: Registering worker 11.14.224.24:55072 >>> with 2 cores, 1020.7 GB RAM >>> 16/05/11 17:05:07 INFO Master: Registering worker 11.14.224.24:49702 >>> with 2 cores, 1020.7 GB RAM >>> ... >>> >>> >>> Could you please let me know the solution >>> >>> Thanks >>> Shuja >>> >>> -- >>> Regards >>> Shuja-ur-Rehman Baig >>> <http://pk.linkedin.com/in/shujamughal> >>> >> >> >> >> -- >> Thanks >> Deepak >> www.bigdatabig.com >> www.keosha.net >> > > > > -- > Regards > Shuja-ur-Rehman Baig > <http://pk.linkedin.com/in/shujamughal> >
