yes, On Wed, May 11, 2016 at 5:43 PM, Deepak Sharma <deepakmc...@gmail.com> wrote:
> Since you are registering workers from the same node , do you have enough > cores and RAM(In this case >=9 cores and > = 24 GB ) on this > node(11.14.224.24)? > > Thanks > Deepak > > On Wed, May 11, 2016 at 9:08 PM, شجاع الرحمن بیگ <shujamug...@gmail.com> > wrote: > >> Hi All, >> >> I need to set same memory and core for each worker on same machine and >> for this purpose, I have set the following properties in conf/spark-env.sh >> >> export SPARK_EXECUTOR_INSTANCE=3 >> export SPARK_WORKER_CORES=3 >> export SPARK_WORKER_MEMORY=8g >> >> but only one worker is getting desired memory and cores and other two are >> not. here is the log of master. >> >> ... >> 6/05/11 17:04:40 INFO Master: I have been elected leader! New state: ALIVE >> 16/05/11 17:04:43 INFO Master: Registering worker 11.14.224.24:53923 >> with 3 cores, 8.0 GB RAM >> 16/05/11 17:04:49 INFO Master: Registering worker 11.14.224.24:55072 >> with 2 cores, 1020.7 GB RAM >> 16/05/11 17:05:07 INFO Master: Registering worker 11.14.224.24:49702 >> with 2 cores, 1020.7 GB RAM >> ... >> >> >> Could you please let me know the solution >> >> Thanks >> Shuja >> >> -- >> Regards >> Shuja-ur-Rehman Baig >> <http://pk.linkedin.com/in/shujamughal> >> > > > > -- > Thanks > Deepak > www.bigdatabig.com > www.keosha.net > -- Regards Shuja-ur-Rehman Baig <http://pk.linkedin.com/in/shujamughal>
