Hi all, I try to run spark on mesos, but it looks like I can not allocate resources from mesos. I am not expert of mesos, but from the mesos log, it seems spark always decline the offer from mesos. Not sure what's wrong, maybe need some configuration change. Here's the mesos master log
I0908 15:08:16.515960 301916160 master.cpp:1767] Received registration request for framework 'Spark shell' at scheduler-1ea1c85b-68bd-40b4-8c7c-ddccfd56f82b@192.168.3.3:57133 I0908 15:08:16.520545 301916160 master.cpp:1834] Registering framework 20150908-143320-16777343-5050-41965-0000 (Spark shell) at scheduler-1ea1c85b-68bd-40b4-8c7c-ddccfd56f82b@192.168.3.3:57133 with checkpointing disabled and capabilities [ ] I0908 15:08:16.522307 300843008 hierarchical.hpp:386] Added framework 20150908-143320-16777343-5050-41965-0000 I0908 15:08:16.525845 301379584 master.cpp:4290] Sending 1 offers to framework 20150908-143320-16777343-5050-41965-0000 (Spark shell) at scheduler-1ea1c85b-68bd-40b4-8c7c-ddccfd56f82b@192.168.3.3:57133 I0908 15:08:16.637677 302452736 master.cpp:2884] Processing DECLINE call for offers: [ 20150908-143320-16777343-5050-41965-O0 ] for framework 20150908-143320-16777343-5050-41965-0000 (Spark shell) at scheduler-1ea1c85b-68bd-40b4-8c7c-ddccfd56f82b@192.168.3.3:57133 I0908 15:08:16.639197 299233280 hierarchical.hpp:761] Recovered cpus(*):8; mem(*):15360; disk(*):470842; ports(*):[31000-32000] (total: cpus(*):8; mem(*):15360; disk(*):470842; ports(*):[31000-32000], allocated: ) on slave 20150908-143320-16777343-5050-41965-S0 from framework 20150908-143320-16777343-5050-41965-0000 I0908 15:08:21.786932 300306432 master.cpp:4290] Sending 1 offers to framework 20150908-143320-16777343-5050-41965-0000 (Spark shell) at scheduler-1ea1c85b-68bd-40b4-8c7c-ddccfd56f82b@192.168.3.3:57133 I0908 15:08:21.789979 298696704 master.cpp:2884] Processing DECLINE call for offers: [ 20150908-143320-16777343-5050-41965-O1 ] for framework 20150908-143320-16777343-5050-41965-0000 (Spark shell) at scheduler-1ea1c85b-68bd-40b4-8c7c-ddccfd56f82b@192.168.3.3:57133
