Alberto, What may be happening in your case is that Master is not able to talk to your scheduler. When responding to a scheduler, Mesos Master doesn't use the IP from which a request came from, but rather an IP set in the "Libprocess-from" field instead. That's exactly what you specify in LIBPROCESS_IP env var prior starting your scheduler. Could you please double check the it set up correctly and that IP is reachable for Mesos Master?
In case you are not able to solve the problem, please provide scheduler and Master logs together with master, zookeeper, and scheduler configurations. On Mon, May 25, 2015 at 6:30 PM, Alberto Rodriguez <[email protected]> wrote: > Hi all, > > I managed to get a mesos cluster up & running on a Ubuntu VM. I've > been also able to run and connect a spark-shell from this machine and > it works properly. > > Unfortunately, I'm trying to connect from the host machine where the > VM is running to launch spark jobs and I can not. > > See below the spark console output: > > Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java > 1.7.0_75) > Type in expressions to have them evaluated. > Type :help for more information. > 15/05/25 18:13:00 INFO SecurityManager: Changing view acls to: arodriguez > 15/05/25 18:13:00 INFO SecurityManager: Changing modify acls to: arodriguez > 15/05/25 18:13:00 INFO SecurityManager: SecurityManager: > authentication disabled; ui acls disabled; users with view > permissions: Set(arodriguez); users with modify permissions: > Set(arodriguez) > 15/05/25 18:13:01 INFO Slf4jLogger: Slf4jLogger started > 15/05/25 18:13:01 INFO Remoting: Starting remoting > 15/05/25 18:13:01 INFO Remoting: Remoting started; listening on > addresses :[akka.tcp://[email protected]:47229] > 15/05/25 18:13:01 INFO Utils: Successfully started service > 'sparkDriver' on port 47229. > 15/05/25 18:13:01 INFO SparkEnv: Registering MapOutputTracker > 15/05/25 18:13:01 INFO SparkEnv: Registering BlockManagerMaster > 15/05/25 18:13:01 INFO DiskBlockManager: Created local directory at > /tmp/spark-local-20150525181301-7fa8 > 15/05/25 18:13:01 INFO MemoryStore: MemoryStore started with capacity > 265.4 MB > 15/05/25 18:13:01 WARN NativeCodeLoader: Unable to load native-hadoop > library for your platform... using builtin-java classes where > applicable > 15/05/25 18:13:01 INFO HttpFileServer: HTTP File server directory is > /tmp/spark-1249c23f-adc8-4fcd-a044-b65a80f40e16 > 15/05/25 18:13:01 INFO HttpServer: Starting HTTP Server > 15/05/25 18:13:01 INFO Utils: Successfully started service 'HTTP file > server' on port 51659. > 15/05/25 18:13:01 INFO Utils: Successfully started service 'SparkUI' > on port 4040. > 15/05/25 18:13:01 INFO SparkUI: Started SparkUI at > http://localhost.localdomain:4040 > WARNING: Logging before InitGoogleLogging() is written to STDERR > W0525 18:13:01.749449 10908 sched.cpp:1323] > ************************************************** > Scheduler driver bound to loopback interface! Cannot communicate with > remote master(s). You might want to set 'LIBPROCESS_IP' environment > variable to use a routable IP address. > ************************************************** > 2015-05-25 18:13:01,749:10746(0x7fd4b1ffb700):ZOO_INFO@log_env@712: > Client environment:zookeeper.version=zookeeper C client 3.4.6 > 2015-05-25 18:13:01,749:10746(0x7fd4b1ffb700):ZOO_INFO@log_env@716: > Client environment:host.name=localhost.localdomain > 2015-05-25 18:13:01,749:10746(0x7fd4b1ffb700):ZOO_INFO@log_env@723: > Client environment:os.name=Linux > 2015-05-25 18:13:01,749:10746(0x7fd4b1ffb700):ZOO_INFO@log_env@724: > Client environment:os.arch=3.19.7-200.fc21.x86_64 > 2015-05-25 18:13:01,749:10746(0x7fd4b1ffb700):ZOO_INFO@log_env@725: > Client environment:os.version=#1 SMP Thu May 7 22:00:21 UTC 2015 > 2015-05-25 18:13:01,749:10746(0x7fd4b1ffb700):ZOO_INFO@log_env@733: > Client environment:user.name=arodriguez > I0525 18:13:01.749791 10908 sched.cpp:157] Version: 0.22.1 > 2015-05-25 18:13:01,749:10746(0x7fd4b1ffb700):ZOO_INFO@log_env@741: > Client environment:user.home=/home/arodriguez > 2015-05-25 18:13:01,749:10746(0x7fd4b1ffb700):ZOO_INFO@log_env@753: > Client > environment:user.dir=/home/arodriguez/dev/spark-1.2.0-bin-hadoop2.4/bin > 2015-05-25 18:13:01,749:10746(0x7fd4b1ffb700):ZOO_INFO@zookeeper_init@786: > Initiating client connection, host=10.141.141.10:2181 > sessionTimeout=10000 watcher=0x7fd4c2f0d5b0 sessionId=0 > sessionPasswd=<null> context=0x7fd3d40063c0 flags=0 > 2015-05-25 18:13:01,750:10746(0x7fd4ab7fe700):ZOO_INFO@check_events@1705: > initiated connection to server [10.141.141.10:2181] > 2015-05-25 18:13:01,752:10746(0x7fd4ab7fe700):ZOO_INFO@check_events@1752: > session establishment complete on server [10.141.141.10:2181], > sessionId=0x14d8babef360022, negotiated timeout=10000 > I0525 18:13:01.752760 10913 group.cpp:313] Group process > (group(1)@127.0.0.1:48557) connected to ZooKeeper > I0525 18:13:01.752787 10913 group.cpp:790] Syncing group operations: > queue size (joins, cancels, datas) = (0, 0, 0) > I0525 18:13:01.752807 10913 group.cpp:385] Trying to create path > '/mesos' in ZooKeeper > I0525 18:13:01.754317 10909 detector.cpp:138] Detected a new leader: > (id='16') > I0525 18:13:01.754408 10913 group.cpp:659] Trying to get > '/mesos/info_0000000016' in ZooKeeper > I0525 18:13:01.755056 10913 detector.cpp:452] A new leading master > ([email protected]:5050) is detected > I0525 18:13:01.755113 10911 sched.cpp:254] New master detected at > [email protected]:5050 > I0525 18:13:01.755345 10911 sched.cpp:264] No credentials provided. > Attempting to register without authentication > > > It hangs up in the last line. > > I've tried to set the LIBPROCESS_IP env variable with no luck. > > Any advice? > > Thank you in advance. > > Kind regards, > > Alberto >
