Joe, do you ever get a line in your slave output that mentions registering with the master? The output you pasted doesn't show that happening. The lines should look something like this (bold added by me):
I0221 10:20:13.964689 230219776 slave.cpp:501] New master detected at [email protected]:5050 I0221 10:20:13.964833 228073472 status_update_manager.cpp:162] New master detected at [email protected]:5050 I0221 10:20:13.964891 230219776 slave.cpp:526] Detecting new master *I0221 10:20:13.965553 227000320 slave.cpp:544] Registered with master [email protected]:5050 <http://[email protected]:5050>; given slave ID 201402211020-1929488576-5050-59729-0* Ross Allen [email protected] On 21 February 2014 01:52, Joe Stein <[email protected]> wrote: > from master > > root@oss001:/home/jstein# /usr/local/sbin/mesos-master --zk=zk:// > 138.113.121.10:2181,/etc > I0221 00:49:22.075003 17646 main.cpp:126] Build: 2014-02-06 19:32:44 by > root > I0221 00:49:22.075582 17646 main.cpp:167] Starting Mesos master > I0221 00:49:22.075772 17650 master.cpp:283] Master started on > 138.138.138.10:5050 > I0221 00:49:22.075848 17650 master.cpp:297] Master ID: > 201402210049-176851594-5050-17646 > I0221 00:49:22.075932 17650 master.cpp:307] Master allowing unauthenticated > frameworks to register!! > 2014-02-21 00:49:22,076:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@658: Client > environment:zookeeper.version=zookeeper C client 3.3.4 > 2014-02-21 00:49:22,076:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@662: Client > environment:host.name=oss001 > 2014-02-21 00:49:22,076:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@669: Client > environment:os.name=Linux > 2014-02-21 00:49:22,076:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@670: Client > environment:os.arch=3.8.0-29-generic > 2014-02-21 00:49:22,076:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@671: Client > environment:os.version=#42~precise1-Ubuntu SMP Wed Aug 14 16:19:23 UTC 2013 > 2014-02-21 00:49:22,076:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@658: Client > environment:zookeeper.version=zookeeper C client 3.3.4 > 2014-02-21 00:49:22,076:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@662: Client > environment:host.name=oss001 > 2014-02-21 00:49:22,076:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@669: Client > environment:os.name=Linux > 2014-02-21 00:49:22,076:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@670: Client > environment:os.arch=3.8.0-29-generic > 2014-02-21 00:49:22,076:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@671: Client > environment:os.version=#42~precise1-Ubuntu SMP Wed Aug 14 16:19:23 UTC 2013 > I0221 00:49:22.078568 17649 contender.cpp:121] Joining the ZK group with > data: '[email protected]:5050' > 2014-02-21 00:49:22,106:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@679: Client > environment:user.name=jstein > 2014-02-21 00:49:22,106:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@687: Client > environment:user.home=/root > 2014-02-21 00:49:22,106:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@699: Client > environment:user.dir=/home/jstein > 2014-02-21 00:49:22,106:17646(0x7fbf0e3e4700):ZOO_INFO@zookeeper_init@727: > Initiating client connection, host=138.113.121.10:2181, > sessionTimeout=10000 watcher=0x7fbf18045e60 sessionId=0 > sessionPasswd=<null> context=0x7fbef0000f90 flags=0 > 2014-02-21 00:49:22,106:17646(0x7fbefffff700):ZOO_INFO@check_events@1585: > initiated connection to server [138.113.121.10:2181] > 2014-02-21 00:49:22,108:17646(0x7fbefffff700):ZOO_INFO@check_events@1632: > session establishment complete on server [138.113.121.10:2181], > sessionId=0x14452bb562c0017, negotiated timeout=10000 > I0221 00:49:22.109210 17648 group.cpp:310] Group process ((5)@ > 138.138.138.10:5050) connected to ZooKeeper > I0221 00:49:22.109261 17648 group.cpp:752] Syncing group operations: queue > size (joins, cancels, datas) = (0, 0, 0) > I0221 00:49:22.109295 17648 group.cpp:367] Trying to create path '/etc' in > ZooKeeper > 2014-02-21 00:49:22,132:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@679: Client > environment:user.name=jstein > 2014-02-21 00:49:22,132:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@687: Client > environment:user.home=/root > 2014-02-21 00:49:22,132:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@699: Client > environment:user.dir=/home/jstein > 2014-02-21 00:49:22,132:17646(0x7fbf0f3e6700):ZOO_INFO@zookeeper_init@727: > Initiating client connection, host=138.113.121.10:2181, > sessionTimeout=10000 watcher=0x7fbf18045e60 sessionId=0 > sessionPasswd=<null> context=0x7fbf08003360 flags=0 > 2014-02-21 00:49:22,133:17646(0x7fbefeffd700):ZOO_INFO@check_events@1585: > initiated connection to server [138.113.121.10:2181] > 2014-02-21 00:49:22,134:17646(0x7fbefeffd700):ZOO_INFO@check_events@1632: > session establishment complete on server [138.113.121.10:2181], > sessionId=0x14452bb562c0018, negotiated timeout=10000 > I0221 00:49:22.134649 17650 group.cpp:310] Group process ((3)@ > 138.138.138.10:5050) connected to ZooKeeper > I0221 00:49:22.134721 17650 group.cpp:752] Syncing group operations: queue > size (joins, cancels, datas) = (1, 0, 0) > I0221 00:49:22.134757 17650 group.cpp:367] Trying to create path '/etc' in > ZooKeeper > I0221 00:49:22.136303 17647 contender.cpp:237] New candidate (id='0', > data=' > [email protected]:5050') has entered the contest for leadership > I0221 00:49:22.136605 17649 detector.cpp:134] Detected a new leader: > (id='0') > I0221 00:49:22.136806 17650 group.cpp:629] Trying to get '/etc/0000000000' > in ZooKeeper > I0221 00:49:22.137348 17654 detector.cpp:354] A new leading master (UPID= > [email protected]:5050) is detected > I0221 00:49:22.137433 17650 master.cpp:728] The newly elected leader is > [email protected]:5050 > I0221 00:49:22.137487 17650 master.cpp:736] Elected as the leading master! > > from slave > > root@oss002:~# /usr/local/sbin/mesos-slave --master=zk:// > 138.113.121.10:2181 > ,/etc > I0221 00:53:39.928858 12586 main.cpp:118] Build: 2014-02-06 19:32:44 by > root > I0221 00:53:39.929018 12586 main.cpp:120] Creating "process" isolator > I0221 00:53:39.929405 12586 main.cpp:132] Starting Mesos slave > I0221 00:53:39.929795 12590 slave.cpp:111] Slave started on 1)@ > 138.138.138.11:5051 > 2014-02-21 00:53:39,929:12586(0x7f2d31e57700):ZOO_INFO@log_env@658: Client > environment:zookeeper.version=zookeeper C client 3.3.4 > 2014-02-21 00:53:39,929:12586(0x7f2d31e57700):ZOO_INFO@log_env@662: Client > environment:host.name=oss002 > 2014-02-21 00:53:39,929:12586(0x7f2d31e57700):ZOO_INFO@log_env@669: Client > environment:os.name=Linux > 2014-02-21 00:53:39,929:12586(0x7f2d31e57700):ZOO_INFO@log_env@670: Client > environment:os.arch=3.8.0-29-generic > 2014-02-21 00:53:39,930:12586(0x7f2d31e57700):ZOO_INFO@log_env@671: Client > environment:os.version=#42~precise1-Ubuntu SMP Wed Aug 14 16:19:23 UTC 2013 > I0221 00:53:39.930083 12590 slave.cpp:211] Slave resources: cpus(*):4; > mem(*):15020; disk(*):115201; ports(*):[31000-32000] > I0221 00:53:39.932523 12591 state.cpp:33] Recovering state from > '/tmp/mesos/meta' > I0221 00:53:39.932719 12591 state.cpp:62] Failed to find the latest slave > from '/tmp/mesos/meta' > I0221 00:53:39.932811 12591 status_update_manager.cpp:186] Recovering > status update manager > I0221 00:53:39.932881 12591 process_isolator.cpp:317] Recovering isolator > I0221 00:53:39.932955 12591 slave.cpp:2752] Finished recovery > 2014-02-21 00:53:39,960:12586(0x7f2d31e57700):ZOO_INFO@log_env@679: Client > environment:user.name=root > 2014-02-21 00:53:39,960:12586(0x7f2d31e57700):ZOO_INFO@log_env@687: Client > environment:user.home=/root > 2014-02-21 00:53:39,960:12586(0x7f2d31e57700):ZOO_INFO@log_env@699: Client > environment:user.dir=/root > 2014-02-21 00:53:39,961:12586(0x7f2d31e57700):ZOO_INFO@zookeeper_init@727: > Initiating client connection, host=138.113.121.10:2181, > sessionTimeout=10000 watcher=0x7f2d392b3e60 sessionId=0 > sessionPasswd=<null> context=0x7f2d08000cc0 flags=0 > 2014-02-21 00:53:39,961:12586(0x7f2d2da22700):ZOO_INFO@check_events@1585: > initiated connection to server [138.113.121.10:2181] > 2014-02-21 00:53:39,963:12586(0x7f2d2da22700):ZOO_INFO@check_events@1632: > session establishment complete on server [138.113.121.10:2181], > sessionId=0x14452bb562c0019, negotiated timeout=10000 > I0221 00:53:39.963670 12590 group.cpp:310] Group process ((2)@ > 138.138.138.11:5051) connected to ZooKeeper > I0221 00:53:39.963760 12590 group.cpp:752] Syncing group operations: queue > size (joins, cancels, datas) = (0, 0, 0) > I0221 00:53:39.963809 12590 group.cpp:367] Trying to create path '/etc' in > ZooKeeper > I0221 00:53:39.964941 12593 detector.cpp:134] Detected a new leader: > (id='0') > I0221 00:53:39.965073 12593 group.cpp:629] Trying to get '/etc/0000000000' > in ZooKeeper > I0221 00:53:39.965636 12588 detector.cpp:354] A new leading master (UPID= > [email protected]:5050) is detected > I0221 00:53:39.965703 12593 slave.cpp:500] New master detected at > [email protected]:5050 > I0221 00:53:39.965816 12588 status_update_manager.cpp:160] New master > detected at [email protected]:5050 > I0221 00:53:39.965916 12593 slave.cpp:525] Detecting new master > I0221 00:54:39.931643 12593 slave.cpp:2602] Current usage 1.58%. Max > allowed age: 6.189622121059202days > > /******************************************* > Joe Stein > Founder, Principal Consultant > Big Data Open Source Security LLC > http://www.stealth.ly > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> > ********************************************/ > > > On Fri, Feb 21, 2014 at 2:22 AM, Vinod Kone <[email protected]> wrote: > > > Hey Joe. Some logs would help diagnose the issue. > > > > @vinodkone > > Sent from my mobile > > > > > On Feb 20, 2014, at 10:58 PM, Joe Stein <[email protected]> wrote: > > > > > > Hi, setting up a new cluster right now with 1x master, 1xZk and 2x > slaves > > > > > > the slaves see the master leader election when I take it down and back > up > > > > > > and the slaves are showing Current usage 1.58%. Max allowed age: > > > 6.189622802823576days > > > > > > but the slave information is not in the mesos user interface still > > showing > > > 0 slaves > > > > > > not sure what is wrong or what to-do next to fix whatever I am doing > > wrong > > > > > > thanks in advance > > > > > > /******************************************* > > > Joe Stein > > > Founder, Principal Consultant > > > Big Data Open Source Security LLC > > > http://www.stealth.ly > > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> > > > ********************************************/ > > >
