Andrei Sekretenko created MESOS-9941: ----------------------------------------
Summary: ZooKeeperMasterContenderDetectorTest.MasterDetectorExpireSlaveZKSessionNewMaster is flaky Key: MESOS-9941 URL: https://issues.apache.org/jira/browse/MESOS-9941 Project: Mesos Issue Type: Bug Environment: Observed in internal CI on Mac: {code} [ RUN ] ZooKeeperMasterContenderDetectorTest.MasterDetectorExpireSlaveZKSessionNewMaster I0815 12:39:25.722012 371160512 zookeeper_test_server.cpp:156] Started ZooKeeperTestServer on port 51882 2019-08-15 12:39:25,722:42028(0x700001551000):ZOO_INFO@log_env@753: Client environment:zookeeper.version=zookeeper C client 3.4.8 2019-08-15 12:39:25,722:42028(0x700001551000):ZOO_INFO@log_env@757: Client environment:host.name=Jenkinss-Mac-mini.local 2019-08-15 12:39:25,722:42028(0x700001551000):ZOO_INFO@log_env@764: Client environment:os.name=Darwin 2019-08-15 12:39:25,722:42028(0x700001551000):ZOO_INFO@log_env@765: Client environment:os.arch=18.2.0 2019-08-15 12:39:25,722:42028(0x700001551000):ZOO_INFO@log_env@766: Client environment:os.version=Darwin Kernel Version 18.2.0: Mon Nov 12 20:24:46 PST 2018; root:xnu-4903.231.4~2/RELEASE_X86_64 2019-08-15 12:39:25,722:42028(0x700001551000):ZOO_INFO@log_env@774: Client environment:user.name=jenkins 2019-08-15 12:39:25,722:42028(0x700001551000):ZOO_INFO@log_env@782: Client environment:user.home=/Users/jenkins 2019-08-15 12:39:25,722:42028(0x700001551000):ZOO_INFO@log_env@794: Client environment:user.dir=/Users/jenkins/workspace/workspace/mesos/Mesos_CI-build/FLAG/SSL/label/mac/mesos/build 2019-08-15 12:39:25,722:42028(0x700001551000):ZOO_INFO@zookeeper_init@827: Initiating client connection, host=127.0.0.1:51882 sessionTimeout=10000 watcher=0x118f74830 sessionId=0 sessionPasswd=<null> context=0x7fce47f77f40 flags=0 2019-08-15 12:39:25,723:42028(0x700002207000):ZOO_INFO@check_events@1764: initiated connection to server [127.0.0.1:51882] I0815 12:39:25.724099 22351872 contender.cpp:152] Joining the ZK group 2019-08-15 12:39:25,726:42028(0x700002207000):ZOO_INFO@check_events@1811: session establishment complete on server [127.0.0.1:51882], sessionId=0x16c96cac0940000, negotiated timeout=10000 I0815 12:39:25.727036 23425024 group.cpp:341] Group process (zookeeper-group(28)@10.0.49.4:50979) connected to ZooKeeper I0815 12:39:25.727079 23425024 group.cpp:831] Syncing group operations: queue size (joins, cancels, datas) = (1, 0, 0) I0815 12:39:25.727094 23425024 group.cpp:419] Trying to create path '/mesos' in ZooKeeper I0815 12:39:25.729692 23961600 contender.cpp:268] New candidate (id='0') has entered the contest for leadership I0815 12:39:25.730315 25571328 detector.cpp:152] Detected a new leader: (id='0') I0815 12:39:25.730464 23961600 group.cpp:700] Trying to get '/mesos/json.info_0000000000' in ZooKeeper I0815 12:39:25.731133 23425024 zookeeper.cpp:262] A new leading master (UPID=@0.152.150.128:10000) is detected 2019-08-15 12:39:25,731:42028(0x7000016da000):ZOO_INFO@log_env@753: Client environment:zookeeper.version=zookeeper C client 3.4.8 2019-08-15 12:39:25,731:42028(0x7000016da000):ZOO_INFO@log_env@757: Client environment:host.name=Jenkinss-Mac-mini.local 2019-08-15 12:39:25,731:42028(0x7000016da000):ZOO_INFO@log_env@764: Client environment:os.name=Darwin 2019-08-15 12:39:25,731:42028(0x7000016da000):ZOO_INFO@log_env@765: Client environment:os.arch=18.2.0 2019-08-15 12:39:25,731:42028(0x7000016da000):ZOO_INFO@log_env@766: Client environment:os.version=Darwin Kernel Version 18.2.0: Mon Nov 12 20:24:46 PST 2018; root:xnu-4903.231.4~2/RELEASE_X86_64 2019-08-15 12:39:25,731:42028(0x7000016da000):ZOO_INFO@log_env@774: Client environment:user.name=jenkins 2019-08-15 12:39:25,731:42028(0x7000016da000):ZOO_INFO@log_env@782: Client environment:user.home=/Users/jenkins 2019-08-15 12:39:25,731:42028(0x7000016da000):ZOO_INFO@log_env@794: Client environment:user.dir=/Users/jenkins/workspace/workspace/mesos/Mesos_CI-build/FLAG/SSL/label/mac/mesos/build 2019-08-15 12:39:25,731:42028(0x7000016da000):ZOO_INFO@zookeeper_init@827: Initiating client connection, host=127.0.0.1:51882 sessionTimeout=10000 watcher=0x118f74830 sessionId=0 sessionPasswd=<null> context=0x7fce4925daf0 flags=0 2019-08-15 12:39:25,732:42028(0x700002e2e000):ZOO_INFO@check_events@1764: initiated connection to server [127.0.0.1:51882] I0815 12:39:25.732513 22351872 contender.cpp:152] Joining the ZK group 2019-08-15 12:39:25,733:42028(0x700002e2e000):ZOO_INFO@check_events@1811: session establishment complete on server [127.0.0.1:51882], sessionId=0x16c96cac0940001, negotiated timeout=10000 I0815 12:39:25.733927 26107904 group.cpp:341] Group process (zookeeper-group(29)@10.0.49.4:50979) connected to ZooKeeper I0815 12:39:25.733970 26107904 group.cpp:831] Syncing group operations: queue size (joins, cancels, datas) = (1, 0, 0) I0815 12:39:25.733991 26107904 group.cpp:419] Trying to create path '/mesos' in ZooKeeper I0815 12:39:25.735771 24498176 contender.cpp:268] New candidate (id='1') has entered the contest for leadership I0815 12:39:25.736553 25571328 detector.cpp:152] Detected a new leader: (id='0') I0815 12:39:25.736773 22351872 group.cpp:700] Trying to get '/mesos/json.info_0000000000' in ZooKeeper I0815 12:39:25.737375 25571328 zookeeper.cpp:262] A new leading master (UPID=@0.152.150.128:10000) is detected 2019-08-15 12:39:25,737:42028(0x7000017e0000):ZOO_INFO@log_env@753: Client environment:zookeeper.version=zookeeper C client 3.4.8 2019-08-15 12:39:25,737:42028(0x7000017e0000):ZOO_INFO@log_env@757: Client environment:host.name=Jenkinss-Mac-mini.local 2019-08-15 12:39:25,737:42028(0x7000017e0000):ZOO_INFO@log_env@764: Client environment:os.name=Darwin 2019-08-15 12:39:25,737:42028(0x7000017e0000):ZOO_INFO@log_env@765: Client environment:os.arch=18.2.0 2019-08-15 12:39:25,737:42028(0x7000017e0000):ZOO_INFO@log_env@766: Client environment:os.version=Darwin Kernel Version 18.2.0: Mon Nov 12 20:24:46 PST 2018; root:xnu-4903.231.4~2/RELEASE_X86_64 2019-08-15 12:39:25,737:42028(0x7000017e0000):ZOO_INFO@log_env@774: Client environment:user.name=jenkins 2019-08-15 12:39:25,737:42028(0x7000017e0000):ZOO_INFO@log_env@782: Client environment:user.home=/Users/jenkins 2019-08-15 12:39:25,737:42028(0x7000017e0000):ZOO_INFO@log_env@794: Client environment:user.dir=/Users/jenkins/workspace/workspace/mesos/Mesos_CI-build/FLAG/SSL/label/mac/mesos/build 2019-08-15 12:39:25,737:42028(0x7000017e0000):ZOO_INFO@zookeeper_init@827: Initiating client connection, host=127.0.0.1:51882 sessionTimeout=10000 watcher=0x118f74830 sessionId=0 sessionPasswd=<null> context=0x7fce492184b0 flags=0 2019-08-15 12:39:25,738:42028(0x700002f34000):ZOO_INFO@check_events@1764: initiated connection to server [127.0.0.1:51882] 2019-08-15 12:39:25,739:42028(0x700002f34000):ZOO_INFO@check_events@1811: session establishment complete on server [127.0.0.1:51882], sessionId=0x16c96cac0940002, negotiated timeout=10000 I0815 12:39:25.739684 25034752 group.cpp:341] Group process (zookeeper-group(30)@10.0.49.4:50979) connected to ZooKeeper I0815 12:39:25.739728 25034752 group.cpp:831] Syncing group operations: queue size (joins, cancels, datas) = (0, 0, 0) I0815 12:39:25.739779 25034752 group.cpp:419] Trying to create path '/mesos' in ZooKeeper I0815 12:39:25.741009 26107904 detector.cpp:152] Detected a new leader: (id='0') I0815 12:39:25.741227 25571328 group.cpp:700] Trying to get '/mesos/json.info_0000000000' in ZooKeeper I0815 12:39:25.741997 26107904 zookeeper.cpp:262] A new leading master (UPID=@0.152.150.128:10000) is detected 2019-08-15 12:39:25,743:42028(0x700002f34000):ZOO_ERROR@handle_socket_error_msg@1782: Socket [127.0.0.1:51882] zk retcode=-4, errno=64(Host is down): failed while receiving a server response 2019-08-15 12:39:25,743:42028(0x700002207000):ZOO_ERROR@handle_socket_error_msg@1782: Socket [127.0.0.1:51882] zk retcode=-4, errno=64(Host is down): failed while receiving a server response I0815 12:39:25.743993 23425024 group.cpp:452] Lost connection to ZooKeeper, attempting to reconnect ... 2019-08-15 12:39:25,744:42028(0x700002207000):ZOO_INFO@check_events@1764: initiated connection to server [127.0.0.1:51882] I0815 12:39:25.744995 26107904 detector.cpp:140] The current leader (id=0) is lost I0815 12:39:25.745023 26107904 detector.cpp:152] Detected a new leader: (id='1') 2019-08-15 12:39:25,745:42028(0x700002207000):ZOO_ERROR@handle_socket_error_msg@1800: Socket [127.0.0.1:51882] zk retcode=-112, errno=70(Stale NFS file handle): sessionId=0x16c96cac0940000 has expired. I0815 12:39:25.745344 25034752 group.cpp:700] Trying to get '/mesos/json.info_0000000001' in ZooKeeper I0815 12:39:25.745687 25571328 group.cpp:452] Lost connection to ZooKeeper, attempting to reconnect ... I0815 12:39:25.745980 25571328 group.cpp:511] ZooKeeper session expired I0815 12:39:25.746156 24498176 detector.cpp:140] The current leader (id=0) is lost I0815 12:39:25.746173 22351872 contender.cpp:217] Membership cancelled: 0 I0815 12:39:25.746181 24498176 detector.cpp:152] Detected a new leader: None 2019-08-15 12:39:25,746:42028(0x700001863000):ZOO_INFO@zookeeper_close@2579: Freeing zookeeper resources for sessionId=0x16c96cac0940000 2019-08-15 12:39:25,746:42028(0x700001551000):ZOO_INFO@log_env@753: Client environment:zookeeper.version=zookeeper C client 3.4.8 2019-08-15 12:39:25,746:42028(0x700001551000):ZOO_INFO@log_env@757: Client environment:host.name=Jenkinss-Mac-mini.local 2019-08-15 12:39:25,746:42028(0x700001551000):ZOO_INFO@log_env@764: Client environment:os.name=Darwin 2019-08-15 12:39:25,746:42028(0x700001551000):ZOO_INFO@log_env@765: Client environment:os.arch=18.2.0 2019-08-15 12:39:25,746:42028(0x700001551000):ZOO_INFO@log_env@766: Client environment:os.version=Darwin Kernel Version 18.2.0: Mon Nov 12 20:24:46 PST 2018; root:xnu-4903.231.4~2/RELEASE_X86_64 2019-08-15 12:39:25,746:42028(0x700001551000):ZOO_INFO@log_env@774: Client environment:user.name=jenkins 2019-08-15 12:39:25,746:42028(0x700001551000):ZOO_INFO@log_env@782: Client environment:user.home=/Users/jenkins 2019-08-15 12:39:25,746:42028(0x700001551000):ZOO_INFO@log_env@794: Client environment:user.dir=/Users/jenkins/workspace/workspace/mesos/Mesos_CI-build/FLAG/SSL/label/mac/mesos/build 2019-08-15 12:39:25,746:42028(0x700001551000):ZOO_INFO@zookeeper_init@827: Initiating client connection, host=127.0.0.1:51882 sessionTimeout=10000 watcher=0x118f74830 sessionId=0 sessionPasswd=<null> context=0x7fce47dbb090 flags=0 I0815 12:39:25.746644 23425024 zookeeper.cpp:262] A new leading master (UPID=@0.152.150.129:10001) is detected 2019-08-15 12:39:25,747:42028(0x700002207000):ZOO_INFO@check_events@1764: initiated connection to server [127.0.0.1:51882] 2019-08-15 12:39:25,748:42028(0x700002207000):ZOO_INFO@check_events@1811: session establishment complete on server [127.0.0.1:51882], sessionId=0x16c96cac0940003, negotiated timeout=10000 I0815 12:39:25.748719 26107904 group.cpp:341] Group process (zookeeper-group(28)@10.0.49.4:50979) connected to ZooKeeper I0815 12:39:25.748772 26107904 group.cpp:831] Syncing group operations: queue size (joins, cancels, datas) = (0, 0, 0) I0815 12:39:25.748788 26107904 group.cpp:419] Trying to create path '/mesos' in ZooKeeper I0815 12:39:25.750473 25571328 detector.cpp:152] Detected a new leader: (id='1') I0815 12:39:25.750689 23425024 group.cpp:700] Trying to get '/mesos/json.info_0000000001' in ZooKeeper I0815 12:39:25.751610 26107904 zookeeper.cpp:262] A new leading master (UPID=@0.152.150.129:10001) is detected 2019-08-15 12:39:34,146:42028(0x700002f34000):ZOO_WARN@zookeeper_interest@1597: Exceeded deadline by 5071ms 2019-08-15 12:39:34,146:42028(0x700002f34000):ZOO_INFO@check_events@1764: initiated connection to server [127.0.0.1:51882] 2019-08-15 12:39:34,147:42028(0x700002f34000):ZOO_ERROR@handle_socket_error_msg@1800: Socket [127.0.0.1:51882] zk retcode=-112, errno=70(Stale NFS file handle): sessionId=0x16c96cac0940002 has expired. I0815 12:39:34.147333 22351872 group.cpp:511] ZooKeeper session expired I0815 12:39:34.147455 25034752 detector.cpp:140] The current leader (id=0) is lost I0815 12:39:34.147478 25034752 detector.cpp:152] Detected a new leader: None 2019-08-15 12:39:34,147:42028(0x700001551000):ZOO_INFO@zookeeper_close@2579: Freeing zookeeper resources for sessionId=0x16c96cac0940002 2019-08-15 12:39:34,147:42028(0x700001657000):ZOO_INFO@log_env@753: Client environment:zookeeper.version=zookeeper C client 3.4.8 2019-08-15 12:39:34,147:42028(0x700001657000):ZOO_INFO@log_env@757: Client environment:host.name=Jenkinss-Mac-mini.local 2019-08-15 12:39:34,147:42028(0x700001657000):ZOO_INFO@log_env@764: Client environment:os.name=Darwin 2019-08-15 12:39:34,147:42028(0x700001657000):ZOO_INFO@log_env@765: Client environment:os.arch=18.2.0 2019-08-15 12:39:34,147:42028(0x700001657000):ZOO_INFO@log_env@766: Client environment:os.version=Darwin Kernel Version 18.2.0: Mon Nov 12 20:24:46 PST 2018; root:xnu-4903.231.4~2/RELEASE_X86_64 2019-08-15 12:39:34,147:42028(0x700001657000):ZOO_INFO@log_env@774: Client environment:user.name=jenkins 2019-08-15 12:39:34,147:42028(0x700001657000):ZOO_INFO@log_env@782: Client environment:user.home=/Users/jenkins 2019-08-15 12:39:34,147:42028(0x700001657000):ZOO_INFO@log_env@794: Client environment:user.dir=/Users/jenkins/workspace/workspace/mesos/Mesos_CI-build/FLAG/SSL/label/mac/mesos/build 2019-08-15 12:39:34,147:42028(0x700001657000):ZOO_INFO@zookeeper_init@827: Initiating client connection, host=127.0.0.1:51882 sessionTimeout=10000 watcher=0x118f74830 sessionId=0 sessionPasswd=<null> context=0x7fce4a82c1b0 flags=0 2019-08-15 12:39:34,148:42028(0x700002e2e000):ZOO_WARN@zookeeper_interest@1597: Exceeded deadline by 5069ms 2019-08-15 12:39:34,148:42028(0x700002e2e000):ZOO_ERROR@handle_socket_error_msg@1702: Socket [127.0.0.1:51882] zk retcode=-7, errno=60(Operation timed out): connection to 127.0.0.1:51882 timed out (exceeded timeout by 1737ms) 2019-08-15 12:39:34,148:42028(0x700002e2e000):ZOO_WARN@zookeeper_interest@1597: Exceeded deadline by 5069ms 2019-08-15 12:39:34,148:42028(0x70000299f000):ZOO_INFO@check_events@1764: initiated connection to server [127.0.0.1:51882] I0815 12:39:34.148876 23425024 group.cpp:452] Lost connection to ZooKeeper, attempting to reconnect ... 2019-08-15 12:39:34,153:42028(0x700002207000):ZOO_WARN@zookeeper_interest@1597: Exceeded deadline by 5069ms 2019-08-15 12:39:34,153:42028(0x700002207000):ZOO_ERROR@handle_socket_error_msg@1702: Socket [127.0.0.1:51882] zk retcode=-7, errno=60(Operation timed out): connection to 127.0.0.1:51882 timed out (exceeded timeout by 1737ms) 2019-08-15 12:39:34,153:42028(0x700002207000):ZOO_WARN@zookeeper_interest@1597: Exceeded deadline by 5069ms I0815 12:39:34.153897 23961600 group.cpp:452] Lost connection to ZooKeeper, attempting to reconnect ... 2019-08-15 12:39:36,279:42028(0x70000299f000):ZOO_INFO@check_events@1811: session establishment complete on server [127.0.0.1:51882], sessionId=0x16c96cac0940004, negotiated timeout=10000 I0815 12:39:36.279836 23961600 group.cpp:341] Group process (zookeeper-group(30)@10.0.49.4:50979) connected to ZooKeeper I0815 12:39:36.279881 23961600 group.cpp:831] Syncing group operations: queue size (joins, cancels, datas) = (0, 0, 0) I0815 12:39:36.279923 23961600 group.cpp:419] Trying to create path '/mesos' in ZooKeeper 2019-08-15 12:39:38,308:42028(0x700002207000):ZOO_WARN@zookeeper_interest@1597: Exceeded deadline by 9224ms 2019-08-15 12:39:38,308:42028(0x700002e2e000):ZOO_WARN@zookeeper_interest@1597: Exceeded deadline by 9229ms 2019-08-15 12:39:38,309:42028(0x700002e2e000):ZOO_INFO@check_events@1764: initiated connection to server [127.0.0.1:51882] 2019-08-15 12:39:38,309:42028(0x700002207000):ZOO_INFO@check_events@1764: initiated connection to server [127.0.0.1:51882] 2019-08-15 12:39:38,310:42028(0x700002e2e000):ZOO_ERROR@handle_socket_error_msg@1800: Socket [127.0.0.1:51882] zk retcode=-112, errno=70(Stale NFS file handle): sessionId=0x16c96cac0940001 has expired. I0815 12:39:38.310292 22888448 group.cpp:511] ZooKeeper session expired I0815 12:39:38.310372 25571328 detector.cpp:140] The current leader (id=1) is lost I0815 12:39:38.310400 25571328 detector.cpp:152] Detected a new leader: None I0815 12:39:38.310441 24498176 contender.cpp:217] Membership cancelled: 1 2019-08-15 12:39:38,310:42028(0x7000015d4000):ZOO_INFO@zookeeper_close@2579: Freeing zookeeper resources for sessionId=0x16c96cac0940001 2019-08-15 12:39:38,310:42028(0x700002207000):ZOO_ERROR@handle_socket_error_msg@1800: Socket [127.0.0.1:51882] zk retcode=-112, errno=70(Stale NFS file handle): sessionId=0x16c96cac0940003 has expired. 2019-08-15 12:39:38,310:42028(0x7000016da000):ZOO_INFO@log_env@753: Client environment:zookeeper.version=zookeeper C client 3.4.8 2019-08-15 12:39:38,310:42028(0x7000016da000):ZOO_INFO@log_env@757: Client environment:host.name=Jenkinss-Mac-mini.local 2019-08-15 12:39:38,310:42028(0x7000016da000):ZOO_INFO@log_env@764: Client environment:os.name=Darwin 2019-08-15 12:39:38,310:42028(0x7000016da000):ZOO_INFO@log_env@765: Client environment:os.arch=18.2.0 2019-08-15 12:39:38,310:42028(0x7000016da000):ZOO_INFO@log_env@766: Client environment:os.version=Darwin Kernel Version 18.2.0: Mon Nov 12 20:24:46 PST 2018; root:xnu-4903.231.4~2/RELEASE_X86_64 2019-08-15 12:39:38,310:42028(0x7000016da000):ZOO_INFO@log_env@774: Client environment:user.name=jenkins 2019-08-15 12:39:38,310:42028(0x7000016da000):ZOO_INFO@log_env@782: Client environment:user.home=/Users/jenkins 2019-08-15 12:39:38,310:42028(0x7000016da000):ZOO_INFO@log_env@794: Client environment:user.dir=/Users/jenkins/workspace/workspace/mesos/Mesos_CI-build/FLAG/SSL/label/mac/mesos/build 2019-08-15 12:39:38,310:42028(0x7000016da000):ZOO_INFO@zookeeper_init@827: Initiating client connection, host=127.0.0.1:51882 sessionTimeout=10000 watcher=0x118f74830 sessionId=0 sessionPasswd=<null> context=0x7fce47f77f40 flags=0 I0815 12:39:38.311100 24498176 group.cpp:511] ZooKeeper session expired I0815 12:39:38.311193 26107904 detector.cpp:140] The current leader (id=1) is lost I0815 12:39:38.311208 26107904 detector.cpp:152] Detected a new leader: None 2019-08-15 12:39:38,311:42028(0x70000175d000):ZOO_INFO@zookeeper_close@2579: Freeing zookeeper resources for sessionId=0x16c96cac0940003 2019-08-15 12:39:38,311:42028(0x7000018e6000):ZOO_INFO@log_env@753: Client environment:zookeeper.version=zookeeper C client 3.4.8 2019-08-15 12:39:38,311:42028(0x7000018e6000):ZOO_INFO@log_env@757: Client environment:host.name=Jenkinss-Mac-mini.local 2019-08-15 12:39:38,311:42028(0x7000018e6000):ZOO_INFO@log_env@764: Client environment:os.name=Darwin 2019-08-15 12:39:38,311:42028(0x7000018e6000):ZOO_INFO@log_env@765: Client environment:os.arch=18.2.0 2019-08-15 12:39:38,311:42028(0x7000018e6000):ZOO_INFO@log_env@766: Client environment:os.version=Darwin Kernel Version 18.2.0: Mon Nov 12 20:24:46 PST 2018; root:xnu-4903.231.4~2/RELEASE_X86_64 2019-08-15 12:39:38,311:42028(0x7000018e6000):ZOO_INFO@log_env@774: Client environment:user.name=jenkins 2019-08-15 12:39:38,311:42028(0x700002e2e000):ZOO_INFO@check_events@1764: initiated connection to server [127.0.0.1:51882] 2019-08-15 12:39:38,311:42028(0x7000018e6000):ZOO_INFO@log_env@782: Client environment:user.home=/Users/jenkins 2019-08-15 12:39:38,311:42028(0x7000018e6000):ZOO_INFO@log_env@794: Client environment:user.dir=/Users/jenkins/workspace/workspace/mesos/Mesos_CI-build/FLAG/SSL/label/mac/mesos/build 2019-08-15 12:39:38,311:42028(0x7000018e6000):ZOO_INFO@zookeeper_init@827: Initiating client connection, host=127.0.0.1:51882 sessionTimeout=10000 watcher=0x118f74830 sessionId=0 sessionPasswd=<null> context=0x7fce4925daf0 flags=0 2019-08-15 12:39:38,312:42028(0x700002207000):ZOO_INFO@check_events@1764: initiated connection to server [127.0.0.1:51882] 2019-08-15 12:39:38,312:42028(0x700002e2e000):ZOO_INFO@check_events@1811: session establishment complete on server [127.0.0.1:51882], sessionId=0x16c96cac0940005, negotiated timeout=10000 I0815 12:39:38.312937 23961600 group.cpp:341] Group process (zookeeper-group(29)@10.0.49.4:50979) connected to ZooKeeper I0815 12:39:38.312975 23961600 group.cpp:831] Syncing group operations: queue size (joins, cancels, datas) = (0, 0, 0) I0815 12:39:38.312990 23961600 group.cpp:419] Trying to create path '/mesos' in ZooKeeper 2019-08-15 12:39:38,313:42028(0x700002207000):ZOO_INFO@check_events@1811: session establishment complete on server [127.0.0.1:51882], sessionId=0x16c96cac0940006, negotiated timeout=10000 I0815 12:39:38.313853 24498176 group.cpp:341] Group process (zookeeper-group(28)@10.0.49.4:50979) connected to ZooKeeper I0815 12:39:38.313920 24498176 group.cpp:831] Syncing group operations: queue size (joins, cancels, datas) = (0, 0, 0) I0815 12:39:38.313961 24498176 group.cpp:419] Trying to create path '/mesos' in ZooKeeper 2019-08-15 12:39:40,442:42028(0x70000299f000):ZOO_WARN@zookeeper_interest@1597: Exceeded deadline by 828ms ../../src/tests/master_contender_detector_tests.cpp:872: Failure Failed to wait 15secs for detected 2019-08-15 12:39:49,153:42028(0x1161f75c0):ZOO_INFO@zookeeper_close@2562: Closing zookeeper sessionId=0x16c96cac0940004 to [127.0.0.1:51882] I0815 12:39:49.154264 371160512 contender.cpp:207] Now cancelling the membership: 1 2019-08-15 12:39:49,154:42028(0x1161f75c0):ZOO_INFO@zookeeper_close@2562: Closing zookeeper sessionId=0x16c96cac0940005 to [127.0.0.1:51882] I0815 12:39:49.154896 371160512 contender.cpp:207] Now cancelling the membership: 0 2019-08-15 12:39:49,155:42028(0x700001863000):ZOO_INFO@zookeeper_close@2562: Closing zookeeper sessionId=0x16c96cac0940006 to [127.0.0.1:51882] I0815 12:39:49.155510 371160512 zookeeper_test_server.cpp:116] Shutting down ZooKeeperTestServer on port 51882 [ FAILED ] ZooKeeperMasterContenderDetectorTest.MasterDetectorExpireSlaveZKSessionNewMaster (23443 ms) {code} Reporter: Andrei Sekretenko -- This message was sent by Atlassian JIRA (v7.6.14#76016)