SlaveRecoveryTest/0.KillTask looks like the test did not wait for the executor to re-register before advancing the clock. Will push a small fix.
SlaveRecoveryTest/0.MultipleSlaves looks like the sleep in the command executor <https://github.com/apache/mesos/blob/0.19.1/src/launcher/executor.cpp#L324> was not enough time for the TASK_KILLED to be sent to the slave. I've seen this in two tests now so it seems like the 1 second sleep might not be enough for the CI machines. On Tue, Jul 29, 2014 at 6:45 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See < > https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui/2283/changes > > > > Changes: > > [dhamon] Converted bool returns to Try<Nothing> in stout/os.hpp. > > [dhamon] Mesos converted to use Try<Nothing> returns from stout/os.hpp. > > [bmahler] Cleaned up TODO comments for ZK file:// URL support. > > [niklas] Task health status change notifications > > [bmahler] Fixed a flaky slave recovery test. > > [bmahler] Cleaned up the flag help documentation. > > ------------------------------------------ > [...truncated 55276 lines...] > I0730 01:45:50.575980 21067 recover.cpp:451] Replica is in EMPTY status > I0730 01:45:50.576040 21067 registrar.cpp:313] Recovering registrar > I0730 01:45:50.576530 21067 replica.cpp:638] Replica in EMPTY status > received a broadcasted recover request > I0730 01:45:50.576594 21067 recover.cpp:188] Received a recover response > from a replica in EMPTY status > I0730 01:45:50.576704 21067 recover.cpp:542] Updating replica status to > STARTING > I0730 01:45:50.589684 21067 leveldb.cpp:306] Persisting metadata (8 bytes) > to leveldb took 12.903968ms > I0730 01:45:50.589740 21067 replica.cpp:320] Persisted replica status to > STARTING > I0730 01:45:50.589856 21067 recover.cpp:451] Replica is in STARTING status > I0730 01:45:50.590235 21067 replica.cpp:638] Replica in STARTING status > received a broadcasted recover request > I0730 01:45:50.590301 21067 recover.cpp:188] Received a recover response > from a replica in STARTING status > I0730 01:45:50.590409 21067 recover.cpp:542] Updating replica status to > VOTING > I0730 01:45:50.613689 21067 leveldb.cpp:306] Persisting metadata (8 bytes) > to leveldb took 23.214235ms > I0730 01:45:50.613843 21067 replica.cpp:320] Persisted replica status to > VOTING > I0730 01:45:50.613976 21067 recover.cpp:556] Successfully joined the Paxos > group > I0730 01:45:50.614120 21067 recover.cpp:440] Recover process terminated > I0730 01:45:50.614296 21047 log.cpp:656] Attempting to start the writer > I0730 01:45:50.614717 21047 replica.cpp:474] Replica received implicit > promise request with proposal 1 > I0730 01:45:50.629683 21047 leveldb.cpp:306] Persisting metadata (8 bytes) > to leveldb took 14.941262ms > I0730 01:45:50.629734 21047 replica.cpp:342] Persisted promised to 1 > I0730 01:45:50.629991 21047 coordinator.cpp:230] Coordinator attemping to > fill missing position > I0730 01:45:50.630377 21047 replica.cpp:375] Replica received explicit > promise request for position 0 with proposal 2 > I0730 01:45:50.645654 21047 leveldb.cpp:343] Persisting action (8 bytes) > to leveldb took 15.245725ms > I0730 01:45:50.645709 21047 replica.cpp:676] Persisted action at 0 > I0730 01:45:50.646080 21047 replica.cpp:508] Replica received write > request for position 0 > I0730 01:45:50.646106 21047 leveldb.cpp:438] Reading position from leveldb > took 14660ns > I0730 01:45:50.665685 21047 leveldb.cpp:343] Persisting action (14 bytes) > to leveldb took 19.555587ms > I0730 01:45:50.665740 21047 replica.cpp:676] Persisted action at 0 > I0730 01:45:50.665961 21047 replica.cpp:655] Replica received learned > notice for position 0 > I0730 01:45:50.681684 21047 leveldb.cpp:343] Persisting action (16 bytes) > to leveldb took 15.693681ms > I0730 01:45:50.681733 21047 replica.cpp:676] Persisted action at 0 > I0730 01:45:50.681743 21047 replica.cpp:661] Replica learned NOP action at > position 0 > I0730 01:45:50.681982 21047 log.cpp:672] Writer started with ending > position 0 > I0730 01:45:50.682251 21047 leveldb.cpp:438] Reading position from leveldb > took 17318ns > I0730 01:45:50.683776 21047 registrar.cpp:346] Successfully fetched the > registry (0B) > I0730 01:45:50.683795 21047 registrar.cpp:422] Attempting to update the > 'registry' > I0730 01:45:50.685314 21047 log.cpp:680] Attempting to append 138 bytes to > the log > I0730 01:45:50.685358 21047 coordinator.cpp:340] Coordinator attempting to > write APPEND action at position 1 > I0730 01:45:50.685586 21047 replica.cpp:508] Replica received write > request for position 1 > I0730 01:45:50.705683 21047 leveldb.cpp:343] Persisting action (157 bytes) > to leveldb took 20.07148ms > I0730 01:45:50.705734 21047 replica.cpp:676] Persisted action at 1 > I0730 01:45:50.706009 21047 replica.cpp:655] Replica received learned > notice for position 1 > I0730 01:45:50.725682 21047 leveldb.cpp:343] Persisting action (159 bytes) > to leveldb took 19.646881ms > I0730 01:45:50.725733 21047 replica.cpp:676] Persisted action at 1 > I0730 01:45:50.725744 21047 replica.cpp:661] Replica learned APPEND action > at position 1 > I0730 01:45:50.726102 21047 registrar.cpp:479] Successfully updated > 'registry' > I0730 01:45:50.726141 21047 registrar.cpp:372] Successfully recovered > registrar > I0730 01:45:50.726182 21047 log.cpp:699] Attempting to truncate the log to > 1 > I0730 01:45:50.726256 21047 master.cpp:987] Recovered 0 slaves from the > Registry (100B) ; allowing 10mins for slaves to re-register > I0730 01:45:50.726294 21047 coordinator.cpp:340] Coordinator attempting to > write TRUNCATE action at position 2 > I0730 01:45:50.726553 21047 replica.cpp:508] Replica received write > request for position 2 > I0730 01:45:50.745668 21047 leveldb.cpp:343] Persisting action (16 bytes) > to leveldb took 19.095229ms > I0730 01:45:50.745703 21047 replica.cpp:676] Persisted action at 2 > I0730 01:45:50.745935 21047 replica.cpp:655] Replica received learned > notice for position 2 > I0730 01:45:50.759333 21047 leveldb.cpp:343] Persisting action (18 bytes) > to leveldb took 13.382009ms > I0730 01:45:50.759376 21047 leveldb.cpp:401] Deleting ~1 keys from leveldb > took 18643ns > I0730 01:45:50.759385 21047 replica.cpp:676] Persisted action at 2 > I0730 01:45:50.759394 21047 replica.cpp:661] Replica learned TRUNCATE > action at position 2 > I0730 01:45:50.769793 21060 slave.cpp:169] Slave started on 196)@ > 140.211.11.27:56984 > I0730 01:45:50.769820 21060 credentials.hpp:84] Loading credential for > authentication from > '/tmp/MultipleExecutorsTest_ExecutorInfoDiffersOnSameSlave_3GakdP/credential' > I0730 01:45:50.769920 21060 slave.cpp:267] Slave using credential for: > test-principal > I0730 01:45:50.770030 21060 slave.cpp:280] Slave resources: cpus(*):2; > mem(*):1024; disk(*):1024; ports(*):[31000-32000] > I0730 01:45:50.771483 20297 sched.cpp:139] Version: 0.20.0 > I0730 01:45:50.771796 21054 sched.cpp:235] New master detected at > master@140.211.11.27:56984 > I0730 01:45:50.771821 21054 sched.cpp:285] Authenticating with master > master@140.211.11.27:56984 > I0730 01:45:50.771909 21054 authenticatee.hpp:128] Creating new client > SASL connection > I0730 01:45:50.772047 21054 master.cpp:3504] Authenticating > scheduler-f1390c07-a5e1-4562-b565-7f44c02b35cf@140.211.11.27:56984 > I0730 01:45:50.772128 21054 authenticator.hpp:156] Creating new server > SASL connection > I0730 01:45:50.772212 21054 authenticatee.hpp:219] Received SASL > authentication mechanisms: CRAM-MD5 > I0730 01:45:50.772228 21054 authenticatee.hpp:245] Attempting to > authenticate with mechanism 'CRAM-MD5' > I0730 01:45:50.772251 21054 authenticator.hpp:262] Received SASL > authentication start > I0730 01:45:50.772286 21054 authenticator.hpp:384] Authentication requires > more steps > I0730 01:45:50.772310 21054 authenticatee.hpp:265] Received SASL > authentication step > I0730 01:45:50.772341 21054 authenticator.hpp:290] Received SASL > authentication step > I0730 01:45:50.772356 21054 auxprop.cpp:81] Request to lookup properties > for user: 'test-principal' realm: 'hemera.apache.org' server FQDN: ' > hemera.apache.org' SASL_AUXPROP_VERIFY_AGAINST_HASH: false > SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false > I0730 01:45:50.772362 21054 auxprop.cpp:153] Looking up auxiliary property > '*userPassword' > I0730 01:45:50.772372 21054 auxprop.cpp:153] Looking up auxiliary property > '*cmusaslsecretCRAM-MD5' > I0730 01:45:50.772382 21054 auxprop.cpp:81] Request to lookup properties > for user: 'test-principal' realm: 'hemera.apache.org' server FQDN: ' > hemera.apache.org' SASL_AUXPROP_VERIFY_AGAINST_HASH: false > SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true > I0730 01:45:50.772387 21054 auxprop.cpp:103] Skipping auxiliary property > '*userPassword' since SASL_AUXPROP_AUTHZID == true > I0730 01:45:50.772392 21054 auxprop.cpp:103] Skipping auxiliary property > '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true > I0730 01:45:50.772403 21054 authenticator.hpp:376] Authentication success > I0730 01:45:50.772428 21054 authenticatee.hpp:305] Authentication success > I0730 01:45:50.772447 21054 master.cpp:3544] Successfully authenticated > principal 'test-principal' at > scheduler-f1390c07-a5e1-4562-b565-7f44c02b35cf@140.211.11.27:56984 > I0730 01:45:50.772512 21054 sched.cpp:359] Successfully authenticated with > master master@140.211.11.27:56984 > I0730 01:45:50.772522 21054 sched.cpp:478] Sending registration request to > master@140.211.11.27:56984 > I0730 01:45:50.772570 21054 master.cpp:1248] Received registration request > from scheduler-f1390c07-a5e1-4562-b565-7f44c02b35cf@140.211.11.27:56984 > I0730 01:45:50.772588 21054 master.cpp:1208] Authorizing framework > principal 'test-principal' to receive offers for role '*' > I0730 01:45:50.772685 21054 master.cpp:1307] Registering framework > 20140730-014550-453759884-56984-20297-0000 at > scheduler-f1390c07-a5e1-4562-b565-7f44c02b35cf@140.211.11.27:56984 > I0730 01:45:50.772768 21054 sched.cpp:409] Framework registered with > 20140730-014550-453759884-56984-20297-0000 > I0730 01:45:50.772786 21054 sched.cpp:423] Scheduler::registered took > 9142ns > I0730 01:45:50.772819 21054 hierarchical_allocator_process.hpp:331] Added > framework 20140730-014550-453759884-56984-20297-0000 > I0730 01:45:50.772826 21054 hierarchical_allocator_process.hpp:724] No > resources available to allocate! > I0730 01:45:50.772831 21054 hierarchical_allocator_process.hpp:686] > Performed allocation for 0 slaves in 5748ns > I0730 01:45:50.772984 21060 slave.cpp:325] Slave hostname: > hemera.apache.org > I0730 01:45:50.772997 21060 slave.cpp:326] Slave checkpoint: false > I0730 01:45:50.773510 21060 state.cpp:33] Recovering state from > '/tmp/MultipleExecutorsTest_ExecutorInfoDiffersOnSameSlave_3GakdP/meta' > I0730 01:45:50.773612 21060 status_update_manager.cpp:193] Recovering > status update manager > I0730 01:45:50.777725 21060 slave.cpp:3128] Finished recovery > I0730 01:45:50.777956 21060 slave.cpp:601] New master detected at > master@140.211.11.27:56984 > I0730 01:45:50.777978 21060 slave.cpp:677] Authenticating with master > master@140.211.11.27:56984 > I0730 01:45:50.778020 21060 slave.cpp:650] Detecting new master > I0730 01:45:50.778059 21060 status_update_manager.cpp:167] New master > detected at master@140.211.11.27:56984 > I0730 01:45:50.778091 21060 authenticatee.hpp:128] Creating new client > SASL connection > I0730 01:45:50.778219 21060 master.cpp:3504] Authenticating slave(196)@ > 140.211.11.27:56984 > I0730 01:45:50.778297 21060 authenticator.hpp:156] Creating new server > SASL connection > I0730 01:45:50.778384 21060 authenticatee.hpp:219] Received SASL > authentication mechanisms: CRAM-MD5 > I0730 01:45:50.778400 21060 authenticatee.hpp:245] Attempting to > authenticate with mechanism 'CRAM-MD5' > I0730 01:45:50.778425 21060 authenticator.hpp:262] Received SASL > authentication start > I0730 01:45:50.778457 21060 authenticator.hpp:384] Authentication requires > more steps > I0730 01:45:50.778489 21060 authenticatee.hpp:265] Received SASL > authentication step > I0730 01:45:50.778524 21060 authenticator.hpp:290] Received SASL > authentication step > I0730 01:45:50.778537 21060 auxprop.cpp:81] Request to lookup properties > for user: 'test-principal' realm: 'hemera.apache.org' server FQDN: ' > hemera.apache.org' SASL_AUXPROP_VERIFY_AGAINST_HASH: false > SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false > I0730 01:45:50.778544 21060 auxprop.cpp:153] Looking up auxiliary property > '*userPassword' > I0730 01:45:50.778554 21060 auxprop.cpp:153] Looking up auxiliary property > '*cmusaslsecretCRAM-MD5' > I0730 01:45:50.778563 21060 auxprop.cpp:81] Request to lookup properties > for user: 'test-principal' realm: 'hemera.apache.org' server FQDN: ' > hemera.apache.org' SASL_AUXPROP_VERIFY_AGAINST_HASH: false > SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true > I0730 01:45:50.778568 21060 auxprop.cpp:103] Skipping auxiliary property > '*userPassword' since SASL_AUXPROP_AUTHZID == true > I0730 01:45:50.778573 21060 auxprop.cpp:103] Skipping auxiliary property > '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true > I0730 01:45:50.778584 21060 authenticator.hpp:376] Authentication success > I0730 01:45:50.778610 21060 authenticatee.hpp:305] Authentication success > I0730 01:45:50.778633 21060 master.cpp:3544] Successfully authenticated > principal 'test-principal' at slave(196)@140.211.11.27:56984 > I0730 01:45:50.778698 21060 slave.cpp:734] Successfully authenticated with > master master@140.211.11.27:56984 > I0730 01:45:50.778740 21060 slave.cpp:972] Will retry registration in > 4.823399ms if necessary > I0730 01:45:50.778812 21060 master.cpp:2762] Registering slave at > slave(196)@140.211.11.27:56984 (hemera.apache.org) with id > 20140730-014550-453759884-56984-20297-0 > I0730 01:45:50.778924 21060 registrar.cpp:422] Attempting to update the > 'registry' > I0730 01:45:50.780408 21060 log.cpp:680] Attempting to append 332 bytes to > the log > I0730 01:45:50.780468 21060 coordinator.cpp:340] Coordinator attempting to > write APPEND action at position 3 > I0730 01:45:50.780742 21060 replica.cpp:508] Replica received write > request for position 3 > I0730 01:45:50.789727 21052 slave.cpp:972] Will retry registration in > 4.307262ms if necessary > I0730 01:45:50.789796 21052 master.cpp:2750] Ignoring register slave > message from slave(196)@140.211.11.27:56984 (hemera.apache.org) as > admission is already in progress > I0730 01:45:50.797801 21056 slave.cpp:972] Will retry registration in > 59.396428ms if necessary > I0730 01:45:50.797901 21056 master.cpp:2750] Ignoring register slave > message from slave(196)@140.211.11.27:56984 (hemera.apache.org) as > admission is already in progress > I0730 01:45:50.829689 21060 leveldb.cpp:343] Persisting action (351 bytes) > to leveldb took 48.916641ms > I0730 01:45:50.829848 21060 replica.cpp:676] Persisted action at 3 > I0730 01:45:50.830270 21056 replica.cpp:655] Replica received learned > notice for position 3 > I0730 01:45:50.844269 21056 leveldb.cpp:343] Persisting action (353 bytes) > to leveldb took 13.969906ms > I0730 01:45:50.844316 21056 replica.cpp:676] Persisted action at 3 > I0730 01:45:50.844327 21056 replica.cpp:661] Replica learned APPEND action > at position 3 > I0730 01:45:50.844794 21056 registrar.cpp:479] Successfully updated > 'registry' > I0730 01:45:50.844884 21056 log.cpp:699] Attempting to truncate the log to > 3 > I0730 01:45:50.844950 21056 master.cpp:2802] Registered slave > 20140730-014550-453759884-56984-20297-0 at slave(196)@140.211.11.27:56984 > (hemera.apache.org) > I0730 01:45:50.844964 21056 master.cpp:3972] Adding slave > 20140730-014550-453759884-56984-20297-0 at slave(196)@140.211.11.27:56984 > (hemera.apache.org) with cpus(*):2; mem(*):1024; disk(*):1024; > ports(*):[31000-32000] > I0730 01:45:50.845087 21056 coordinator.cpp:340] Coordinator attempting to > write TRUNCATE action at position 4 > I0730 01:45:50.845166 21056 slave.cpp:768] Registered with master > master@140.211.11.27:56984; given slave ID > 20140730-014550-453759884-56984-20297-0 > I0730 01:45:50.845237 21056 hierarchical_allocator_process.hpp:444] Added > slave 20140730-014550-453759884-56984-20297-0 (hemera.apache.org) with > cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] (and > cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] available) > I0730 01:45:50.845298 21056 hierarchical_allocator_process.hpp:750] > Offering cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on > slave 20140730-014550-453759884-56984-20297-0 to framework > 20140730-014550-453759884-56984-20297-0000 > I0730 01:45:50.845402 21056 hierarchical_allocator_process.hpp:706] > Performed allocation for slave 20140730-014550-453759884-56984-20297-0 in > 134270ns > I0730 01:45:50.845455 21056 slave.cpp:2325] Received ping from > slave-observer(165)@140.211.11.27:56984 > I0730 01:45:50.845512 21056 master.hpp:816] Adding offer > 20140730-014550-453759884-56984-20297-0 with resources cpus(*):2; > mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave > 20140730-014550-453759884-56984-20297-0 (hemera.apache.org) > I0730 01:45:50.845554 21056 master.cpp:3451] Sending 1 offers to framework > 20140730-014550-453759884-56984-20297-0000 > I0730 01:45:50.845746 21056 sched.cpp:546] Scheduler::resourceOffers took > 31773ns > I0730 01:45:50.846127 21059 replica.cpp:508] Replica received write > request for position 4 > I0730 01:45:50.856356 21059 leveldb.cpp:343] Persisting action (16 bytes) > to leveldb took 10.20412ms > I0730 01:45:50.856395 21059 replica.cpp:676] Persisted action at 4 > I0730 01:45:50.856613 21059 replica.cpp:655] Replica received learned > notice for position 4 > I0730 01:45:50.857946 21043 master.hpp:826] Removing offer > 20140730-014550-453759884-56984-20297-0 with resources cpus(*):2; > mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave > 20140730-014550-453759884-56984-20297-0 (hemera.apache.org) > I0730 01:45:50.858012 21043 master.cpp:2125] Processing reply for offers: > [ 20140730-014550-453759884-56984-20297-0 ] on slave > 20140730-014550-453759884-56984-20297-0 at slave(196)@140.211.11.27:56984 > (hemera.apache.org) for framework > 20140730-014550-453759884-56984-20297-0000 > I0730 01:45:50.858043 21043 master.cpp:2211] Authorizing framework > principal 'test-principal' to launch task 1 as user 'jenkins' > I0730 01:45:50.858552 21043 master.hpp:788] Adding task 1 with resources > cpus(*):1; mem(*):512 on slave 20140730-014550-453759884-56984-20297-0 ( > hemera.apache.org) > I0730 01:45:50.858578 21043 master.cpp:2277] Launching task 1 of framework > 20140730-014550-453759884-56984-20297-0000 with resources cpus(*):1; > mem(*):512 on slave 20140730-014550-453759884-56984-20297-0 at slave(196)@ > 140.211.11.27:56984 (hemera.apache.org) > I0730 01:45:50.859840 21043 master.cpp:3126] Sending status update > TASK_LOST (UUID: e40f0a64-232a-4036-9f3d-d0d76fbf5489) for task 2 of > framework 20140730-014550-453759884-56984-20297-0000 'Task has invalid > ExecutorInfo (existing ExecutorInfo with same ExecutorID is not compatible). > ------------------------------------------------------------ > Existing ExecutorInfo: > executor_id { > value: "default" > } > command { > value: "exit 1" > } > framework_id { > value: "20140730-014550-453759884-56984-20297-0000" > } > > ------------------------------------------------------------ > Task's ExecutorInfo: > executor_id { > value: "default" > } > command { > value: "exit 2" > } > framework_id { > value: "20140730-014550-453759884-56984-20297-0000" > } > > ------------------------------------------------------------ > ' > I0730 01:45:50.860007 21043 slave.cpp:1003] Got assigned task 1 for > framework 20140730-014550-453759884-56984-20297-0000 > I0730 01:45:50.860201 21043 slave.cpp:1113] Launching task 1 for framework > 20140730-014550-453759884-56984-20297-0000 > I0730 01:45:50.860852 21048 hierarchical_allocator_process.hpp:546] > Framework 20140730-014550-453759884-56984-20297-0000 left cpus(*):1; > mem(*):512; disk(*):1024; ports(*):[31000-32000] unused on slave > 20140730-014550-453759884-56984-20297-0 > I0730 01:45:50.860898 21050 sched.cpp:637] Scheduler::statusUpdate took > 20007ns > I0730 01:45:50.860951 21048 hierarchical_allocator_process.hpp:588] > Framework 20140730-014550-453759884-56984-20297-0000 filtered slave > 20140730-014550-453759884-56984-20297-0 for 5secs > I0730 01:45:50.863068 21043 exec.cpp:131] Version: 0.20.0 > I0730 01:45:50.863153 21066 exec.cpp:181] Executor started at: > executor(62)@140.211.11.27:56984 with pid 20297 > I0730 01:45:50.863199 21043 slave.cpp:1223] Queuing task '1' for executor > default of framework '20140730-014550-453759884-56984-20297-0000 > I0730 01:45:50.863251 21043 slave.cpp:562] Successfully attached file > '/tmp/MultipleExecutorsTest_ExecutorInfoDiffersOnSameSlave_3GakdP/slaves/20140730-014550-453759884-56984-20297-0/frameworks/20140730-014550-453759884-56984-20297-0000/executors/default/runs/974ced3f-ea41-4d3a-b2ff-b698de2a04f5' > I0730 01:45:50.863275 21043 slave.cpp:2470] Monitoring executor 'default' > of framework '20140730-014550-453759884-56984-20297-0000' in container > '974ced3f-ea41-4d3a-b2ff-b698de2a04f5' > I0730 01:45:50.863332 21043 slave.cpp:1734] Got registration for executor > 'default' of framework 20140730-014550-453759884-56984-20297-0000 > I0730 01:45:50.863428 21043 slave.cpp:1853] Flushing queued task 1 for > executor 'default' of framework 20140730-014550-453759884-56984-20297-0000 > I0730 01:45:50.863468 21066 exec.cpp:205] Executor registered on slave > 20140730-014550-453759884-56984-20297-0 > I0730 01:45:50.864792 21066 exec.cpp:217] Executor::registered took 14731ns > I0730 01:45:50.864850 21066 exec.cpp:292] Executor asked to run task '1' > I0730 01:45:50.864889 21066 exec.cpp:301] Executor::launchTask took 31367ns > I0730 01:45:50.865082 21056 sched.cpp:747] Stopping framework > '20140730-014550-453759884-56984-20297-0000' > I0730 01:45:50.865114 20297 master.cpp:626] Master terminating > I0730 01:45:50.865159 20297 master.hpp:806] Removing task 1 with resources > cpus(*):1; mem(*):512 on slave 20140730-014550-453759884-56984-20297-0 ( > hemera.apache.org) > W0730 01:45:50.865206 20297 master.cpp:4261] Removing task 1 of framework > 20140730-014550-453759884-56984-20297-0000 and slave > 20140730-014550-453759884-56984-20297-0 in non-terminal state TASK_STAGING > I0730 01:45:50.865272 21056 hierarchical_allocator_process.hpp:635] > Recovered cpus(*):1; mem(*):512 (total allocatable: cpus(*):2; mem(*):1024; > disk(*):1024; ports(*):[31000-32000]) on slave > 20140730-014550-453759884-56984-20297-0 from framework > 20140730-014550-453759884-56984-20297-0000 > I0730 01:45:50.865316 21056 slave.cpp:2332] master@140.211.11.27:56984 > exited > W0730 01:45:50.865327 21056 slave.cpp:2335] Master disconnected! Waiting > for a new master to be elected > I0730 01:45:50.868448 21059 leveldb.cpp:343] Persisting action (18 bytes) > to leveldb took 11.813287ms > I0730 01:45:50.868496 21059 leveldb.cpp:401] Deleting ~2 keys from leveldb > took 29354ns > I0730 01:45:50.868510 21059 replica.cpp:676] Persisted action at 4 > I0730 01:45:50.868518 21059 replica.cpp:661] Replica learned TRUNCATE > action at position 4 > I0730 01:45:50.868931 21054 slave.cpp:2528] Executor 'default' of > framework 20140730-014550-453759884-56984-20297-0000 exited with status 0 > I0730 01:45:50.870251 21054 slave.cpp:2088] Handling status update > TASK_LOST (UUID: eaa81f86-f3a0-4113-90ec-b486bea51c07) for task 1 of > framework 20140730-014550-453759884-56984-20297-0000 from @0.0.0.0:0 > I0730 01:45:50.870280 21054 slave.cpp:3770] Terminating task 1 > I0730 01:45:50.870373 21054 slave.cpp:485] Slave terminating > I0730 01:45:50.870385 21054 slave.cpp:1407] Asked to shut down framework > 20140730-014550-453759884-56984-20297-0000 by @0.0.0.0:0 > I0730 01:45:50.870394 21054 slave.cpp:1432] Shutting down framework > 20140730-014550-453759884-56984-20297-0000 > I0730 01:45:50.870405 21054 slave.cpp:2662] Cleaning up executor 'default' > of framework 20140730-014550-453759884-56984-20297-0000 > I0730 01:45:50.870507 21054 slave.cpp:2737] Cleaning up framework > 20140730-014550-453759884-56984-20297-0000 > I0730 01:45:50.870580 21054 gc.cpp:56] Scheduling > '/tmp/MultipleExecutorsTest_ExecutorInfoDiffersOnSameSlave_3GakdP/slaves/20140730-014550-453759884-56984-20297-0/frameworks/20140730-014550-453759884-56984-20297-0000/executors/default/runs/974ced3f-ea41-4d3a-b2ff-b698de2a04f5' > for gc 6.99998992539259days in the future > I0730 01:45:50.870637 21054 gc.cpp:56] Scheduling > '/tmp/MultipleExecutorsTest_ExecutorInfoDiffersOnSameSlave_3GakdP/slaves/20140730-014550-453759884-56984-20297-0/frameworks/20140730-014550-453759884-56984-20297-0000/executors/default' > for gc 6.99998992483852days in the future > I0730 01:45:50.870669 21054 gc.cpp:56] Scheduling > '/tmp/MultipleExecutorsTest_ExecutorInfoDiffersOnSameSlave_3GakdP/slaves/20140730-014550-453759884-56984-20297-0/frameworks/20140730-014550-453759884-56984-20297-0000' > for gc 6.99998992431704days in the future > [ OK ] MultipleExecutorsTest.ExecutorInfoDiffersOnSameSlave (368 ms) > [----------] 2 tests from MultipleExecutorsTest (809 ms total) > > [----------] 1 test from ZooKeeper > [ RUN ] ZooKeeper.URL > [ OK ] ZooKeeper.URL (0 ms) > [----------] 1 test from ZooKeeper (0 ms total) > > [----------] Global test environment tear-down > [==========] 352 tests from 57 test cases ran. (243846 ms total) > [ PASSED ] 350 tests. > [ FAILED ] 2 tests, listed below: > [ FAILED ] SlaveRecoveryTest/0.KillTask, where TypeParam = > mesos::internal::slave::MesosContainerizer > [ FAILED ] SlaveRecoveryTest/0.MultipleSlaves, where TypeParam = > mesos::internal::slave::MesosContainerizer > > 2 FAILED TESTS > YOU HAVE 3 DISABLED TESTS > > make[3]: *** [check-local] Error 1 > make[3]: Leaving directory > `/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui/build/src' > make[2]: *** [check-am] Error 2 > make[2]: Leaving directory > `/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui/build/src' > make[1]: *** [check] Error 2 > make[1]: Leaving directory > `/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui/build/src' > make: *** [check-recursive] Error 1 > Build step 'Execute shell' marked build as failure >