See <https://builds.apache.org/job/Mesos-Buildbot/BUILDTOOL=cmake,COMPILER=gcc,CONFIGURATION=--verbose%20--disable-libtool-wrappers,ENVIRONMENT=GLOG_v=1%20MESOS_VERBOSE=1,OS=ubuntu%3A14.04,label_exp=(ubuntu)&&(!ubuntu-us1)&&(!ubuntu-eu2)&&(!qnode3)&&(!H23)/4588/display/redirect?page=changes>
Changes: [gregorywmann] Added pause/resume methods to `OfferOperationStatusUpdateManager`. [gregorywmann] Improved the logging in `StatusUpdateManagerProcess`. [gregorywmann] Fixed naming of a variable in `status_update_manager_process.hpp`. [gregorywmann] Made the `StatusUpdateManagerProcess` process ID configurable. [gregorywmann] Made master reconcile known offer operations with agent. [gregorywmann] Avoided returning prematurely in an agent handler. [gregorywmann] Made the agent respond to reconciliation requests for default resources. ------------------------------------------ [...truncated 3.50 MB...] 3: I1213 01:59:22.707033 17450 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' 3: I1213 01:59:22.707191 17450 authenticator.cpp:204] Received SASL authentication start 3: I1213 01:59:22.707276 17450 authenticator.cpp:326] Authentication requires more steps 3: I1213 01:59:22.707468 17450 authenticatee.cpp:259] Received SASL authentication step 3: I1213 01:59:22.707679 17453 authenticator.cpp:232] Received SASL authentication step 3: I1213 01:59:22.707722 17453 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c6667db7a1a3' server FQDN: 'c6667db7a1a3' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 3: I1213 01:59:22.707739 17453 auxprop.cpp:181] Looking up auxiliary property '*userPassword' 3: I1213 01:59:22.707782 17453 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' 3: I1213 01:59:22.707816 17453 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c6667db7a1a3' server FQDN: 'c6667db7a1a3' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 3: I1213 01:59:22.707829 17453 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true 3: I1213 01:59:22.707839 17453 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true 3: I1213 01:59:22.707859 17453 authenticator.cpp:318] Authentication success 3: I1213 01:59:22.708000 17451 authenticatee.cpp:299] Authentication success 3: I1213 01:59:22.708084 17436 master.cpp:8962] Successfully authenticated principal 'test-principal' at [email protected]:35041 3: I1213 01:59:22.708154 17448 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(131)@172.17.0.3:35041 3: I1213 01:59:22.708333 17445 sched.cpp:502] Successfully authenticated with master [email protected]:35041 3: I1213 01:59:22.708353 17445 sched.cpp:824] Sending SUBSCRIBE call to [email protected]:35041 3: I1213 01:59:22.708483 17445 sched.cpp:857] Will retry registration in 1.579740191secs if necessary 3: I1213 01:59:22.708703 17456 master.cpp:2957] Received SUBSCRIBE call for framework 'default' at [email protected]:35041 3: I1213 01:59:22.708777 17456 master.cpp:2274] Authorizing framework principal 'test-principal' to receive offers for roles '{ * }' 3: I1213 01:59:22.709179 17444 state.cpp:66] Recovering state from '/tmp/FaultToleranceTest_SplitBrainMasters_NUBd28/meta' 3: I1213 01:59:22.709300 17455 master.cpp:3037] Subscribing framework default with checkpointing disabled and capabilities [ MULTI_ROLE, RESERVATION_REFINEMENT ] 3: I1213 01:59:22.709481 17455 master.cpp:9153] Adding framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 (default) at [email protected]:35041 with roles { } suppressed 3: I1213 01:59:22.709563 17446 task_status_update_manager.cpp:207] Recovering task status update manager 3: I1213 01:59:22.710019 17454 hierarchical.cpp:297] Added framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.710208 17452 sched.cpp:751] Framework registered with 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.710211 17450 slave.cpp:6747] Finished recovery 3: I1213 01:59:22.710265 17454 hierarchical.cpp:1517] Performed allocation for 0 agents in 62241ns 3: I1213 01:59:22.710301 17452 sched.cpp:765] Scheduler::registered took 52516ns 3: I1213 01:59:22.711381 17441 task_status_update_manager.cpp:181] Pausing sending task status updates 3: I1213 01:59:22.711383 17434 slave.cpp:1033] New master detected at [email protected]:35041 3: I1213 01:59:22.711503 17434 slave.cpp:1088] Detecting new master 3: I1213 01:59:22.712780 17457 slave.cpp:1115] Authenticating with master [email protected]:35041 3: I1213 01:59:22.712847 17457 slave.cpp:1124] Using default CRAM-MD5 authenticatee 3: I1213 01:59:22.713161 17444 authenticatee.cpp:121] Creating new client SASL connection 3: I1213 01:59:22.713503 17442 master.cpp:8932] Authenticating slave(59)@172.17.0.3:35041 3: I1213 01:59:22.713657 17446 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(132)@172.17.0.3:35041 3: I1213 01:59:22.713915 17455 authenticator.cpp:98] Creating new server SASL connection 3: I1213 01:59:22.714170 17449 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 3: I1213 01:59:22.714200 17449 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' 3: I1213 01:59:22.714352 17435 authenticator.cpp:204] Received SASL authentication start 3: I1213 01:59:22.714433 17435 authenticator.cpp:326] Authentication requires more steps 3: I1213 01:59:22.714593 17451 authenticatee.cpp:259] Received SASL authentication step 3: I1213 01:59:22.714794 17438 authenticator.cpp:232] Received SASL authentication step 3: I1213 01:59:22.714846 17438 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c6667db7a1a3' server FQDN: 'c6667db7a1a3' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 3: I1213 01:59:22.714864 17438 auxprop.cpp:181] Looking up auxiliary property '*userPassword' 3: I1213 01:59:22.714916 17438 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' 3: I1213 01:59:22.714963 17438 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c6667db7a1a3' server FQDN: 'c6667db7a1a3' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 3: I1213 01:59:22.714982 17438 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true 3: I1213 01:59:22.714998 17438 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true 3: I1213 01:59:22.715021 17438 authenticator.cpp:318] Authentication success 3: I1213 01:59:22.715116 17454 authenticatee.cpp:299] Authentication success 3: I1213 01:59:22.715314 17439 master.cpp:8962] Successfully authenticated principal 'test-principal' at slave(59)@172.17.0.3:35041 3: I1213 01:59:22.715359 17453 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(132)@172.17.0.3:35041 3: I1213 01:59:22.715528 17452 slave.cpp:1207] Successfully authenticated with master [email protected]:35041 3: I1213 01:59:22.715780 17452 slave.cpp:1684] Will retry registration in 11.134007ms if necessary 3: I1213 01:59:22.715909 17445 master.cpp:6077] Received register agent message from slave(59)@172.17.0.3:35041 (c6667db7a1a3) 3: I1213 01:59:22.715987 17445 master.cpp:3866] Authorizing agent with principal 'test-principal' 3: I1213 01:59:22.716545 17447 master.cpp:6147] Authorized registration of agent at slave(59)@172.17.0.3:35041 (c6667db7a1a3) 3: I1213 01:59:22.716619 17447 master.cpp:6240] Registering agent at slave(59)@172.17.0.3:35041 (c6667db7a1a3) with id 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 3: I1213 01:59:22.717078 17456 registrar.cpp:495] Applied 1 operations in 83166ns; attempting to update the registry 3: I1213 01:59:22.717720 17444 registrar.cpp:552] Successfully updated the registry in 574976ns 3: I1213 01:59:22.717965 17442 master.cpp:6288] Admitted agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 at slave(59)@172.17.0.3:35041 (c6667db7a1a3) 3: I1213 01:59:22.718860 17455 slave.cpp:1253] Registered with master [email protected]:35041; given agent ID 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 3: I1213 01:59:22.718850 17442 master.cpp:6337] Registered agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 at slave(59)@172.17.0.3:35041 (c6667db7a1a3) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] 3: I1213 01:59:22.718971 17451 task_status_update_manager.cpp:188] Resuming sending task status updates 3: I1213 01:59:22.719166 17455 slave.cpp:1273] Checkpointing SlaveInfo to '/tmp/FaultToleranceTest_SplitBrainMasters_NUBd28/meta/slaves/41e86780-fd89-4e82-a8c9-d727332ccca7-S0/slave.info' 3: I1213 01:59:22.719352 17449 hierarchical.cpp:574] Added agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 (c6667db7a1a3) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (allocated: {}) 3: I1213 01:59:22.719642 17455 slave.cpp:1330] Forwarding agent update {"offer_operations":{},"resource_categories":{"oversubscribed":true},"resource_version_uuid":"XU2v9HqtRuqE8Yc4GT7tXA==","slave_id":{"value":"41e86780-fd89-4e82-a8c9-d727332ccca7-S0"}} 3: I1213 01:59:22.719813 17436 master.cpp:7270] Received update of agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 at slave(59)@172.17.0.3:35041 (c6667db7a1a3) with total oversubscribed resources {} 3: I1213 01:59:22.720021 17436 master.cpp:7368] Ignoring update on agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 at slave(59)@172.17.0.3:35041 (c6667db7a1a3) as it reports no changes 3: I1213 01:59:22.721352 17449 hierarchical.cpp:1517] Performed allocation for 1 agents in 1.741825ms 3: I1213 01:59:22.721951 17438 master.cpp:8762] Sending 1 offers to framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 (default) at [email protected]:35041 3: I1213 01:59:22.723577 17439 sched.cpp:921] Scheduler::resourceOffers took 1.076854ms 3: I1213 01:59:22.725183 17440 master.cpp:10683] Removing offer 41e86780-fd89-4e82-a8c9-d727332ccca7-O0 3: I1213 01:59:22.725365 17440 master.cpp:4273] Processing ACCEPT call for offers: [ 41e86780-fd89-4e82-a8c9-d727332ccca7-O0 ] on agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 at slave(59)@172.17.0.3:35041 (c6667db7a1a3) for framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 (default) at [email protected]:35041 3: I1213 01:59:22.725487 17440 master.cpp:3593] Authorizing framework principal 'test-principal' to launch task 0 3: W1213 01:59:22.728109 17452 validation.cpp:1387] Executor 'default' for task '0' uses less CPUs (None) than the minimum required (0.01). Please update your executor, as this will be mandatory in future releases. 3: W1213 01:59:22.728152 17452 validation.cpp:1399] Executor 'default' for task '0' uses less memory (None) than the minimum required (32MB). Please update your executor, as this will be mandatory in future releases. 3: I1213 01:59:22.728672 17452 master.cpp:11438] Adding task 0 with resources cpus(allocated: *):1; mem(allocated: *):512 on agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 at slave(59)@172.17.0.3:35041 (c6667db7a1a3) 3: I1213 01:59:22.728941 17452 master.cpp:5024] Launching task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 (default) at [email protected]:35041 with resources [{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":1.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":512.0},"type":"SCALAR"}] on agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 at slave(59)@172.17.0.3:35041 (c6667db7a1a3) 3: I1213 01:59:22.729624 17450 slave.cpp:1807] Got assigned task '0' for framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.730346 17450 slave.cpp:2077] Authorizing task '0' for framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.730412 17450 slave.cpp:7755] Authorizing framework principal 'test-principal' to launch task 0 3: I1213 01:59:22.730976 17447 hierarchical.cpp:1192] Recovered cpus(allocated: *):1; mem(allocated: *):512; disk(allocated: *):1024; ports(allocated: *):[31000-32000] (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000], allocated: cpus(allocated: *):1; mem(allocated: *):512) on agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 from framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.731099 17447 hierarchical.cpp:1238] Framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 filtered agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 for 5secs 3: I1213 01:59:22.731668 17457 slave.cpp:2471] Launching task '0' for framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.732331 17457 paths.cpp:702] Trying to chown '/tmp/FaultToleranceTest_SplitBrainMasters_NUBd28/slaves/41e86780-fd89-4e82-a8c9-d727332ccca7-S0/frameworks/41e86780-fd89-4e82-a8c9-d727332ccca7-0000/executors/default/runs/363692b1-29de-43ad-8a6a-6a3cec8c170c' to user 'mesos' 3: I1213 01:59:22.732640 17457 slave.cpp:8229] Launching executor 'default' of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 with resources [] in work directory '/tmp/FaultToleranceTest_SplitBrainMasters_NUBd28/slaves/41e86780-fd89-4e82-a8c9-d727332ccca7-S0/frameworks/41e86780-fd89-4e82-a8c9-d727332ccca7-0000/executors/default/runs/363692b1-29de-43ad-8a6a-6a3cec8c170c' 3: I1213 01:59:22.733218 17457 slave.cpp:3023] Launching container 363692b1-29de-43ad-8a6a-6a3cec8c170c for executor 'default' of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.733745 17457 slave.cpp:2557] Queued task '0' for executor 'default' of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.733868 17457 slave.cpp:984] Successfully attached '/tmp/FaultToleranceTest_SplitBrainMasters_NUBd28/slaves/41e86780-fd89-4e82-a8c9-d727332ccca7-S0/frameworks/41e86780-fd89-4e82-a8c9-d727332ccca7-0000/executors/default/runs/363692b1-29de-43ad-8a6a-6a3cec8c170c' to virtual path '/tmp/FaultToleranceTest_SplitBrainMasters_NUBd28/slaves/41e86780-fd89-4e82-a8c9-d727332ccca7-S0/frameworks/41e86780-fd89-4e82-a8c9-d727332ccca7-0000/executors/default/runs/latest' 3: I1213 01:59:22.733930 17457 slave.cpp:984] Successfully attached '/tmp/FaultToleranceTest_SplitBrainMasters_NUBd28/slaves/41e86780-fd89-4e82-a8c9-d727332ccca7-S0/frameworks/41e86780-fd89-4e82-a8c9-d727332ccca7-0000/executors/default/runs/363692b1-29de-43ad-8a6a-6a3cec8c170c' to virtual path '/frameworks/41e86780-fd89-4e82-a8c9-d727332ccca7-0000/executors/default/runs/latest' 3: I1213 01:59:22.733992 17457 slave.cpp:984] Successfully attached '/tmp/FaultToleranceTest_SplitBrainMasters_NUBd28/slaves/41e86780-fd89-4e82-a8c9-d727332ccca7-S0/frameworks/41e86780-fd89-4e82-a8c9-d727332ccca7-0000/executors/default/runs/363692b1-29de-43ad-8a6a-6a3cec8c170c' to virtual path '/tmp/FaultToleranceTest_SplitBrainMasters_NUBd28/slaves/41e86780-fd89-4e82-a8c9-d727332ccca7-S0/frameworks/41e86780-fd89-4e82-a8c9-d727332ccca7-0000/executors/default/runs/363692b1-29de-43ad-8a6a-6a3cec8c170c' 3: W1213 01:59:22.737442 17435 process.cpp:2756] Attempted to spawn already running process [email protected]:35041 3: I1213 01:59:22.737723 17435 exec.cpp:162] Version: 1.5.0 3: I1213 01:59:22.738119 17451 exec.cpp:212] Executor started at: executor(11)@172.17.0.3:35041 with pid 17433 3: I1213 01:59:22.738421 17451 slave.cpp:4298] Got registration for executor 'default' of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 from executor(11)@172.17.0.3:35041 3: I1213 01:59:22.738991 17436 exec.cpp:237] Executor registered on agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 3: I1213 01:59:22.739066 17436 exec.cpp:249] Executor::registered took 37699ns 3: I1213 01:59:22.740169 17453 slave.cpp:2762] Sending queued task '0' to executor 'default' of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 at executor(11)@172.17.0.3:35041 3: I1213 01:59:22.740623 17440 exec.cpp:331] Executor asked to run task '0' 3: I1213 01:59:22.740730 17440 exec.cpp:340] Executor::launchTask took 80521ns 3: I1213 01:59:22.740847 17440 exec.cpp:571] Executor sending status update TASK_RUNNING (Status UUID: 66236c8b-0c0d-49c3-9d2c-883def63a48c) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.741174 17440 slave.cpp:4755] Handling status update TASK_RUNNING (Status UUID: 66236c8b-0c0d-49c3-9d2c-883def63a48c) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 from executor(11)@172.17.0.3:35041 3: I1213 01:59:22.742163 17452 task_status_update_manager.cpp:328] Received task status update TASK_RUNNING (Status UUID: 66236c8b-0c0d-49c3-9d2c-883def63a48c) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.742236 17452 task_status_update_manager.cpp:507] Creating StatusUpdate stream for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.742905 17452 task_status_update_manager.cpp:383] Forwarding task status update TASK_RUNNING (Status UUID: 66236c8b-0c0d-49c3-9d2c-883def63a48c) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 to the agent 3: I1213 01:59:22.743185 17437 slave.cpp:5238] Forwarding the update TASK_RUNNING (Status UUID: 66236c8b-0c0d-49c3-9d2c-883def63a48c) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 to [email protected]:35041 3: I1213 01:59:22.743460 17437 slave.cpp:5131] Task status update manager successfully handled status update TASK_RUNNING (Status UUID: 66236c8b-0c0d-49c3-9d2c-883def63a48c) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.743517 17437 slave.cpp:5147] Sending acknowledgement for status update TASK_RUNNING (Status UUID: 66236c8b-0c0d-49c3-9d2c-883def63a48c) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 to executor(11)@172.17.0.3:35041 3: I1213 01:59:22.743649 17450 master.cpp:7855] Status update TASK_RUNNING (Status UUID: 66236c8b-0c0d-49c3-9d2c-883def63a48c) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 from agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 at slave(59)@172.17.0.3:35041 (c6667db7a1a3) 3: I1213 01:59:22.743706 17434 exec.cpp:388] Executor received status update acknowledgement 66236c8b-0c0d-49c3-9d2c-883def63a48c for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.743718 17450 master.cpp:7911] Forwarding status update TASK_RUNNING (Status UUID: 66236c8b-0c0d-49c3-9d2c-883def63a48c) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.743952 17450 master.cpp:10158] Updating the state of task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 (latest state: TASK_RUNNING, status update state: TASK_RUNNING) 3: I1213 01:59:22.744365 17441 sched.cpp:1029] Scheduler::statusUpdate took 141993ns 3: I1213 01:59:22.744879 17444 master.cpp:5842] Processing ACKNOWLEDGE call 66236c8b-0c0d-49c3-9d2c-883def63a48c for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 (default) at [email protected]:35041 on agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 3: I1213 01:59:22.745214 17444 sched.cpp:983] Ignoring status update message because it was sent from '[email protected]:50' instead of the leading master '[email protected]:35041' 3: I1213 01:59:22.745299 17435 task_status_update_manager.cpp:401] Received task status update acknowledgement (UUID: 66236c8b-0c0d-49c3-9d2c-883def63a48c) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.745548 17436 master.cpp:5660] Processing KILL call for task '0' of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 (default) at [email protected]:35041 3: I1213 01:59:22.745620 17436 master.cpp:5734] Telling agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 at slave(59)@172.17.0.3:35041 (c6667db7a1a3) to kill task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 (default) at [email protected]:35041 3: I1213 01:59:22.745628 17438 slave.cpp:4033] Task status update manager successfully handled status update acknowledgement (UUID: 66236c8b-0c0d-49c3-9d2c-883def63a48c) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.745750 17438 slave.cpp:3111] Asked to kill task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.745954 17451 exec.cpp:351] Executor asked to kill task '0' 3: I1213 01:59:22.746044 17451 exec.cpp:360] Executor::killTask took 66877ns 3: I1213 01:59:22.746153 17451 exec.cpp:571] Executor sending status update TASK_KILLED (Status UUID: 744cbd4f-55c9-4156-b06a-7406c3b28072) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.746461 17439 slave.cpp:4755] Handling status update TASK_KILLED (Status UUID: 744cbd4f-55c9-4156-b06a-7406c3b28072) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 from executor(11)@172.17.0.3:35041 3: I1213 01:59:22.747498 17448 task_status_update_manager.cpp:328] Received task status update TASK_KILLED (Status UUID: 744cbd4f-55c9-4156-b06a-7406c3b28072) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.747633 17448 task_status_update_manager.cpp:383] Forwarding task status update TASK_KILLED (Status UUID: 744cbd4f-55c9-4156-b06a-7406c3b28072) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 to the agent 3: I1213 01:59:22.747819 17452 slave.cpp:5238] Forwarding the update TASK_KILLED (Status UUID: 744cbd4f-55c9-4156-b06a-7406c3b28072) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 to [email protected]:35041 3: I1213 01:59:22.748037 17452 slave.cpp:5131] Task status update manager successfully handled status update TASK_KILLED (Status UUID: 744cbd4f-55c9-4156-b06a-7406c3b28072) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.748086 17452 slave.cpp:5147] Sending acknowledgement for status update TASK_KILLED (Status UUID: 744cbd4f-55c9-4156-b06a-7406c3b28072) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 to executor(11)@172.17.0.3:35041 3: I1213 01:59:22.748181 17437 master.cpp:7855] Status update TASK_KILLED (Status UUID: 744cbd4f-55c9-4156-b06a-7406c3b28072) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 from agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 at slave(59)@172.17.0.3:35041 (c6667db7a1a3) 3: I1213 01:59:22.748236 17437 master.cpp:7911] Forwarding status update TASK_KILLED (Status UUID: 744cbd4f-55c9-4156-b06a-7406c3b28072) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.748242 17434 exec.cpp:388] Executor received status update acknowledgement 744cbd4f-55c9-4156-b06a-7406c3b28072 for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.748422 17437 master.cpp:10158] Updating the state of task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED) 3: I1213 01:59:22.748877 17450 sched.cpp:1029] Scheduler::statusUpdate took 134317ns 3: I1213 01:59:22.749374 17433 sched.cpp:2009] Asked to stop the driver 3: I1213 01:59:22.749420 17457 master.cpp:5842] Processing ACKNOWLEDGE call 744cbd4f-55c9-4156-b06a-7406c3b28072 for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 (default) at [email protected]:35041 on agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 3: I1213 01:59:22.749476 17447 hierarchical.cpp:1192] Recovered cpus(allocated: *):1; mem(allocated: *):512 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000], allocated: {}) on agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 from framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.749545 17442 sched.cpp:1191] Stopping framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.749596 17457 master.cpp:10264] Removing task 0 with resources cpus(allocated: *):1; mem(allocated: *):512 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 on agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 at slave(59)@172.17.0.3:35041 (c6667db7a1a3) 3: I1213 01:59:22.750250 17457 master.cpp:9442] Processing TEARDOWN call for framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 (default) at [email protected]:35041 3: I1213 01:59:22.750293 17457 master.cpp:9454] Removing framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 (default) at [email protected]:35041 3: I1213 01:59:22.750313 17457 master.cpp:3327] Deactivating framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 (default) at [email protected]:35041 3: I1213 01:59:22.750360 17435 task_status_update_manager.cpp:401] Received task status update acknowledgement (UUID: 744cbd4f-55c9-4156-b06a-7406c3b28072) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.750521 17438 hierarchical.cpp:405] Deactivated framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.750526 17435 task_status_update_manager.cpp:538] Cleaning up status update stream for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.750679 17439 slave.cpp:3375] Asked to shut down framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 by [email protected]:35041 3: I1213 01:59:22.750706 17457 master.cpp:10293] Removing executor 'default' with resources [] of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 on agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 at slave(59)@172.17.0.3:35041 (c6667db7a1a3) 3: I1213 01:59:22.750735 17439 slave.cpp:3400] Shutting down framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.750819 17439 slave.cpp:6114] Shutting down executor 'default' of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 at executor(11)@172.17.0.3:35041 3: I1213 01:59:22.750973 17453 exec.cpp:435] Executor asked to shutdown 3: I1213 01:59:22.751044 17453 exec.cpp:450] Executor::shutdown took 35693ns 3: I1213 01:59:22.751169 17445 slave.cpp:4033] Task status update manager successfully handled status update acknowledgement (UUID: 744cbd4f-55c9-4156-b06a-7406c3b28072) for task 0 of framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.751235 17445 slave.cpp:8834] Completing task 0 3: I1213 01:59:22.756642 17434 slave.cpp:5370] Got exited event for executor(11)@172.17.0.3:35041 3: I1213 01:59:22.757066 17437 hierarchical.cpp:344] Removed framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 3: I1213 01:59:22.757215 17433 slave.cpp:909] Agent terminating 3: I1213 01:59:22.757302 17433 slave.cpp:3375] Asked to shut down framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 by @0.0.0.0:0 3: W1213 01:59:22.757335 17433 slave.cpp:3396] Ignoring shutdown framework 41e86780-fd89-4e82-a8c9-d727332ccca7-0000 because it is terminating 3: I1213 01:59:22.757567 17444 master.cpp:1305] Agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 at slave(59)@172.17.0.3:35041 (c6667db7a1a3) disconnected 3: I1213 01:59:22.757594 17444 master.cpp:3364] Disconnecting agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 at slave(59)@172.17.0.3:35041 (c6667db7a1a3) 3: I1213 01:59:22.757652 17444 master.cpp:3383] Deactivating agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 at slave(59)@172.17.0.3:35041 (c6667db7a1a3) 3: I1213 01:59:22.757788 17440 hierarchical.cpp:766] Agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 deactivated 3: I1213 01:59:22.764987 17433 master.cpp:1147] Master terminating 3: I1213 01:59:22.765954 17452 hierarchical.cpp:609] Removed agent 41e86780-fd89-4e82-a8c9-d727332ccca7-S0 3: [ OK ] FaultToleranceTest.SplitBrainMasters (93 ms) 3: [ RUN ] FaultToleranceTest.UpdateFrameworkInfoOnSchedulerFailover 3: I1213 01:59:22.773627 17433 cluster.cpp:172] Creating default 'local' authorizer 3: I1213 01:59:22.777401 17452 master.cpp:456] Master f8271a09-86c2-4406-9129-8529cb3f798a (c6667db7a1a3) started on 172.17.0.3:35041 3: I1213 01:59:22.777427 17452 master.cpp:458] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="1secs" --allocator="HierarchicalDRF" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/AyMybP/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_unreachable_tasks_per_framework="1000" --port="5050" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --root_submissions="true" --user_sorter="drf" --version="false" --webui_dir="/usr/local/share/mesos/webui" --work_dir="/tmp/AyMybP/master" --zk_session_timeout="10secs" 3: I1213 01:59:22.777771 17452 master.cpp:507] Master only allowing authenticated frameworks to register 3: I1213 01:59:22.777779 17452 master.cpp:513] Master only allowing authenticated agents to register 3: I1213 01:59:22.777786 17452 master.cpp:519] Master only allowing authenticated HTTP frameworks to register 3: I1213 01:59:22.777791 17452 credentials.hpp:37] Loading credentials for authentication from '/tmp/AyMybP/credentials' 3: I1213 01:59:22.778131 17452 master.cpp:563] Using default 'crammd5' authenticator 3: I1213 01:59:22.778312 17452 http.cpp:1045] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' 3: I1213 01:59:22.778499 17452 http.cpp:1045] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' 3: I1213 01:59:22.778650 17452 http.cpp:1045] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' 3: I1213 01:59:22.778795 17452 master.cpp:642] Authorization enabled 3: I1213 01:59:22.778976 17438 hierarchical.cpp:175] Initialized hierarchical allocator process 3: I1213 01:59:22.778998 17449 whitelist_watcher.cpp:77] No whitelist given 3: I1213 01:59:22.782380 17445 master.cpp:2209] Elected as the leading master! 3: I1213 01:59:22.782418 17445 master.cpp:1689] Recovering from registrar 3: I1213 01:59:22.782656 17434 registrar.cpp:347] Recovering registrar 3: I1213 01:59:22.783592 17434 registrar.cpp:391] Successfully fetched the registry (0B) in 884992ns 3: I1213 01:59:22.783758 17434 registrar.cpp:495] Applied 1 operations in 50164ns; attempting to update the registry 3: I1213 01:59:22.784572 17434 registrar.cpp:552] Successfully updated the registry in 741888ns 3: I1213 01:59:22.784729 17434 registrar.cpp:424] Successfully recovered registrar 3: I1213 01:59:22.785277 17436 master.cpp:1802] Recovered 0 agents from the registry (135B); allowing 10mins for agents to re-register 3: I1213 01:59:22.785347 17440 hierarchical.cpp:213] Skipping recovery of hierarchical allocator: nothing to recover 3: W1213 01:59:22.790563 17433 process.cpp:2756] Attempted to spawn already running process [email protected]:35041 3: I1213 01:59:22.791633 17433 containerizer.cpp:304] Using isolation { environment_secret, posix/cpu, posix/mem, filesystem/posix, network/cni } 3: W1213 01:59:22.792199 17433 backend.cpp:76] Failed to create 'aufs' backend: AufsBackend requires root privileges 3: W1213 01:59:22.792335 17433 backend.cpp:76] Failed to create 'bind' backend: BindBackend requires root privileges 3: I1213 01:59:22.792381 17433 provisioner.cpp:299] Using default backend 'copy' 3: I1213 01:59:22.794548 17433 cluster.cpp:460] Creating default 'local' authorizer 3: I1213 01:59:22.796967 17440 slave.cpp:258] Mesos agent started on (60)@172.17.0.3:35041 3: W1213 01:59:22.797410 17433 process.cpp:2756] Attempted to spawn already running process [email protected]:35041 3: I1213 01:59:22.796990 17440 slave.cpp:259] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://" --appc_store_dir="/tmp/FaultToleranceTest_UpdateFrameworkInfoOnSchedulerFailover_Ewgmya/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/FaultToleranceTest_UpdateFrameworkInfoOnSchedulerFailover_Ewgmya/credential" --default_role="*" --disallow_sharing_agent_pid_namespace="false" --disk_watch_interval="1mins" --docker="docker" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io" --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/FaultToleranceTest_UpdateFrameworkInfoOnSchedulerFailover_Ewgmya/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_reregistration_timeout="2secs" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/FaultToleranceTest_UpdateFrameworkInfoOnSchedulerFailover_Ewgmya/fetch" --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks" --gc_disk_headroom="0.1" --hadoop_home="" --help="false" --hostname_lookup="true" --http_command_executor="false" --http_credentials="/tmp/FaultToleranceTest_UpdateFrameworkInfoOnSchedulerFailover_Ewgmya/http_credentials" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="posix" --launcher_dir="/mesos/build/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --reconfiguration_policy="equal" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/FaultToleranceTest_UpdateFrameworkInfoOnSchedulerFailover_Ewgmya" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/FaultToleranceTest_UpdateFrameworkInfoOnSchedulerFailover_y0WWRZ" --zk_session_timeout="10secs" 3: I1213 01:59:22.797513 17440 credentials.hpp:86] Loading credential for authentication from '/tmp/FaultToleranceTest_UpdateFrameworkInfoOnSchedulerFailover_Ewgmya/credential' 3: I1213 01:59:22.797745 17440 slave.cpp:291] Agent using credential for: test-principal 3: I1213 01:59:22.797765 17440 credentials.hpp:37] Loading credentials for authentication from '/tmp/FaultToleranceTest_UpdateFrameworkInfoOnSchedulerFailover_Ewgmya/http_credentials' 3: I1213 01:59:22.798048 17440 http.cpp:1045] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' 3: I1213 01:59:22.798236 17440 http.cpp:1045] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readwrite' 3: I1213 01:59:22.798446 17433 sched.cpp:232] Version: 1.5.0 3: I1213 01:59:22.799165 17454 sched.cpp:336] New master detected at [email protected]:35041 3: I1213 01:59:22.799270 17454 sched.cpp:396] Authenticating with master [email protected]:35041 3: I1213 01:59:22.799289 17454 sched.cpp:403] Using default CRAM-MD5 authenticatee 3: I1213 01:59:22.799576 17435 authenticatee.cpp:121] Creating new client SASL connection 3: I1213 01:59:22.799846 17455 master.cpp:8932] Authenticating [email protected]:35041 3: I1213 01:59:22.800009 17434 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(133)@172.17.0.3:35041 3: I1213 01:59:22.800021 17440 slave.cpp:590] Agent resources: [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] 3: I1213 01:59:22.800282 17440 slave.cpp:598] Agent attributes: [ ] 3: I1213 01:59:22.800297 17440 slave.cpp:607] Agent hostname: c6667db7a1a3 3: I1213 01:59:22.800346 17442 authenticator.cpp:98] Creating new server SASL connection 3: I1213 01:59:22.800453 17434 task_status_update_manager.cpp:181] Pausing sending task status updates 3: I1213 01:59:22.800655 17456 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 3: I1213 01:59:22.800688 17456 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' 3: I1213 01:59:22.800813 17449 authenticator.cpp:204] Received SASL authentication start 3: I1213 01:59:22.800880 17449 authenticator.cpp:326] Authentication requires more steps 3: I1213 01:59:22.800987 17449 authenticatee.cpp:259] Received SASL authentication step 3: I1213 01:59:22.801115 17449 authenticator.cpp:232] Received SASL authentication step 3: I1213 01:59:22.801143 17449 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c6667db7a1a3' server FQDN: 'c6667db7a1a3' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 3: I1213 01:59:22.801160 17449 auxprop.cpp:181] Looking up auxiliary property '*userPassword' 3: I1213 01:59:22.801203 17449 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' 3: I1213 01:59:22.801224 17449 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c6667db7a1a3' server FQDN: 'c6667db7a1a3' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 3: I1213 01:59:22.801237 17449 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true 3: I1213 01:59:22.801250 17449 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true 3: I1213 01:59:22.801265 17449 authenticator.cpp:318] Authentication success 3: I1213 01:59:22.801344 17448 authenticatee.cpp:299] Authentication success 3: I1213 01:59:22.801497 17441 master.cpp:8962] Successfully authenticated principal 'test-principal' at [email protected]:35041 3: I1213 01:59:22.801537 17452 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(133)@172.17.0.3:35041 3: I1213 01:59:22.801645 17450 sched.cpp:502] Successfully authenticated with master [email protected]:35041 3: I1213 01:59:22.801666 17450 sched.cpp:824] Sending SUBSCRIBE call to [email protected]:35041 3: I1213 01:59:22.801812 17450 sched.cpp:857] Will retry registration in 141.619283ms if necessary 3: I1213 01:59:22.802018 17453 master.cpp:2957] Received SUBSCRIBE call for framework 'Framework 1' at [email protected]:35041 3: I1213 01:59:22.802096 17453 master.cpp:2274] Authorizing framework principal 'test-principal' to receive offers for roles '{ * }' 3: I1213 01:59:22.802431 17446 state.cpp:66] Recovering state from '/tmp/FaultToleranceTest_UpdateFrameworkInfoOnSchedulerFailover_y0WWRZ/meta' 3: I1213 01:59:22.802675 17447 master.cpp:3037] Subscribing framework Framework 1 with checkpointing disabled and capabilities [ ] 3: I1213 01:59:22.802816 17455 task_status_update_manager.cpp:207] Recovering task status update manager 3: I1213 01:59:22.802911 17447 master.cpp:9153] Adding framework f8271a09-86c2-4406-9129-8529cb3f798a-0000 (Framework 1) at [email protected]:35041 with roles { } suppressed 3: I1213 01:59:22.803016 17434 containerizer.cpp:674] Recovering containerizer + docker rmi mesos-1513127279-25396 Build step 'Execute shell' marked build as failure Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected]
