[ 
https://issues.apache.org/jira/browse/MESOS-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14042946#comment-14042946
 ] 

Vinod Kone commented on MESOS-1497:
-----------------------------------

The reason the slave never registered is because it backed off up to 20 seconds 
for lack of acknowledgement for registered message from the master. It is 
strange that the registrar's update took more than 9s! cc [~bmahler]

> FaultToleranceTest.PartitionedSlaveStatusUpdates flaky
> ------------------------------------------------------
>
>                 Key: MESOS-1497
>                 URL: https://issues.apache.org/jira/browse/MESOS-1497
>             Project: Mesos
>          Issue Type: Bug
>            Reporter: Dominic Hamon
>            Assignee: Vinod Kone
>
> Slave trying to register, already in progress, doesn't complete.
> Full log:
> {{noformat}}
> I0616 17:18:38.884569 11401 slave.cpp:908] Will retry registration in 
> 19.7107804secs if necessary
> I0616 17:18:38.884745 11401 master.cpp:2608] Ignoring register slave message 
> from slave(35)@192.168.122.135:40919 (fedora-19) as admission is already in 
> progress
> I0616 17:18:39.534111 11401 master.cpp:114] No whitelist given. Advertising 
> offers for all slaves
> I0616 17:18:39.540422 11401 hierarchical_allocator_process.hpp:724] No 
> resources available to allocate!
> I0616 17:18:39.540442 11401 hierarchical_allocator_process.hpp:686] Performed 
> allocation for 0 slaves in 29281ns
> tests/fault_tolerance_tests.cpp:382: Failure
> Failed to wait 10secs for slaveRegisteredMessage
> I0616 17:18:39.569171 11379 master.cpp:575] Master terminating
> I0616 17:18:39.569422 11399 slave.cpp:2267] master@192.168.122.135:40919 
> exited
> W0616 17:18:39.569444 11399 slave.cpp:2270] Master disconnected! Waiting for 
> a new master to be elected
> {{noformat}}
> {{noformat}}
> [ RUN      ] FaultToleranceTest.PartitionedSlaveStatusUpdates
> Using temporary directory 
> '/tmp/FaultToleranceTest_PartitionedSlaveStatusUpdates_ayQvXb'
> I0616 17:18:29.519136 11379 leveldb.cpp:176] Opened db in 730451ns
> I0616 17:18:29.519909 11379 leveldb.cpp:183] Compacted db in 281154ns
> I0616 17:18:29.520432 11379 leveldb.cpp:198] Created db iterator in 17248ns
> I0616 17:18:29.520814 11379 leveldb.cpp:204] Seeked to beginning of db in 
> 14638ns
> I0616 17:18:29.521200 11379 leveldb.cpp:273] Iterated through 0 keys in the 
> db in 14493ns
> I0616 17:18:29.521610 11379 replica.cpp:741] Replica recovered with log 
> positions 0 -> 0 with 1 holes and 0 unlearned
> I0616 17:18:29.522150 11399 recover.cpp:425] Starting replica recovery
> I0616 17:18:29.522223 11399 recover.cpp:451] Replica is in EMPTY status
> I0616 17:18:29.522557 11399 replica.cpp:638] Replica in EMPTY status received 
> a broadcasted recover request
> I0616 17:18:29.522620 11399 recover.cpp:188] Received a recover response from 
> a replica in EMPTY status
> I0616 17:18:29.523074 11399 recover.cpp:542] Updating replica status to 
> STARTING
> I0616 17:18:29.523183 11399 leveldb.cpp:306] Persisting metadata (8 bytes) to 
> leveldb took 50390ns
> I0616 17:18:29.523200 11399 replica.cpp:320] Persisted replica status to 
> STARTING
> I0616 17:18:29.523254 11399 recover.cpp:451] Replica is in STARTING status
> I0616 17:18:29.523841 11401 replica.cpp:638] Replica in STARTING status 
> received a broadcasted recover request
> I0616 17:18:29.524261 11399 recover.cpp:188] Received a recover response from 
> a replica in STARTING status
> I0616 17:18:29.527649 11404 recover.cpp:542] Updating replica status to VOTING
> I0616 17:18:29.527720 11404 leveldb.cpp:306] Persisting metadata (8 bytes) to 
> leveldb took 26123ns
> I0616 17:18:29.527735 11404 replica.cpp:320] Persisted replica status to 
> VOTING
> I0616 17:18:29.527765 11404 recover.cpp:556] Successfully joined the Paxos 
> group
> I0616 17:18:29.528094 11401 recover.cpp:440] Recover process terminated
> I0616 17:18:29.532279 11404 master.cpp:280] Master 
> 20140616-171829-2272962752-40919-11379 (fedora-19) started on 
> 192.168.122.135:40919
> I0616 17:18:29.532358 11404 master.cpp:317] Master only allowing 
> authenticated frameworks to register
> I0616 17:18:29.532368 11404 master.cpp:322] Master only allowing 
> authenticated slaves to register
> I0616 17:18:29.532377 11404 credentials.hpp:35] Loading credentials for 
> authentication from 
> '/tmp/FaultToleranceTest_PartitionedSlaveStatusUpdates_ayQvXb/credentials'
> I0616 17:18:29.532455 11404 master.cpp:348] Authorization enabled
> I0616 17:18:29.532812 11404 hierarchical_allocator_process.hpp:301] 
> Initializing hierarchical allocator process with master : 
> master@192.168.122.135:40919
> I0616 17:18:29.532853 11404 master.cpp:114] No whitelist given. Advertising 
> offers for all slaves
> I0616 17:18:29.533010 11404 master.cpp:961] The newly elected leader is 
> master@192.168.122.135:40919 with id 20140616-171829-2272962752-40919-11379
> I0616 17:18:29.533025 11404 master.cpp:974] Elected as the leading master!
> I0616 17:18:29.533032 11404 master.cpp:792] Recovering from registrar
> I0616 17:18:29.533099 11404 registrar.cpp:313] Recovering registrar
> I0616 17:18:29.533687 11404 log.cpp:656] Attempting to start the writer
> I0616 17:18:29.534579 11404 replica.cpp:474] Replica received implicit 
> promise request with proposal 1
> I0616 17:18:29.535001 11404 leveldb.cpp:306] Persisting metadata (8 bytes) to 
> leveldb took 64156ns
> I0616 17:18:29.535393 11404 replica.cpp:342] Persisted promised to 1
> I0616 17:18:29.535940 11404 coordinator.cpp:230] Coordinator attemping to 
> fill missing position
> I0616 17:18:29.536691 11401 replica.cpp:375] Replica received explicit 
> promise request for position 0 with proposal 2
> I0616 17:18:29.536736 11401 leveldb.cpp:343] Persisting action (8 bytes) to 
> leveldb took 26850ns
> I0616 17:18:29.536749 11401 replica.cpp:676] Persisted action at 0
> I0616 17:18:29.536972 11401 replica.cpp:508] Replica received write request 
> for position 0
> I0616 17:18:29.537001 11401 leveldb.cpp:438] Reading position from leveldb 
> took 17576ns
> I0616 17:18:29.537029 11401 leveldb.cpp:343] Persisting action (14 bytes) to 
> leveldb took 18226ns
> I0616 17:18:29.537039 11401 replica.cpp:676] Persisted action at 0
> I0616 17:18:29.537257 11403 replica.cpp:655] Replica received learned notice 
> for position 0
> I0616 17:18:29.537327 11403 leveldb.cpp:343] Persisting action (16 bytes) to 
> leveldb took 60116ns
> I0616 17:18:29.537344 11403 replica.cpp:676] Persisted action at 0
> I0616 17:18:29.537353 11403 replica.cpp:661] Replica learned NOP action at 
> position 0
> I0616 17:18:29.537892 11404 log.cpp:672] Writer started with ending position 0
> I0616 17:18:29.538684 11404 leveldb.cpp:438] Reading position from leveldb 
> took 22029ns
> I0616 17:18:29.544896 11404 registrar.cpp:346] Successfully fetched the 
> registry (0B)
> I0616 17:18:29.544929 11404 registrar.cpp:422] Attempting to update the 
> 'registry'
> I0616 17:18:29.545876 11404 log.cpp:680] Attempting to append 131 bytes to 
> the log
> I0616 17:18:29.545922 11404 coordinator.cpp:340] Coordinator attempting to 
> write APPEND action at position 1
> I0616 17:18:29.546581 11402 replica.cpp:508] Replica received write request 
> for position 1
> I0616 17:18:29.546627 11402 leveldb.cpp:343] Persisting action (150 bytes) to 
> leveldb took 29858ns
> I0616 17:18:29.546641 11402 replica.cpp:676] Persisted action at 1
> I0616 17:18:29.547143 11403 replica.cpp:655] Replica received learned notice 
> for position 1
> I0616 17:18:29.547184 11403 leveldb.cpp:343] Persisting action (152 bytes) to 
> leveldb took 26389ns
> I0616 17:18:29.547197 11403 replica.cpp:676] Persisted action at 1
> I0616 17:18:29.547205 11403 replica.cpp:661] Replica learned APPEND action at 
> position 1
> I0616 17:18:29.550392 11401 registrar.cpp:479] Successfully updated 'registry'
> I0616 17:18:29.550432 11401 registrar.cpp:372] Successfully recovered 
> registrar
> I0616 17:18:29.550493 11401 master.cpp:819] Recovered 0 slaves from the 
> Registry (95B) ; allowing 10mins for slaves to re-register
> I0616 17:18:29.552655 11399 log.cpp:699] Attempting to truncate the log to 1
> I0616 17:18:29.552744 11399 coordinator.cpp:340] Coordinator attempting to 
> write TRUNCATE action at position 2
> I0616 17:18:29.552906 11399 replica.cpp:508] Replica received write request 
> for position 2
> I0616 17:18:29.552942 11399 leveldb.cpp:343] Persisting action (16 bytes) to 
> leveldb took 25102ns
> I0616 17:18:29.552953 11399 replica.cpp:676] Persisted action at 2
> I0616 17:18:29.553112 11399 replica.cpp:655] Replica received learned notice 
> for position 2
> I0616 17:18:29.553144 11399 leveldb.cpp:343] Persisting action (18 bytes) to 
> leveldb took 21545ns
> I0616 17:18:29.553160 11399 leveldb.cpp:401] Deleting ~1 keys from leveldb 
> took 9928ns
> I0616 17:18:29.553170 11399 replica.cpp:676] Persisted action at 2
> I0616 17:18:29.553179 11399 replica.cpp:661] Replica learned TRUNCATE action 
> at position 2
> I0616 17:18:29.555407 11398 slave.cpp:143] Slave started on 
> 35)@192.168.122.135:40919
> I0616 17:18:29.555434 11398 credentials.hpp:35] Loading credentials for 
> authentication from 
> '/tmp/FaultToleranceTest_PartitionedSlaveStatusUpdates_v7Tqvm/credential'
> I0616 17:18:29.555505 11398 slave.cpp:243] Slave using credential for: 
> test-principal
> I0616 17:18:29.555588 11398 slave.cpp:256] Slave resources: cpus(*):2; 
> mem(*):1024; disk(*):1024; ports(*):[31000-32000]
> I0616 17:18:29.556069 11398 slave.cpp:284] Slave hostname: fedora-19
> I0616 17:18:29.556087 11398 slave.cpp:285] Slave checkpoint: false
> I0616 17:18:29.556555 11397 state.cpp:33] Recovering state from 
> '/tmp/FaultToleranceTest_PartitionedSlaveStatusUpdates_v7Tqvm/meta'
> I0616 17:18:29.557152 11398 status_update_manager.cpp:193] Recovering status 
> update manager
> I0616 17:18:29.557231 11398 slave.cpp:3068] Finished recovery
> I0616 17:18:29.557890 11398 slave.cpp:537] New master detected at 
> master@192.168.122.135:40919
> I0616 17:18:29.557924 11398 slave.cpp:613] Authenticating with master 
> master@192.168.122.135:40919
> I0616 17:18:29.557965 11398 slave.cpp:586] Detecting new master
> I0616 17:18:29.557997 11398 status_update_manager.cpp:167] New master 
> detected at master@192.168.122.135:40919
> I0616 17:18:29.558027 11398 authenticatee.hpp:128] Creating new client SASL 
> connection
> I0616 17:18:29.558694 11401 master.cpp:3341] Authenticating 
> slave(35)@192.168.122.135:40919
> I0616 17:18:29.558789 11401 authenticator.hpp:156] Creating new server SASL 
> connection
> I0616 17:18:29.559404 11398 authenticatee.hpp:219] Received SASL 
> authentication mechanisms: CRAM-MD5
> I0616 17:18:29.559623 11398 authenticatee.hpp:245] Attempting to authenticate 
> with mechanism 'CRAM-MD5'
> I0616 17:18:29.559866 11398 authenticator.hpp:262] Received SASL 
> authentication start
> I0616 17:18:29.560112 11398 authenticator.hpp:384] Authentication requires 
> more steps
> I0616 17:18:29.560374 11398 authenticatee.hpp:265] Received SASL 
> authentication step
> I0616 17:18:29.560848 11397 authenticator.hpp:290] Received SASL 
> authentication step
> I0616 17:18:29.560880 11397 auxprop.cpp:81] Request to lookup properties for 
> user: 'test-principal' realm: 'fedora-19' server FQDN: 'fedora-19' 
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false 
> SASL_AUXPROP_AUTHZID: false 
> I0616 17:18:29.560890 11397 auxprop.cpp:153] Looking up auxiliary property 
> '*userPassword'
> I0616 17:18:29.560902 11397 auxprop.cpp:153] Looking up auxiliary property 
> '*cmusaslsecretCRAM-MD5'
> I0616 17:18:29.560912 11397 auxprop.cpp:81] Request to lookup properties for 
> user: 'test-principal' realm: 'fedora-19' server FQDN: 'fedora-19' 
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false 
> SASL_AUXPROP_AUTHZID: true 
> I0616 17:18:29.560920 11397 auxprop.cpp:103] Skipping auxiliary property 
> '*userPassword' since SASL_AUXPROP_AUTHZID == true
> I0616 17:18:29.560926 11397 auxprop.cpp:103] Skipping auxiliary property 
> '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
> I0616 17:18:29.560938 11397 authenticator.hpp:376] Authentication success
> I0616 17:18:29.560974 11397 master.cpp:3381] Successfully authenticated 
> principal 'test-principal' at slave(35)@192.168.122.135:40919
> I0616 17:18:29.564326 11398 authenticatee.hpp:305] Authentication success
> I0616 17:18:29.567379 11401 slave.cpp:670] Successfully authenticated with 
> master master@192.168.122.135:40919
> I0616 17:18:29.567705 11401 slave.cpp:908] Will retry registration in 
> 7.339644ms if necessary
> I0616 17:18:29.568169 11397 master.cpp:2620] Registering slave at 
> slave(35)@192.168.122.135:40919 (fedora-19) with id 
> 20140616-171829-2272962752-40919-11379-0
> I0616 17:18:29.568775 11403 registrar.cpp:422] Attempting to update the 
> 'registry'
> I0616 17:18:29.575954 11401 slave.cpp:908] Will retry registration in 
> 20.473816ms if necessary
> I0616 17:18:29.576019 11401 master.cpp:2608] Ignoring register slave message 
> from slave(35)@192.168.122.135:40919 (fedora-19) as admission is already in 
> progress
> I0616 17:18:29.597661 11401 slave.cpp:908] Will retry registration in 
> 17.362678ms if necessary
> I0616 17:18:29.597892 11401 master.cpp:2608] Ignoring register slave message 
> from slave(35)@192.168.122.135:40919 (fedora-19) as admission is already in 
> progress
> I0616 17:18:29.615427 11401 slave.cpp:908] Will retry registration in 
> 78.730183ms if necessary
> I0616 17:18:29.615489 11401 master.cpp:2608] Ignoring register slave message 
> from slave(35)@192.168.122.135:40919 (fedora-19) as admission is already in 
> progress
> I0616 17:18:29.694946 11401 slave.cpp:908] Will retry registration in 
> 66.307626ms if necessary
> I0616 17:18:29.695065 11401 master.cpp:2608] Ignoring register slave message 
> from slave(35)@192.168.122.135:40919 (fedora-19) as admission is already in 
> progress
> I0616 17:18:29.761473 11401 slave.cpp:908] Will retry registration in 
> 282.444844ms if necessary
> I0616 17:18:29.761592 11401 master.cpp:2608] Ignoring register slave message 
> from slave(35)@192.168.122.135:40919 (fedora-19) as admission is already in 
> progress
> I0616 17:18:30.044380 11401 slave.cpp:908] Will retry registration in 
> 379.754768ms if necessary
> I0616 17:18:30.044497 11401 master.cpp:2608] Ignoring register slave message 
> from slave(35)@192.168.122.135:40919 (fedora-19) as admission is already in 
> progress
> I0616 17:18:30.425350 11401 slave.cpp:908] Will retry registration in 
> 84.187455ms if necessary
> I0616 17:18:30.425469 11401 master.cpp:2608] Ignoring register slave message 
> from slave(35)@192.168.122.135:40919 (fedora-19) as admission is already in 
> progress
> I0616 17:18:30.509944 11401 slave.cpp:908] Will retry registration in 
> 1.433873708secs if necessary
> I0616 17:18:30.510047 11401 master.cpp:2608] Ignoring register slave message 
> from slave(35)@192.168.122.135:40919 (fedora-19) as admission is already in 
> progress
> I0616 17:18:30.533041 11401 hierarchical_allocator_process.hpp:724] No 
> resources available to allocate!
> I0616 17:18:30.533062 11401 hierarchical_allocator_process.hpp:686] Performed 
> allocation for 0 slaves in 32005ns
> I0616 17:18:31.534133 11401 hierarchical_allocator_process.hpp:724] No 
> resources available to allocate!
> I0616 17:18:31.534217 11401 hierarchical_allocator_process.hpp:686] Performed 
> allocation for 0 slaves in 109231ns
> I0616 17:18:31.944669 11401 slave.cpp:908] Will retry registration in 
> 6.93868604secs if necessary
> I0616 17:18:31.944851 11401 master.cpp:2608] Ignoring register slave message 
> from slave(35)@192.168.122.135:40919 (fedora-19) as admission is already in 
> progress
> I0616 17:18:32.535365 11401 hierarchical_allocator_process.hpp:724] No 
> resources available to allocate!
> I0616 17:18:32.535410 11401 hierarchical_allocator_process.hpp:686] Performed 
> allocation for 0 slaves in 63555ns
> I0616 17:18:33.536496 11401 hierarchical_allocator_process.hpp:724] No 
> resources available to allocate!
> I0616 17:18:33.536541 11401 hierarchical_allocator_process.hpp:686] Performed 
> allocation for 0 slaves in 59268ns
> I0616 17:18:34.533962 11401 master.cpp:114] No whitelist given. Advertising 
> offers for all slaves
> I0616 17:18:34.537124 11401 hierarchical_allocator_process.hpp:724] No 
> resources available to allocate!
> I0616 17:18:34.537144 11401 hierarchical_allocator_process.hpp:686] Performed 
> allocation for 0 slaves in 28619ns
> I0616 17:18:35.537505 11401 hierarchical_allocator_process.hpp:724] No 
> resources available to allocate!
> I0616 17:18:35.537549 11401 hierarchical_allocator_process.hpp:686] Performed 
> allocation for 0 slaves in 59010ns
> I0616 17:18:36.538498 11401 hierarchical_allocator_process.hpp:724] No 
> resources available to allocate!
> I0616 17:18:36.538543 11401 hierarchical_allocator_process.hpp:686] Performed 
> allocation for 0 slaves in 59428ns
> I0616 17:18:37.538897 11401 hierarchical_allocator_process.hpp:724] No 
> resources available to allocate!
> I0616 17:18:37.538964 11401 hierarchical_allocator_process.hpp:686] Performed 
> allocation for 0 slaves in 91037ns
> I0616 17:18:38.539971 11401 hierarchical_allocator_process.hpp:724] No 
> resources available to allocate!
> I0616 17:18:38.540016 11401 hierarchical_allocator_process.hpp:686] Performed 
> allocation for 0 slaves in 58199ns
> I0616 17:18:38.884569 11401 slave.cpp:908] Will retry registration in 
> 19.7107804secs if necessary
> I0616 17:18:38.884745 11401 master.cpp:2608] Ignoring register slave message 
> from slave(35)@192.168.122.135:40919 (fedora-19) as admission is already in 
> progress
> I0616 17:18:39.534111 11401 master.cpp:114] No whitelist given. Advertising 
> offers for all slaves
> I0616 17:18:39.540422 11401 hierarchical_allocator_process.hpp:724] No 
> resources available to allocate!
> I0616 17:18:39.540442 11401 hierarchical_allocator_process.hpp:686] Performed 
> allocation for 0 slaves in 29281ns
> tests/fault_tolerance_tests.cpp:382: Failure
> Failed to wait 10secs for slaveRegisteredMessage
> I0616 17:18:39.569171 11379 master.cpp:575] Master terminating
> I0616 17:18:39.569422 11399 slave.cpp:2267] master@192.168.122.135:40919 
> exited
> W0616 17:18:39.569444 11399 slave.cpp:2270] Master disconnected! Waiting for 
> a new master to be elected
> E0616 17:18:39.571076 11401 registrar.cpp:500] Registrar aborting: Failed to 
> update 'registry': Failed to perform store within 10secs
> I0616 17:18:58.596258 11401 slave.cpp:908] Will retry registration in 
> 28.736588529secs if necessary
> I0616 17:19:27.333842 11401 slave.cpp:908] Will retry registration in 
> 26.371592705secs if necessary
> I0616 17:19:29.557536 11401 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:19:53.706254 11401 slave.cpp:908] Will retry registration in 
> 29.848241605secs if necessary
> I0616 17:20:23.556136 11401 slave.cpp:908] Will retry registration in 
> 24.067293696secs if necessary
> I0616 17:20:29.557991 11401 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:20:47.624315 11401 slave.cpp:908] Will retry registration in 
> 37.542190913secs if necessary
> I0616 17:21:25.167711 11401 slave.cpp:908] Will retry registration in 
> 43.962791861secs if necessary
> I0616 17:21:29.559128 11401 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:22:09.131609 11401 slave.cpp:908] Will retry registration in 
> 55.715292662secs if necessary
> I0616 17:22:29.559895 11401 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:23:04.848270 11401 slave.cpp:908] Will retry registration in 
> 19.71901521secs if necessary
> I0616 17:23:24.569455 11401 slave.cpp:908] Will retry registration in 
> 12.788557621secs if necessary
> I0616 17:23:29.560813 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:23:37.362653 11402 slave.cpp:908] Will retry registration in 
> 53.595005345secs if necessary
> I0616 17:24:29.561787 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:24:30.959084 11402 slave.cpp:908] Will retry registration in 
> 10.110984328secs if necessary
> I0616 17:24:41.071492 11402 slave.cpp:908] Will retry registration in 
> 7.134839653secs if necessary
> I0616 17:24:48.207552 11402 slave.cpp:908] Will retry registration in 
> 55.518127416secs if necessary
> I0616 17:25:29.563338 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:25:43.726920 11402 slave.cpp:908] Will retry registration in 
> 11.265912461secs if necessary
> I0616 17:25:54.994148 11402 slave.cpp:908] Will retry registration in 
> 17.562091572secs if necessary
> I0616 17:26:12.557714 11402 slave.cpp:908] Will retry registration in 
> 33.67482809secs if necessary
> I0616 17:26:29.564657 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:26:46.233772 11402 slave.cpp:908] Will retry registration in 
> 21.850492228secs if necessary
> I0616 17:27:08.085125 11402 slave.cpp:908] Will retry registration in 
> 8.182961972secs if necessary
> I0616 17:27:16.269772 11402 slave.cpp:908] Will retry registration in 
> 30.40175254secs if necessary
> I0616 17:27:29.565538 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:27:46.672708 11402 slave.cpp:908] Will retry registration in 
> 33.860296138secs if necessary
> I0616 17:28:20.535161 11402 slave.cpp:908] Will retry registration in 
> 21.040038774secs if necessary
> I0616 17:28:29.566625 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:28:41.576572 11402 slave.cpp:908] Will retry registration in 
> 1.112477286secs if necessary
> I0616 17:28:42.689430 11402 slave.cpp:908] Will retry registration in 
> 46.882305129secs if necessary
> I0616 17:29:29.567360 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:29:29.572481 11402 slave.cpp:908] Will retry registration in 
> 50.5638577secs if necessary
> I0616 17:30:20.136976 11402 slave.cpp:908] Will retry registration in 
> 13.545157263secs if necessary
> I0616 17:30:29.568275 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:30:33.683555 11402 slave.cpp:908] Will retry registration in 
> 13.361509318secs if necessary
> I0616 17:30:47.045861 11402 slave.cpp:908] Will retry registration in 
> 8.364862458secs if necessary
> I0616 17:30:55.411973 11402 slave.cpp:908] Will retry registration in 
> 15.518300745secs if necessary
> I0616 17:31:10.931728 11402 slave.cpp:908] Will retry registration in 
> 30.164716872secs if necessary
> I0616 17:31:29.569315 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:31:41.097853 11402 slave.cpp:908] Will retry registration in 
> 49.021225976secs if necessary
> I0616 17:32:29.570176 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:32:30.119793 11402 slave.cpp:908] Will retry registration in 
> 13.264727673secs if necessary
> I0616 17:32:43.385035 11402 slave.cpp:908] Will retry registration in 
> 12.259328948secs if necessary
> I0616 17:32:55.645277 11402 slave.cpp:908] Will retry registration in 
> 15.392818653secs if necessary
> I0616 17:33:11.039726 11402 slave.cpp:908] Will retry registration in 
> 43.112969278secs if necessary
> I0616 17:33:29.571110 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:33:54.153619 11402 slave.cpp:908] Will retry registration in 
> 36.326622672secs if necessary
> I0616 17:34:29.572109 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:34:30.480865 11402 slave.cpp:908] Will retry registration in 
> 52.935009567secs if necessary
> I0616 17:35:23.416909 11402 slave.cpp:908] Will retry registration in 
> 27.075761112secs if necessary
> I0616 17:35:29.573047 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:35:50.493963 11402 slave.cpp:908] Will retry registration in 
> 32.041915306secs if necessary
> I0616 17:36:22.537431 11402 slave.cpp:908] Will retry registration in 
> 12.65402475secs if necessary
> I0616 17:36:29.574502 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:36:35.192558 11402 slave.cpp:908] Will retry registration in 
> 39.864318761secs if necessary
> I0616 17:37:15.058526 11402 slave.cpp:908] Will retry registration in 
> 25.636920624secs if necessary
> I0616 17:37:29.575356 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:37:40.696542 11402 slave.cpp:908] Will retry registration in 
> 22.765009078secs if necessary
> I0616 17:38:03.462684 11402 slave.cpp:908] Will retry registration in 
> 46.999158415secs if necessary
> I0616 17:38:29.576843 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:38:50.462700 11402 slave.cpp:908] Will retry registration in 
> 21.155048013secs if necessary
> I0616 17:39:11.619050 11402 slave.cpp:908] Will retry registration in 
> 34.03092154secs if necessary
> I0616 17:39:29.577883 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:39:45.651011 11402 slave.cpp:908] Will retry registration in 
> 4.56124996secs if necessary
> I0616 17:39:50.214270 11402 slave.cpp:908] Will retry registration in 
> 54.829876103secs if necessary
> I0616 17:40:29.578673 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:40:45.045351 11402 slave.cpp:908] Will retry registration in 
> 55.881413796secs if necessary
> I0616 17:41:29.579717 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:41:40.927477 11402 slave.cpp:908] Will retry registration in 
> 12.744211932secs if necessary
> I0616 17:41:53.672745 11402 slave.cpp:908] Will retry registration in 
> 25.231628615secs if necessary
> I0616 17:42:18.905035 11402 slave.cpp:908] Will retry registration in 
> 29.741709907secs if necessary
> I0616 17:42:29.580662 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:42:48.647752 11402 slave.cpp:908] Will retry registration in 
> 33.784250707secs if necessary
> I0616 17:43:22.433564 11402 slave.cpp:908] Will retry registration in 
> 26.34410593secs if necessary
> I0616 17:43:29.581598 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:43:48.778710 11402 slave.cpp:908] Will retry registration in 
> 16.624015009secs if necessary
> I0616 17:44:05.403445 11402 slave.cpp:908] Will retry registration in 
> 24.348108379secs if necessary
> I0616 17:44:29.582552 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:44:29.752590 11402 slave.cpp:908] Will retry registration in 
> 39.889263194secs if necessary
> I0616 17:45:09.642628 11402 slave.cpp:908] Will retry registration in 
> 29.985524327secs if necessary
> I0616 17:45:29.583523 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:45:39.629645 11402 slave.cpp:908] Will retry registration in 
> 32.712970838secs if necessary
> I0616 17:46:12.344259 11402 slave.cpp:908] Will retry registration in 
> 55.407563939secs if necessary
> I0616 17:46:29.584436 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:47:07.753232 11402 slave.cpp:908] Will retry registration in 
> 150.241172ms if necessary
> I0616 17:47:07.904378 11402 slave.cpp:908] Will retry registration in 
> 21.734196786secs if necessary
> I0616 17:47:29.585860 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:47:29.639863 11402 slave.cpp:908] Will retry registration in 
> 8.672291584secs if necessary
> I0616 17:47:38.314318 11397 slave.cpp:908] Will retry registration in 
> 12.409570148secs if necessary
> I0616 17:47:50.729507 11398 slave.cpp:908] Will retry registration in 
> 37.12701544secs if necessary
> I0616 17:48:27.857504 11398 slave.cpp:908] Will retry registration in 
> 51.785260863secs if necessary
> I0616 17:48:29.587505 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:49:19.644258 11398 slave.cpp:908] Will retry registration in 
> 48.73619282secs if necessary
> I0616 17:49:29.588254 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:50:08.381985 11398 slave.cpp:908] Will retry registration in 
> 30.062025007secs if necessary
> I0616 17:50:29.589128 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:50:38.445051 11398 slave.cpp:908] Will retry registration in 
> 18.861021948secs if necessary
> I0616 17:50:57.307761 11398 slave.cpp:908] Will retry registration in 
> 20.778108099secs if necessary
> I0616 17:51:18.086586 11398 slave.cpp:908] Will retry registration in 
> 42.716049758secs if necessary
> I0616 17:51:29.590780 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:52:00.803659 11398 slave.cpp:908] Will retry registration in 
> 58.72534071secs if necessary
> I0616 17:52:29.592030 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:52:59.529881 11398 slave.cpp:908] Will retry registration in 
> 46.415028724secs if necessary
> I0616 17:53:29.592900 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:53:45.946349 11398 slave.cpp:908] Will retry registration in 
> 5.481058836secs if necessary
> I0616 17:53:51.428743 11398 slave.cpp:908] Will retry registration in 
> 45.724499097secs if necessary
> I0616 17:54:29.593842 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:54:37.154415 11398 slave.cpp:908] Will retry registration in 
> 7.570076709secs if necessary
> I0616 17:54:44.726080 11398 slave.cpp:908] Will retry registration in 
> 39.511980376secs if necessary
> I0616 17:55:24.239545 11398 slave.cpp:908] Will retry registration in 
> 50.285749058secs if necessary
> I0616 17:55:29.594693 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:56:14.526761 11398 slave.cpp:908] Will retry registration in 
> 2.399952813secs if necessary
> I0616 17:56:16.927963 11398 slave.cpp:908] Will retry registration in 
> 35.393394145secs if necessary
> I0616 17:56:29.595680 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:56:52.322569 11398 slave.cpp:908] Will retry registration in 
> 3.029960991secs if necessary
> I0616 17:56:55.353279 11398 slave.cpp:908] Will retry registration in 
> 27.631581429secs if necessary
> I0616 17:57:22.986162 11398 slave.cpp:908] Will retry registration in 
> 5.135104025secs if necessary
> I0616 17:57:28.122007 11398 slave.cpp:908] Will retry registration in 
> 36.814211698secs if necessary
> I0616 17:57:29.596737 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:58:04.936997 11398 slave.cpp:908] Will retry registration in 
> 53.975687359secs if necessary
> I0616 17:58:29.597611 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:58:58.913883 11398 slave.cpp:908] Will retry registration in 
> 21.759119034secs if necessary
> I0616 17:59:20.673682 11398 slave.cpp:908] Will retry registration in 
> 1.162320077secs if necessary
> I0616 17:59:21.836449 11398 slave.cpp:908] Will retry registration in 
> 33.864950525secs if necessary
> I0616 17:59:29.598458 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 17:59:55.702369 11398 slave.cpp:908] Will retry registration in 
> 51.74464339secs if necessary
> I0616 18:00:29.599500 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:00:47.448353 11398 slave.cpp:908] Will retry registration in 
> 33.875290916secs if necessary
> I0616 18:01:21.325224 11398 slave.cpp:908] Will retry registration in 
> 29.272514436secs if necessary
> I0616 18:01:29.600913 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:01:50.602067 11399 slave.cpp:908] Will retry registration in 
> 51.894884562secs if necessary
> I0616 18:02:29.601691 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:02:42.498440 11399 slave.cpp:908] Will retry registration in 
> 55.60948773secs if necessary
> I0616 18:03:29.603526 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:03:38.109046 11402 slave.cpp:908] Will retry registration in 
> 37.944806021secs if necessary
> I0616 18:04:16.054728 11402 slave.cpp:908] Will retry registration in 
> 4.304454682secs if necessary
> I0616 18:04:20.359899 11402 slave.cpp:908] Will retry registration in 
> 32.736503143secs if necessary
> I0616 18:04:29.605523 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:04:53.097780 11402 slave.cpp:908] Will retry registration in 
> 29.730066857secs if necessary
> I0616 18:05:22.829463 11402 slave.cpp:908] Will retry registration in 
> 53.040647503secs if necessary
> I0616 18:05:29.606081 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:06:15.871522 11402 slave.cpp:908] Will retry registration in 
> 2.798528123secs if necessary
> I0616 18:06:18.671077 11402 slave.cpp:908] Will retry registration in 
> 48.591088833secs if necessary
> I0616 18:06:29.607189 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:07:07.262774 11402 slave.cpp:908] Will retry registration in 
> 13.818755575secs if necessary
> I0616 18:07:21.082377 11402 slave.cpp:908] Will retry registration in 
> 45.514577909secs if necessary
> I0616 18:07:29.608079 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:08:06.598408 11402 slave.cpp:908] Will retry registration in 
> 47.316429515secs if necessary
> I0616 18:08:29.609072 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:08:53.915786 11402 slave.cpp:908] Will retry registration in 
> 233.784271ms if necessary
> I0616 18:08:54.151051 11402 slave.cpp:908] Will retry registration in 
> 50.995636745secs if necessary
> I0616 18:09:29.610029 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:09:45.147452 11402 slave.cpp:908] Will retry registration in 
> 33.040928613secs if necessary
> I0616 18:10:18.189548 11402 slave.cpp:908] Will retry registration in 
> 7.803861008secs if necessary
> I0616 18:10:25.994230 11402 slave.cpp:908] Will retry registration in 
> 30.507617094secs if necessary
> I0616 18:10:29.610780 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:10:56.502715 11402 slave.cpp:908] Will retry registration in 
> 23.326677644secs if necessary
> I0616 18:11:19.830090 11402 slave.cpp:908] Will retry registration in 
> 10.203813822secs if necessary
> I0616 18:11:29.611774 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:11:30.035254 11402 slave.cpp:908] Will retry registration in 
> 5.90101124secs if necessary
> I0616 18:11:35.937623 11402 slave.cpp:908] Will retry registration in 
> 26.356638635secs if necessary
> I0616 18:12:02.295526 11402 slave.cpp:908] Will retry registration in 
> 37.835395251secs if necessary
> I0616 18:12:29.612668 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:12:40.132311 11402 slave.cpp:908] Will retry registration in 
> 11.036115265secs if necessary
> I0616 18:12:51.169366 11402 slave.cpp:908] Will retry registration in 
> 3.170850334secs if necessary
> I0616 18:12:54.341337 11402 slave.cpp:908] Will retry registration in 
> 31.81108261secs if necessary
> I0616 18:13:26.153337 11402 slave.cpp:908] Will retry registration in 
> 32.795234328secs if necessary
> I0616 18:13:29.613584 11402 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:13:58.950167 11397 slave.cpp:908] Will retry registration in 
> 4.333170412secs if necessary
> I0616 18:14:03.284204 11397 slave.cpp:908] Will retry registration in 
> 5.676033108secs if necessary
> I0616 18:14:08.960907 11397 slave.cpp:908] Will retry registration in 
> 24.53987769secs if necessary
> I0616 18:14:29.614862 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:14:33.501826 11397 slave.cpp:908] Will retry registration in 
> 38.208461328secs if necessary
> I0616 18:15:11.712097 11397 slave.cpp:908] Will retry registration in 
> 34.948547573secs if necessary
> I0616 18:15:29.616807 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:15:46.661701 11397 slave.cpp:908] Will retry registration in 
> 16.434762224secs if necessary
> I0616 18:16:03.097103 11397 slave.cpp:908] Will retry registration in 
> 33.817949031secs if necessary
> I0616 18:16:29.617578 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:16:36.915928 11397 slave.cpp:908] Will retry registration in 
> 12.893353566secs if necessary
> I0616 18:16:49.810526 11397 slave.cpp:908] Will retry registration in 
> 20.739216935secs if necessary
> I0616 18:17:10.550516 11397 slave.cpp:908] Will retry registration in 
> 6.554452174secs if necessary
> I0616 18:17:17.106112 11397 slave.cpp:908] Will retry registration in 
> 42.623420452secs if necessary
> I0616 18:17:29.618456 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:17:59.730665 11397 slave.cpp:908] Will retry registration in 
> 13.77986441secs if necessary
> I0616 18:18:13.511451 11397 slave.cpp:908] Will retry registration in 
> 9.352980297secs if necessary
> I0616 18:18:22.865526 11397 slave.cpp:908] Will retry registration in 
> 31.214509257secs if necessary
> I0616 18:18:29.619350 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:18:54.080736 11397 slave.cpp:908] Will retry registration in 
> 27.598620014secs if necessary
> I0616 18:19:21.680474 11397 slave.cpp:908] Will retry registration in 
> 54.867558206secs if necessary
> I0616 18:19:29.620360 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:20:16.549350 11397 slave.cpp:908] Will retry registration in 
> 18.530938745secs if necessary
> I0616 18:20:29.621356 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:20:35.081676 11397 slave.cpp:908] Will retry registration in 
> 27.832404285secs if necessary
> I0616 18:21:02.914613 11397 slave.cpp:908] Will retry registration in 
> 45.863194924secs if necessary
> I0616 18:21:29.622253 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:21:48.778538 11397 slave.cpp:908] Will retry registration in 
> 51.571867359secs if necessary
> I0616 18:22:29.623083 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:22:40.351889 11397 slave.cpp:908] Will retry registration in 
> 35.636265294secs if necessary
> I0616 18:23:15.989615 11397 slave.cpp:908] Will retry registration in 
> 16.370812019secs if necessary
> I0616 18:23:29.624801 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:23:32.361670 11397 slave.cpp:908] Will retry registration in 
> 14.898545003secs if necessary
> I0616 18:23:47.260529 11397 slave.cpp:908] Will retry registration in 
> 45.840079116secs if necessary
> I0616 18:24:29.626104 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:24:33.101485 11397 slave.cpp:908] Will retry registration in 
> 22.27182326secs if necessary
> I0616 18:24:55.374804 11397 slave.cpp:908] Will retry registration in 
> 41.255183639secs if necessary
> I0616 18:25:29.627053 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:25:36.630991 11397 slave.cpp:908] Will retry registration in 
> 23.675474367secs if necessary
> I0616 18:26:00.307703 11397 slave.cpp:908] Will retry registration in 
> 33.307938526secs if necessary
> I0616 18:26:29.628013 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:26:33.616930 11397 slave.cpp:908] Will retry registration in 
> 44.426033973secs if necessary
> I0616 18:27:18.043692 11397 slave.cpp:908] Will retry registration in 
> 55.486556978secs if necessary
> I0616 18:27:29.628801 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:28:13.531808 11397 slave.cpp:908] Will retry registration in 
> 6.103172826secs if necessary
> I0616 18:28:19.635555 11397 slave.cpp:908] Will retry registration in 
> 48.759204386secs if necessary
> I0616 18:28:29.629856 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:29:08.395567 11397 slave.cpp:908] Will retry registration in 
> 1.162590059secs if necessary
> I0616 18:29:09.559478 11397 slave.cpp:908] Will retry registration in 
> 30.643050517secs if necessary
> I0616 18:29:29.630686 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:29:40.203312 11397 slave.cpp:908] Will retry registration in 
> 26.967665714secs if necessary
> I0616 18:30:07.172453 11397 slave.cpp:908] Will retry registration in 
> 36.111137632secs if necessary
> I0616 18:30:29.631600 11397 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:30:43.284803 11397 slave.cpp:908] Will retry registration in 
> 47.077812769secs if necessary
> I0616 18:31:29.632673 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:31:30.366183 11398 slave.cpp:908] Will retry registration in 
> 785.614718ms if necessary
> I0616 18:31:31.152869 11398 slave.cpp:908] Will retry registration in 
> 49.004491227secs if necessary
> I0616 18:32:20.158164 11398 slave.cpp:908] Will retry registration in 
> 7.817029677secs if necessary
> I0616 18:32:27.975662 11398 slave.cpp:908] Will retry registration in 
> 7.340066892secs if necessary
> I0616 18:32:29.633713 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:32:35.316051 11398 slave.cpp:908] Will retry registration in 
> 31.627911651secs if necessary
> I0616 18:33:06.944886 11398 slave.cpp:908] Will retry registration in 
> 21.596894088secs if necessary
> I0616 18:33:28.542425 11398 slave.cpp:908] Will retry registration in 
> 16.693047218secs if necessary
> I0616 18:33:29.634438 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:33:45.236356 11398 slave.cpp:908] Will retry registration in 
> 2.842420881secs if necessary
> I0616 18:33:48.079747 11398 slave.cpp:908] Will retry registration in 
> 49.195514102secs if necessary
> I0616 18:34:29.635767 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:34:37.275954 11398 slave.cpp:908] Will retry registration in 
> 11.560605397secs if necessary
> I0616 18:34:48.837472 11398 slave.cpp:908] Will retry registration in 
> 21.373359626secs if necessary
> I0616 18:35:10.212003 11398 slave.cpp:908] Will retry registration in 
> 17.027918387secs if necessary
> I0616 18:35:27.241046 11398 slave.cpp:908] Will retry registration in 
> 57.423800349secs if necessary
> I0616 18:35:29.637367 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:36:24.666429 11398 slave.cpp:908] Will retry registration in 
> 12.945226986secs if necessary
> I0616 18:36:29.638424 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:36:37.612100 11398 slave.cpp:908] Will retry registration in 
> 52.664183682secs if necessary
> I0616 18:37:29.639224 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:37:30.276831 11398 slave.cpp:908] Will retry registration in 
> 13.794612341secs if necessary
> I0616 18:37:44.072646 11398 slave.cpp:908] Will retry registration in 
> 27.84377199secs if necessary
> I0616 18:38:11.917505 11398 slave.cpp:908] Will retry registration in 
> 38.504262798secs if necessary
> I0616 18:38:29.640174 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:38:50.423212 11398 slave.cpp:908] Will retry registration in 
> 36.066435601secs if necessary
> I0616 18:39:26.490319 11398 slave.cpp:908] Will retry registration in 
> 9.098955601secs if necessary
> I0616 18:39:29.641131 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:39:35.589862 11398 slave.cpp:908] Will retry registration in 
> 2.179737138secs if necessary
> I0616 18:39:37.770190 11398 slave.cpp:908] Will retry registration in 
> 9.374374099secs if necessary
> I0616 18:39:47.145637 11398 slave.cpp:908] Will retry registration in 
> 53.524989603secs if necessary
> I0616 18:40:29.642102 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:40:40.672101 11398 slave.cpp:908] Will retry registration in 
> 57.666294117secs if necessary
> I0616 18:41:29.643036 11398 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:41:38.339649 11398 slave.cpp:908] Will retry registration in 
> 15.477546954secs if necessary
> I0616 18:41:53.818203 11399 slave.cpp:908] Will retry registration in 
> 42.284193962secs if necessary
> I0616 18:42:29.644019 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:42:36.103744 11399 slave.cpp:908] Will retry registration in 
> 58.828884176secs if necessary
> I0616 18:43:29.644886 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:43:34.934263 11399 slave.cpp:908] Will retry registration in 
> 46.120597471secs if necessary
> I0616 18:44:21.056408 11399 slave.cpp:908] Will retry registration in 
> 9.251859648secs if necessary
> I0616 18:44:29.645841 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:44:30.309641 11399 slave.cpp:908] Will retry registration in 
> 34.940021808secs if necessary
> I0616 18:45:05.250463 11399 slave.cpp:908] Will retry registration in 
> 33.198410213secs if necessary
> I0616 18:45:29.646672 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:45:38.450315 11399 slave.cpp:908] Will retry registration in 
> 10.037474394secs if necessary
> I0616 18:45:48.488603 11399 slave.cpp:908] Will retry registration in 
> 23.944513007secs if necessary
> I0616 18:46:12.434623 11399 slave.cpp:908] Will retry registration in 
> 41.01543989secs if necessary
> I0616 18:46:29.647711 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:46:53.451635 11399 slave.cpp:908] Will retry registration in 
> 17.377541287secs if necessary
> I0616 18:47:10.829900 11399 slave.cpp:908] Will retry registration in 
> 55.572424659secs if necessary
> I0616 18:47:29.648536 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:48:06.403442 11399 slave.cpp:908] Will retry registration in 
> 2.612333978secs if necessary
> I0616 18:48:09.017345 11399 slave.cpp:908] Will retry registration in 
> 34.070588505secs if necessary
> I0616 18:48:29.649633 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:48:43.089118 11399 slave.cpp:908] Will retry registration in 
> 58.41484554secs if necessary
> I0616 18:49:29.650543 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:49:41.505424 11399 slave.cpp:908] Will retry registration in 
> 51.80784808secs if necessary
> I0616 18:50:29.651669 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:50:33.314139 11399 slave.cpp:908] Will retry registration in 
> 45.631193931secs if necessary
> I0616 18:51:18.946719 11399 slave.cpp:908] Will retry registration in 
> 19.788205139secs if necessary
> I0616 18:51:29.652379 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:51:38.736572 11399 slave.cpp:908] Will retry registration in 
> 8.83576644secs if necessary
> I0616 18:51:47.573166 11399 slave.cpp:908] Will retry registration in 
> 43.054994253secs if necessary
> I0616 18:52:29.653950 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:52:30.628626 11399 slave.cpp:908] Will retry registration in 
> 32.733432125secs if necessary
> I0616 18:53:03.363121 11399 slave.cpp:908] Will retry registration in 
> 1.499950122secs if necessary
> I0616 18:53:04.864441 11399 slave.cpp:908] Will retry registration in 
> 56.849606594secs if necessary
> I0616 18:53:29.654630 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:54:01.715442 11399 slave.cpp:908] Will retry registration in 
> 577.204088ms if necessary
> I0616 18:54:02.293781 11399 slave.cpp:908] Will retry registration in 
> 40.004212921secs if necessary
> I0616 18:54:29.656322 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:54:42.298913 11399 slave.cpp:908] Will retry registration in 
> 32.916042168secs if necessary
> I0616 18:55:15.215718 11399 slave.cpp:908] Will retry registration in 
> 9.676159717secs if necessary
> I0616 18:55:24.892429 11399 slave.cpp:908] Will retry registration in 
> 42.18395006secs if necessary
> I0616 18:55:29.657120 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:56:07.078219 11399 slave.cpp:908] Will retry registration in 
> 42.290416267secs if necessary
> I0616 18:56:29.658396 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:56:49.370077 11399 slave.cpp:908] Will retry registration in 
> 3.201149293secs if necessary
> I0616 18:56:52.571723 11399 slave.cpp:908] Will retry registration in 
> 39.850244149secs if necessary
> I0616 18:57:29.660207 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:57:32.422793 11399 slave.cpp:908] Will retry registration in 
> 57.767963222secs if necessary
> I0616 18:58:29.660903 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:58:30.191550 11399 slave.cpp:908] Will retry registration in 
> 45.485343255secs if necessary
> I0616 18:59:15.678019 11399 slave.cpp:908] Will retry registration in 
> 38.679128297secs if necessary
> I0616 18:59:29.661864 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 18:59:54.358816 11399 slave.cpp:908] Will retry registration in 
> 43.888560693secs if necessary
> I0616 19:00:29.662832 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 19:00:38.248347 11399 slave.cpp:908] Will retry registration in 
> 54.737202932secs if necessary
> I0616 19:01:29.663777 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 19:01:32.986008 11399 slave.cpp:908] Will retry registration in 
> 13.619150078secs if necessary
> I0616 19:01:46.605772 11399 slave.cpp:908] Will retry registration in 
> 17.086970879secs if necessary
> I0616 19:02:03.693934 11399 slave.cpp:908] Will retry registration in 
> 4.774677299secs if necessary
> I0616 19:02:08.469562 11399 slave.cpp:908] Will retry registration in 
> 37.563663086secs if necessary
> I0616 19:02:29.664757 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 19:02:46.034406 11399 slave.cpp:908] Will retry registration in 
> 58.102410798secs if necessary
> I0616 19:03:29.665621 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 19:03:44.144069 11399 slave.cpp:908] Will retry registration in 
> 22.152218586secs if necessary
> I0616 19:04:06.297528 11399 slave.cpp:908] Will retry registration in 
> 33.136087718secs if necessary
> I0616 19:04:29.666635 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 19:04:39.434396 11399 slave.cpp:908] Will retry registration in 
> 714.744748ms if necessary
> I0616 19:04:40.149935 11399 slave.cpp:908] Will retry registration in 
> 56.22280712secs if necessary
> I0616 19:05:29.667616 11399 slave.cpp:2923] Current usage 4.19%. Max allowed 
> age: 6.006391780402407days
> I0616 19:05:36.373328 11399 slave.cpp:908] Will retry registration in 
> 31.55093323secs if necessary
> Build timed out (after 180 minutes). Marking the build as failed.
> erreicht: 2295685
> Build was aborted
> {{noformat}}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to