[
https://issues.apache.org/jira/browse/MESOS-6745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15732327#comment-15732327
]
Benjamin Bannier commented on MESOS-6745:
-----------------------------------------
The issue here seems to be that the scheduler sends status update
acknowledgements in not exactly in the order the agent originally sent the
updates.
{code}
E1208 03:32:35.358795 29303 slave.cpp:3018] Failed to handle status update
acknowledgement (UUID: aed3ed28-1943-44c3-a8b6-40be41ffc20b) for task
93d62044-e146-4b70-9648-221b72cfaad7 of framework
67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000: Duplicate acknowledgement
{code}
(The error string {{Duplicate acknowledgment}} is incorrect here; the only
issue was that we were not waiting for this exact acknowledgement).
[~anandmazumdar] [~vinodkone]: Should the status update manager allow
acknowledging in any order? The documentation does not make a strong point
about ordering, and it would be relatively easy to e.g., subscribe to
schedulers to the same stream, which would lead to issues like this on in
production scenarios.
{code}
# ACKNOWLEDGE
Sent by the scheduler to acknowledge a status update. Note that with the new
API, schedulers are responsible for explicitly acknowledging the receipt of
status updates that have “status.uuid()” set. These status updates are reliably
retried until they are acknowledged by the scheduler. The scheduler must not
acknowledge status updates that do not have “status.uuid()” set as they are not
retried. “uuid” is raw bytes encoded in Base64.
{code}
> MesosContainerizer/DefaultExecutorTest.KillTask/0 is flaky
> ----------------------------------------------------------
>
> Key: MESOS-6745
> URL: https://issues.apache.org/jira/browse/MESOS-6745
> Project: Mesos
> Issue Type: Bug
> Environment: Recent Arch Linux VM
> Reporter: Neil Conway
> Labels: mesosphere
>
> This repros consistently for me (< 20 test iterations), using {{master}} as
> of {{ab79d58c9df0ffb8ad35f6662541e7a5c3ea4a80}}. Test log:
> {noformat}
> [----------] 1 test from MesosContainerizer/DefaultExecutorTest
> [ RUN ] MesosContainerizer/DefaultExecutorTest.KillTask/0
> I1208 03:32:34.943745 29285 cluster.cpp:160] Creating default 'local'
> authorizer
> I1208 03:32:34.944695 29285 replica.cpp:776] Replica recovered with log
> positions 0 -> 0 with 1 holes and 0 unlearned
> I1208 03:32:34.945287 29306 recover.cpp:451] Starting replica recovery
> I1208 03:32:34.945431 29306 recover.cpp:477] Replica is in EMPTY status
> I1208 03:32:34.946542 29300 replica.cpp:673] Replica in EMPTY status received
> a broadcasted recover request from __req_res__(127)@10.0.2.15:36807
> I1208 03:32:34.946768 29301 recover.cpp:197] Received a recover response from
> a replica in EMPTY status
> I1208 03:32:34.947377 29299 recover.cpp:568] Updating replica status to
> STARTING
> I1208 03:32:34.947746 29306 replica.cpp:320] Persisted replica status to
> STARTING
> I1208 03:32:34.947887 29306 recover.cpp:477] Replica is in STARTING status
> I1208 03:32:34.948559 29306 replica.cpp:673] Replica in STARTING status
> received a broadcasted recover request from __req_res__(128)@10.0.2.15:36807
> I1208 03:32:34.948771 29299 recover.cpp:197] Received a recover response from
> a replica in STARTING status
> I1208 03:32:34.949097 29302 recover.cpp:568] Updating replica status to VOTING
> I1208 03:32:34.949385 29306 replica.cpp:320] Persisted replica status to
> VOTING
> I1208 03:32:34.949467 29306 recover.cpp:582] Successfully joined the Paxos
> group
> I1208 03:32:34.971436 29301 master.cpp:380] Master
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290 (archlinux.vagrant.vm) started on
> 10.0.2.15:36807
> I1208 03:32:34.971519 29301 master.cpp:382] Flags at startup: --acls=""
> --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins"
> --allocation_interval="1secs" --allocator="HierarchicalDRF"
> --authenticate_agents="true" --authenticate_frameworks="true"
> --authenticate_http_frameworks="true" --authenticate_http_readonly="true"
> --authenticate_http_readwrite="true" --authenticators="crammd5"
> --authorizers="local" --credentials="/tmp/8oMk6W/credentials"
> --framework_sorter="drf" --help="false" --hostname_lookup="true"
> --http_authenticators="basic" --http_framework_authenticators="basic"
> --initialize_driver_logging="true" --log_auto_initialize="true"
> --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5"
> --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000"
> --quiet="false" --recovery_agent_removal_limit="100%"
> --registry="replicated_log" --registry_fetch_timeout="1mins"
> --registry_gc_interval="15mins" --registry_max_agent_age="2weeks"
> --registry_max_agent_count="102400" --registry_store_timeout="100secs"
> --registry_strict="false" --root_submissions="true" --user_sorter="drf"
> --version="false" --webui_dir="/usr/local/share/mesos/webui"
> --work_dir="/tmp/8oMk6W/master" --zk_session_timeout="10secs"
> I1208 03:32:34.971824 29301 master.cpp:432] Master only allowing
> authenticated frameworks to register
> I1208 03:32:34.971832 29301 master.cpp:446] Master only allowing
> authenticated agents to register
> I1208 03:32:34.971837 29301 master.cpp:459] Master only allowing
> authenticated HTTP frameworks to register
> I1208 03:32:34.971842 29301 credentials.hpp:37] Loading credentials for
> authentication from '/tmp/8oMk6W/credentials'
> I1208 03:32:34.972051 29301 master.cpp:504] Using default 'crammd5'
> authenticator
> I1208 03:32:34.972198 29301 http.cpp:922] Using default 'basic' HTTP
> authenticator for realm 'mesos-master-readonly'
> I1208 03:32:34.972327 29301 http.cpp:922] Using default 'basic' HTTP
> authenticator for realm 'mesos-master-readwrite'
> I1208 03:32:34.972436 29301 http.cpp:922] Using default 'basic' HTTP
> authenticator for realm 'mesos-master-scheduler'
> I1208 03:32:34.972561 29301 master.cpp:584] Authorization enabled
> I1208 03:32:34.974555 29300 master.cpp:2043] Elected as the leading master!
> I1208 03:32:34.974586 29300 master.cpp:1566] Recovering from registrar
> I1208 03:32:34.975244 29306 log.cpp:553] Attempting to start the writer
> I1208 03:32:34.976706 29304 replica.cpp:493] Replica received implicit
> promise request from __req_res__(129)@10.0.2.15:36807 with proposal 1
> I1208 03:32:34.976793 29304 replica.cpp:342] Persisted promised to 1
> I1208 03:32:34.977449 29300 coordinator.cpp:238] Coordinator attempting to
> fill missing positions
> I1208 03:32:34.978907 29303 replica.cpp:388] Replica received explicit
> promise request from __req_res__(130)@10.0.2.15:36807 for position 0 with
> proposal 2
> I1208 03:32:34.980016 29303 replica.cpp:537] Replica received write request
> for position 0 from __req_res__(131)@10.0.2.15:36807
> I1208 03:32:34.980762 29304 replica.cpp:691] Replica received learned notice
> for position 0 from @0.0.0.0:0
> I1208 03:32:34.981369 29303 log.cpp:569] Writer started with ending position 0
> I1208 03:32:34.982964 29300 registrar.cpp:362] Successfully fetched the
> registry (0B) in 8.218112ms
> I1208 03:32:34.983037 29300 registrar.cpp:461] Applied 1 operations in
> 10890ns; attempting to update the registry
> I1208 03:32:34.983845 29300 coordinator.cpp:348] Coordinator attempting to
> write APPEND action at position 1
> I1208 03:32:34.984659 29300 replica.cpp:537] Replica received write request
> for position 1 from __req_res__(132)@10.0.2.15:36807
> I1208 03:32:34.985409 29300 replica.cpp:691] Replica received learned notice
> for position 1 from @0.0.0.0:0
> I1208 03:32:34.986521 29300 registrar.cpp:506] Successfully updated the
> registry in 3.441152ms
> I1208 03:32:34.986608 29300 registrar.cpp:392] Successfully recovered
> registrar
> I1208 03:32:34.986986 29300 master.cpp:1682] Recovered 0 agents from the
> registry (145B); allowing 10mins for agents to re-register
> I1208 03:32:34.987040 29300 coordinator.cpp:348] Coordinator attempting to
> write TRUNCATE action at position 2
> I1208 03:32:34.987974 29306 replica.cpp:537] Replica received write request
> for position 2 from __req_res__(133)@10.0.2.15:36807
> I1208 03:32:34.988716 29299 replica.cpp:691] Replica received learned notice
> for position 2 from @0.0.0.0:0
> I1208 03:32:35.014484 29285 containerizer.cpp:207] Using isolation:
> posix/cpu,posix/mem,filesystem/posix,network/cni
> W1208 03:32:35.014842 29285 backend.cpp:76] Failed to create 'bind' backend:
> BindBackend requires root privileges
> I1208 03:32:35.016302 29285 cluster.cpp:446] Creating default 'local'
> authorizer
> I1208 03:32:35.017352 29299 slave.cpp:208] Mesos agent started on
> (15)@10.0.2.15:36807
> I1208 03:32:35.017374 29299 slave.cpp:209] Flags at startup: --acls=""
> --appc_simple_discovery_uri_prefix="http://";
> --appc_store_dir="/tmp/mesos/store/appc" --authenticate_http_readonly="true"
> --authenticate_http_readwrite="false" --authenticatee="crammd5"
> --authentication_backoff_factor="1secs" --authorizer="local"
> --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false"
> --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false"
> --cgroups_root="mesos" --container_disk_watch_interval="15secs"
> --containerizers="mesos"
> --credential="/tmp/MesosContainerizer_DefaultExecutorTest_KillTask_0_MN1ibR/credential"
> --default_role="*" --disk_watch_interval="1mins" --docker="docker"
> --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io";
> --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock"
> --docker_stop_timeout="0ns" --docker_store_dir="/tmp/mesos/store/docker"
> --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume"
> --enforce_container_disk_quota="false"
> --executor_registration_timeout="1mins"
> --executor_shutdown_grace_period="5secs"
> --fetcher_cache_dir="/tmp/MesosContainerizer_DefaultExecutorTest_KillTask_0_MN1ibR/fetch"
> --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
> --gc_disk_headroom="0.1" --hadoop_home="" --help="false"
> --hostname_lookup="true" --http_authenticators="basic"
> --http_command_executor="false"
> --http_credentials="/tmp/MesosContainerizer_DefaultExecutorTest_KillTask_0_MN1ibR/http_credentials"
> --image_provisioner_backend="copy" --initialize_driver_logging="true"
> --io_switchboard_enable_server="true" --isolation="posix/cpu,posix/mem"
> --launcher="posix" --launcher_dir="/home/vagrant/build-mesos/src"
> --logbufsecs="0" --logging_level="INFO"
> --max_completed_executors_per_framework="150"
> --oversubscribed_resources_interval="15secs" --perf_duration="10secs"
> --perf_interval="1mins" --qos_correction_interval_min="0ns" --quiet="false"
> --recover="reconnect" --recovery_timeout="15mins"
> --registration_backoff_factor="10ms"
> --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]"
> --revocable_cpu_low_priority="true"
> --runtime_dir="/tmp/MesosContainerizer_DefaultExecutorTest_KillTask_0_MN1ibR"
> --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true"
> --systemd_enable_support="true"
> --systemd_runtime_directory="/run/systemd/system" --version="false"
> --work_dir="/tmp/MesosContainerizer_DefaultExecutorTest_KillTask_0_HvRO8o"
> I1208 03:32:35.017683 29299 credentials.hpp:86] Loading credential for
> authentication from
> '/tmp/MesosContainerizer_DefaultExecutorTest_KillTask_0_MN1ibR/credential'
> I1208 03:32:35.017772 29285 scheduler.cpp:182] Version: 1.2.0
> I1208 03:32:35.017784 29299 slave.cpp:346] Agent using credential for:
> test-principal
> I1208 03:32:35.017797 29299 credentials.hpp:37] Loading credentials for
> authentication from
> '/tmp/MesosContainerizer_DefaultExecutorTest_KillTask_0_MN1ibR/http_credentials'
> I1208 03:32:35.017921 29299 http.cpp:922] Using default 'basic' HTTP
> authenticator for realm 'mesos-agent-readonly'
> I1208 03:32:35.038817 29306 scheduler.cpp:475] New master detected at
> master@10.0.2.15:36807
> I1208 03:32:35.039311 29299 slave.cpp:533] Agent resources: cpus(*):2;
> mem(*):1024; disk(*):1024; ports(*):[31000-32000]
> I1208 03:32:35.039384 29299 slave.cpp:541] Agent attributes: [ ]
> I1208 03:32:35.039393 29299 slave.cpp:546] Agent hostname:
> archlinux.vagrant.vm
> I1208 03:32:35.041291 29300 state.cpp:57] Recovering state from
> '/tmp/MesosContainerizer_DefaultExecutorTest_KillTask_0_HvRO8o/meta'
> I1208 03:32:35.041695 29305 status_update_manager.cpp:203] Recovering status
> update manager
> I1208 03:32:35.042660 29305 containerizer.cpp:581] Recovering containerizer
> I1208 03:32:35.043954 29305 provisioner.cpp:253] Provisioner recovery complete
> I1208 03:32:35.044245 29305 slave.cpp:5414] Finished recovery
> I1208 03:32:35.044770 29305 slave.cpp:918] New master detected at
> master@10.0.2.15:36807
> I1208 03:32:35.044790 29305 slave.cpp:977] Authenticating with master
> master@10.0.2.15:36807
> I1208 03:32:35.044831 29305 slave.cpp:988] Using default CRAM-MD5
> authenticatee
> I1208 03:32:35.044935 29305 slave.cpp:950] Detecting new master
> I1208 03:32:35.045037 29305 status_update_manager.cpp:177] Pausing sending
> status updates
> I1208 03:32:35.045119 29305 authenticatee.cpp:121] Creating new client SASL
> connection
> I1208 03:32:35.045295 29305 master.cpp:6793] Authenticating
> slave(15)@10.0.2.15:36807
> I1208 03:32:35.045591 29305 authenticator.cpp:98] Creating new server SASL
> connection
> I1208 03:32:35.045696 29305 authenticatee.cpp:213] Received SASL
> authentication mechanisms: CRAM-MD5
> I1208 03:32:35.045711 29305 authenticatee.cpp:239] Attempting to authenticate
> with mechanism 'CRAM-MD5'
> I1208 03:32:35.045755 29305 authenticator.cpp:204] Received SASL
> authentication start
> I1208 03:32:35.045783 29305 authenticator.cpp:326] Authentication requires
> more steps
> I1208 03:32:35.045820 29305 authenticatee.cpp:259] Received SASL
> authentication step
> I1208 03:32:35.045864 29305 authenticator.cpp:232] Received SASL
> authentication step
> I1208 03:32:35.045912 29305 authenticator.cpp:318] Authentication success
> I1208 03:32:35.046001 29305 authenticatee.cpp:299] Authentication success
> I1208 03:32:35.046047 29305 master.cpp:6823] Successfully authenticated
> principal 'test-principal' at slave(15)@10.0.2.15:36807
> I1208 03:32:35.046273 29305 slave.cpp:1072] Successfully authenticated with
> master master@10.0.2.15:36807
> I1208 03:32:35.046571 29305 master.cpp:5202] Registering agent at
> slave(15)@10.0.2.15:36807 (archlinux.vagrant.vm) with id
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0
> I1208 03:32:35.046859 29305 registrar.cpp:461] Applied 1 operations in
> 36199ns; attempting to update the registry
> I1208 03:32:35.047488 29305 coordinator.cpp:348] Coordinator attempting to
> write APPEND action at position 3
> I1208 03:32:35.048190 29303 replica.cpp:537] Replica received write request
> for position 3 from __req_res__(134)@10.0.2.15:36807
> I1208 03:32:35.048971 29305 replica.cpp:691] Replica received learned notice
> for position 3 from @0.0.0.0:0
> I1208 03:32:35.049500 29306 http.cpp:391] HTTP POST for
> /master/api/v1/scheduler from 10.0.2.15:54722
> I1208 03:32:35.049639 29306 master.cpp:2340] Received subscription request
> for HTTP framework 'default'
> I1208 03:32:35.049691 29306 master.cpp:2079] Authorizing framework principal
> 'test-principal' to receive offers for role '*'
> I1208 03:32:35.050125 29304 master.cpp:2454] Subscribing framework 'default'
> with checkpointing disabled and capabilities [ ]
> I1208 03:32:35.050231 29306 registrar.cpp:506] Successfully updated the
> registry in 3.32416ms
> I1208 03:32:35.050590 29299 hierarchical.cpp:275] Added framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.050866 29299 coordinator.cpp:348] Coordinator attempting to
> write TRUNCATE action at position 4
> I1208 03:32:35.050879 29304 master.cpp:5273] Registered agent
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0 at slave(15)@10.0.2.15:36807
> (archlinux.vagrant.vm) with cpus(*):2; mem(*):1024; disk(*):1024;
> ports(*):[31000-32000]
> I1208 03:32:35.051034 29306 slave.cpp:1118] Registered with master
> master@10.0.2.15:36807; given agent ID 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0
> I1208 03:32:35.051120 29304 hierarchical.cpp:485] Added agent
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0 (archlinux.vagrant.vm) with
> cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] (allocated: {})
> I1208 03:32:35.051209 29299 status_update_manager.cpp:184] Resuming sending
> status updates
> I1208 03:32:35.051242 29306 slave.cpp:1178] Forwarding total oversubscribed
> resources {}
> I1208 03:32:35.051383 29299 master.cpp:5672] Received update of agent
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0 at slave(15)@10.0.2.15:36807
> (archlinux.vagrant.vm) with total oversubscribed resources {}
> I1208 03:32:35.051553 29299 replica.cpp:537] Replica received write request
> for position 4 from __req_res__(135)@10.0.2.15:36807
> I1208 03:32:35.051617 29304 hierarchical.cpp:555] Agent
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0 (archlinux.vagrant.vm) updated with
> oversubscribed resources {} (total: cpus(*):2; mem(*):1024; disk(*):1024;
> ports(*):[31000-32000], allocated: cpus(*):2; mem(*):1024; disk(*):1024;
> ports(*):[31000-32000])
> I1208 03:32:35.051746 29306 master.cpp:6622] Sending 1 offers to framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 (default)
> I1208 03:32:35.051970 29299 replica.cpp:691] Replica received learned notice
> for position 4 from @0.0.0.0:0
> I1208 03:32:35.057456 29300 http.cpp:391] HTTP POST for
> /master/api/v1/scheduler from 10.0.2.15:54720
> I1208 03:32:35.058238 29300 master.cpp:3629] Processing ACCEPT call for
> offers: [ 67de7bda-9b5b-4fe9-aede-390ec9ca7290-O0 ] on agent
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0 at slave(15)@10.0.2.15:36807
> (archlinux.vagrant.vm) for framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 (default)
> I1208 03:32:35.058313 29300 master.cpp:3216] Authorizing framework principal
> 'test-principal' to launch task 93d62044-e146-4b70-9648-221b72cfaad7
> I1208 03:32:35.058464 29300 master.cpp:3216] Authorizing framework principal
> 'test-principal' to launch task 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b
> I1208 03:32:35.060178 29302 master.cpp:8424] Adding task
> 93d62044-e146-4b70-9648-221b72cfaad7 with resources cpus(*):0.1; mem(*):32;
> disk(*):32 on agent 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0
> (archlinux.vagrant.vm)
> I1208 03:32:35.060353 29302 master.cpp:8424] Adding task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b with resources cpus(*):0.1; mem(*):32;
> disk(*):32 on agent 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0
> (archlinux.vagrant.vm)
> I1208 03:32:35.060420 29302 master.cpp:4486] Launching task group {
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b, 93d62044-e146-4b70-9648-221b72cfaad7 }
> of framework 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 (default) with
> resources cpus(*):0.2; mem(*):64; disk(*):64 on agent
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0 at slave(15)@10.0.2.15:36807
> (archlinux.vagrant.vm)
> I1208 03:32:35.060748 29300 slave.cpp:1550] Got assigned task group
> containing tasks [ 93d62044-e146-4b70-9648-221b72cfaad7,
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b ] for framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.061226 29300 slave.cpp:1712] Launching task group containing
> tasks [ 93d62044-e146-4b70-9648-221b72cfaad7,
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b ] for framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.061377 29300 paths.cpp:530] Trying to chown
> '/tmp/MesosContainerizer_DefaultExecutorTest_KillTask_0_HvRO8o/slaves/67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0/frameworks/67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000/executors/default/runs/935514b3-95ae-450e-b766-084fb5e7734e'
> to user 'vagrant'
> I1208 03:32:35.066329 29300 slave.cpp:6341] Launching executor 'default' of
> framework 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 with resources
> cpus(*):0.1; mem(*):32; disk(*):32 in work directory
> '/tmp/MesosContainerizer_DefaultExecutorTest_KillTask_0_HvRO8o/slaves/67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0/frameworks/67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000/executors/default/runs/935514b3-95ae-450e-b766-084fb5e7734e'
> I1208 03:32:35.066738 29302 containerizer.cpp:973] Starting container
> 935514b3-95ae-450e-b766-084fb5e7734e for executor 'default' of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.066845 29300 slave.cpp:2034] Queued task group containing
> tasks [ 93d62044-e146-4b70-9648-221b72cfaad7,
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b ] for executor 'default' of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.070379 29302 launcher.cpp:133] Forked child with pid '30301'
> for container '935514b3-95ae-450e-b766-084fb5e7734e'
> I1208 03:32:35.251523 30315 executor.cpp:189] Version: 1.2.0
> I1208 03:32:35.259582 29301 http.cpp:288] HTTP POST for
> /slave(15)/api/v1/executor from 10.0.2.15:54724
> I1208 03:32:35.259738 29301 slave.cpp:3089] Received Subscribe request for
> HTTP executor 'default' of framework 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.261139 29299 slave.cpp:2279] Sending queued task group task
> group containing tasks [ 93d62044-e146-4b70-9648-221b72cfaad7,
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b ] to executor 'default' of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 (via HTTP)
> I1208 03:32:35.264493 30330 default_executor.cpp:131] Received SUBSCRIBED
> event
> I1208 03:32:35.271474 30330 default_executor.cpp:135] Subscribed executor on
> archlinux.vagrant.vm
> I1208 03:32:35.271862 30330 default_executor.cpp:131] Received LAUNCH_GROUP
> event
> I1208 03:32:35.275249 29301 http.cpp:288] HTTP POST for /slave(15)/api/v1
> from 10.0.2.15:54728
> I1208 03:32:35.275681 29301 http.cpp:449] Processing call
> LAUNCH_NESTED_CONTAINER
> I1208 03:32:35.275827 29301 http.cpp:288] HTTP POST for /slave(15)/api/v1
> from 10.0.2.15:54728
> I1208 03:32:35.276204 29301 http.cpp:449] Processing call
> LAUNCH_NESTED_CONTAINER
> I1208 03:32:35.276213 29303 containerizer.cpp:1776] Starting nested container
> 935514b3-95ae-450e-b766-084fb5e7734e.1df56862-093d-4a93-85e0-f955c67c333c
> I1208 03:32:35.276324 29303 containerizer.cpp:1800] Trying to chown
> '/tmp/MesosContainerizer_DefaultExecutorTest_KillTask_0_HvRO8o/slaves/67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0/frameworks/67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000/executors/default/runs/935514b3-95ae-450e-b766-084fb5e7734e/containers/1df56862-093d-4a93-85e0-f955c67c333c'
> to user 'vagrant'
> I1208 03:32:35.282511 29303 containerizer.cpp:1776] Starting nested container
> 935514b3-95ae-450e-b766-084fb5e7734e.97ef5b4e-b4be-4777-b8d8-180333e5a3d3
> I1208 03:32:35.282573 29303 containerizer.cpp:1800] Trying to chown
> '/tmp/MesosContainerizer_DefaultExecutorTest_KillTask_0_HvRO8o/slaves/67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0/frameworks/67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000/executors/default/runs/935514b3-95ae-450e-b766-084fb5e7734e/containers/97ef5b4e-b4be-4777-b8d8-180333e5a3d3'
> to user 'vagrant'
> I1208 03:32:35.288836 29303 launcher.cpp:133] Forked child with pid '30340'
> for container
> '935514b3-95ae-450e-b766-084fb5e7734e.1df56862-093d-4a93-85e0-f955c67c333c'
> I1208 03:32:35.291239 29303 launcher.cpp:133] Forked child with pid '30341'
> for container
> '935514b3-95ae-450e-b766-084fb5e7734e.97ef5b4e-b4be-4777-b8d8-180333e5a3d3'
> I1208 03:32:35.301012 30331 default_executor.cpp:452] Successfully launched
> child containers [
> 935514b3-95ae-450e-b766-084fb5e7734e.1df56862-093d-4a93-85e0-f955c67c333c,
> 935514b3-95ae-450e-b766-084fb5e7734e.97ef5b4e-b4be-4777-b8d8-180333e5a3d3 ]
> for tasks [ 93d62044-e146-4b70-9648-221b72cfaad7,
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b ]
> I1208 03:32:35.304010 30335 default_executor.cpp:528] Waiting for child
> container
> 935514b3-95ae-450e-b766-084fb5e7734e.1df56862-093d-4a93-85e0-f955c67c333c of
> task '93d62044-e146-4b70-9648-221b72cfaad7'
> I1208 03:32:35.304203 30335 default_executor.cpp:528] Waiting for child
> container
> 935514b3-95ae-450e-b766-084fb5e7734e.97ef5b4e-b4be-4777-b8d8-180333e5a3d3 of
> task '004a6d7e-e6be-4a1c-a23d-b5b83e69a19b'
> I1208 03:32:35.305105 29299 http.cpp:288] HTTP POST for
> /slave(15)/api/v1/executor from 10.0.2.15:54726
> I1208 03:32:35.305248 29299 slave.cpp:3743] Handling status update
> TASK_RUNNING (UUID: b3bbc1e3-b15b-4227-94ff-209b0d7aa181) for task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.306941 29299 http.cpp:288] HTTP POST for
> /slave(15)/api/v1/executor from 10.0.2.15:54726
> I1208 03:32:35.307052 29299 slave.cpp:3743] Handling status update
> TASK_RUNNING (UUID: aed3ed28-1943-44c3-a8b6-40be41ffc20b) for task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.307536 29301 http.cpp:288] HTTP POST for /slave(15)/api/v1
> from 10.0.2.15:54730
> I1208 03:32:35.307814 29301 http.cpp:288] HTTP POST for /slave(15)/api/v1
> from 10.0.2.15:54732
> I1208 03:32:35.308068 29301 http.cpp:449] Processing call
> WAIT_NESTED_CONTAINER
> I1208 03:32:35.308425 29301 http.cpp:449] Processing call
> WAIT_NESTED_CONTAINER
> I1208 03:32:35.308574 29305 status_update_manager.cpp:323] Received status
> update TASK_RUNNING (UUID: aed3ed28-1943-44c3-a8b6-40be41ffc20b) for task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.309396 29304 status_update_manager.cpp:323] Received status
> update TASK_RUNNING (UUID: b3bbc1e3-b15b-4227-94ff-209b0d7aa181) for task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.309468 29299 slave.cpp:4184] Forwarding the update
> TASK_RUNNING (UUID: aed3ed28-1943-44c3-a8b6-40be41ffc20b) for task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 to master@10.0.2.15:36807
> I1208 03:32:35.309793 29299 master.cpp:5808] Status update TASK_RUNNING
> (UUID: aed3ed28-1943-44c3-a8b6-40be41ffc20b) for task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 from agent
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0 at slave(15)@10.0.2.15:36807
> (archlinux.vagrant.vm)
> I1208 03:32:35.309833 29299 master.cpp:5870] Forwarding status update
> TASK_RUNNING (UUID: aed3ed28-1943-44c3-a8b6-40be41ffc20b) for task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.309991 29304 slave.cpp:4184] Forwarding the update
> TASK_RUNNING (UUID: b3bbc1e3-b15b-4227-94ff-209b0d7aa181) for task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 to master@10.0.2.15:36807
> I1208 03:32:35.310056 29299 master.cpp:7790] Updating the state of task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 (latest state: TASK_RUNNING, status
> update state: TASK_RUNNING)
> I1208 03:32:35.310166 29299 master.cpp:5808] Status update TASK_RUNNING
> (UUID: b3bbc1e3-b15b-4227-94ff-209b0d7aa181) for task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 from agent
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0 at slave(15)@10.0.2.15:36807
> (archlinux.vagrant.vm)
> I1208 03:32:35.310199 29299 master.cpp:5870] Forwarding status update
> TASK_RUNNING (UUID: b3bbc1e3-b15b-4227-94ff-209b0d7aa181) for task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.310392 29299 master.cpp:7790] Updating the state of task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 (latest state: TASK_RUNNING, status
> update state: TASK_RUNNING)
> I1208 03:32:35.312916 30333 default_executor.cpp:131] Received ACKNOWLEDGED
> event
> I1208 03:32:35.313199 30333 default_executor.cpp:131] Received ACKNOWLEDGED
> event
> I1208 03:32:35.357170 29303 http.cpp:391] HTTP POST for
> /master/api/v1/scheduler from 10.0.2.15:54720
> I1208 03:32:35.357322 29303 master.cpp:4918] Processing ACKNOWLEDGE call
> aed3ed28-1943-44c3-a8b6-40be41ffc20b for task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 (default) on agent
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0
> I1208 03:32:35.358458 29303 status_update_manager.cpp:395] Received status
> update acknowledgement (UUID: aed3ed28-1943-44c3-a8b6-40be41ffc20b) for task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> W1208 03:32:35.358573 29303 status_update_manager.cpp:769] Unexpected status
> update acknowledgement (received aed3ed28-1943-44c3-a8b6-40be41ffc20b,
> expecting b3bbc1e3-b15b-4227-94ff-209b0d7aa181) for update TASK_RUNNING
> (UUID: b3bbc1e3-b15b-4227-94ff-209b0d7aa181) for task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> E1208 03:32:35.358795 29303 slave.cpp:3018] Failed to handle status update
> acknowledgement (UUID: aed3ed28-1943-44c3-a8b6-40be41ffc20b) for task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000: Duplicate acknowledgement
> I1208 03:32:35.359001 29303 http.cpp:391] HTTP POST for
> /master/api/v1/scheduler from 10.0.2.15:54720
> I1208 03:32:35.359069 29303 master.cpp:4918] Processing ACKNOWLEDGE call
> b3bbc1e3-b15b-4227-94ff-209b0d7aa181 for task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 (default) on agent
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0
> I1208 03:32:35.359213 29303 http.cpp:391] HTTP POST for
> /master/api/v1/scheduler from 10.0.2.15:54720
> I1208 03:32:35.359316 29303 master.cpp:4810] Telling agent
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0 at slave(15)@10.0.2.15:36807
> (archlinux.vagrant.vm) to kill task 93d62044-e146-4b70-9648-221b72cfaad7 of
> framework 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 (default)
> I1208 03:32:35.359495 29303 slave.cpp:2347] Asked to kill task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.359784 29303 status_update_manager.cpp:395] Received status
> update acknowledgement (UUID: b3bbc1e3-b15b-4227-94ff-209b0d7aa181) for task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> W1208 03:32:35.359866 29303 status_update_manager.cpp:769] Unexpected status
> update acknowledgement (received b3bbc1e3-b15b-4227-94ff-209b0d7aa181,
> expecting aed3ed28-1943-44c3-a8b6-40be41ffc20b) for update TASK_RUNNING
> (UUID: aed3ed28-1943-44c3-a8b6-40be41ffc20b) for task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> E1208 03:32:35.360075 29303 slave.cpp:3018] Failed to handle status update
> acknowledgement (UUID: b3bbc1e3-b15b-4227-94ff-209b0d7aa181) for task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000: Duplicate acknowledgement
> I1208 03:32:35.361574 30334 default_executor.cpp:131] Received KILL event
> I1208 03:32:35.361610 30334 default_executor.cpp:809] Received kill for task
> '93d62044-e146-4b70-9648-221b72cfaad7'
> I1208 03:32:35.361631 30334 default_executor.cpp:687] Shutting down
> I1208 03:32:35.362273 30332 default_executor.cpp:781] Killing child container
> 935514b3-95ae-450e-b766-084fb5e7734e.1df56862-093d-4a93-85e0-f955c67c333c
> I1208 03:32:35.362457 30332 default_executor.cpp:781] Killing child container
> 935514b3-95ae-450e-b766-084fb5e7734e.97ef5b4e-b4be-4777-b8d8-180333e5a3d3
> I1208 03:32:35.364953 29304 http.cpp:288] HTTP POST for /slave(15)/api/v1
> from 10.0.2.15:54734
> I1208 03:32:35.365206 29304 http.cpp:288] HTTP POST for /slave(15)/api/v1
> from 10.0.2.15:54734
> I1208 03:32:35.365443 29304 http.cpp:449] Processing call
> KILL_NESTED_CONTAINER
> I1208 03:32:35.365655 29304 http.cpp:449] Processing call
> KILL_NESTED_CONTAINER
> I1208 03:32:35.365854 29301 containerizer.cpp:2087] Destroying container
> 935514b3-95ae-450e-b766-084fb5e7734e.1df56862-093d-4a93-85e0-f955c67c333c in
> RUNNING state
> I1208 03:32:35.366088 29301 containerizer.cpp:2087] Destroying container
> 935514b3-95ae-450e-b766-084fb5e7734e.97ef5b4e-b4be-4777-b8d8-180333e5a3d3 in
> RUNNING state
> I1208 03:32:35.366221 29301 launcher.cpp:149] Asked to destroy container
> 935514b3-95ae-450e-b766-084fb5e7734e.1df56862-093d-4a93-85e0-f955c67c333c
> I1208 03:32:35.373039 29301 launcher.cpp:149] Asked to destroy container
> 935514b3-95ae-450e-b766-084fb5e7734e.97ef5b4e-b4be-4777-b8d8-180333e5a3d3
> I1208 03:32:35.435508 29305 containerizer.cpp:2450] Container
> 935514b3-95ae-450e-b766-084fb5e7734e.1df56862-093d-4a93-85e0-f955c67c333c has
> exited
> I1208 03:32:35.436269 29305 containerizer.cpp:2450] Container
> 935514b3-95ae-450e-b766-084fb5e7734e.97ef5b4e-b4be-4777-b8d8-180333e5a3d3 has
> exited
> I1208 03:32:35.438416 29306 containerizer.cpp:2366] Checkpointing termination
> state to nested container's runtime directory
> '/tmp/MesosContainerizer_DefaultExecutorTest_KillTask_0_MN1ibR/containers/935514b3-95ae-450e-b766-084fb5e7734e/containers/1df56862-093d-4a93-85e0-f955c67c333c/termination'
> I1208 03:32:35.440366 29306 containerizer.cpp:2366] Checkpointing termination
> state to nested container's runtime directory
> '/tmp/MesosContainerizer_DefaultExecutorTest_KillTask_0_MN1ibR/containers/935514b3-95ae-450e-b766-084fb5e7734e/containers/97ef5b4e-b4be-4777-b8d8-180333e5a3d3/termination'
> I1208 03:32:35.442040 30332 default_executor.cpp:656] Successfully waited for
> child container
> 935514b3-95ae-450e-b766-084fb5e7734e.1df56862-093d-4a93-85e0-f955c67c333c of
> task '93d62044-e146-4b70-9648-221b72cfaad7' in state TASK_KILLED
> I1208 03:32:35.443637 30333 default_executor.cpp:656] Successfully waited for
> child container
> 935514b3-95ae-450e-b766-084fb5e7734e.97ef5b4e-b4be-4777-b8d8-180333e5a3d3 of
> task '004a6d7e-e6be-4a1c-a23d-b5b83e69a19b' in state TASK_KILLED
> I1208 03:32:35.443677 30333 default_executor.cpp:767] Terminating after 1secs
> I1208 03:32:35.487275 29305 http.cpp:288] HTTP POST for
> /slave(15)/api/v1/executor from 10.0.2.15:54726
> I1208 03:32:35.487534 29305 slave.cpp:3743] Handling status update
> TASK_KILLED (UUID: f15f490b-a278-406e-abfa-9f1129d7c036) for task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.488466 29305 http.cpp:288] HTTP POST for
> /slave(15)/api/v1/executor from 10.0.2.15:54726
> I1208 03:32:35.488623 29305 slave.cpp:3743] Handling status update
> TASK_KILLED (UUID: 0bed5420-7a04-49fe-9823-2d6a7aff53dc) for task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.489390 29300 status_update_manager.cpp:323] Received status
> update TASK_KILLED (UUID: f15f490b-a278-406e-abfa-9f1129d7c036) for task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:35.492724 29300 status_update_manager.cpp:323] Received status
> update TASK_KILLED (UUID: 0bed5420-7a04-49fe-9823-2d6a7aff53dc) for task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:36.451230 29302 containerizer.cpp:2450] Container
> 935514b3-95ae-450e-b766-084fb5e7734e has exited
> I1208 03:32:36.451273 29302 containerizer.cpp:2087] Destroying container
> 935514b3-95ae-450e-b766-084fb5e7734e in RUNNING state
> I1208 03:32:36.451477 29302 launcher.cpp:149] Asked to destroy container
> 935514b3-95ae-450e-b766-084fb5e7734e
> I1208 03:32:36.457315 29301 slave.cpp:4675] Executor 'default' of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 exited with status 0
> I1208 03:32:36.457854 29301 master.cpp:5932] Executor 'default' of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 on agent
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0 at slave(15)@10.0.2.15:36807
> (archlinux.vagrant.vm): exited with status 0
> I1208 03:32:36.457904 29301 master.cpp:7915] Removing executor 'default' with
> resources cpus(*):0.1; mem(*):32; disk(*):32 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 on agent
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0 at slave(15)@10.0.2.15:36807
> (archlinux.vagrant.vm)
> GMOCK WARNING:
> Uninteresting mock function call - returning directly.
> Function call: failure(0x7ffdffc62f80, @0x7fb2340a8bd0 48-byte object
> <48-EF 6C-64 B2-7F 00-00 00-00 00-00 00-00 00-00 07-00 00-00 00-00 00-00
> 40-83 0A-34 B2-7F 00-00 A0-6F 0A-34 B2-7F 00-00 00-00 00-00 00-00 00-00>)
> Stack trace:
> I1208 03:32:36.976519 29304 master.cpp:6622] Sending 1 offers to framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 (default)
> W1208 03:32:45.311133 29305 status_update_manager.cpp:478] Resending status
> update TASK_RUNNING (UUID: b3bbc1e3-b15b-4227-94ff-209b0d7aa181) for task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> W1208 03:32:45.311413 29305 status_update_manager.cpp:478] Resending status
> update TASK_RUNNING (UUID: aed3ed28-1943-44c3-a8b6-40be41ffc20b) for task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:45.311717 29305 slave.cpp:4184] Forwarding the update
> TASK_RUNNING (UUID: b3bbc1e3-b15b-4227-94ff-209b0d7aa181) for task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 to master@10.0.2.15:36807
> I1208 03:32:45.311951 29305 slave.cpp:4184] Forwarding the update
> TASK_RUNNING (UUID: aed3ed28-1943-44c3-a8b6-40be41ffc20b) for task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 to master@10.0.2.15:36807
> I1208 03:32:45.312207 29305 master.cpp:5808] Status update TASK_RUNNING
> (UUID: b3bbc1e3-b15b-4227-94ff-209b0d7aa181) for task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 from agent
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0 at slave(15)@10.0.2.15:36807
> (archlinux.vagrant.vm)
> I1208 03:32:45.312252 29305 master.cpp:5870] Forwarding status update
> TASK_RUNNING (UUID: b3bbc1e3-b15b-4227-94ff-209b0d7aa181) for task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:45.312572 29305 master.cpp:7790] Updating the state of task
> 93d62044-e146-4b70-9648-221b72cfaad7 of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 (latest state: TASK_KILLED, status
> update state: TASK_RUNNING)
> I1208 03:32:45.312834 29305 master.cpp:5808] Status update TASK_RUNNING
> (UUID: aed3ed28-1943-44c3-a8b6-40be41ffc20b) for task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 from agent
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-S0 at slave(15)@10.0.2.15:36807
> (archlinux.vagrant.vm)
> I1208 03:32:45.312870 29305 master.cpp:5870] Forwarding status update
> TASK_RUNNING (UUID: aed3ed28-1943-44c3-a8b6-40be41ffc20b) for task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000
> I1208 03:32:45.313035 29305 master.cpp:7790] Updating the state of task
> 004a6d7e-e6be-4a1c-a23d-b5b83e69a19b of framework
> 67de7bda-9b5b-4fe9-aede-390ec9ca7290-0000 (latest state: TASK_KILLED, status
> update state: TASK_RUNNING)
> ../../mesos/src/tests/default_executor_tests.cpp:417: Failure
> Value of: killedUpdate1->status().state()
> Actual: TASK_RUNNING
> Expected: TASK_KILLED
> *** Aborted at 1481128365 (unix time) try "date -d @1481128365" if you are
> using GNU date ***
> PC: @ 0x1bb3ed4 testing::UnitTest::AddTestPartResult()
> *** SIGSEGV (@0x0) received by PID 29285 (TID 0x7fb264acac40) from PID 0;
> stack trace: ***
> @ 0x7fb25ded5080 (unknown)
> @ 0x1bb3ed4 testing::UnitTest::AddTestPartResult()
> @ 0x1ba86d1 testing::internal::AssertHelper::operator=()
> @ 0xe357d9
> mesos::internal::tests::DefaultExecutorTest_KillTask_Test::TestBody()
> @ 0x1bd1df0
> testing::internal::HandleSehExceptionsInMethodIfSupported<>()
> @ 0x1bcce74
> testing::internal::HandleExceptionsInMethodIfSupported<>()
> @ 0x1badb08 testing::Test::Run()
> @ 0x1bae2c0 testing::TestInfo::Run()
> @ 0x1bae8fd testing::TestCase::Run()
> @ 0x1bb53f1 testing::internal::UnitTestImpl::RunAllTests()
> @ 0x1bd2ab7
> testing::internal::HandleSehExceptionsInMethodIfSupported<>()
> @ 0x1bcd9b4
> testing::internal::HandleExceptionsInMethodIfSupported<>()
> @ 0x1bb40f5 testing::UnitTest::Run()
> @ 0x118c09e RUN_ALL_TESTS()
> @ 0x118bc54 main
> @ 0x7fb25be62291 __libc_start_main
> @ 0xa842fa _start
> @ 0x0 (unknown)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
