[jira] [Commented] (MESOS-3579) FetcherCacheTest.LocalUncachedExtract is flaky
[
https://issues.apache.org/jira/browse/MESOS-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029909#comment-15029909
]
Till Toenshoff commented on MESOS-3579:
---
Thanks for this research [~bbannier]!
> FetcherCacheTest.LocalUncachedExtract is flaky
> --
>
> Key: MESOS-3579
> URL: https://issues.apache.org/jira/browse/MESOS-3579
> Project: Mesos
> Issue Type: Bug
> Components: fetcher, test
>Reporter: Anand Mazumdar
>Assignee: Benjamin Bannier
> Labels: flaky-test, mesosphere
> Attachments: mesos-fetcher-test-archive.tgz,
> ubuntu14_clang-3.6_FAILED.log
>
>
> From ASF CI:
> https://builds.apache.org/job/Mesos/866/COMPILER=clang,CONFIGURATION=--verbose,OS=ubuntu:14.04,label_exp=docker%7C%7CHadoop/console
> {code}
> [ RUN ] FetcherCacheTest.LocalUncachedExtract
> Using temporary directory '/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA'
> I0925 19:15:39.541198 27410 leveldb.cpp:176] Opened db in 3.43934ms
> I0925 19:15:39.542362 27410 leveldb.cpp:183] Compacted db in 1.136184ms
> I0925 19:15:39.542428 27410 leveldb.cpp:198] Created db iterator in 35866ns
> I0925 19:15:39.542448 27410 leveldb.cpp:204] Seeked to beginning of db in
> 8807ns
> I0925 19:15:39.542459 27410 leveldb.cpp:273] Iterated through 0 keys in the
> db in 6325ns
> I0925 19:15:39.542505 27410 replica.cpp:744] Replica recovered with log
> positions 0 -> 0 with 1 holes and 0 unlearned
> I0925 19:15:39.543143 27438 recover.cpp:449] Starting replica recovery
> I0925 19:15:39.543393 27438 recover.cpp:475] Replica is in EMPTY status
> I0925 19:15:39.544373 27436 replica.cpp:641] Replica in EMPTY status received
> a broadcasted recover request
> I0925 19:15:39.544791 27433 recover.cpp:195] Received a recover response from
> a replica in EMPTY status
> I0925 19:15:39.545284 27433 recover.cpp:566] Updating replica status to
> STARTING
> I0925 19:15:39.546155 27436 master.cpp:376] Master
> c8bf1c95-50f4-4832-a570-c560f0b466ae (f57fd4291168) started on
> 172.17.1.195:41781
> I0925 19:15:39.546257 27433 leveldb.cpp:306] Persisting metadata (8 bytes) to
> leveldb took 747249ns
> I0925 19:15:39.546288 27433 replica.cpp:323] Persisted replica status to
> STARTING
> I0925 19:15:39.546483 27434 recover.cpp:475] Replica is in STARTING status
> I0925 19:15:39.546187 27436 master.cpp:378] Flags at startup: --acls=""
> --allocation_interval="1secs" --allocator="HierarchicalDRF"
> --authenticate="true" --authenticate_slaves="true" --authenticators="crammd5"
> --authorizers="local"
> --credentials="/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA/credentials"
> --framework_sorter="drf" --help="false" --hostname_lookup="true"
> --initialize_driver_logging="true" --log_auto_initialize="true"
> --logbufsecs="0" --logging_level="INFO" --max_slave_ping_timeouts="5"
> --quiet="false" --recovery_slave_removal_limit="100%"
> --registry="replicated_log" --registry_fetch_timeout="1mins"
> --registry_store_timeout="25secs" --registry_strict="true"
> --root_submissions="true" --slave_ping_timeout="15secs"
> --slave_reregister_timeout="10mins" --user_sorter="drf" --version="false"
> --webui_dir="/mesos/mesos-0.26.0/_inst/share/mesos/webui"
> --work_dir="/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA/master"
> --zk_session_timeout="10secs"
> I0925 19:15:39.546567 27436 master.cpp:423] Master only allowing
> authenticated frameworks to register
> I0925 19:15:39.546617 27436 master.cpp:428] Master only allowing
> authenticated slaves to register
> I0925 19:15:39.546632 27436 credentials.hpp:37] Loading credentials for
> authentication from
> '/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA/credentials'
> I0925 19:15:39.546931 27436 master.cpp:467] Using default 'crammd5'
> authenticator
> I0925 19:15:39.547044 27436 master.cpp:504] Authorization enabled
> I0925 19:15:39.547276 27441 whitelist_watcher.cpp:79] No whitelist given
> I0925 19:15:39.547320 27434 hierarchical.hpp:468] Initialized hierarchical
> allocator process
> I0925 19:15:39.547471 27438 replica.cpp:641] Replica in STARTING status
> received a broadcasted recover request
> I0925 19:15:39.548318 27443 recover.cpp:195] Received a recover response from
> a replica in STARTING status
> I0925 19:15:39.549067 27435 recover.cpp:566] Updating replica status to VOTING
> I0925 19:15:39.549115 27440 master.cpp:1603] The newly elected leader is
> master@172.17.1.195:41781 with id c8bf1c95-50f4-4832-a570-c560f0b466ae
> I0925 19:15:39.549162 27440 master.cpp:1616] Elected as the leading master!
> I0925 19:15:39.549190 27440 master.cpp:1376] Recovering from registrar
> I0925 19:15:39.549342 27434 registrar.cpp:309] Recovering registrar
> I0925 19:15:39.549666 27430 leveldb.cpp:306] Persisting metadata (8 bytes) to
> leveldb took 418187ns
> I0
[jira] [Commented] (MESOS-3579) FetcherCacheTest.LocalUncachedExtract is flaky
[
https://issues.apache.org/jira/browse/MESOS-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029803#comment-15029803
]
Benjamin Bannier commented on MESOS-3579:
-
The problem here seems related to unpacking the file, which happens by directly
invoking {{tar -C $DEST_DIR -xf $TGZ_FILE}}.
>From the shell I can successfully unpack the {{$TGZ_FILE}} for which the test
>failed when not specifying a destination, but from there fail like the test
>for the full command. I confirmed that Ubuntu trusty's version of tar ({{tar
>(GNU tar) 1.27.1}}) is able to unpack gzip'ed tar files with the used call
>syntax by creating a test file and repacking it.
Updating the test to explicitly check the integrity of the created archive
(with {{tar tf $TGZ_FILE}}) but found this test to fail even though tar did not
find any issues with the file when asked.
> FetcherCacheTest.LocalUncachedExtract is flaky
> --
>
> Key: MESOS-3579
> URL: https://issues.apache.org/jira/browse/MESOS-3579
> Project: Mesos
> Issue Type: Bug
> Components: fetcher, test
>Reporter: Anand Mazumdar
>Assignee: Benjamin Bannier
> Labels: flaky-test, mesosphere
> Attachments: ubuntu14_clang-3.6_FAILED.log
>
>
> From ASF CI:
> https://builds.apache.org/job/Mesos/866/COMPILER=clang,CONFIGURATION=--verbose,OS=ubuntu:14.04,label_exp=docker%7C%7CHadoop/console
> {code}
> [ RUN ] FetcherCacheTest.LocalUncachedExtract
> Using temporary directory '/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA'
> I0925 19:15:39.541198 27410 leveldb.cpp:176] Opened db in 3.43934ms
> I0925 19:15:39.542362 27410 leveldb.cpp:183] Compacted db in 1.136184ms
> I0925 19:15:39.542428 27410 leveldb.cpp:198] Created db iterator in 35866ns
> I0925 19:15:39.542448 27410 leveldb.cpp:204] Seeked to beginning of db in
> 8807ns
> I0925 19:15:39.542459 27410 leveldb.cpp:273] Iterated through 0 keys in the
> db in 6325ns
> I0925 19:15:39.542505 27410 replica.cpp:744] Replica recovered with log
> positions 0 -> 0 with 1 holes and 0 unlearned
> I0925 19:15:39.543143 27438 recover.cpp:449] Starting replica recovery
> I0925 19:15:39.543393 27438 recover.cpp:475] Replica is in EMPTY status
> I0925 19:15:39.544373 27436 replica.cpp:641] Replica in EMPTY status received
> a broadcasted recover request
> I0925 19:15:39.544791 27433 recover.cpp:195] Received a recover response from
> a replica in EMPTY status
> I0925 19:15:39.545284 27433 recover.cpp:566] Updating replica status to
> STARTING
> I0925 19:15:39.546155 27436 master.cpp:376] Master
> c8bf1c95-50f4-4832-a570-c560f0b466ae (f57fd4291168) started on
> 172.17.1.195:41781
> I0925 19:15:39.546257 27433 leveldb.cpp:306] Persisting metadata (8 bytes) to
> leveldb took 747249ns
> I0925 19:15:39.546288 27433 replica.cpp:323] Persisted replica status to
> STARTING
> I0925 19:15:39.546483 27434 recover.cpp:475] Replica is in STARTING status
> I0925 19:15:39.546187 27436 master.cpp:378] Flags at startup: --acls=""
> --allocation_interval="1secs" --allocator="HierarchicalDRF"
> --authenticate="true" --authenticate_slaves="true" --authenticators="crammd5"
> --authorizers="local"
> --credentials="/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA/credentials"
> --framework_sorter="drf" --help="false" --hostname_lookup="true"
> --initialize_driver_logging="true" --log_auto_initialize="true"
> --logbufsecs="0" --logging_level="INFO" --max_slave_ping_timeouts="5"
> --quiet="false" --recovery_slave_removal_limit="100%"
> --registry="replicated_log" --registry_fetch_timeout="1mins"
> --registry_store_timeout="25secs" --registry_strict="true"
> --root_submissions="true" --slave_ping_timeout="15secs"
> --slave_reregister_timeout="10mins" --user_sorter="drf" --version="false"
> --webui_dir="/mesos/mesos-0.26.0/_inst/share/mesos/webui"
> --work_dir="/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA/master"
> --zk_session_timeout="10secs"
> I0925 19:15:39.546567 27436 master.cpp:423] Master only allowing
> authenticated frameworks to register
> I0925 19:15:39.546617 27436 master.cpp:428] Master only allowing
> authenticated slaves to register
> I0925 19:15:39.546632 27436 credentials.hpp:37] Loading credentials for
> authentication from
> '/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA/credentials'
> I0925 19:15:39.546931 27436 master.cpp:467] Using default 'crammd5'
> authenticator
> I0925 19:15:39.547044 27436 master.cpp:504] Authorization enabled
> I0925 19:15:39.547276 27441 whitelist_watcher.cpp:79] No whitelist given
> I0925 19:15:39.547320 27434 hierarchical.hpp:468] Initialized hierarchical
> allocator process
> I0925 19:15:39.547471 27438 replica.cpp:641] Replica in STARTING status
> received a broadcasted recover request
> I0925 19:15:39.548318 27443 recover.cpp:195] Rec
[jira] [Commented] (MESOS-3579) FetcherCacheTest.LocalUncachedExtract is flaky
[
https://issues.apache.org/jira/browse/MESOS-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15022170#comment-15022170
]
Benjamin Bannier commented on MESOS-3579:
-
Some extra code was added middle of October to log additional information on
the fetcher (who looks like the culprit here) in case of failure. We should add
more information once it fails again.
> FetcherCacheTest.LocalUncachedExtract is flaky
> --
>
> Key: MESOS-3579
> URL: https://issues.apache.org/jira/browse/MESOS-3579
> Project: Mesos
> Issue Type: Bug
> Components: fetcher, test
>Reporter: Anand Mazumdar
>Assignee: Benjamin Bannier
> Labels: flaky-test, mesosphere
>
> From ASF CI:
> https://builds.apache.org/job/Mesos/866/COMPILER=clang,CONFIGURATION=--verbose,OS=ubuntu:14.04,label_exp=docker%7C%7CHadoop/console
> {code}
> [ RUN ] FetcherCacheTest.LocalUncachedExtract
> Using temporary directory '/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA'
> I0925 19:15:39.541198 27410 leveldb.cpp:176] Opened db in 3.43934ms
> I0925 19:15:39.542362 27410 leveldb.cpp:183] Compacted db in 1.136184ms
> I0925 19:15:39.542428 27410 leveldb.cpp:198] Created db iterator in 35866ns
> I0925 19:15:39.542448 27410 leveldb.cpp:204] Seeked to beginning of db in
> 8807ns
> I0925 19:15:39.542459 27410 leveldb.cpp:273] Iterated through 0 keys in the
> db in 6325ns
> I0925 19:15:39.542505 27410 replica.cpp:744] Replica recovered with log
> positions 0 -> 0 with 1 holes and 0 unlearned
> I0925 19:15:39.543143 27438 recover.cpp:449] Starting replica recovery
> I0925 19:15:39.543393 27438 recover.cpp:475] Replica is in EMPTY status
> I0925 19:15:39.544373 27436 replica.cpp:641] Replica in EMPTY status received
> a broadcasted recover request
> I0925 19:15:39.544791 27433 recover.cpp:195] Received a recover response from
> a replica in EMPTY status
> I0925 19:15:39.545284 27433 recover.cpp:566] Updating replica status to
> STARTING
> I0925 19:15:39.546155 27436 master.cpp:376] Master
> c8bf1c95-50f4-4832-a570-c560f0b466ae (f57fd4291168) started on
> 172.17.1.195:41781
> I0925 19:15:39.546257 27433 leveldb.cpp:306] Persisting metadata (8 bytes) to
> leveldb took 747249ns
> I0925 19:15:39.546288 27433 replica.cpp:323] Persisted replica status to
> STARTING
> I0925 19:15:39.546483 27434 recover.cpp:475] Replica is in STARTING status
> I0925 19:15:39.546187 27436 master.cpp:378] Flags at startup: --acls=""
> --allocation_interval="1secs" --allocator="HierarchicalDRF"
> --authenticate="true" --authenticate_slaves="true" --authenticators="crammd5"
> --authorizers="local"
> --credentials="/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA/credentials"
> --framework_sorter="drf" --help="false" --hostname_lookup="true"
> --initialize_driver_logging="true" --log_auto_initialize="true"
> --logbufsecs="0" --logging_level="INFO" --max_slave_ping_timeouts="5"
> --quiet="false" --recovery_slave_removal_limit="100%"
> --registry="replicated_log" --registry_fetch_timeout="1mins"
> --registry_store_timeout="25secs" --registry_strict="true"
> --root_submissions="true" --slave_ping_timeout="15secs"
> --slave_reregister_timeout="10mins" --user_sorter="drf" --version="false"
> --webui_dir="/mesos/mesos-0.26.0/_inst/share/mesos/webui"
> --work_dir="/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA/master"
> --zk_session_timeout="10secs"
> I0925 19:15:39.546567 27436 master.cpp:423] Master only allowing
> authenticated frameworks to register
> I0925 19:15:39.546617 27436 master.cpp:428] Master only allowing
> authenticated slaves to register
> I0925 19:15:39.546632 27436 credentials.hpp:37] Loading credentials for
> authentication from
> '/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA/credentials'
> I0925 19:15:39.546931 27436 master.cpp:467] Using default 'crammd5'
> authenticator
> I0925 19:15:39.547044 27436 master.cpp:504] Authorization enabled
> I0925 19:15:39.547276 27441 whitelist_watcher.cpp:79] No whitelist given
> I0925 19:15:39.547320 27434 hierarchical.hpp:468] Initialized hierarchical
> allocator process
> I0925 19:15:39.547471 27438 replica.cpp:641] Replica in STARTING status
> received a broadcasted recover request
> I0925 19:15:39.548318 27443 recover.cpp:195] Received a recover response from
> a replica in STARTING status
> I0925 19:15:39.549067 27435 recover.cpp:566] Updating replica status to VOTING
> I0925 19:15:39.549115 27440 master.cpp:1603] The newly elected leader is
> master@172.17.1.195:41781 with id c8bf1c95-50f4-4832-a570-c560f0b466ae
> I0925 19:15:39.549162 27440 master.cpp:1616] Elected as the leading master!
> I0925 19:15:39.549190 27440 master.cpp:1376] Recovering from registrar
> I0925 19:15:39.549342 27434 registrar.cpp:309] Recovering registrar
> I0925 19:15:39.549666 27430 level
[jira] [Commented] (MESOS-3579) FetcherCacheTest.LocalUncachedExtract is flaky
[
https://issues.apache.org/jira/browse/MESOS-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14950288#comment-14950288
]
Bernd Mathiske commented on MESOS-3579:
---
@greggomann Thank you! I will debug this.
> FetcherCacheTest.LocalUncachedExtract is flaky
> --
>
> Key: MESOS-3579
> URL: https://issues.apache.org/jira/browse/MESOS-3579
> Project: Mesos
> Issue Type: Bug
> Components: fetcher, test
>Reporter: Anand Mazumdar
>Assignee: Bernd Mathiske
> Labels: flaky-test, mesosphere
>
> From ASF CI:
> https://builds.apache.org/job/Mesos/866/COMPILER=clang,CONFIGURATION=--verbose,OS=ubuntu:14.04,label_exp=docker%7C%7CHadoop/console
> {code}
> [ RUN ] FetcherCacheTest.LocalUncachedExtract
> Using temporary directory '/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA'
> I0925 19:15:39.541198 27410 leveldb.cpp:176] Opened db in 3.43934ms
> I0925 19:15:39.542362 27410 leveldb.cpp:183] Compacted db in 1.136184ms
> I0925 19:15:39.542428 27410 leveldb.cpp:198] Created db iterator in 35866ns
> I0925 19:15:39.542448 27410 leveldb.cpp:204] Seeked to beginning of db in
> 8807ns
> I0925 19:15:39.542459 27410 leveldb.cpp:273] Iterated through 0 keys in the
> db in 6325ns
> I0925 19:15:39.542505 27410 replica.cpp:744] Replica recovered with log
> positions 0 -> 0 with 1 holes and 0 unlearned
> I0925 19:15:39.543143 27438 recover.cpp:449] Starting replica recovery
> I0925 19:15:39.543393 27438 recover.cpp:475] Replica is in EMPTY status
> I0925 19:15:39.544373 27436 replica.cpp:641] Replica in EMPTY status received
> a broadcasted recover request
> I0925 19:15:39.544791 27433 recover.cpp:195] Received a recover response from
> a replica in EMPTY status
> I0925 19:15:39.545284 27433 recover.cpp:566] Updating replica status to
> STARTING
> I0925 19:15:39.546155 27436 master.cpp:376] Master
> c8bf1c95-50f4-4832-a570-c560f0b466ae (f57fd4291168) started on
> 172.17.1.195:41781
> I0925 19:15:39.546257 27433 leveldb.cpp:306] Persisting metadata (8 bytes) to
> leveldb took 747249ns
> I0925 19:15:39.546288 27433 replica.cpp:323] Persisted replica status to
> STARTING
> I0925 19:15:39.546483 27434 recover.cpp:475] Replica is in STARTING status
> I0925 19:15:39.546187 27436 master.cpp:378] Flags at startup: --acls=""
> --allocation_interval="1secs" --allocator="HierarchicalDRF"
> --authenticate="true" --authenticate_slaves="true" --authenticators="crammd5"
> --authorizers="local"
> --credentials="/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA/credentials"
> --framework_sorter="drf" --help="false" --hostname_lookup="true"
> --initialize_driver_logging="true" --log_auto_initialize="true"
> --logbufsecs="0" --logging_level="INFO" --max_slave_ping_timeouts="5"
> --quiet="false" --recovery_slave_removal_limit="100%"
> --registry="replicated_log" --registry_fetch_timeout="1mins"
> --registry_store_timeout="25secs" --registry_strict="true"
> --root_submissions="true" --slave_ping_timeout="15secs"
> --slave_reregister_timeout="10mins" --user_sorter="drf" --version="false"
> --webui_dir="/mesos/mesos-0.26.0/_inst/share/mesos/webui"
> --work_dir="/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA/master"
> --zk_session_timeout="10secs"
> I0925 19:15:39.546567 27436 master.cpp:423] Master only allowing
> authenticated frameworks to register
> I0925 19:15:39.546617 27436 master.cpp:428] Master only allowing
> authenticated slaves to register
> I0925 19:15:39.546632 27436 credentials.hpp:37] Loading credentials for
> authentication from
> '/tmp/FetcherCacheTest_LocalUncachedExtract_jHBfeA/credentials'
> I0925 19:15:39.546931 27436 master.cpp:467] Using default 'crammd5'
> authenticator
> I0925 19:15:39.547044 27436 master.cpp:504] Authorization enabled
> I0925 19:15:39.547276 27441 whitelist_watcher.cpp:79] No whitelist given
> I0925 19:15:39.547320 27434 hierarchical.hpp:468] Initialized hierarchical
> allocator process
> I0925 19:15:39.547471 27438 replica.cpp:641] Replica in STARTING status
> received a broadcasted recover request
> I0925 19:15:39.548318 27443 recover.cpp:195] Received a recover response from
> a replica in STARTING status
> I0925 19:15:39.549067 27435 recover.cpp:566] Updating replica status to VOTING
> I0925 19:15:39.549115 27440 master.cpp:1603] The newly elected leader is
> master@172.17.1.195:41781 with id c8bf1c95-50f4-4832-a570-c560f0b466ae
> I0925 19:15:39.549162 27440 master.cpp:1616] Elected as the leading master!
> I0925 19:15:39.549190 27440 master.cpp:1376] Recovering from registrar
> I0925 19:15:39.549342 27434 registrar.cpp:309] Recovering registrar
> I0925 19:15:39.549666 27430 leveldb.cpp:306] Persisting metadata (8 bytes) to
> leveldb took 418187ns
> I0925 19:15:39.549753 27430 replica.cpp:323] Persisted replica status to
> VOTING
> I0925
[jira] [Commented] (MESOS-3579) FetcherCacheTest.LocalUncachedExtract is flaky
[
https://issues.apache.org/jira/browse/MESOS-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949670#comment-14949670
]
Greg Mann commented on MESOS-3579:
--
Currently on my OSX 10.10.5 machine, this test will fail consistently when run
as root, and will pass when run as non-root user:
As root:
{code}
[ RUN ] FetcherCacheTest.LocalUncachedExtract
I1008 17:27:19.557225 2022589184 exec.cpp:136] Version: 0.26.0
I1008 17:27:19.559309 334864384 exec.cpp:210] Executor registered on slave
7b04b222-eeed-493f-8f07-19500c44317c-S0
E1008 17:27:19.559310 339156992 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
E1008 17:27:19.563957 339156992 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
Registered executor on 192.168.99.1
Starting task 0
Forked command at 79228
sh -c './mesos-fetcher-test-acmd 0'
E1008 17:27:19.573187 339156992 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
Command exited with status 0 (pid: 79228)
E1008 17:27:19.679196 339156992 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
../../src/tests/fetcher_cache_tests.cpp:295: Failure
access: Operation not permitted
I1008 17:27:20.492368 2022589184 exec.cpp:136] Version: 0.26.0
E1008 17:27:20.494282 231800832 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
I1008 17:27:20.494310 229117952 exec.cpp:210] Executor registered on slave
7b04b222-eeed-493f-8f07-19500c44317c-S0
E1008 17:27:20.499080 231800832 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
Registered executor on 192.168.99.1
Starting task 1
Forked command at 79277
sh -c './mesos-fetcher-test-acmd 1'
E1008 17:27:20.507637 231800832 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
Command exited with status 0 (pid: 79277)
E1008 17:27:20.614815 231800832 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
../../src/tests/fetcher_cache_tests.cpp:295: Failure
access: Operation not permitted
I1008 17:27:21.523294 2022589184 exec.cpp:136] Version: 0.26.0
E1008 17:27:21.525332 181792768 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
I1008 17:27:21.525349 178573312 exec.cpp:210] Executor registered on slave
7b04b222-eeed-493f-8f07-19500c44317c-S0
E1008 17:27:21.530045 181792768 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
Registered executor on 192.168.99.1
Starting task 2
Forked command at 79326
sh -c './mesos-fetcher-test-acmd 2'
E1008 17:27:21.538776 181792768 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
Command exited with status 0 (pid: 79326)
E1008 17:27:21.646376 181792768 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
../../src/tests/fetcher_cache_tests.cpp:295: Failure
access: Operation not permitted
I1008 17:27:21.647663 179109888 exec.cpp:383] Executor asked to shutdown
E1008 17:27:21.647759 181792768 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
[ FAILED ] FetcherCacheTest.LocalUncachedExtract (2503 ms)
{code}
As non-root:
{code}
[ RUN ] FetcherCacheTest.LocalUncachedExtract
I1008 17:27:27.067136 2022589184 exec.cpp:136] Version: 0.26.0
I1008 17:27:27.069087 240009216 exec.cpp:210] Executor registered on slave
caf7bdb6-392d-473d-a244-65c294d49b10-S0
E1008 17:27:27.069103 244301824 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
E1008 17:27:27.073662 244301824 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
Registered executor on 192.168.99.1
Starting task 0
Forked command at 79391
sh -c './mesos-fetcher-test-acmd 0'
E1008 17:27:27.082144 244301824 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
Command exited with status 0 (pid: 79391)
E1008 17:27:27.183621 244301824 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
I1008 17:27:28.001024 2022589184 exec.cpp:136] Version: 0.26.0
E1008 17:27:28.003052 340783104 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
I1008 17:27:28.003059 340246528 exec.cpp:210] Executor registered on slave
caf7bdb6-392d-473d-a244-65c294d49b10-S0
E1008 17:27:28.008353 340783104 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
Registered executor on 192.168.99.1
Starting task 1
sh -c './mesos-fetcher-test-acmd 1'
Forked command at 79440
E1008 17:27:28.018365 340783104 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
Command exited with status 0 (pid: 79440)
E1008 17:27:28.118818 340783104 process.cpp:1912] Failed to shutdown socket
with fd 16: Socket is not connected
I1008 17:27:29.034039 2022589184 exec.cpp:136] Ve
