Stephen Hankinson created MESOS-6587: ----------------------------------------
Summary: Unable to cache certain archives with custom outputFile Key: MESOS-6587 URL: https://issues.apache.org/jira/browse/MESOS-6587 Project: Mesos Issue Type: Bug Components: fetcher Reporter: Stephen Hankinson Assignee: Stephen Hankinson Priority: Minor When caching an archive that is retrieved from a signed URL from somewhere like Amazon S3 or Azure Blob, the archive is not decompressed properly even when a valid compression suffix is set on the output_file parameter. An example log is show below: I1114 14:49:49.689990 39178 logging.cpp:194] INFO level logging started! I1114 14:49:49.690237 39178 fetcher.cpp:498] Fetcher Info: {"cache_directory":"\/tmp\/mesos\/fetch\/slaves\/68721b22-f102-443a-887c-b1df78f40bf5-S8\/root","items":[{"action":"RETRIEVE_FROM_CACHE","cache_filename":"c4-docker.tar_5.255&sr=b","uri":{"cache":true,"executable":false,"extract":true,"output_file":"docker.tar.gz","value":"https:\/\/reportresources.blob.core.windows.net\/mesos\/docker.tar.gz?sig=thesignaturegoeshere"}}],"sandbox_directory":"\/var\/lib\/mesos\/slave\/slaves\/68721b22-f102-443a-887c-b1df78f40bf5-S8\/frameworks\/68721b22-f102-443a-887c-b1df78f40bf5-0000\/executors\/test.97c76288-aa79-11e6-9316-70b3d5800002\/runs\/a21ecf01-e80a-4d2b-b094-34d442081818","user":"root"} I1114 14:49:49.692350 39178 fetcher.cpp:409] Fetching URI 'https://reportresources.blob.core.windows.net/mesos/docker.tar.gz?sig=thesignaturegoeshere' I1114 14:49:49.692369 39178 fetcher.cpp:306] Fetching from cache W1114 14:49:49.692384 39178 fetcher.cpp:350] Copying instead of extracting resource from URI with 'extract' flag, because it does not seem to be an archive: https://reportresources.blob.core.windows.net/mesos/docker.tar.gz?sig=thesignaturegoeshere I1114 14:49:49.692464 39178 fetcher.cpp:167] Copying resource with command:cp '/tmp/mesos/fetch/slaves/68721b22-f102-443a-887c-b1df78f40bf5-S8/root/c4-docker.tar_5.255&sr=b' '/var/lib/mesos/slave/slaves/68721b22-f102-443a-887c-b1df78f40bf5-S8/frameworks/68721b22-f102-443a-887c-b1df78f40bf5-0000/executors/test.97c76288-aa79-11e6-9316-70b3d5800002/runs/a21ecf01-e80a-4d2b-b094-34d442081818/docker.tar.gz' I1114 14:49:49.694368 39178 fetcher.cpp:547] Fetched 'https://reportresources.blob.core.windows.net/mesos/docker.tar.gz?sig=thesignaturegoeshere' to '/var/lib/mesos/slave/slaves/68721b22-f102-443a-887c-b1df78f40bf5-S8/frameworks/68721b22-f102-443a-887c-b1df78f40bf5-0000/executors/test.97c76288-aa79-11e6-9316-70b3d5800002/runs/a21ecf01-e80a-4d2b-b094-34d442081818/docker.tar.gz' Even though the output_file is set to docker.tar.gz, the archive is copied instead of extracted because of the signature suffix from the source URL. -- This message was sent by Atlassian JIRA (v6.3.4#6332)