[ https://issues.apache.org/jira/browse/MESOS-4585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anand Mazumdar updated MESOS-4585: ---------------------------------- Priority: Critical (was: Major) > mesos-fetcher LIBPROCESS_PORT set to 5051 URI fetch failure > ----------------------------------------------------------- > > Key: MESOS-4585 > URL: https://issues.apache.org/jira/browse/MESOS-4585 > Project: Mesos > Issue Type: Bug > Affects Versions: 0.27.0 > Reporter: Drew Robb > Priority: Critical > Attachments: hdfs-stderr.log > > > When starting a task with a {{s3a://}} URI, the fetcher fails to download the > URI, failing when trying to bind to the slave's port 5051. The URI gets > successfully downloaded, but the error is fatal. If the URI is changed to > {{http://}}. The root cause of this is that apparently the mesos-fetcher > process has {{LIBPROCESS_PORT=5051}} in its environment as I was able to find > from {{cat "/proc/`pgrep mesos-fetcher`/environ"}}. > stderr from a failing task: > {quote} > I0203 00:11:55.815500 4964 fetcher.cpp:424] Fetcher Info: > {"cache_directory":"\/tmp\/mesos\/fetch\/slaves\/ede0e5bc-d7ac-4b9a-8d35-b210fa785db0-S0","items":[{"action":"BYPASS_CACHE","uri":{"cache":false,"executable":false,"extract":true,"value":"s3a:\/\/strava.mesos\/foo"}}],"sandbox_directory":"\/mnt\/mesos\/slaves\/ede0e5bc-d7ac-4b9a-8d35-b210fa785db0-S0\/frameworks\/fe927665-1516-46cf-94dd-6d2ca84007f1-0000\/executors\/uris-test.bc047306-ca0a-11e5-b742-e2162bf6108e\/runs\/24ebd807-b065-4776-a0bf-84bda4a82f01"} > I0203 00:11:55.816830 4964 fetcher.cpp:379] Fetching URI > 's3a://strava.mesos/foo' > I0203 00:11:55.816846 4964 fetcher.cpp:250] Fetching directly into the > sandbox directory > I0203 00:11:55.816864 4964 fetcher.cpp:187] Fetching URI > 's3a://strava.mesos/foo' > I0203 00:11:56.191640 4964 fetcher.cpp:109] Downloading resource with Hadoop > client from 's3a://strava.mesos/foo' to > '/mnt/mesos/slaves/ede0e5bc-d7ac-4b9a-8d35-b210fa785db0-S0/frameworks/fe927665-1516-46cf-94dd-6d2ca84007f1-0000/executors/uris-test.bc047306-ca0a-11e5-b742-e2162bf6108e/runs/24ebd807-b065-4776-a0bf-84bda4a82f01/foo' > F0203 00:11:56.192503 4964 process.cpp:892] Failed to initialize: Failed to > bind on 0.0.0.0:5051: Address already in use: Address already in use [98] > *** Check failure stack trace: *** > @ 0x7f229ce50e7d google::LogMessage::Fail() > @ 0x7f229ce52c10 google::LogMessage::SendToLog() > @ 0x7f229ce50a42 google::LogMessage::Flush() > @ 0x7f229ce50c89 google::LogMessage::~LogMessage() > @ 0x7f229ce51c32 google::ErrnoLogMessage::~ErrnoLogMessage() > @ 0x7f229cdf16b9 process::initialize() > @ 0x7f229cdf2f36 process::ProcessBase::ProcessBase() > @ 0x7f229ce22875 process::reap() > @ 0x7f229ce2ced7 process::subprocess() > @ 0x7f229c50ab7b HDFS::copyToLocal() > @ 0x40f03e download() > @ 0x40b69f main > @ 0x7f229adc8a40 (unknown) > @ 0x40cf59 _start > Aborted (core dumped) > {quote} -- This message was sent by Atlassian JIRA (v6.3.4#6332)