6 at 1:40 PM
To: user <user@mesos.apache.org<mailto:user@mesos.apache.org>>
Subject: Re: Enable s3a for fetcher
I can't speak to what DCOS does or will do (you can ask on the associated
mailing list: us...@dcos.io<mailto:us...@dcos.io>).
We will be maintaining existing functionality
:40 PM
> To: user <user@mesos.apache.org <mailto:user@mesos.apache.org>>
> Subject: Re: Enable s3a for fetcher
>
> I can't speak to what DCOS does or will do (you can ask on the associated
> mailing list: us...@dcos.io <mailto:us...@dcos.io>).
>
> We will be
luster, on AWS?
>
> Jamie
>
> From: Cody Maloney <c...@mesosphere.io <mailto:c...@mesosphere.io>>
> Reply-To: "user@mesos.apache.org <mailto:user@mesos.apache.org>"
> <user@mesos.apache.org <mailto:user@mesos.apache.org>>
> Date: Tuesday, May
sos.apache.org <mailto:user@mesos.apache.org>"
> <user@mesos.apache.org <mailto:user@mesos.apache.org>>
> Subject: Re: Enable s3a for fetcher
>
> The s3 fetcher stuff inside of DC/OS is not supported. The `hadoop` binary
> has been entirely removed from DC/OS
ailto:user@mesos.apache.org>>
Date: Tuesday, May 10, 2016 at 1:40 PM
To: user <user@mesos.apache.org<mailto:user@mesos.apache.org>>
Subject: Re: Enable s3a for fetcher
I can't speak to what DCOS does or will do (you can ask on the associated
mailing list: us...@dcos.io<m
, such that mesos will recognize s3a?
>
>
> From: Joseph Wu <jos...@mesosphere.io>
> Reply-To: "user@mesos.apache.org" <user@mesos.apache.org>
> Date: Tuesday, May 10, 2016 at 12:20 PM
> To: user <user@mesos.apache.org>
>
> Subject: Re: Enable s3a
esday, May 10, 2016 at 12:20 PM
To: user <user@mesos.apache.org<mailto:user@mesos.apache.org>>
Subject: Re: Enable s3a for fetcher
Mesos does not explicitly support HDFS and S3. Rather, Mesos will assume you
have a hadoop binary and use it (blindly) for certain types of URIs. If the
hadoop binary
do you propose I make large binaries available
> to my cluster, and only to my cluster, on AWS?
>
> Jamie
>
> From: Cody Maloney <c...@mesosphere.io>
> Reply-To: "user@mesos.apache.org" <user@mesos.apache.org>
> Date: Tuesday, May 10, 2016 at 10:58 AM
uot;
<user@mesos.apache.org<mailto:user@mesos.apache.org>>
Date: Tuesday, May 10, 2016 at 10:58 AM
To: "user@mesos.apache.org<mailto:user@mesos.apache.org>"
<user@mesos.apache.org<mailto:user@mesos.apache.org>>
Subject: Re: Enable s3a for fetcher
The s3 fet
The s3 fetcher stuff inside of DC/OS is not supported. The `hadoop` binary
has been entirely removed from DC/OS 1.8 already. There have been various
proposals to make it so the mesos fetcher is much more pluggable /
extensible (https://issues.apache.org/jira/browse/MESOS-2731 for instance).
I want to use s3a: urls in fetcher. I’m using dcos 1.7 which has hadoop 2.5 on
its agents. This version has the necessary hadoop-aws and aws-sdk:
hadoop--afadb46fe64d0ee7ce23dbe769e44bfb0767a8b9]$ ls
usr/share/hadoop/tools/lib/ | grep aws
aws-java-sdk-1.7.4.jar
hadoop-aws-2.5.0-cdh5.3.3.jar
11 matches
Mail list logo
