I am on a wonderful journey trying to get hadoop on Mesos working with
MapR. I feel like I am close, but when the slaves try to run the packaged
Hadoop, I get the error below. The odd thing is, I KNOW I got Spark
running on Mesos pulling both data and the packages from MapRFS. So I am
confused
Hey John,
Have you recompiled and adjusted the check here:
https://github.com/apache/mesos/blob/master/src/launcher/fetcher.cpp#L92
I don't think you'll be able to get this to work with maprfs:// without
adjusting that.
Tom
On 15 August 2014 21:55, John Omernik wrote:
> I am on a wonderful j
user@mesos.apache.org
> Sent: Friday, August 15, 2014 3:55:02 PM
> Subject: Alternate HDFS Filesystems + Hadoop on Mesos
> I am on a wonderful journey trying to get hadoop on Mesos working with MapR.
> I feel like I am close, but when the slaves try to run the packaged Hadoop,
> I get
>
> *From: *"John Omernik"
> *To: *user@mesos.apache.org
> *Sent: *Friday, August 15, 2014 3:55:02 PM
> *Subject: *Alternate HDFS Filesystems + Hadoop on Mesos
>
> I am on a wonderful journey trying to get hadoop on Mesos working with
> MapR. I feel like I am close, bu
> 1st grok).
>> You could redirect via a proxy that does the job for you.
>>
>> | if you had some fuse mount that would work too.
>>
>> Cheers,
>> Tim
>>
>> --
>>
>> *From: *"John Omernik"
>> *
;>>
>>> | if you had some fuse mount that would work too.
>>>
>>> Cheers,
>>> Tim
>>>
>>> --
>>>
>>> *From: *"John Omernik"
>>> *To: *user@mesos.apache.org
>>> *Sent:
gt;> On Aug 15, 2014 4:02 PM, "Tim St Clair" wrote:
>>>
>>>> The uri doesn't currently start with any of the known types (at least
>>>> on 1st grok).
>>>> You could redirect via a proxy that does the job for you.
>>>>
>>>> | if you had som
gt;>>> Hard coding a pluggable system seems like a long term issue that will keep
>>>> coming up.
>>>> On Aug 15, 2014 4:02 PM, "Tim St Clair" wrote:
>>>>
>>>>> The uri doesn't currently start with any of the known types (at
I should be able to get the
>>>>> tar from there.
>>>>>
>>>>> That said, perhaps someone with better coding skills than me could
>>>>> provide an env variable where a user could provide the HDFS prefixes to
>>>>> try. I know we did that with the tachyon project and it works wel
inline
- Original Message -
> From: "Adam Bordelon"
> To: user@mesos.apache.org
> Sent: Monday, August 18, 2014 4:43:34 AM
> Subject: Re: Alternate HDFS Filesystems + Hadoop on Mesos
> Okay, I guess MapRFS is protocol compatible with HDFS, but not
> uri
asier than handling persistent storage like HDFS.
On Mon, Aug 18, 2014 at 8:08 AM, Tim St Clair wrote:
> inline
>
> --
>
> *From: *"Adam Bordelon"
> *To: *user@mesos.apache.org
> *Sent: *Monday, August 18, 2014 4:43:34 AM
> *Subject: *Re:
able where a user could provide the HDFS prefixes to
>>>>> try. I know we did that with the tachyon project and it works well for
>>>>> other HDFS compatible fs implementations, perhaps that would work here?
>>>>> Hard coding a pluggable system seems
12 matches
Mail list logo
