Re: Spark 1.3.1 On Mesos Issues.

2015-06-08 Thread John Omernik
It appears this may be related. https://issues.apache.org/jira/browse/SPARK-1403 Granted the NPE is in MapR's code, having Spark (seemingly, I am not an expert here, just basing it off the comments) switch in its behavior (if that's what it is doing) probably isn't good either. I guess the level

Re: Spark 1.3.1 On Mesos Issues.

2015-06-05 Thread Steve Loughran
On 2 Jun 2015, at 00:14, Dean Wampler deanwamp...@gmail.commailto:deanwamp...@gmail.com wrote: It would be nice to see the code for MapR FS Java API, but my google foo failed me (assuming it's open source)... I know that MapRFS is closed source, don't know about the java JAR. Why not ask

Re: Spark 1.3.1 On Mesos Issues.

2015-06-05 Thread John Omernik
Thanks all. The answers post is me too, I multi thread. That and Ted is aware to and Mapr is helping me with it. I shall report the answer of that investigation when we have it. As to reproduction, I've installed mapr file system, tired both version 4.0.2 and 4.1.0. Have mesos running along

Re: Spark 1.3.1 On Mesos Issues.

2015-06-05 Thread Tim Chen
It seems like there is another thread going on: http://answers.mapr.com/questions/163353/spark-from-apache-downloads-site-for-mapr.html I'm not particularly sure why, seems like the problem is that getting the current context class loader is returning null in this instance. Do you have some

Re: Spark 1.3.1 On Mesos Issues.

2015-06-04 Thread John Omernik
So a few updates. When I run local as stated before, it works fine. When I run in Yarn (via Apache Myriad on Mesos) it also runs fine. The only issue is specifically with Mesos. I wonder if there is some sort of class path goodness I need to fix or something along that lines. Any tips would be

Spark 1.3.1 On Mesos Issues.

2015-06-01 Thread John Omernik
All - I am facing and odd issue and I am not really sure where to go for support at this point. I am running MapR which complicates things as it relates to Mesos, however this HAS worked in the past with no issues so I am stumped here. So for starters, here is what I am trying to run. This is a

Re: Spark 1.3.1 On Mesos Issues.

2015-06-01 Thread Dean Wampler
It would be nice to see the code for MapR FS Java API, but my google foo failed me (assuming it's open source)... So, shooting in the dark ;) there are a few things I would check, if you haven't already: 1. Could there be 1.2 versions of some Spark jars that get picked up at run time (but