, 2015 at 2:08 PM, Ondrej Smola ondrej.sm...@gmail.com
wrote:
Hi thanks for reply,
yes I have custom receiver - but it has simple logic .. pop ids from
redis queue - load docs based on ids from elastic and store them in spark.
No classloader modifications. I am running multiple Spark batch jobs
More info
when using *spark.mesos.coarse* everything works as expected. I think this
must be a bug in spark-mesos integration.
2015-03-27 9:23 GMT+01:00 Ondrej Smola ondrej.sm...@gmail.com:
It happens only when StorageLevel is used with 1 replica ( StorageLevel.
MEMORY_ONLY_2
Yes, only when using fine grained mode and replication
(StorageLevel.MEMORY_ONLY_2
etc).
2015-03-27 19:06 GMT+01:00 Tathagata Das t...@databricks.com:
Does it fail with just Spark jobs (using storage levels) on non-coarse
mode?
TD
On Fri, Mar 27, 2015 at 4:39 AM, Ondrej Smola ondrej.sm
