Hi,
I am using spark 1.0.0. In my spark code i m trying to persist an rdd to
disk as rrd.persist(DISK_ONLY). But unfortunately couldn't find the
location where the rdd has been written to disk. I specified
SPARK_LOCAL_DIRS and SPARK_WORKER_DIR to some other location rather than
using the default
[mailto:learnings.chitt...@gmail.com]
Sent: Tuesday, September 23, 2014 6:31 PM
To: user@spark.apache.org; d...@spark.apache.org
Subject: spark.local.dir and spark.worker.dir not used
Hi,
I am using spark 1.0.0. In my spark code i m trying to persist an rdd to disk
as rrd.persist(DISK_ONLY). But unfortunately
and spark.worker.dir not used
Hi,
I am using spark 1.0.0. In my spark code i m trying to persist an rdd to
disk as rrd.persist(DISK_ONLY). But unfortunately couldn't find the
location where the rdd has been written to disk. I specified
SPARK_LOCAL_DIRS and SPARK_WORKER_DIR to some other location rather
*To:* [hidden email] http://user/SendEmail.jtp?type=nodenode=14885i=1;
[hidden email] http://user/SendEmail.jtp?type=nodenode=14885i=2
*Subject:* spark.local.dir and spark.worker.dir not used
Hi,
I am using spark 1.0.0. In my spark code i m trying to persist an rdd to
disk as rrd.persist
]
Sent: Tuesday, September 23, 2014 6:31 PM
To: [hidden email]http://user/SendEmail.jtp?type=nodenode=14885i=1; [hidden
email]http://user/SendEmail.jtp?type=nodenode=14885i=2
Subject: spark.local.dir and spark.worker.dir not used
Hi,
I am using spark 1.0.0. In my spark code i m trying to persist