Thanks, Ted, will try it out. On Wed, Sep 30, 2015 at 9:07 AM, Ted Yu <yuzhih...@gmail.com> wrote:
> See the tail of this: > https://bugzilla.redhat.com/show_bug.cgi?id=1005811 > > FYI > > > On Sep 30, 2015, at 5:54 AM, Dmitry Goldenberg <dgoldenberg...@gmail.com> > wrote: > > > > Is there a way to ensure Spark doesn't write to /tmp directory? > > > > We've got spark.local.dir specified in the spark-defaults.conf file to > point at another directory. But we're seeing many of these > snappy-unknown-***-libsnappyjava.so files being written to /tmp still. > > > > Is there a config setting or something that would cause Spark to use > another directory of our choosing? > > > > Thanks. >
