...@tellapart.com]
*Sent:* Friday, June 13, 2014 10:15 AM
*To:* user@spark.apache.org
*Subject:* Re: Spilled shuffle files not being cleared
Bump
On Mon, Jun 9, 2014 at 3:22 PM, Michael Chang m...@tellapart.com wrote:
Hi all,
I'm seeing exceptions that look like the below in Spark 0.9.1
Bump
On Mon, Jun 9, 2014 at 3:22 PM, Michael Chang m...@tellapart.com wrote:
Hi all,
I'm seeing exceptions that look like the below in Spark 0.9.1. It looks
like I'm running out of inodes on my machines (I have around 300k each in a
12 machine cluster). I took a quick look and I'm seeing
is spark.cleaner.referenceTracking),
and it is enabled by default.
Thanks
Saisai
From: Michael Chang [mailto:m...@tellapart.com]
Sent: Friday, June 13, 2014 10:15 AM
To: user@spark.apache.org
Subject: Re: Spilled shuffle files not being cleared
Bump
On Mon, Jun 9, 2014 at 3:22 PM, Michael Chang
m
Hi all,
I'm seeing exceptions that look like the below in Spark 0.9.1. It looks
like I'm running out of inodes on my machines (I have around 300k each in a
12 machine cluster). I took a quick look and I'm seeing some shuffle spill
files that are around even around 12 minutes after they are