...@amazon.com
Cc: user user@spark.apache.org
Subject: Re: [ERROR] Insufficient Space
Thanks Jonathan. I should totally move to EMR. Spark on EMR was
announced at Spark Summit!
There's no easy way to resize the cluster on EC2. You basically have to
destroy it and launch a new one. Right
Vadim,
You could edit /etc/fstab, then issue mount -o remount to give more shared
memory online.
Didn't know Spark uses shared memory.
Hope this helps.
On Fri, Jun 19, 2015, 8:15 AM Vadim Bichutskiy vadim.bichuts...@gmail.com
wrote:
Hello Spark Experts,
I've been running a standalone Spark
at 7:15 AM
To: user user@spark.apache.org
Subject: [ERROR] Insufficient Space
Hello Spark Experts,
I've been running a standalone Spark cluster on EC2 for a few months
now, and today I get this error:
IOError: [Errno 28] No space left on device
Spark assembly has been built with Hive
Hello Spark Experts,
I've been running a standalone Spark cluster on EC2 for a few months now,
and today I get this error:
IOError: [Errno 28] No space left on device
Spark assembly has been built with Hive, including Datanucleus jars on
classpath
OpenJDK 64-Bit Server VM warning: Insufficient
...@gmail.com
Date: Friday, June 19, 2015 at 7:15 AM
To: user user@spark.apache.orgmailto:user@spark.apache.org
Subject: [ERROR] Insufficient Space
Hello Spark Experts,
I've been running a standalone Spark cluster on EC2 for a few months now, and
today I get this error:
IOError: [Errno 28] No space left