Re: [ERROR] Insufficient Space

2015-06-19 Thread Vadim Bichutskiy
...@amazon.com Cc: user user@spark.apache.org Subject: Re: [ERROR] Insufficient Space Thanks Jonathan. I should totally move to EMR. Spark on EMR was announced at Spark Summit! There's no easy way to resize the cluster on EC2. You basically have to destroy it and launch a new one. Right

Re: [ERROR] Insufficient Space

2015-06-19 Thread Ruslan Dautkhanov
Vadim, You could edit /etc/fstab, then issue mount -o remount to give more shared memory online. Didn't know Spark uses shared memory. Hope this helps. On Fri, Jun 19, 2015, 8:15 AM Vadim Bichutskiy vadim.bichuts...@gmail.com wrote: Hello Spark Experts, I've been running a standalone Spark

Re: [ERROR] Insufficient Space

2015-06-19 Thread Vadim Bichutskiy
at 7:15 AM To: user user@spark.apache.org Subject: [ERROR] Insufficient Space Hello Spark Experts, I've been running a standalone Spark cluster on EC2 for a few months now, and today I get this error: IOError: [Errno 28] No space left on device Spark assembly has been built with Hive

[ERROR] Insufficient Space

2015-06-19 Thread Vadim Bichutskiy
Hello Spark Experts, I've been running a standalone Spark cluster on EC2 for a few months now, and today I get this error: IOError: [Errno 28] No space left on device Spark assembly has been built with Hive, including Datanucleus jars on classpath OpenJDK 64-Bit Server VM warning: Insufficient

Re: [ERROR] Insufficient Space

2015-06-19 Thread Kelly, Jonathan
...@gmail.com Date: Friday, June 19, 2015 at 7:15 AM To: user user@spark.apache.orgmailto:user@spark.apache.org Subject: [ERROR] Insufficient Space Hello Spark Experts, I've been running a standalone Spark cluster on EC2 for a few months now, and today I get this error: IOError: [Errno 28] No space left