Re: spark-ec2 - HDFS doesn't start on AWS EC2 cluster

2014-10-08 Thread Akhil Das
Revert the script to an older version. Thanks Best Regards On Wed, Oct 8, 2014 at 9:57 PM, Jan Warchoł wrote: > Thanks for explanation, i was going to ask exactly about this :) > > On Wed, Oct 8, 2014 at 6:23 PM, Nicholas Chammas < > nichola

Re: spark-ec2 - HDFS doesn't start on AWS EC2 cluster

2014-10-08 Thread Jan Warchoł
Thanks for explanation, i was going to ask exactly about this :) On Wed, Oct 8, 2014 at 6:23 PM, Nicholas Chammas wrote: > Yup, though to be clear, Josh reverted a change to a hosted script that > spark-ec2 references. The spark-ec2 script y’all are running locally > hasn’t changed, obviously. >

Re: spark-ec2 - HDFS doesn't start on AWS EC2 cluster

2014-10-08 Thread Nicholas Chammas
Yup, though to be clear, Josh reverted a change to a hosted script that spark-ec2 references. The spark-ec2 script y’all are running locally hasn’t changed, obviously. ​ On Wed, Oct 8, 2014 at 12:20 PM, mrm wrote: > They reverted to a previous version of the spark-ec2 script and things are > wor

Re: spark-ec2 - HDFS doesn't start on AWS EC2 cluster

2014-10-08 Thread mrm
They reverted to a previous version of the spark-ec2 script and things are working again! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-ec2-HDFS-doesn-t-start-on-AWS-EC2-cluster-tp15921p15945.html Sent from the Apache Spark User List mailing list arc

Re: spark-ec2 - HDFS doesn't start on AWS EC2 cluster

2014-10-08 Thread mrm
Has anybody found a workaround for this? It would be great if you could share it! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-ec2-HDFS-doesn-t-start-on-AWS-EC2-cluster-tp15921p15932.html Sent from the Apache Spark User List mailing list archive at

Re: spark-ec2 - HDFS doesn't start on AWS EC2 cluster

2014-10-08 Thread mrm
I have the same problems. I get asked the questions about hdfs, and then the cluster finishes launching, but I also have one executor in my application (the driver node). Anybody knows what is happening? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-

spark-ec2 - HDFS doesn't start on AWS EC2 cluster

2014-10-08 Thread Jan Warchoł
Hi all, I'm trying to launch an EC2 cluster using spark-ec2 script, and it seems that the script fails to configure HDFS properly. What's most puzzling is that it did work perfectly on Sunday. Here's the command i'm using: ./spark-1.1.0-bin-hadoop2.4/ec2/spark-ec2 \ -k xx \ -i x