[ https://issues.apache.org/jira/browse/SPARK-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14070823#comment-14070823 ]
bruce szalwinski commented on SPARK-1166: ----------------------------------------- I've been able to reproduce, but not consistently. On this occasion, I had previously started an instance, didn't use it for anything and soon there after shut it down. Don't know if that means anything. Using spark 1.0 from spark-ec2 -k mykeypair -i ~/.aws/mykeypair.pem -s 7 -r "us-west-2" -t r3.large launch "sparck-cluster" Setting up security groups... Creating security group sparck-cluster-master Creating security group sparck-cluster-slaves ERROR:boto:400 Bad Request ERROR:boto:<?xml version="1.0" encoding="UTF-8"?> <Response><Errors><Error><Code>InvalidGroup.NotFound</Code><Message>The security group 'sg-185fe07d' does not exist</Message></Error></Errors><RequestID>80f1e1e3-e340-4cd2-ba64-53c13525ab2b</RequestID></Response> Traceback (most recent call last): File "./spark_ec2.py", line 909, in <module> main() File "./spark_ec2.py", line 901, in main real_main() File "./spark_ec2.py", line 779, in real_main (master_nodes, slave_nodes) = launch_cluster(conn, opts, cluster_name) File "./spark_ec2.py", line 279, in launch_cluster master_group.authorize(src_group=slave_group) File "/Users/szalwinb/playpen/spark/ec2/third_party/boto-2.4.1.zip/boto-2.4.1/boto/ec2/securitygroup.py", line 184, in authorize File "/Users/szalwinb/playpen/spark/ec2/third_party/boto-2.4.1.zip/boto-2.4.1/boto/ec2/connection.py", line 2150, in authorize_security_group File "/Users/szalwinb/playpen/spark/ec2/third_party/boto-2.4.1.zip/boto-2.4.1/boto/ec2/connection.py", line 2093, in authorize_security_group_deprecated File "/Users/szalwinb/playpen/spark/ec2/third_party/boto-2.4.1.zip/boto-2.4.1/boto/connection.py", line 944, in get_status boto.exception.EC2ResponseError: EC2ResponseError: 400 Bad Request <?xml version="1.0" encoding="UTF-8"?> <Response><Errors><Error><Code>InvalidGroup.NotFound</Code><Message>The security group 'sg-185fe07d' does not exist</Message></Error></Errors><RequestID>80f1e1e3-e340-4cd2-ba64-53c13525ab2b</RequestID></Response> > leftover vpc_id may block the creation of new ec2 cluster > --------------------------------------------------------- > > Key: SPARK-1166 > URL: https://issues.apache.org/jira/browse/SPARK-1166 > Project: Spark > Issue Type: Bug > Affects Versions: 0.9.0 > Reporter: Nan Zhu > Assignee: Nan Zhu > > When I run the spark-ec2 script to build ec2 cluster in EC2, for some reason, > I always received errors as following: > {code} > Setting up security groups... > ERROR:boto:400 Bad Request > ERROR:boto:<?xml version="1.0" encoding="UTF-8"?> > <Response><Errors><Error><Code>InvalidParameterValue</Code><Message>Invalid > value 'null' for protocol. VPC security group rules must specify protocols > explicitly.</Message></Error></Errors><RequestID>fc56f0ba-915a-45b6-8555-05d4dd0f14ee</RequestID></Response> > Traceback (most recent call last): > File "./spark_ec2.py", line 813, in <module> > main() > File "./spark_ec2.py", line 806, in main > real_main() > File "./spark_ec2.py", line 689, in real_main > conn, opts, cluster_name) > File "./spark_ec2.py", line 244, in launch_cluster > slave_group.authorize(src_group=master_group) > File > "/Users/nanzhu/code/spark/ec2/third_party/boto-2.4.1.zip/boto-2.4.1/boto/ec2/securitygroup.py", > line 184, in authorize > File > "/Users/nanzhu/code/spark/ec2/third_party/boto-2.4.1.zip/boto-2.4.1/boto/ec2/connection.py", > line 2181, in authorize_security_group > File > "/Users/nanzhu/code/spark/ec2/third_party/boto-2.4.1.zip/boto-2.4.1/boto/connection.py", > line 944, in get_status > boto.exception.EC2ResponseError: EC2ResponseError: 400 Bad Request > <?xml version="1.0" encoding="UTF-8"?> > <Response><Errors><Error><Code>InvalidParameterValue</Code><Message>Invalid > value 'null' for protocol. VPC security group rules must specify protocols > explicitly.</Message></Error></Errors><RequestID>fc56f0ba-915a-45b6-8555-05d4dd0f14ee</RequestID></Response> > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)