[ https://issues.apache.org/jira/browse/SPARK-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352331#comment-14352331 ]
Nicholas Chammas commented on SPARK-6218: ----------------------------------------- [~shivaram], [~joshrosen]: What do you think? > Upgrade spark-ec2 from optparse to argparse > ------------------------------------------- > > Key: SPARK-6218 > URL: https://issues.apache.org/jira/browse/SPARK-6218 > Project: Spark > Issue Type: Improvement > Components: EC2 > Reporter: Nicholas Chammas > Priority: Minor > > spark-ec2 [currently uses > optparse|https://github.com/apache/spark/blob/55b1b32dc8b9b25deea8e5864b53fe802bb92741/ec2/spark_ec2.py#L43]. > In Python 2.7, optparse was [deprecated in favor of > argparse|https://docs.python.org/2/library/optparse.html]. This is the main > motivation for moving away from optparse. > Additionally, upgrading to argparse provides some [additional benefits noted > in the > docs|https://argparse.googlecode.com/svn/trunk/doc/argparse-vs-optparse.html]. > The one we are mostly likely to benefit from is the better input validation. > Specifically, being able to cleanly tie each input parameter to a validation > method will cut down the input validation code currently spread out across > the script. > argparse is not include with Python 2.6, which is currently the minimum > version of Python we support in Spark, but it can easily be downloaded by > spark-ec2 with the work that has already been done in SPARK-6191. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org