Re: Directly reading data from S3 to EC2 with PySpark

2015-09-15 Thread ayan guha
Hyeok >> >> Did you set HADOOP_CONF_DIR? It seems that spark cannot find AWS key >> properties >> >> If it doesn't work after set, How about export AWS_ACCESS_KEY_ID, >> AWS_SECRET_ACCESS_KEY before running py-spark shell? >> >> BR >> >&g

Re: Directly reading data from S3 to EC2 with PySpark

2015-09-15 Thread Gourav Sengupta
; > BR > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Directly-reading-data-from-S3-to-EC2-with-PySpark-tp24638p24698.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > ---

Re: Directly reading data from S3 to EC2 with PySpark

2015-09-15 Thread Cazen
01560.n3.nabble.com/Directly-reading-data-from-S3-to-EC2-with-PySpark-tp24638p24698.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For addit