HI GUYS... I realised that it was a bug in my code that caused the code to break.. I was running the filter on a SchemaRDD when I was supposed to be running it on an RDD.
But I still don't understand why the stderr was about S3 request rather than a type checking error such as "No tuple position 0 found in Row type" was thrown. The error was kinda misleading that I kindof oversaw this logical error in my code. Just thought should keep this posted. -in4 -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/AWS-Credentials-fails-with-org-apache-hadoop-fs-s3-S3Exception-FORBIDDEN-tp22800p22815.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org