[ https://issues.apache.org/jira/browse/SPARK-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259966#comment-15259966 ]
Steve Loughran commented on SPARK-6527: --------------------------------------- Actually, looking at {{SparkContext.binaryFiles()}}, this could just be SPARK-7155 surfacing. Does this happen on Spark >= 1.3.2? Ideally, checking on 1.6.1+? > sc.binaryFiles can not access files on s3 > ----------------------------------------- > > Key: SPARK-6527 > URL: https://issues.apache.org/jira/browse/SPARK-6527 > Project: Spark > Issue Type: Bug > Components: EC2, Input/Output > Affects Versions: 1.2.0, 1.3.0 > Environment: I am running Spark on EC2 > Reporter: Zhao Zhang > Priority: Minor > > The sc.binaryFIles() can not access the files stored on s3. It can correctly > list the number of files, but report "file does not exist" when processing > them. I also tried sc.textFile() which works fine. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org