[ https://issues.apache.org/jira/browse/SPARK-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620232#comment-14620232 ]
Sun Rui commented on SPARK-8952: -------------------------------- jsonFile() and parquetFile() will call R normalizePath function to normalize the data source path passed in. However, it seems normalizePath() is used to normalize local file path, not remote URI. > JsonFile() of SQLContext display improper warning message for a S3 path > ----------------------------------------------------------------------- > > Key: SPARK-8952 > URL: https://issues.apache.org/jira/browse/SPARK-8952 > Project: Spark > Issue Type: Bug > Components: SparkR > Affects Versions: 1.4.0 > Reporter: Sun Rui > > This is an issue reported by Ben Spark <ben_spar...@yahoo.com.au>. > {quote} > Spark 1.4 deployed on AWS EMR > "jsonFile" is working though with some warning message > Warning message: > In normalizePath(path) : > > path[1]="s3://rea-consumer-data-dev/cbr/profiler/output/20150618/part-00000": > No such file or directory > {quote} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org