[
https://issues.apache.org/jira/browse/SPARK-16126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-16126:
---------------------------------
Labels: bulk-closed (was: )
> Better Error Message When using DataFrameReader without `path`
> --------------------------------------------------------------
>
> Key: SPARK-16126
> URL: https://issues.apache.org/jira/browse/SPARK-16126
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.0.0
> Reporter: Xiao Li
> Priority: Major
> Labels: bulk-closed
>
> When users do not specify the path in `DataFrameReader` APIs, it can get a
> confusing error message. For example,
> {noformat}
> spark.read.json()
> {noformat}
> Error message:
> {noformat}
> Unable to infer schema for JSON at . It must be specified manually;
> {noformat}
> After the fix, the error message will be like:
> {noformat}
> 'path' is not specified
> {noformat}
> Another major goal of this PR is to add test cases for the latest changes in
> https://github.com/apache/spark/pull/13727.
> - orc read APIs
> - illegal format name
> - save API - empty path or illegal path
> - load API - empty path
> - illegal compression
> - fixed a test case in the existing test case `prevent all column
> partitioning`
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
