Maxim Gekk created SPARK-26309: ---------------------------------- Summary: Verification of Data source options Key: SPARK-26309 URL: https://issues.apache.org/jira/browse/SPARK-26309 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 2.4.0 Reporter: Maxim Gekk
Currently, applicability of datasource options passed to DataFrameReader and DataFrameWriter are not checked fully. For example, If an option is used only in write, it will be silently ignored in read. Such behavior of built-in datasource usually confuses users. The ticket aims to implement additional verification of datasource option and detect option misusing. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org