Maxim Gekk created SPARK-26309:
----------------------------------

             Summary: Verification of Data source options
                 Key: SPARK-26309
                 URL: https://issues.apache.org/jira/browse/SPARK-26309
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.4.0
            Reporter: Maxim Gekk


Currently, applicability of datasource options passed to DataFrameReader and 
DataFrameWriter are not checked fully. For example, If an option is used only 
in write, it will be silently ignored in read. Such behavior of built-in 
datasource usually confuses users. The ticket aims to implement additional 
verification of datasource option and detect option misusing. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to