Reynold Xin created SPARK-14912:
-----------------------------------

             Summary: Propagate data source options to Hadoop configurations
                 Key: SPARK-14912
                 URL: https://issues.apache.org/jira/browse/SPARK-14912
             Project: Spark
          Issue Type: Improvement
          Components: SQL
            Reporter: Reynold Xin
            Assignee: Reynold Xin


We currently have no way for users to propagate options to the underlying 
library that rely in Hadoop configurations to work. For example, there are 
various options in parquet-mr that users might want to set, but the data source 
API does not expose a per-job way to set it.

This patch propagates the user-specified options also into Hadoop Configuration.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to