[jira] [Commented] (SPARK-15025) creating datasource table with option (PATH) results in duplicate path key in serdeProperties
[ https://issues.apache.org/jira/browse/SPARK-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15265179#comment-15265179 ] Apache Spark commented on SPARK-15025: -- User 'xwu0226' has created a pull request for this issue: https://github.com/apache/spark/pull/12804 > creating datasource table with option (PATH) results in duplicate path key in > serdeProperties > - > > Key: SPARK-15025 > URL: https://issues.apache.org/jira/browse/SPARK-15025 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.0.0 >Reporter: Xin Wu > > Repro: > {code}create table t1 using parquet options (PATH "/tmp/t1") as select 1 as > a, 2 as b{code} > This will create a hive external table whose dataLocation is > "/someDefaultPath", which is not the same as the provided one. Yet, > serdeInfo.parameters contain following key value pairs: > PATH, "/tmp/t1" > path, "/someDefaultPath" -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-15025) creating datasource table with option (PATH) results in duplicate path key in serdeProperties
[ https://issues.apache.org/jira/browse/SPARK-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15265127#comment-15265127 ] Xin Wu commented on SPARK-15025: I am testing a fix on this . will submit a PR soon. > creating datasource table with option (PATH) results in duplicate path key in > serdeProperties > - > > Key: SPARK-15025 > URL: https://issues.apache.org/jira/browse/SPARK-15025 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.0.0 >Reporter: Xin Wu > > Repro: > {code}create table t1 using parquet options (PATH "/tmp/t1") as select 1 as > a, 2 as b{code} > This will create a hive external table whose dataLocation is > "/someDefaultPath", which is not the same as the provided one. Yet, > serdeInfo.parameters contain following key value pairs: > PATH, "/tmp/t1" > path, "/someDefaultPath" -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org