[
https://issues.apache.org/jira/browse/SPARK-36962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17426458#comment-17426458
]
Yann Byron commented on SPARK-36962:
------------------------------------
[~cloud_fan] can you have a look at it?
> Make HiveSerDe.serdeMap extensible
> ----------------------------------
>
> Key: SPARK-36962
> URL: https://issues.apache.org/jira/browse/SPARK-36962
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.4.9, 3.1.3
> Reporter: Yann Byron
> Priority: Major
>
> Currently, Only tables with certain types (e.g. json, orc, parquet, avro)
> which defined in HiveSerDe.serdeMap can be created correctly in Hive
> metastore.
> Other tables won't be persisted in a Hive compatible way. Only persisting
> these tables into Hive metastore in Spark SQL specific format as follow:
> {code:java}
> col array<string> from deserializer
> {code}
> So, can we make this extensible, so that we can pass the serde info needed to
> spark and create a hive-compatible table by spark-sql.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
