Yann Byron created SPARK-36962:
----------------------------------
Summary: Make HiveSerDe.serdeMap extensible
Key: SPARK-36962
URL: https://issues.apache.org/jira/browse/SPARK-36962
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 2.4.9, 3.1.3
Reporter: Yann Byron
Currently, Only tables with certain types (e.g. json, orc, parquet, avro) which
defined in HiveSerDe.serdeMap can be created correctly in Hive metastore.
Other tables won't be persisted in a Hive compatible way. Only persisting these
tables into Hive metastore in Spark SQL specific format as follow:
{code:java}
col array<string> from deserializer
{code}
So, can we make this extensible, so that we can pass the serde info needed to
spark and create a hive-compatible table by spark-sql.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
