Xin Ren created SPARK-28555:
-------------------------------
Summary: Recover options and properties and pass them back into
the v1 API
Key: SPARK-28555
URL: https://issues.apache.org/jira/browse/SPARK-28555
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.0.0
Reporter: Xin Ren
When tables are created, the {{CREATE TABLE}} syntax supports both
{{TBLPROPERTIES}} and {{OPTIONS}}. Options were used in v1 to configure the
table itself, like options passed to {{DataFrameReader}}. Right now, both
properties and options are stored in v2 table properties, because v2 only has
properties, not both. But, we aren't able to recover which properties were set
through {{OPTIONS}} and which were set through {{TBLPROPERTIES}}.
Instead of the current behavior, I think options should be prefixed with
{{option.}}. That way, we can recover options and properties and pass them back
into the v1 API.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
