Szehon Ho created SPARK-52991:
---------------------------------
Summary: Implement MERGE INTO with SCHEMA EVOLUTION for V2
DataSource
Key: SPARK-52991
URL: https://issues.apache.org/jira/browse/SPARK-52991
Project: Spark
Issue Type: New Feature
Components: SQL
Affects Versions: 4.1.0
Reporter: Szehon Ho
https://issues.apache.org/jira/browse/SPARK-47627 already add the syntax for
MERGE WITH SCHEMA EVOLUTION INTO. to support schema evolution if the SOURCE
table has different schema than TARGET table.
However, this require some external Spark extension to make a custom merge
plan, and is not used natively by Spark when making Merge plan.
We should honor the syntax when Spark makes the Merge plan for data source that
support it (currently V2 Data Sources)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
