Johan Lasperas created SPARK-56559:
--------------------------------------
Summary: Add .withSchemaEvolution() method to dataframe writer API
Key: SPARK-56559
URL: https://issues.apache.org/jira/browse/SPARK-56559
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 4.2.0
Reporter: Johan Lasperas
Schema evolution in inserts can only be enabled using SQL at the moment:
`INSERT WITH SCHEMA EVOLUTION INTO ...`
We should introduce a similar user surface in dataframe writes, mirroring the
existing `withSchemaEvolution()` method in
[mergeInto|https://github.com/apache/spark/blob/cf8be22a20bfc1e6fe2265977540974f810795ad/sql/api/src/main/scala/org/apache/spark/sql/MergeIntoWriter.scala#L162]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
