Hongze Zhang created SPARK-52978:
------------------------------------
Summary: Make FileFormatWriter customizable via SQL config option
Key: SPARK-52978
URL: https://issues.apache.org/jira/browse/SPARK-52978
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 4.0.0
Reporter: Hongze Zhang
This is to propose a change to make the V1 file write API
*FileFormatWriter.write* customizable via a SQL configuration option.
Doing this will potentially:
# Allow 3rd columnar plugins (by setting this option by default) to specify a
columnar v1 writer during plugin initialization;
# Allow user to specify a customized row-based writer for certain purposes,
e.g., performance;
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
