[
https://issues.apache.org/jira/browse/SPARK-52978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongze Zhang updated SPARK-52978:
---------------------------------
Description:
This is to propose a change to make the V1 file write API
*FileFormatWriter.write* customizable via a SQL configuration option.
Doing this will:
# Allow 3rd columnar plugins (by setting this option by default) to specify a
columnar v1 writer during plugin initialization;
# Allow user to specify a customized row-based writer for certain purposes,
e.g., performance;
was:
This is to propose a change to make the V1 file write API
*FileFormatWriter.write* customizable via a SQL configuration option.
Doing this will potentially:
# Allow 3rd columnar plugins (by setting this option by default) to specify a
columnar v1 writer during plugin initialization;
# Allow user to specify a customized row-based writer for certain purposes,
e.g., performance;
> Make FileFormatWriter customizable via SQL configuration
> --------------------------------------------------------
>
> Key: SPARK-52978
> URL: https://issues.apache.org/jira/browse/SPARK-52978
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 4.0.0
> Reporter: Hongze Zhang
> Priority: Major
>
> This is to propose a change to make the V1 file write API
> *FileFormatWriter.write* customizable via a SQL configuration option.
>
> Doing this will:
> # Allow 3rd columnar plugins (by setting this option by default) to specify
> a columnar v1 writer during plugin initialization;
> # Allow user to specify a customized row-based writer for certain purposes,
> e.g., performance;
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
