Szehon Ho created SPARK-52029:
---------------------------------
Summary: Support external field-id to column-name mapping for
Parquet
Key: SPARK-52029
URL: https://issues.apache.org/jira/browse/SPARK-52029
Project: Spark
Issue Type: New Feature
Components: SQL
Affects Versions: 4.0.0
Reporter: Szehon Ho
Similar to Iceberg's schema.name-mapping.default
([https://iceberg.apache.org/spec/#column-projection)]
it would be nice for Spark parquet data source to also be able to specify an
external mapping, so we can read externally-created files added to the table,
with field-ids not in the existing table schema.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
