Michael Armbrust created SPARK-3851:
---------------------------------------
Summary: Support for reading parquet files with different but
compatible schema
Key: SPARK-3851
URL: https://issues.apache.org/jira/browse/SPARK-3851
Project: Spark
Issue Type: Bug
Components: SQL
Reporter: Michael Armbrust
Right now it is required that all of the parquet files have the same schema.
It would be nice to support some safe subset of cases where the schemas of
files is different. For example:
- Adding and removing nullable columns.
- Widening types (a column that is of both Int and Long type)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
