Hanifi Gunes created DRILL-1613:
-----------------------------------
Summary: Drill does not honor nested schema changes
Key: DRILL-1613
URL: https://issues.apache.org/jira/browse/DRILL-1613
Project: Apache Drill
Issue Type: Bug
Reporter: Hanifi Gunes
Assignee: Hanifi Gunes
Drill's current definition of schema change is an incremental update to the
top-level schema structure. This is inappropriate for complex data types where
schema change may occur at any level in the hierarchy of vectors. Current
design does not fit into this requirement neatly as only top-level containers
are able to mutate the schema. We need a minor to major re-design to handle
this situation.
This issue exacerbates when querying partitions or batches of files that do not
necessarily conform to the exact same schema. New fields from upcoming batches
will be omitted in either case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
