Zoltán Borók-Nagy created IMPALA-10974:
------------------------------------------

             Summary: Impala cannot resolve columns of converted Iceberg table
                 Key: IMPALA-10974
                 URL: https://issues.apache.org/jira/browse/IMPALA-10974
             Project: IMPALA
          Issue Type: Bug
            Reporter: Zoltán Borók-Nagy


When a regular Parquet/ORC table is converted to Iceberg via Hive, only the 
Iceberg metadata files need to be created. The data files can stay in place.

This causes problems when the data files don't have field ids for the schema 
elements. Currently Impala resolves columns in data files based on Iceberg 
field ids, but since they are missing, Impala raises an error or returns NULLs.

We could fallback to the default column resolution strategy when the data files 
lack field ids.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to