[ https://issues.apache.org/jira/browse/IMPALA-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646134#comment-17646134 ]
Noemi Pap-Takacs commented on IMPALA-10569: ------------------------------------------- This feature is added to IcebergContentFileStore (introduced by IMPALA-11591) in IMPALA-11158. > Impala should determine Iceberg data file format from Iceberg metadata > ---------------------------------------------------------------------- > > Key: IMPALA-10569 > URL: https://issues.apache.org/jira/browse/IMPALA-10569 > Project: IMPALA > Issue Type: Bug > Components: Frontend > Reporter: Zoltán Borók-Nagy > Priority: Major > Labels: impala-iceberg > > When Impala creates an Iceberg table it sets HMS table property > 'iceberg.file_format' to indicate the underlying data file format. > However, when the table was created by Hive or Spark, we don't have this > property and Impala assumes that the data file format is PARQUET. This > assumption is just a wild guess, and when it's wrong Impala raises an error > during query execution. > Instead of only checking the table property, Impala could also try to > determine the file format based on Iceberg metadata. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org