zhongyujiang commented on issue #9404: URL: https://github.com/apache/iceberg/issues/9404#issuecomment-1886935837
@purna344 I have used migrate procedure to migrate partitioned Parquet tables to Iceberg tables(no partition columns exists in Parquet files neither), based on my experience, Spark can handle Parquet files without partition columns as long as these Parquet files' partition metadata is correct in iceberg's metadata. This is because the Spark reader can infer the constant partition values from the partition metadata(instead of inferring from the folder path), it does not require reading of the constant partition column actually. Not sure if this is also the case with your table, I think you can use [files](https://iceberg.apache.org/docs/latest/spark-queries/#files) metadata table to determine whether the file's partition metadata is correct. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
