vamsibokam commented on issue #7771: URL: https://github.com/apache/iceberg/issues/7771#issuecomment-2022070117
@zhongyujiang, Could you elaborate on how to preserve the nullability constraints using the above [change](https://github.com/apache/spark/pull/41070) mentioned above? Should we set some kind of config property or table property to have the right nullability constraint in the final iceberg table? A little more context: I am using spark(3.5.1) and iceberg-spark(1.5.0), which should have the above change. I am seeing this issue when creating iceberg tables using Pyspark like above. However, I see that the parquet files have the expected schema with the right annotation(required/optional). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
