MehulBatra opened a new issue, #7735:
URL: https://github.com/apache/iceberg/issues/7735
### Feature Request / Improvement
A sample example would be good, as it was problematic to configure
additional glue properties with spark conf and took lot of back and forth.
For eg. If you want to enable the glue.skip-archive there is no way given
how to enable it in spark
After a lot of internet scrapping, I got to know the right way is :
```
pyspark.SparkConf()
.set('spark.sql.catalog.{catalog_name}.glue.skip-archive', 'true')
```
I would love to contribute on the same to add this in the aws iceberg
integration doc
### Query engine
Spark
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
