soumya-ghosh opened a new issue, #948:
URL: https://github.com/apache/iceberg-python/issues/948
### Apache Iceberg version
main (development)
### Please describe the bug 🐞
Executing DDL operations on Iceberg table using Pyiceberg is not updating
`last-updated-ms` field in metadata file.
`last-updated-ms` field is updated correctly when using RestCatalog, but it
is not updated when using GlueCatalog, SqlCatalog (and possibly HiveCatalog as
well).
Sequence of operations/updates:
- Create table
- Append data
- Update schema - Add a column / add description for a column
- Set a table property
Although new metadata file is generated for each update, last-updated-ms is
not updated when changes are limited to metadata file only.
Sample code:
```python
catalog = load_catalog("glue", **glue_catalog_conf)
table = catalog.create_table(
"namespace.table1",
schema=Schema(
NestedField(1, "city", StringType(), required=False),
NestedField(2, "lat", DoubleType(), required=False),
NestedField(3, "long", DoubleType(), required=False),
),
)
df = pa.Table.from_pylist(. . .)
table.append(df)
with table.update_schema() as update:
update.add_column("country", StringType(), required=False)
with table.transaction() as txn:
txn.set_properties({"abc": "def"})
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
