eugenegujing opened a new issue, #7575:
URL: https://github.com/apache/texera/issues/7575

   ### Task Summary
   
   `amber/src/main/python/core/storage/iceberg/iceberg_table_writer.py` is the 
buffered append-only writer used by the Python engine to persist tuples to 
Iceberg tables: it buffers items up to a configurable `buffer_size`, flushes 
them as Arrow tables, and wraps each Iceberg commit in a retry loop 
(`table.refresh()` then `table.append()`, up to 10 attempts) to survive 
concurrent-commit conflicts.
   
   The class has no spec of its own. Its only test-tree coverage is incidental: 
`test_state_materialization_e2e.py` drives a real writer against a local 
catalog on the happy path, and `test_iceberg_document.py` requires a live 
Postgres catalog.
   
   ### Task Type
   
   - [ ] Refactor / Cleanup
   - [ ] DevOps / Deployment / CI
   - [x] Testing / QA
   - [ ] Documentation
   - [ ] Performance
   - [ ] Other


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to