laskoviymishka commented on issue #831:
URL: https://github.com/apache/iceberg-go/issues/831#issuecomment-4263723660
Two items still open:
1. ListableIO interface: `table/orphan_cleanup.go:313` still does
`reflect.ValueOf(fsys).Elem().FieldByName("Bucket")` to grab the bucket for
directory walking. Need a proper ListableIO interface with WalkDir so custom IO
implementations don't break.
2. BulkRemovableIO interface: `table/orphan_cleanup.go:428,469` and
`table/updates.go:540` still delete files one at a time via fs.Remove. S3
DeleteObjects handles 1000 keys/call; an optional BulkRemovableIO interface
would let orphan cleanup batch deletes.
Statistics-file tracking (the third gap) is done. Happy to pick up the IO
work here. It's a quality of life improvement, but really nice to have.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
