I'd love to contribute documentation about the actions - just need some
time to understand the needs for some actions (like RewriteManifestAction).
I just submitted a PR for structured streaming sink [1]. I mentioned
expireSnapshot() there with linking javadoc page, but it'd be nice if
there's
Thanks for the quick response!
And yes I also went through experimenting expireSnapshots() and it looked
good. I can imagine some alternative conditions on expiring snapshots (like
adjusting "granularity" between snapshots instead of removing all snapshots
before the specific timestamp), but for
Hi devs,
I'm experimenting with Apache Iceberg for Structured Streaming sink - plan
to experiment with source as well, but I see PR still in review.
It seems that "fast append" pretty much helps to retain reasonable latency
for committing, though the metadata directory grows too fast. I found
