jayceslesar commented on PR #1995: URL: https://github.com/apache/iceberg-python/pull/1995#issuecomment-2931251163
fwiw I think we should try to get this merged in at some point. Some ideas: 1. Make it a flag to use the batchreader or not, some users might have basically infinite memory 2. Is there a more optimal way to batch data? Thinking along the lines of using partitions although that may already happen under the hood -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
