icexelloss commented on PR #45330: URL: https://github.com/apache/arrow/pull/45330#issuecomment-2625742487
I wonder if we can have a mode to release the fragment once the data for that fragment has been read in a "scan once" usage pattern. But also I don't know how hard it is to change that. Per `physical_schema_` - I am not familiar with the details but it seems fine to me if this is "scan once" and the fragment is not used again? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
