saulpw commented on PR #13442: URL: https://github.com/apache/arrow/pull/13442#issuecomment-1171467657
> If we didn't care about performance or resource consumption at all, we could just read the entire file in one block and that would solve the issue. Let's not fall into slippery-slope strawmen, that is not what this PR is about at all. Is there any amount we could bump this number that you would be okay with? Assuming a distribution of data sizes, even 2x would make this better for some group of people (though not me or the bug participants). Basically are we arguing over a value or a principle? If the latter, then what is the principle at stake? I'd like to know so I can develop my personal heuristic of when it's worthwhile to submit small UX improvements like this to Arrow, vs. e.g. creating a separate project that wraps Arrow and makes it nicer for users. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
