raulcd opened a new pull request, #46859: URL: https://github.com/apache/arrow/pull/46859
### Rationale for this change Using `SimplifyIsIn` when the value set is large has a substantial performance penalty. ### What changes are included in this PR? Ensure we do not use the simplification when the value_set on the expression is higher than a threshold (50). ### Are these changes tested? I've tested locally that the reproducer goes back to pre change levels. ``` $ python read.py === PYARROW VERSION 20 === Retrieved 10,000,000 rows in 3.08 seconds. ``` ### Are there any user-facing changes? No -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
