ndemir commented on issue #7348: URL: https://github.com/apache/arrow-rs/issues/7348#issuecomment-2764806031
Hi, I saw this issue when it was opened, and I decided to work on a PoC over the last couple of days. The PoC currently supports ONLY the Gt (Greater Than) condition. I wanted to confirm if that is what we are looking for. If so, I will continue implementing. By the way, my tests clearly showed a performance increase. I've attached reports of 2 tests in the PR. I also want to share a couple more test reports here. Each test is executed with a random value, where I compare Row Filter and the new Predicate Pushdown implementation using only the Greater Than condition. ``` === PERFORMANCE COMPARISON === Filter type | Time | Row count -------------------|-------------|---------- Row Filter | 21.466226ms | 10 Predicate Pushdown| 5.067886ms | 10 Improvement | 4.24x | ``` ``` === PERFORMANCE COMPARISON === Filter type | Time | Row count -------------------|-------------|---------- Row Filter | 23.964348ms | 90 Predicate Pushdown| 6.166618ms | 90 Improvement | 3.89x | ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
