adriangb commented on PR #11892: URL: https://github.com/apache/arrow-rs/pull/11892#issuecomment-6459878558
my feeling from reading the issue: the chosen fpp is 1%. java doesn’t size filters so it’s larger filters have a lower than requested fpp. parquet-rs delivers exactly what was requested. which one is better depends: larger filters mean more io and slower lookups, smaller filters mean more false positives (although never higher than requested). could one solution be to request the fpp that is actually wanted, eg 0.01%? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
