maheshk114 commented on PR #41860: URL: https://github.com/apache/spark/pull/41860#issuecomment-1637439815
> > I have got some number with varying size for the bloom filter. This decides the amount of data filtered by bloom from the application side. Even if the data size is reduced to half, I can see some improvements. When number of bits to be used are set very low (77864), I can see a regression of around 4 secs as no records are filtered out. > > Yeah. That's exactly what I'm worried about. cc @somani @beliefer But that is expected right ? If the configs are incorrect and no records are filtered out then user will see regression. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
