jerqi commented on issue #137: URL: https://github.com/apache/incubator-uniffle/issues/137#issuecomment-1294727847
> > > This looks ineffective and it's the same with the original block filter. > > > > > > Actually considering random io, It will cost the same time when you read 3 records or 2 records. > > Yes. According to the problems mentioned by proposal design motivation section, the key point is a lot of data read by multiple times which depends on split number optimized by AQE. From this view, we should sort the data file. We don't need global order, local order should be enough. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@uniffle.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
