lidavidm commented on pull request #9656: URL: https://github.com/apache/arrow/pull/9656#issuecomment-794352385
FWIW, here's a benchmark of reading a compressed file, with and without readahead: ``` ------------------------------------------------------------------------------------------------- Benchmark Time CPU Iterations UserCounters... ------------------------------------------------------------------------------------------------- ReadCompressedFile/1/real_time 254476620 ns 11010761 ns 3 bytes_per_second=502.993M/s ReadCompressedFile/4/real_time 73552088 ns 4851059 ns 8 bytes_per_second=1.69948G/s ReadCompressedFile/16/real_time 46830653 ns 14603649 ns 15 bytes_per_second=2.66919G/s ReadCompressedFile/64/real_time 69125517 ns 52987906 ns 10 bytes_per_second=1.8083G/s ReadCompressedFile/256/real_time 180001740 ns 171520913 ns 4 bytes_per_second=711.104M/s ReadCompressedFile/1024/real_time 670619546 ns 646285305 ns 1 bytes_per_second=190.868M/s ReadaheadCompressedFile/1/real_time 66585787 ns 4212685 ns 10 bytes_per_second=1.87728G/s ReadaheadCompressedFile/4/real_time 28566113 ns 3307862 ns 25 bytes_per_second=4.37581G/s ReadaheadCompressedFile/16/real_time 31308089 ns 6213048 ns 22 bytes_per_second=3.99258G/s ReadaheadCompressedFile/64/real_time 43825981 ns 23104706 ns 16 bytes_per_second=2.85219G/s ReadaheadCompressedFile/256/real_time 125055297 ns 92982211 ns 6 bytes_per_second=1023.55M/s ReadaheadCompressedFile/1024/real_time 510944855 ns 375741074 ns 1 bytes_per_second=250.516M/s ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
