etseidl commented on issue #8518: URL: https://github.com/apache/arrow-rs/issues/8518#issuecomment-3378120898
Here's a benchmark using all of the suggested optimizations so far (including skipping column chunk statistics and page encoding statistics). This is compared to the head of the feature branch from #8530. ``` group all_opt gh5854 ----- ------- ------ decode parquet metadata 1.00 13.5±0.27µs ? ?/sec 1.45 19.5±0.37µs ? ?/sec decode parquet metadata (wide) 1.00 49.8±1.04ms ? ?/sec 1.82 90.7±3.11ms ? ?/sec open(default) 1.00 14.2±0.24µs ? ?/sec 1.49 21.2±0.64µs ? ?/sec open(page index) 1.00 251.7±4.43µs ? ?/sec 1.02 257.5±5.27µs ? ?/sec ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
