zhuqi-lucas commented on issue #16200: URL: https://github.com/apache/datafusion/issues/16200#issuecomment-2953664649
Test experiment for datafusion: https://github.com/apache/arrow-rs/pull/7624 https://github.com/apache/datafusion/pull/16329 ```rust python3 ./compare.py /tmp/clickbench_main /tmp/clickbench_load_page_index_with_column_id ┏━━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓ ┃ Query ┃ tmp ┃ tmp ┃ Change ┃ ┡━━━━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩ │ QQuery 0 │ 12.13 ms │ 10.64 ms │ +1.14x faster │ │ QQuery 1 │ 89.03 ms │ 46.27 ms │ +1.92x faster │ │ QQuery 2 │ 36.80 ms │ 35.80 ms │ no change │ │ QQuery 3 │ 35.67 ms │ 35.99 ms │ no change │ │ QQuery 4 │ 268.92 ms │ 256.73 ms │ no change │ │ QQuery 5 │ 310.28 ms │ 313.01 ms │ no change │ │ QQuery 6 │ 13.22 ms │ 12.86 ms │ no change │ │ QQuery 7 │ 92.93 ms │ 46.94 ms │ +1.98x faster │ │ QQuery 8 │ 314.49 ms │ 340.63 ms │ 1.08x slower │ │ QQuery 9 │ 483.32 ms │ 481.19 ms │ no change │ │ QQuery 10 │ 190.48 ms │ 137.51 ms │ +1.39x faster │ │ QQuery 11 │ 202.86 ms │ 151.79 ms │ +1.34x faster │ │ QQuery 12 │ 405.74 ms │ 360.43 ms │ +1.13x faster │ │ QQuery 13 │ 536.49 ms │ 488.00 ms │ +1.10x faster │ │ QQuery 14 │ 397.92 ms │ 346.56 ms │ +1.15x faster │ │ QQuery 15 │ 327.45 ms │ 323.72 ms │ no change │ │ QQuery 16 │ 699.47 ms │ 734.16 ms │ no change │ │ QQuery 17 │ 632.90 ms │ 654.54 ms │ no change │ │ QQuery 18 │ 2018.58 ms │ 2052.34 ms │ no change │ │ QQuery 19 │ 99.19 ms │ 67.29 ms │ +1.47x faster │ │ QQuery 20 │ 885.77 ms │ 1047.55 ms │ 1.18x slower │ │ QQuery 21 │ 470.21 ms │ 420.91 ms │ +1.12x faster │ │ QQuery 22 │ 2994.52 ms │ 2677.85 ms │ +1.12x faster │ │ QQuery 23 │ 9516.60 ms │ 9347.08 ms │ no change │ │ QQuery 24 │ 245.20 ms │ 189.26 ms │ +1.30x faster │ │ QQuery 25 │ 234.46 ms │ 191.13 ms │ +1.23x faster │ │ QQuery 26 │ 281.25 ms │ 203.97 ms │ +1.38x faster │ │ QQuery 27 │ 737.55 ms │ 656.28 ms │ +1.12x faster │ │ QQuery 28 │ 6585.31 ms │ 6629.37 ms │ no change │ │ QQuery 29 │ 308.20 ms │ 314.17 ms │ no change │ │ QQuery 30 │ 378.65 ms │ 315.16 ms │ +1.20x faster │ │ QQuery 31 │ 374.84 ms │ 329.12 ms │ +1.14x faster │ │ QQuery 32 │ 1125.68 ms │ 1145.51 ms │ no change │ │ QQuery 33 │ 1885.61 ms │ 1976.18 ms │ no change │ │ QQuery 34 │ 1898.28 ms │ 2030.53 ms │ 1.07x slower │ │ QQuery 35 │ 449.56 ms │ 453.16 ms │ no change │ │ QQuery 36 │ 130.23 ms │ 173.75 ms │ 1.33x slower │ │ QQuery 37 │ 141.73 ms │ 224.22 ms │ 1.58x slower │ │ QQuery 38 │ 123.32 ms │ 165.20 ms │ 1.34x slower │ │ QQuery 39 │ 167.83 ms │ 310.21 ms │ 1.85x slower │ │ QQuery 40 │ 103.24 ms │ 87.30 ms │ +1.18x faster │ │ QQuery 41 │ 105.57 ms │ 56.85 ms │ +1.86x faster │ │ QQuery 42 │ 90.65 ms │ 65.76 ms │ +1.38x faster │ └──────────────┴────────────┴────────────┴───────────────┘ ┏━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓ ┃ Benchmark Summary ┃ ┃ ┡━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩ │ Total Time (tmp) │ 36402.11ms │ │ Total Time (tmp) │ 35906.88ms │ │ Average Time (tmp) │ 846.56ms │ │ Average Time (tmp) │ 835.04ms │ │ Queries Faster │ 20 │ │ Queries Slower │ 7 │ │ Queries with No Change │ 16 │ │ Queries with Failure │ 0 │ └────────────────────────┴────────────┘ ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org