pitrou commented on pull request #9435: URL: https://github.com/apache/arrow/pull/9435#issuecomment-783483294
Here are the new benchmark results. It seems TDigest is only really useful for centiles (!): ``` QuantileKernelMedianNarrow<Int32Type>/1048576/0 611 us 610 us 1170 bytes_per_second=1.59974G/s items_per_second=429.428M/s null_percent=0 size=1048.58k QuantileKernelMedianWide<Int32Type>/1048576/0 1602 us 1595 us 438 bytes_per_second=627.15M/s items_per_second=164.404M/s null_percent=0 size=1048.58k QuantileKernelMedianNarrow<Int64Type>/1048576/0 332 us 331 us 2111 bytes_per_second=2.95009G/s items_per_second=395.955M/s null_percent=0 size=1048.58k QuantileKernelMedianWide<Int64Type>/1048576/0 553 us 550 us 1272 bytes_per_second=1.77461G/s items_per_second=238.185M/s null_percent=0 size=1048.58k QuantileKernelMedianWide<DoubleType>/1048576/0 1148 us 1145 us 609 bytes_per_second=873.302M/s items_per_second=114.465M/s null_percent=0 size=1048.58k QuantileKernelDecilesNarrow<Int32Type>/1048576/0 620 us 617 us 1158 bytes_per_second=1.5826G/s items_per_second=424.825M/s null_percent=0 size=1048.58k QuantileKernelDecilesWide<Int32Type>/1048576/0 4685 us 4666 us 151 bytes_per_second=214.324M/s items_per_second=56.1838M/s null_percent=0 size=1048.58k QuantileKernelDecilesWide<DoubleType>/1048576/0 2841 us 2829 us 247 bytes_per_second=353.477M/s items_per_second=46.3309M/s null_percent=0 size=1048.58k QuantileKernelCentilesNarrow<Int32Type>/1048576/0 621 us 619 us 1137 bytes_per_second=1.57778G/s items_per_second=423.531M/s null_percent=0 size=1048.58k QuantileKernelCentilesWide<Int32Type>/1048576/0 14151 us 14120 us 50 bytes_per_second=70.8198M/s items_per_second=18.565M/s null_percent=0 size=1048.58k QuantileKernelCentilesWide<DoubleType>/1048576/0 7354 us 7328 us 97 bytes_per_second=136.46M/s items_per_second=17.8861M/s null_percent=0 size=1048.58k TDigestKernelDoubleMedian/1048576/0 5655 us 5628 us 125 bytes_per_second=177.681M/s items_per_second=23.289M/s null_percent=0 size=1048.58k TDigestKernelDoubleDeciles/1048576/0 5617 us 5598 us 125 bytes_per_second=178.645M/s items_per_second=23.4154M/s null_percent=0 size=1048.58k TDigestKernelDoubleCentiles/1048576/0 5802 us 5784 us 125 bytes_per_second=172.883M/s items_per_second=22.6601M/s null_percent=0 size=1048.58k ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
