adriangbot commented on PR #9653: URL: https://github.com/apache/arrow-rs/pull/9653#issuecomment-4522163336
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9653#issuecomment-4214179774) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group faster_sparse_columns_encoding main ----- ------------------------------ ---- bool/bloom_filter 1.00 13.0±0.05ms 19.2 MB/sec 1.00 13.0±0.05ms 19.2 MB/sec bool/cdc 1.00 15.8±0.12ms 15.9 MB/sec 1.01 16.0±0.07ms 15.7 MB/sec bool/default 1.00 10.9±0.03ms 23.0 MB/sec 1.01 10.9±0.05ms 22.8 MB/sec bool/parquet_2 1.00 14.6±0.05ms 17.1 MB/sec 1.00 14.7±0.04ms 17.0 MB/sec bool/zstd 1.00 11.4±0.04ms 22.0 MB/sec 1.01 11.5±0.04ms 21.8 MB/sec bool/zstd_parquet_2 1.00 15.0±0.08ms 16.6 MB/sec 1.00 15.1±0.05ms 16.6 MB/sec bool_non_null/bloom_filter 1.00 6.8±0.02ms 18.5 MB/sec 1.04 7.0±0.02ms 17.8 MB/sec bool_non_null/cdc 1.00 6.5±0.06ms 19.2 MB/sec 1.05 6.9±0.03ms 18.2 MB/sec bool_non_null/default 1.00 4.0±0.02ms 30.9 MB/sec 1.06 4.3±0.02ms 29.2 MB/sec bool_non_null/parquet_2 1.00 8.8±0.04ms 14.3 MB/sec 1.04 9.1±0.04ms 13.8 MB/sec bool_non_null/zstd 1.00 4.4±0.02ms 28.5 MB/sec 1.06 4.6±0.02ms 27.0 MB/sec bool_non_null/zstd_parquet_2 1.00 9.1±0.04ms 13.7 MB/sec 1.03 9.4±0.04ms 13.2 MB/sec float_with_nans/bloom_filter 1.00 91.2±0.34ms 153.4 MB/sec 1.04 94.6±0.45ms 148.0 MB/sec float_with_nans/cdc 1.00 79.3±0.17ms 176.6 MB/sec 1.04 82.3±0.19ms 170.0 MB/sec float_with_nans/default 1.00 72.4±0.26ms 193.5 MB/sec 1.04 75.0±0.21ms 186.7 MB/sec float_with_nans/parquet_2 1.00 92.8±0.35ms 150.9 MB/sec 1.03 95.5±0.49ms 146.6 MB/sec float_with_nans/zstd 1.00 110.2±0.22ms 127.0 MB/sec 1.03 113.4±6.19ms 123.5 MB/sec float_with_nans/zstd_parquet_2 1.00 130.0±0.37ms 107.7 MB/sec 1.02 132.7±0.25ms 105.5 MB/sec list_primitive/bloom_filter 1.11 382.7±1.96ms 1425.2 MB/sec 1.00 344.7±1.86ms 1582.3 MB/sec list_primitive/cdc 1.13 421.2±2.51ms 1294.7 MB/sec 1.00 371.4±4.58ms 1468.5 MB/sec list_primitive/default 1.16 301.5±2.52ms 1808.8 MB/sec 1.00 259.5±2.49ms 2.1 GB/sec list_primitive/parquet_2 1.15 320.4±1.49ms 1702.1 MB/sec 1.00 279.5±0.86ms 1951.4 MB/sec list_primitive/zstd 1.06 545.1±19.64ms 1000.6 MB/sec 1.00 512.2±2.14ms 1064.8 MB/sec list_primitive/zstd_parquet_2 1.07 537.8±2.04ms 1014.1 MB/sec 1.00 502.5±1.19ms 1085.3 MB/sec list_primitive_non_null/bloom_filter 1.00 397.2±10.10ms 1370.2 MB/sec 1.06 422.2±5.29ms 1289.2 MB/sec list_primitive_non_null/cdc 1.00 418.8±29.04ms 1299.5 MB/sec 1.05 440.2±8.50ms 1236.2 MB/sec list_primitive_non_null/default 1.00 282.5±1.53ms 1926.6 MB/sec 1.01 286.5±4.43ms 1899.8 MB/sec list_primitive_non_null/parquet_2 1.01 305.1±15.33ms 1783.6 MB/sec 1.00 303.3±8.29ms 1794.5 MB/sec list_primitive_non_null/zstd 1.00 691.1±6.82ms 787.5 MB/sec 1.02 707.0±6.24ms 769.8 MB/sec list_primitive_non_null/zstd_parquet_2 1.02 690.9±6.33ms 787.8 MB/sec 1.00 675.4±3.67ms 805.7 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.9±0.08ms 3.1 GB/sec 1.00 11.9±0.05ms 3.1 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 23.1±0.16ms 1620.1 MB/sec 1.02 23.5±0.12ms 1588.4 MB/sec list_primitive_sparse_99pct_null/default 1.02 11.7±0.24ms 3.1 GB/sec 1.00 11.6±0.05ms 3.2 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.01 11.7±0.13ms 3.1 GB/sec 1.00 11.6±0.05ms 3.2 GB/sec list_primitive_sparse_99pct_null/zstd 1.02 13.7±0.17ms 2.7 GB/sec 1.00 13.4±0.05ms 2.7 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.02 11.9±0.13ms 3.1 GB/sec 1.00 11.7±0.04ms 3.1 GB/sec primitive/bloom_filter 1.00 151.1±0.50ms 297.0 MB/sec 1.00 151.8±0.56ms 295.7 MB/sec primitive/cdc 1.00 157.9±0.56ms 284.2 MB/sec 1.01 160.0±0.53ms 280.5 MB/sec primitive/default 1.00 117.9±0.33ms 380.7 MB/sec 1.01 119.5±1.57ms 375.6 MB/sec primitive/parquet_2 1.00 132.8±0.33ms 337.8 MB/sec 1.01 134.0±0.46ms 334.8 MB/sec primitive/zstd 1.00 147.8±0.43ms 303.6 MB/sec 1.00 148.1±0.43ms 303.1 MB/sec primitive/zstd_parquet_2 1.00 166.4±0.37ms 269.7 MB/sec 1.00 166.4±0.43ms 269.7 MB/sec primitive_all_null/bloom_filter 1.01 900.3±5.07µs 48.7 GB/sec 1.00 895.7±2.83µs 48.9 GB/sec primitive_all_null/cdc 1.00 18.0±0.13ms 2.4 GB/sec 1.04 18.8±0.32ms 2.3 GB/sec primitive_all_null/default 1.00 272.9±0.89µs 160.6 GB/sec 1.00 273.6±0.75µs 160.2 GB/sec primitive_all_null/parquet_2 1.00 273.1±0.73µs 160.5 GB/sec 1.02 277.5±1.17µs 157.9 GB/sec primitive_all_null/zstd 1.00 387.6±1.00µs 113.1 GB/sec 1.00 387.5±0.90µs 113.1 GB/sec primitive_all_null/zstd_parquet_2 1.00 350.4±1.07µs 125.1 GB/sec 1.02 356.0±1.34µs 123.1 GB/sec primitive_non_null/bloom_filter 1.00 100.5±0.22ms 437.8 MB/sec 1.07 107.3±0.40ms 409.9 MB/sec primitive_non_null/cdc 1.00 81.6±0.24ms 539.3 MB/sec 1.10 90.1±0.35ms 488.4 MB/sec primitive_non_null/default 1.00 60.1±0.13ms 731.7 MB/sec 1.12 67.6±0.23ms 650.5 MB/sec primitive_non_null/parquet_2 1.00 81.7±0.15ms 538.5 MB/sec 1.09 89.4±0.34ms 492.1 MB/sec primitive_non_null/zstd 1.00 90.9±0.11ms 484.2 MB/sec 1.15 104.8±0.96ms 419.8 MB/sec primitive_non_null/zstd_parquet_2 1.00 115.5±0.15ms 381.0 MB/sec 1.12 129.0±2.54ms 341.1 MB/sec primitive_sparse_99pct_null/bloom_filter 1.03 12.4±0.19ms 3.5 GB/sec 1.00 12.0±0.10ms 3.6 GB/sec primitive_sparse_99pct_null/cdc 1.00 29.7±0.20ms 1510.9 MB/sec 1.07 31.8±0.31ms 1409.7 MB/sec primitive_sparse_99pct_null/default 1.02 10.8±0.08ms 4.1 GB/sec 1.00 10.6±0.04ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.02 10.8±0.10ms 4.1 GB/sec 1.00 10.6±0.05ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.01 14.1±0.09ms 3.1 GB/sec 1.00 13.9±0.07ms 3.2 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.01 12.7±0.09ms 3.5 GB/sec 1.00 12.5±0.05ms 3.5 GB/sec string/bloom_filter 1.00 218.5±16.29ms 2.3 GB/sec 1.04 227.1±21.78ms 2.3 GB/sec string/cdc 1.00 217.6±4.99ms 2.4 GB/sec 1.03 223.2±4.96ms 2.3 GB/sec string/default 1.03 135.2±21.33ms 3.8 GB/sec 1.00 131.2±22.32ms 3.9 GB/sec string/parquet_2 1.12 126.2±0.92ms 4.1 GB/sec 1.00 112.6±6.67ms 4.5 GB/sec string/zstd 1.05 440.1±19.42ms 1191.2 MB/sec 1.00 419.0±2.03ms 1251.3 MB/sec string/zstd_parquet_2 1.00 395.7±1.04ms 1324.7 MB/sec 1.02 403.9±7.02ms 1298.1 MB/sec string_and_binary_view/bloom_filter 1.04 68.0±0.25ms 474.1 MB/sec 1.00 65.5±0.26ms 492.1 MB/sec string_and_binary_view/cdc 1.05 62.4±0.15ms 516.7 MB/sec 1.00 59.2±0.18ms 544.9 MB/sec string_and_binary_view/default 1.05 50.8±0.11ms 634.8 MB/sec 1.00 48.5±0.16ms 664.9 MB/sec string_and_binary_view/parquet_2 1.04 62.0±0.26ms 520.2 MB/sec 1.00 59.7±0.21ms 540.4 MB/sec string_and_binary_view/zstd 1.03 87.6±0.30ms 368.0 MB/sec 1.00 85.1±0.14ms 378.8 MB/sec string_and_binary_view/zstd_parquet_2 1.03 75.8±0.15ms 425.7 MB/sec 1.00 73.6±0.17ms 438.5 MB/sec string_dictionary/bloom_filter 1.00 90.9±0.53ms 2.8 GB/sec 1.06 96.4±6.77ms 2.7 GB/sec string_dictionary/cdc 1.07 60.3±4.73ms 4.3 GB/sec 1.00 56.3±0.65ms 4.6 GB/sec string_dictionary/default 1.00 47.2±0.74ms 5.5 GB/sec 1.01 47.6±0.98ms 5.4 GB/sec string_dictionary/parquet_2 1.00 54.7±0.34ms 4.7 GB/sec 1.01 55.2±0.48ms 4.7 GB/sec string_dictionary/zstd 1.00 207.7±1.07ms 1271.7 MB/sec 1.02 212.0±2.21ms 1245.7 MB/sec string_dictionary/zstd_parquet_2 1.00 199.3±0.16ms 1325.4 MB/sec 1.01 200.5±0.34ms 1317.6 MB/sec string_non_null/bloom_filter 1.00 229.8±14.08ms 2.2 GB/sec 1.17 268.3±14.36ms 1952.7 MB/sec string_non_null/cdc 1.00 273.2±14.07ms 1917.9 MB/sec 1.01 277.1±8.67ms 1891.1 MB/sec string_non_null/default 1.00 115.3±14.14ms 4.4 GB/sec 1.29 148.9±13.30ms 3.4 GB/sec string_non_null/parquet_2 1.42 202.7±3.20ms 2.5 GB/sec 1.00 142.8±6.84ms 3.6 GB/sec string_non_null/zstd 1.03 555.5±26.40ms 943.4 MB/sec 1.00 537.7±2.63ms 974.5 MB/sec string_non_null/zstd_parquet_2 1.03 518.7±8.97ms 1010.2 MB/sec 1.00 505.6±1.19ms 1036.3 MB/sec struct_all_null/bloom_filter 1.00 374.6±1.37µs 42.0 GB/sec 1.01 376.8±1.85µs 41.8 GB/sec struct_all_null/cdc 1.00 7.5±0.12ms 2.1 GB/sec 1.03 7.7±0.12ms 2.1 GB/sec struct_all_null/default 1.00 118.8±0.37µs 132.5 GB/sec 1.00 118.3±0.34µs 133.1 GB/sec struct_all_null/parquet_2 1.00 118.9±0.33µs 132.4 GB/sec 1.00 119.3±0.48µs 132.0 GB/sec struct_all_null/zstd 1.00 166.3±4.84µs 94.7 GB/sec 1.00 166.0±0.42µs 94.9 GB/sec struct_all_null/zstd_parquet_2 1.00 152.0±0.50µs 103.6 GB/sec 1.01 153.1±0.62µs 102.9 GB/sec struct_non_null/bloom_filter 1.00 43.2±0.12ms 370.4 MB/sec 1.07 46.1±0.16ms 347.1 MB/sec struct_non_null/cdc 1.00 42.3±0.14ms 378.6 MB/sec 1.10 46.3±1.62ms 345.2 MB/sec struct_non_null/default 1.00 29.4±0.12ms 544.8 MB/sec 1.09 32.0±0.12ms 500.6 MB/sec struct_non_null/parquet_2 1.00 38.5±0.21ms 415.8 MB/sec 1.06 40.7±0.12ms 392.9 MB/sec struct_non_null/zstd 1.00 38.2±0.09ms 419.4 MB/sec 1.07 40.6±0.09ms 393.6 MB/sec struct_non_null/zstd_parquet_2 1.00 52.3±0.22ms 305.8 MB/sec 1.04 54.7±0.12ms 292.7 MB/sec struct_sparse_99pct_null/bloom_filter 1.04 6.7±0.08ms 2.4 GB/sec 1.00 6.4±0.03ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 14.1±0.11ms 1142.8 MB/sec 1.04 14.6±0.12ms 1103.1 MB/sec struct_sparse_99pct_null/default 1.03 6.1±0.05ms 2.6 GB/sec 1.00 5.9±0.02ms 2.7 GB/sec struct_sparse_99pct_null/parquet_2 1.03 6.1±0.06ms 2.6 GB/sec 1.00 5.9±0.02ms 2.7 GB/sec struct_sparse_99pct_null/zstd 1.03 7.5±0.05ms 2.1 GB/sec 1.00 7.3±0.04ms 2.2 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.9±0.08ms 2.3 GB/sec 1.00 6.9±0.04ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1940.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1889.5s | | CPU sys | 45.8s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 1940.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.3 GiB | | CPU user | 1869.3s | | CPU sys | 69.2s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
