Dandandan commented on PR #8868: URL: https://github.com/apache/arrow-rs/pull/8868#issuecomment-3550908205
> 🤖: Benchmark completed > > Details > > ``` > group main speedup_filter2 > ----- ---- --------------- > filter context decimal128 (kept 1/2) 1.00 43.9±7.28µs ? ?/sec 1.06 46.6±6.87µs ? ?/sec > filter context decimal128 high selectivity (kept 1023/1024) 1.01 49.9±1.04µs ? ?/sec 1.00 49.6±0.81µs ? ?/sec > filter context decimal128 low selectivity (kept 1/1024) 1.00 236.0±0.34ns ? ?/sec 1.01 237.6±1.03ns ? ?/sec > filter context f32 (kept 1/2) 1.86 96.6±0.29µs ? ?/sec 1.00 52.0±0.20µs ? ?/sec > filter context f32 high selectivity (kept 1023/1024) 1.00 10.2±0.47µs ? ?/sec 1.00 10.2±0.39µs ? ?/sec > filter context f32 low selectivity (kept 1/1024) 1.33 581.6±0.87ns ? ?/sec 1.00 436.3±0.86ns ? ?/sec > filter context fsb with value length 20 (kept 1/2) 2.26 79.5±0.14µs ? ?/sec 1.00 35.2±0.08µs ? ?/sec > filter context fsb with value length 20 high selectivity (kept 1023/1024) 2.26 79.6±0.81µs ? ?/sec 1.00 35.3±0.55µs ? ?/sec > filter context fsb with value length 20 low selectivity (kept 1/1024) 2.26 79.7±0.88µs ? ?/sec 1.00 35.2±0.10µs ? ?/sec > filter context fsb with value length 5 (kept 1/2) 2.26 79.6±0.23µs ? ?/sec 1.00 35.2±0.09µs ? ?/sec > filter context fsb with value length 5 high selectivity (kept 1023/1024) 2.27 79.8±2.68µs ? ?/sec 1.00 35.2±0.08µs ? ?/sec > filter context fsb with value length 5 low selectivity (kept 1/1024) 2.26 79.5±0.18µs ? ?/sec 1.00 35.2±0.09µs ? ?/sec > filter context fsb with value length 50 (kept 1/2) 2.26 79.5±0.26µs ? ?/sec 1.00 35.2±0.08µs ? ?/sec > filter context fsb with value length 50 high selectivity (kept 1023/1024) 2.26 79.5±0.17µs ? ?/sec 1.00 35.2±0.10µs ? ?/sec > filter context fsb with value length 50 low selectivity (kept 1/1024) 2.26 79.5±0.23µs ? ?/sec 1.00 35.2±0.05µs ? ?/sec > filter context i32 (kept 1/2) 1.03 16.8±0.05µs ? ?/sec 1.00 16.3±0.05µs ? ?/sec > filter context i32 high selectivity (kept 1023/1024) 1.01 6.5±0.34µs ? ?/sec 1.00 6.4±0.41µs ? ?/sec > filter context i32 low selectivity (kept 1/1024) 1.04 241.0±0.98ns ? ?/sec 1.00 230.7±1.77ns ? ?/sec > filter context i32 w NULLs (kept 1/2) 1.87 97.2±1.04µs ? ?/sec 1.00 51.9±0.14µs ? ?/sec > filter context i32 w NULLs high selectivity (kept 1023/1024) 1.00 10.4±0.34µs ? ?/sec 1.00 10.4±0.35µs ? ?/sec > filter context i32 w NULLs low selectivity (kept 1/1024) 1.09 587.7±1.07ns ? ?/sec 1.00 538.1±0.94ns ? ?/sec > filter context mixed string view (kept 1/2) 1.60 133.6±5.60µs ? ?/sec 1.00 83.3±7.10µs ? ?/sec > filter context mixed string view high selectivity (kept 1023/1024) 1.00 53.4±0.91µs ? ?/sec 1.01 54.1±1.45µs ? ?/sec > filter context mixed string view low selectivity (kept 1/1024) 1.08 684.3±1.98ns ? ?/sec 1.00 635.6±1.99ns ? ?/sec > filter context short string view (kept 1/2) 1.51 121.5±4.14µs ? ?/sec 1.00 80.6±5.95µs ? ?/sec > filter context short string view high selectivity (kept 1023/1024) 1.00 53.8±1.69µs ? ?/sec 1.00 53.9±1.51µs ? ?/sec > filter context short string view low selectivity (kept 1/1024) 1.11 499.8±5.02ns ? ?/sec 1.00 448.8±1.86ns ? ?/sec > filter context string (kept 1/2) 1.07 593.2±6.17µs ? ?/sec 1.00 556.0±11.47µs ? ?/sec > filter context string dictionary (kept 1/2) 1.01 17.2±0.06µs ? ?/sec 1.00 17.0±0.04µs ? ?/sec > filter context string dictionary high selectivity (kept 1023/1024) 1.00 7.1±0.36µs ? ?/sec 1.05 7.5±0.40µs ? ?/sec > filter context string dictionary low selectivity (kept 1/1024) 1.00 824.2±1.26ns ? ?/sec 1.00 820.3±2.17ns ? ?/sec > filter context string dictionary w NULLs (kept 1/2) 1.86 98.2±0.37µs ? ?/sec 1.00 52.9±0.20µs ? ?/sec > filter context string dictionary w NULLs high selectivity (kept 1023/1024) 1.00 11.0±0.55µs ? ?/sec 1.02 11.3±0.34µs ? ?/sec > filter context string dictionary w NULLs low selectivity (kept 1/1024) 1.04 1087.7±4.66ns ? ?/sec 1.00 1048.6±7.61ns ? ?/sec > filter context string high selectivity (kept 1023/1024) 1.00 670.4±16.84µs ? ?/sec 1.00 667.4±16.68µs ? ?/sec > filter context string low selectivity (kept 1/1024) 1.00 1052.3±5.71ns ? ?/sec 1.05 1106.1±9.91ns ? ?/sec > filter context u8 (kept 1/2) 1.50 22.4±0.05µs ? ?/sec 1.00 15.0±0.29µs ? ?/sec > filter context u8 high selectivity (kept 1023/1024) 1.00 1870.0±13.38ns ? ?/sec 1.12 2.1±0.01µs ? ?/sec > filter context u8 low selectivity (kept 1/1024) 1.07 243.9±0.36ns ? ?/sec 1.00 228.5±0.45ns ? ?/sec > filter context u8 w NULLs (kept 1/2) 2.03 102.3±0.22µs ? ?/sec 1.00 50.5±0.19µs ? ?/sec > filter context u8 w NULLs high selectivity (kept 1023/1024) 1.00 5.3±0.01µs ? ?/sec 1.00 5.3±0.01µs ? ?/sec > filter context u8 w NULLs low selectivity (kept 1/1024) 1.35 594.0±5.03ns ? ?/sec 1.00 439.1±0.95ns ? ?/sec > filter decimal128 (kept 1/2) 1.02 50.6±1.50µs ? ?/sec 1.00 49.6±3.33µs ? ?/sec > filter decimal128 high selectivity (kept 1023/1024) 1.00 51.8±1.23µs ? ?/sec 1.03 53.3±0.97µs ? ?/sec > filter decimal128 low selectivity (kept 1/1024) 1.03 3.0±0.01µs ? ?/sec 1.00 2.9±0.01µs ? ?/sec > filter f32 (kept 1/2) 1.00 117.3±0.28µs ? ?/sec 1.23 144.4±0.26µs ? ?/sec > filter fsb with value length 20 (kept 1/2) 1.00 144.6±0.37µs ? ?/sec 1.00 144.6±0.40µs ? ?/sec > filter fsb with value length 20 high selectivity (kept 1023/1024) 1.05 72.4±3.31µs ? ?/sec 1.00 69.0±2.44µs ? ?/sec > filter fsb with value length 20 low selectivity (kept 1/1024) 1.00 2.7±0.01µs ? ?/sec 1.03 2.8±0.01µs ? ?/sec > filter fsb with value length 5 (kept 1/2) 1.00 150.5±0.37µs ? ?/sec 1.00 150.6±0.30µs ? ?/sec > filter fsb with value length 5 high selectivity (kept 1023/1024) 1.00 11.0±0.56µs ? ?/sec 1.04 11.5±0.51µs ? ?/sec > filter fsb with value length 5 low selectivity (kept 1/1024) 1.00 2.6±0.01µs ? ?/sec 1.02 2.6±0.01µs ? ?/sec > filter fsb with value length 50 (kept 1/2) 1.05 166.0±7.50µs ? ?/sec 1.00 158.7±2.11µs ? ?/sec > filter fsb with value length 50 high selectivity (kept 1023/1024) 1.00 211.4±6.49µs ? ?/sec 1.04 220.4±11.24µs ? ?/sec > filter fsb with value length 50 low selectivity (kept 1/1024) 1.00 2.7±0.01µs ? ?/sec 1.00 2.6±0.01µs ? ?/sec > filter i32 (kept 1/2) 1.00 45.7±0.15µs ? ?/sec 1.17 53.4±0.10µs ? ?/sec > filter i32 high selectivity (kept 1023/1024) 1.02 8.8±0.42µs ? ?/sec 1.00 8.7±0.40µs ? ?/sec > filter i32 low selectivity (kept 1/1024) 1.01 3.0±0.01µs ? ?/sec 1.00 3.0±0.01µs ? ?/sec > filter optimize (kept 1/2) 1.00 53.5±0.11µs ? ?/sec 1.01 54.1±0.11µs ? ?/sec > filter optimize high selectivity (kept 1023/1024) 1.00 2.8±0.01µs ? ?/sec 1.01 2.8±0.01µs ? ?/sec > filter optimize low selectivity (kept 1/1024) 1.12 3.1±0.01µs ? ?/sec 1.00 2.8±0.01µs ? ?/sec > filter run array (kept 1/2) 1.00 370.8±0.78µs ? ?/sec 1.02 377.9±0.67µs ? ?/sec > filter run array high selectivity (kept 1023/1024) 1.00 395.5±1.47µs ? ?/sec 1.00 394.7±1.20µs ? ?/sec > filter run array low selectivity (kept 1/1024) 1.00 282.4±1.18µs ? ?/sec 1.00 282.0±1.32µs ? ?/sec > filter single record batch 1.05 46.3±0.10µs ? ?/sec 1.00 44.3±0.07µs ? ?/sec > filter u8 (kept 1/2) 1.01 46.0±0.07µs ? ?/sec 1.00 45.6±0.11µs ? ?/sec > filter u8 high selectivity (kept 1023/1024) 1.00 3.8±0.01µs ? ?/sec 1.04 4.0±0.02µs ? ?/sec > filter u8 low selectivity (kept 1/1024) 1.00 3.1±0.01µs ? ?/sec 1.05 3.2±0.01µs ? ?/sec > ``` Very nice, even larger difference -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
