zhuqi-lucas commented on PR #7401:
URL: https://github.com/apache/arrow-rs/pull/7401#issuecomment-2799825990
Benchmark Result compare after the fix:
```rust
group
better_decode main
-----
------------- ----
arrow_reader_row_filter/filter: 1% Unclustered Filter proj: all_columns/
1.07 7.7±0.09ms ? ?/sec 1.00
7.2±0.13ms ? ?/sec
arrow_reader_row_filter/filter: 1% Unclustered Filter proj:
exclude_filter_column/ 1.08 7.0±0.08ms ?
?/sec 1.00 6.5±0.10ms ? ?/sec
arrow_reader_row_filter/filter: 10% Clustered Filter proj: all_columns/
1.12 6.8±0.15ms ? ?/sec 1.00
6.0±0.07ms ? ?/sec
arrow_reader_row_filter/filter: 10% Clustered Filter proj:
exclude_filter_column/ 1.12 6.0±0.08ms ?
?/sec 1.00 5.4±0.07ms ? ?/sec
arrow_reader_row_filter/filter: 10% Unclustered Filter proj: all_columns/
1.06 14.5±0.13ms ? ?/sec 1.00
13.7±0.20ms ? ?/sec
arrow_reader_row_filter/filter: 10% Unclustered Filter proj:
exclude_filter_column/ 1.05 13.2±0.08ms ?
?/sec 1.00 12.6±0.22ms ? ?/sec
arrow_reader_row_filter/filter: 90% Clustered Filter proj: all_columns/
1.10 9.8±0.32ms ? ?/sec 1.00
9.0±0.10ms ? ?/sec
arrow_reader_row_filter/filter: 90% Clustered Filter proj:
exclude_filter_column/ 1.07 9.4±0.09ms ?
?/sec 1.00 8.8±0.10ms ? ?/sec
arrow_reader_row_filter/filter: 99% Unclustered Filter proj: all_columns/
1.09 12.0±0.07ms ? ?/sec 1.00
11.0±0.11ms ? ?/sec
arrow_reader_row_filter/filter: 99% Unclustered Filter proj:
exclude_filter_column/ 1.09 11.7±0.09ms ?
?/sec 1.00 10.7±0.09ms ? ?/sec
arrow_reader_row_filter/filter: Point Lookup proj: all_columns/
1.27 6.5±0.10ms ? ?/sec 1.00
5.1±0.21ms ? ?/sec
arrow_reader_row_filter/filter: Point Lookup proj: exclude_filter_column/
1.31 5.9±0.07ms ? ?/sec 1.00
4.5±0.06ms ? ?/sec
arrow_reader_row_filter/filter: float64 > 50.0 proj: all_columns/
1.02 26.6±0.21ms ? ?/sec 1.00
26.0±0.23ms ? ?/sec
arrow_reader_row_filter/filter: float64 > 50.0 proj: exclude_filter_column/
1.04 23.8±0.15ms ? ?/sec 1.00
22.8±0.17ms ? ?/sec
arrow_reader_row_filter/filter: int64 > 0 proj: all_columns/
1.05 10.7±0.12ms ? ?/sec 1.00
10.1±0.18ms ? ?/sec
arrow_reader_row_filter/filter: int64 > 0 proj: exclude_filter_column/
1.07 10.4±0.11ms ? ?/sec 1.00
9.7±0.10ms ? ?/sec
arrow_reader_row_filter/filter: ts > 50_000 proj: all_columns/
1.12 7.4±0.05ms ? ?/sec 1.00
6.6±0.08ms ? ?/sec
arrow_reader_row_filter/filter: ts > 50_000 proj: exclude_filter_column/
1.13 7.3±0.05ms ? ?/sec 1.00
6.5±0.08ms ? ?/sec
arrow_reader_row_filter/filter: utf8View <> '' proj: all_columns/
1.00 22.9±0.21ms ? ?/sec 1.03
23.5±0.70ms ? ?/sec
arrow_reader_row_filter/filter: utf8View <> '' proj: exclude_filter_column/
1.01 20.6±0.15ms ? ?/sec 1.00
20.3±0.17ms ? ?/sec
arrow_reader_row_filter/filter: utf8View = 'const' proj: all_columns/
1.04 10.3±0.21ms ? ?/sec 1.00
9.9±0.10ms ? ?/sec
arrow_reader_row_filter/filter: utf8View = 'const' proj:
exclude_filter_column/ 1.04 9.4±0.11ms ?
?/sec 1.00 9.0±0.09ms ? ?/sec
arrow_reader_row_filter/filter_case: int64 = 0 project_case: all_columns/
1.00 821.4±37.47µs ? ?/sec 1.00
820.8±12.99µs ? ?/sec
arrow_reader_row_filter/filter_case: int64 = 0 project_case:
exclude_filter_column/ 1.00 754.9±29.52µs ?
?/sec 1.03 779.4±8.15µs ? ?/sec
arrow_reader_row_filter/filter_case: int64 even project_case: all_columns/
1.01 18.7±0.77ms ? ?/sec 1.00
18.6±0.37ms ? ?/sec
arrow_reader_row_filter/filter_case: int64 even project_case:
exclude_filter_column/ 1.00 13.8±0.60ms ?
?/sec 1.00 13.8±0.11ms ? ?/sec
arrow_reader_row_filter/filter_case: ts > 50_000 project_case: all_columns/
1.12 1288.7±69.60µs ? ?/sec 1.00
1148.8±29.81µs ? ?/sec
arrow_reader_row_filter/filter_case: ts > 50_000 project_case:
exclude_filter_column/ 1.08 1142.3±71.12µs ? ?/sec
1.00 1054.0±16.71µs ? ?/sec
arrow_reader_row_filter/filter_case: utf8View <> '' project_case:
all_columns/ 1.00 17.7±0.14ms ? ?/sec
1.05 18.6±0.15ms ? ?/sec
arrow_reader_row_filter/filter_case: utf8View <> '' project_case:
exclude_filter_column/ 1.00 14.8±0.23ms ? ?/sec
1.05 15.6±0.12ms ? ?/sec
arrow_reader_row_filter/filter_case: utf8View = 'const' project_case:
all_columns/ 1.00 921.0±43.84µs ? ?/sec
1.19 1093.5±19.65µs ? ?/sec
arrow_reader_row_filter/filter_case: utf8View = 'const' project_case:
exclude_filter_column/ 1.00 887.9±47.56µs ? ?/sec
1.22 1080.5±15.66µs ? ?/sec
composite_filter/Composite Filter: sel AND mod_clustered/
1.10 7.5±0.12ms ? ?/sec 1.00
6.8±0.12ms ? ?/sec
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
