zhuqi-lucas commented on PR #7401:
URL: https://github.com/apache/arrow-rs/pull/7401#issuecomment-2800558854
Still can't see performance improvement, need to investigate...
```rust
critcmp better_decode main
group
better_decode main
-----
------------- ----
arrow_reader_row_filter/filter: float64 <= 99.0 proj: all_columns/
1.02 2.6±0.03ms ? ?/sec 1.00 2.5±0.20ms
? ?/sec
arrow_reader_row_filter/filter: float64 <= 99.0 proj: exclude_filter_column/
1.10 2.5±0.17ms ? ?/sec 1.00 2.3±0.02ms
? ?/sec
arrow_reader_row_filter/filter: float64 > 99.0 AND ts >= 9000 proj:
all_columns/ 1.06 2.3±0.03ms ? ?/sec 1.00
2.2±0.04ms ? ?/sec
arrow_reader_row_filter/filter: float64 > 99.0 AND ts >= 9000 proj:
exclude_filter_column/ 1.09 2.3±0.03ms ? ?/sec 1.00
2.1±0.15ms ? ?/sec
arrow_reader_row_filter/filter: float64 > 99.0 proj: all_columns/
1.02 2.6±0.03ms ? ?/sec 1.00 2.5±0.16ms
? ?/sec
arrow_reader_row_filter/filter: float64 > 99.0 proj: exclude_filter_column/
1.14 2.6±0.27ms ? ?/sec 1.00 2.2±0.02ms
? ?/sec
arrow_reader_row_filter/filter: int64 == 9999 proj: all_columns/
1.31 2.1±0.04ms ? ?/sec 1.00 1571.4±48.50µs
? ?/sec
arrow_reader_row_filter/filter: int64 == 9999 proj: exclude_filter_column/
1.26 2.0±0.02ms ? ?/sec 1.00 1607.4±135.41µs
? ?/sec
arrow_reader_row_filter/filter: int64 > 90 proj: all_columns/
1.06 5.1±0.24ms ? ?/sec 1.00 4.8±0.04ms
? ?/sec
arrow_reader_row_filter/filter: int64 > 90 proj: exclude_filter_column/
1.05 4.4±0.04ms ? ?/sec 1.00 4.2±0.06ms
? ?/sec
arrow_reader_row_filter/filter: ts < 9000 proj: all_columns/
1.07 2.8±0.18ms ? ?/sec 1.00 2.6±0.04ms
? ?/sec
arrow_reader_row_filter/filter: ts < 9000 proj: exclude_filter_column/
1.05 2.6±0.03ms ? ?/sec 1.00 2.5±0.15ms
? ?/sec
arrow_reader_row_filter/filter: ts >= 9000 proj: all_columns/
1.04 2.2±0.07ms ? ?/sec 1.00 2.1±0.02ms
? ?/sec
arrow_reader_row_filter/filter: ts >= 9000 proj: exclude_filter_column/
1.07 2.2±0.11ms ? ?/sec 1.00 2.0±0.15ms
? ?/sec
arrow_reader_row_filter/filter: utf8View <> '' proj: all_columns/
1.00 10.5±0.13ms ? ?/sec 1.03 10.8±0.43ms
? ?/sec
arrow_reader_row_filter/filter: utf8View <> '' proj: exclude_filter_column/
1.03 8.1±0.31ms ? ?/sec 1.00 7.9±0.12ms
? ?/sec
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
