alamb commented on code in PR #7537:
URL: https://github.com/apache/arrow-rs/pull/7537#discussion_r2102257029
##########
parquet/src/arrow/arrow_reader/read_plan.rs:
##########
@@ -247,3 +328,23 @@ impl ReadPlan {
self.batch_size
}
}
+
+/// How to select the next batch of rows to read from the Parquet file
+///
+/// This allows the reader to dynamically choose between decoding strategies
+pub(crate) enum RowsPlan {
Review Comment:
Thank you.
It isn't quite done yet, but it is getting close.
I am thinking I will likely make 2 PRs
1. one PR that rearranges when the selectors are created, but still uses
`RowSelector`
2. a second PR that will switch to use this enum
However, I will leave out the BooleanBuffer part of the enum initially I
think, to keep the review load manageabe
Then I am thinking we can can adapt the code from these PRs
- https://github.com/apache/arrow-rs/pull/7454
- https://github.com/apache/arrow-rs/pull/7503
- https://github.com/apache/arrow-rs/pull/7524
To implement filtering via mask
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
