vustef commented on issue #10381: URL: https://github.com/apache/arrow-rs/issues/10381#issuecomment-5044668634
One other thing came to mind @zhuqi-lucas . We probably need to be careful about mixed row group ordinals case. What happens if we assign ordinals to some row groups but not to others, and user then uses numbering? They might be doing row group elimination and therefore accidentally skipping row groups without ordinals. Then another query comes, this time it reads a row group without ordinal, and it fails. I think we want uniform behaviour in case of mixed row group ordinals - row numbering should never work. Which means once we encounter a row group without ordinal, while having previously encountered ordinals, we still want row numbering not to work ever. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
