Gabriel39 opened a new pull request, #66575:
URL: https://github.com/apache/doris/pull/66575
### What problem does this PR solve?
Issue Number: None
Related PR: None
Problem Summary:
File Scanner V2 previously received Variant access paths as untyped string
tokens. Iceberg and Paimon native Parquet scans therefore could only project
one unambiguous top-level shredded leaf and had to abandon physical projection
for deeper object paths.
This change transports a backward-compatible object-only Variant suffix from
FE to BE, merges multiple paths in the AccessPath tree, and traverses nested
Parquet `typed_value` wrappers to project arbitrary-depth primitive object
leaves. Legacy, numeric-index, mixed, missing, unshredded, and ambiguous
physical schemas keep the conservative full-Variant fallback. Numeric array
indexes remain explicitly unsupported with a TODO.
### Release note
Support arbitrary-depth object-only Variant leaf projection for Iceberg and
Paimon native Parquet scans.
### Check List (For Author)
- Test
- [x] Regression test
- [x] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason
- Behavior changed:
- [ ] No.
- [x] Yes. Iceberg and Paimon native Parquet scans can physically
project deeply shredded Variant object leaves while preserving conservative
fallback behavior.
- Does this need documentation?
- [x] No.
- [ ] Yes.
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
