Gabriel39 opened a new pull request, #70185:
URL: https://github.com/apache/doris/pull/70185
### What problem does this PR solve?
Backport the following master PRs to `branch-4.2`, in master merge order:
1. #69672 — Preserve source values and alias semantics in ES scans.
2. #69971 — Add session controls for Parquet page indexes and data-page size.
3. #70155 — Repair ES source predicate regression cases.
4. #70079 — Fix ORC condition-cache seeks past filtered stripe suffixes.
5. #70154 — Preserve JSON and WAL rows with empty file projections.
The ES changes are adapted to the existing 4.2 FE planner and BE source
locations. Mapping safety, scan-wide read mode, local residuals, native
`esquery` handling and alias routing retain the upstream behavior without
introducing the master connector framework. Added adapter tests cover both scan
protocols, aliases, missing-value negations and native residual rejection.
Preserve existing branch-specific ES regression coverage. Bring in the
previously absent predicate suite, adapting its plan assertions to 4.2's
`LOCAL_PREDICATES` output and retaining LIMIT result checks. Parquet variables
use the 4.2 annotation interface and the original optional Thrift field IDs.
The ORC dependency is pinned to the same fixed commit as #70079.
### Release note
Fix ES source-value and alias query correctness, ORC condition-cache seek
crashes/missing rows, and JSON/WAL row counts for empty file projections. Add
Parquet output page-index and data-page-size session controls.
### Validation
- FE compilation and Checkstyle passed; 53 ES tests and 9 Parquet
session-variable tests passed.
- Rebuilt the pinned ORC dependency under AddressSanitizer: 56 focused tests
passed, including 32 filtered-stripe-suffix seek cases.
- Compiled all 10 affected Doris C++ implementation/test translation units
and the ORC fixture generator. The regenerated fixture is byte-for-byte
identical to the committed fixture.
- clang-format 16 checks passed for all affected Doris C++ sources and
headers. Modified Groovy suites compiled successfully.
- Full Doris BE unit-test execution and external SQL regression execution
were not performed locally; CI validation is requested.
### Check List (For Author)
- Test
- [x] Unit Test
- [x] Regression tests included
- Behavior changed:
- [x] Yes; the upstream behavior is backported to 4.2.
- Does this need documentation?
- [x] Parquet controls are documented by the upstream documentation PR:
https://github.com/apache/doris-website/pull/4581
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
