wenzhenghu opened a new pull request, #64035:
URL: https://github.com/apache/doris/pull/64035
### What problem does this PR solve?
Issue Number: None
Related PR: None
Problem Summary:
This PR preloads external table metadata before internal table plan-time
read locks are acquired in Nereids, so slow external metadata initialization no
longer extends the lock holding window of internal tables. The preload path
covers Hive, Hudi, Iceberg, Paimon, and JDBC catalog schema loading. The change
also adds an experimental session variable to control the behavior, DEBUG logs
for preload decisions, a dedicated profile counter for preload time, FE unit
tests, and a JDBC regression case that validates the time shift from analysis
to preload with a debug point.
### Release note
Improve FE planning by moving external metadata preload ahead of internal
table plan-time read locks, with observability and JDBC coverage.
### Check List (For Author)
- Test: FE Unit Test / Manual test
- FE Unit Test: `./run-fe-ut.sh --run
org.apache.doris.nereids.StatementContextTest,org.apache.doris.common.profile.SummaryProfileTest,org.apache.doris.datasource.PluginDrivenExternalTableEngineTest`
- Manual test: validated the JDBC preload profile case against a custom
Doris environment with an equivalent setup
- Behavior changed: Yes
- Does this need documentation: No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
