Gabriel39 opened a new pull request, #65218:
URL: https://github.com/apache/doris/pull/65218
### What problem does this PR solve?
Issue Number: None
Related PR: #65046
Problem Summary: FileScannerV2 only refreshed profile file-read counters in
update_realtime_counters(), so the query IOContext counters stayed at zero for
external file scans. Workload policies using be_scan_bytes_from_remote_storage
could therefore miss remote Hive/Parquet reads and fail to cancel queries. This
change publishes FileScannerV2 scan rows, scan bytes, local bytes, and remote
bytes to the query IOContext using deltas from cumulative reader/cache stats,
and falls back to treating file reader bytes as remote bytes when no file cache
statistics are available.
### Release note
None
### Check List (For Author)
- Test: Unit Test / Manual test
- Ran build-support/clang-format.sh
- Ran targeted run_clang_format.py check for modified BE files
- Ran git diff --check
- Attempted ./run-be-ut.sh --run --filter='FileScannerV2Test.*' (blocked
by missing Snappy in thirdparty/installed in this worktree)
- Behavior changed: No
- Does this need documentation: No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
