suxiaogang223 opened a new pull request, #63516:
URL: https://github.com/apache/doris/pull/63516
### What problem does this PR solve?
HDFS file handles were cached only by file path and mtime. In a pipeline
that runs multiple Hive catalog cases against the same HDFS path shape, a later
query can use a different `hdfsFS` authentication context while still matching
the old cache key. That can reuse a handle opened under another context and
lead to HDFS auth failures such as `SIMPLE authentication is not enabled.
Available:[TOKEN, KERBEROS]`.
This PR includes the `hdfsFS` identity in the file handle cache key and
partition hash, so cached handles are only reused within the same
filesystem/authentication context.
Issue Number: None
Related PR: None
### Release note
None
### Check List (For Author)
- Test: Manual test
- `build-support/clang-format.sh be/src/io/fs/file_handle_cache.cpp
be/src/io/fs/file_handle_cache.h be/test/io/fs/file_handle_cache_test.cpp`
- `git diff --cached --check`
- BE UT not run locally per request
- Behavior changed: No
- Does this need documentation: No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
