Hello Xuebin Su, Joe McDonnell, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/24744
to look at the new patch set (#3).
Change subject: IMPALA-15290: Retry for exists check in
HadoopFsCommandLineClient
......................................................................
IMPALA-15290: Retry for exists check in HadoopFsCommandLineClient
HadoopFsCommandLineClient.exists() currently ignores the stdout and
stderr of the hdfs CLI command. When it returns false, it could due to
transient errors like S3 503 Slow Down error. In such error cases,
stderr is not empty.
This adds a retry in exists() when the command exits with non-zero
status and non-empty stderr. Also adds logging to show stdout and stderr
for further debugging.
Testing
- Ran test_execute_remove_orphan_files locally.
- Ran tests/query_test/test_iceberg.py on S3.
Assisted-by: Opus 4.8 (Claude Code)
Change-Id: I071472529ec1b923e74e960a24e19b9e70c80011
---
M tests/util/hdfs_util.py
1 file changed, 29 insertions(+), 2 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/44/24744/3
--
To view, visit http://gerrit.cloudera.org:8080/24744
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I071472529ec1b923e74e960a24e19b9e70c80011
Gerrit-Change-Number: 24744
Gerrit-PatchSet: 3
Gerrit-Owner: Quanlong Huang <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Quanlong Huang <[email protected]>
Gerrit-Reviewer: Xuebin Su <[email protected]>
