Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/24744 )
Change subject: IMPALA-15290: Retry for exists check in HadoopFsCommandLineClient ...................................................................... IMPALA-15290: Retry for exists check in HadoopFsCommandLineClient HadoopFsCommandLineClient.exists() currently ignores the stdout and stderr of the hdfs CLI command. When it returns false, it could due to transient errors like S3 503 Slow Down error. In such error cases, stderr is not empty. This adds a retry in exists() when the command exits with non-zero status and non-empty stderr. Also adds logging to show stdout and stderr for further debugging. Testing - Ran test_execute_remove_orphan_files locally. - Ran tests/query_test/test_iceberg.py on S3. Assisted-by: Opus 4.8 (Claude Code) Change-Id: I071472529ec1b923e74e960a24e19b9e70c80011 Reviewed-on: http://gerrit.cloudera.org:8080/24744 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M tests/util/hdfs_util.py 1 file changed, 29 insertions(+), 2 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/24744 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I071472529ec1b923e74e960a24e19b9e70c80011 Gerrit-Change-Number: 24744 Gerrit-PatchSet: 5 Gerrit-Owner: Quanlong Huang <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Joe McDonnell <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Xuebin Su <[email protected]>
