[
https://issues.apache.org/jira/browse/IMPALA-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17626389#comment-17626389
]
ASF subversion and git services commented on IMPALA-11671:
----------------------------------------------------------
Commit 1e30ca228d683821e42e51f94478c77642f5331a in impala's branch
refs/heads/dependabot/maven/fe/org.eclipse.jetty-jetty-server-9.4.41.v20210516
from Michael Smith
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=1e30ca228 ]
IMPALA-11671: Clear trash for Ozone to avoid bug
When using Ozone, clears trash before listing it after running tests to
avoid HDDS-4974. It seems to come up specifically for files generated by
query_test/test_cancellation.py and query_test/test_decimal_queries.py.
Change-Id: I3dfdac33484cc4a033a81943c655928b8c5b24b0
Reviewed-on: http://gerrit.cloudera.org:8080/19151
Reviewed-by: Daniel Becker <daniel.bec...@cloudera.com>
Reviewed-by: Joe McDonnell <joemcdonn...@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
> run-all-tests.sh with Ozone fails listing DFS files
> ---------------------------------------------------
>
> Key: IMPALA-11671
> URL: https://issues.apache.org/jira/browse/IMPALA-11671
> Project: IMPALA
> Issue Type: Bug
> Affects Versions: Impala 4.2.0
> Reporter: Michael Smith
> Assignee: Michael Smith
> Priority: Critical
> Labels: ci-failure
> Fix For: Impala 4.2.0
>
>
> {code}
> hdfs dfs -ls -R ${FILESYSTEM_PREFIX}/test-warehouse \
> > ${IMPALA_LOGS_DIR}/file-list-end-${i}.log 2>&1
> {code}
> in run-all-tests.sh fails when testing with Ozone. Errors like
> {code}
> ls: Unable to get file status: volume: impala bucket: test-warehouse key:
> .Trash/jenkins/Current/impala/test-warehouse/test_insert_select_exprs_5162abf6.db/overflowed_decimal_tbl_2/_impala_insert_staging/c94353a630109577_202e902000000000
> ls: Unable to get file status: volume: impala bucket: test-warehouse key:
> .Trash/jenkins/Current/impala/test-warehouse/tpch.db/ctas_cancel/_impala_insert_staging/454c6614d6c20d17_94fac58c00000000
> ls: Unable to get file status: volume: impala bucket: test-warehouse key:
> .Trash/jenkins/Current/impala/test-warehouse/tpch.db/ctas_cancel1665933223846/_impala_insert_staging/7a46352d463f457e_fcabb6e000000000
> ls: Unable to get file status: volume: impala bucket: test-warehouse key:
> .Trash/jenkins/Current/impala/test-warehouse/tpch.db/ctas_cancel1665933261855/_impala_insert_staging/d24d1c35c2a9360c_90e32ce200000000
> {code}
> are visible in file-list-end-1.log. Current theory is that Ozone is cleaning
> up trash files while we list them.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
