[
https://issues.apache.org/jira/browse/IMPALA-8315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872758#comment-16872758
]
ASF subversion and git services commented on IMPALA-8315:
---------------------------------------------------------
Commit 9e117be4a63ae90e80b6d99a004750e5d3d9744a in impala's branch
refs/heads/master from Tim Armstrong
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=9e117be ]
IMPALA-8315: ignore rmtree errors in run_stmt_in_hive()
Per Joe's suggestion in the JIRA, we shouldn't fail the
test if rmtree() hits an error.
Change-Id: Ic303b61e4df0a7a3fcabbae812a6d2b9a8aa52df
Reviewed-on: http://gerrit.cloudera.org:8080/13720
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Joe McDonnell <[email protected]>
> Error from shutil.rmtree in ImpalaTestSuite::run_stmt_in_hive()
> ---------------------------------------------------------------
>
> Key: IMPALA-8315
> URL: https://issues.apache.org/jira/browse/IMPALA-8315
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 3.3.0
> Reporter: Joe McDonnell
> Assignee: Tim Armstrong
> Priority: Critical
> Labels: broken-build
>
> TestHBaseQueries.test_hbase_col_filter() failed on a centos6 exhaustive build
> with the following error:
> {noformat}
> query_test/test_hbase_queries.py:89: in test_hbase_col_filter
> self.run_stmt_in_hive(add_data)
> common/impala_test_suite.py:781: in run_stmt_in_hive
> if tmpdir is not None: shutil.rmtree(tmpdir)
> /usr/lib64/python2.6/shutil.py:212: in rmtree
> rmtree(fullname, ignore_errors, onerror)
> /usr/lib64/python2.6/shutil.py:212: in rmtree
> rmtree(fullname, ignore_errors, onerror)
> /usr/lib64/python2.6/shutil.py:212: in rmtree
> rmtree(fullname, ignore_errors, onerror)
> /usr/lib64/python2.6/shutil.py:217: in rmtree
> onerror(os.remove, fullname, sys.exc_info())
> /usr/lib64/python2.6/shutil.py:215: in rmtree
> os.remove(fullname)
> E OSError: [Errno 2] No such file or directory:
> '/tmp/impala-tests-j2b9bQ/localRunner/jenkins/job_local541814598_0023/job_local541814598_0023.xml'{noformat}
> ImpalaTestSuite::run_stmt_in_hive() creates a temporary directory when in
> LocalRunner mode to avoid different tests conflicting on the directory name.
> It creates the temp directory, runs the Hive statement, then removes the
> directory at the end. The removal is failing here. It looks like there might
> be a race between pytest running shutil.rmtree() and Hive cleaning up its own
> files from the statement.
> We might want to use shutil.rmtree(..., ignore_errors=True).
> Seen once.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
