[
https://issues.apache.org/jira/browse/IMPALA-7726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16656004#comment-16656004
]
Jim Apple commented on IMPALA-7726:
-----------------------------------
Basic question: in
https://gerrit.cloudera.org/#/c/11630/5/tests/util/abfs_util.py, you use
{{hadoop_fs_shell(['-test', '-e', fixed_path])}}: Does that always work when
it's looking in the trash, even in the abstract?
You tried with {{subprocess.Popen}} - did you try with any other methods of
calling hdfs? For instance, you could just call out to a bash script.
Did you try using this exact same {{exists}} command but shimming it over S3 or
HDFS and see if they fail in a similar way?
> Drop with purge tests fail against ABFS due to trash misbehavior
> ----------------------------------------------------------------
>
> Key: IMPALA-7726
> URL: https://issues.apache.org/jira/browse/IMPALA-7726
> Project: IMPALA
> Issue Type: Bug
> Reporter: Sean Mackrory
> Assignee: Sean Mackrory
> Priority: Major
>
> In testing IMPALA-7681, I've seen test_drop_partition_with_purge and
> test_drop_table_with_purge fail because of files not found in the trash are a
> drop without purge. I've traced that functionality through Hive, which uses
> Hadoop's Trash API, and traced through a bunch of scenarios in that API with
> ABFS and I can't see it misbehaving in any way. It also should be pretty
> FS-agnostic. I also suspected a bug in abfs_utils.py's exists() function, but
> have not been able to find one.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
