[
https://issues.apache.org/jira/browse/SENTRY-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16007601#comment-16007601
]
Na Li edited comment on SENTRY-1723 at 5/12/17 4:03 AM:
--------------------------------------------------------
I have reproduced the failure locally. from the log, I found
"TestHDFSIntegrationAdvanced.testAuthzObjOnPartitionMultipleTables" fails from
time to time. When I run the particular test, it always passes. When I run all
test cases in TestHDFSIntegrationAdvanced, then
testAuthzObjOnPartitionMultipleTables fails. I suspect it is because previous
test clean up is not done before next test starts. So creating external table
fails in the next test.
After adding delay in test clean up function
TestHDFSIntegrationBase.cleanAfterTest(), the test succeeds.
In log, when such test failed, I can see the first time [Starting command:
create external table tab1(a int) location '/tmp/external/p1'] succeeds, but
the second time [Starting command: create external table tab1(a int) location
'/tmp/external/p1'] fails due to
[org.apache.hadoop.security.AccessControlException Permission denied:
user=hive, access=EXECUTE, inode="/tmp/external/p1":hdfs:hdfs:drwxrwx---]
was (Author: linaataustin):
I have reproduced the failure locally. from the log, I found
"TestHDFSIntegrationAdvanced.testAuthzObjOnPartitionMultipleTables" fails from
time to time. When I run the particular test, it always passes. When I run all
test cases in TestHDFSIntegrationAdvanced, then
testAuthzObjOnPartitionMultipleTables fails. I suspect it is because previous
test clean up is not done before next test starts. So creating external table
fails in the next test.
After adding delay in test clean up function
TestHDFSIntegrationBase.cleanAfterTest(), the test succeeds.
> HDFS e2e tests should wait for HMSFollower to start
> ---------------------------------------------------
>
> Key: SENTRY-1723
> URL: https://issues.apache.org/jira/browse/SENTRY-1723
> Project: Sentry
> Issue Type: Sub-task
> Components: Sentry
> Reporter: Alexander Kolbasov
> Assignee: Na Li
> Fix For: sentry-ha-redesign
>
>
> When I run the {{TestHDFSIntegrationEnd2End}} test from sentry-ha-redesign
> branch, I get
> {code}
> -------------------------------------------------------
> T E S T S
> -------------------------------------------------------
> Running org.apache.sentry.tests.e2e.hdfs.TestHDFSIntegrationEnd2End
> Tests run: 6, Failures: 1, Errors: 0, Skipped: 2, Time elapsed: 142.788 sec
> <<< FAILURE! - in org.apa
> che.sentry.tests.e2e.hdfs.TestHDFSIntegrationEnd2End
> testColumnPrivileges(org.apache.sentry.tests.e2e.hdfs.TestHDFSIntegrationEnd2End)
> Time elapsed: 15.0
> 14 sec <<< FAILURE!
> java.lang.AssertionError: Error at verifying Path action :
> /user/hive/warehouse/db2.db/p1 ; expected:
> <READ_EXECUTE> but was:<null>
> at
> org.apache.sentry.tests.e2e.hdfs.TestHDFSIntegrationEnd2End.testColumnPrivileges(TestHDFSI
> ntegrationEnd2End.java:505)
> Results :
> Flaked tests:
> org.apache.sentry.tests.e2e.hdfs.TestHDFSIntegrationEnd2End.testColumnPrivileges(org.apache.sentry.te
> sts.e2e.hdfs.TestHDFSIntegrationEnd2End)
> Run 1:
> TestHDFSIntegrationEnd2End.testColumnPrivileges:505->TestHDFSIntegrationBase.verifyOnAllSubDirs:186->TestHDFSIntegrationBase.verifyOnAllSubDirs:205->TestHDFSIntegrationBase.verifyOnAllSubDirs:209->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:224
> Error at verifying Path action : /user/hive/warehouse/db2.db/p1 ;
> expected:<READ_EXECUTE> but was:<null>
> Run 2: PASS
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 2, Flakes: 1
> {code}
> I run the test with
> {code}
> mvn clean -pl sentry-tests/sentry-tests-hive -am -DfailIfNoTests=false
> -Dtest=TestHDFSIntegrationEnd2End test
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
