[
https://issues.apache.org/jira/browse/IMPALA-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16774448#comment-16774448
]
ASF subversion and git services commented on IMPALA-7169:
---------------------------------------------------------
Commit 7b9bdd42bf52b6eae4d5322c9b0a34297c0d40e2 in impala's branch
refs/heads/2.x from Tianyi Wang
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=7b9bdd4 ]
IMPALA-7169: Prevent HDFS from checkpointing trash until 3000 AD
HDFS trash checkpointing renames files in the trash folder and breaks
impala tests. Impala set the trash checkpointing interval to 1440 to try
to postpone it for 24 hours. Unfortunately that told HDFS to do it when
the UNIX time is a multiple of 1440 * 60 and it broke trash-related
tests run around midnight in GMT. This patch sets the interval to
541728000 so that HDFS won't do the checkpointing until Jan 1st 3000,
and HDFS will checkpoint every 1030 years after that.
Change-Id: I9452f7e44c7679f86a947cd20115c078757223d8
Reviewed-on: http://gerrit.cloudera.org:8080/10742
Reviewed-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
> TestHdfsEncryption::()::test_drop_partition_encrypt fails to find file
> ----------------------------------------------------------------------
>
> Key: IMPALA-7169
> URL: https://issues.apache.org/jira/browse/IMPALA-7169
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 2.13.0
> Reporter: Lars Volker
> Assignee: Tianyi Wang
> Priority: Critical
> Labels: broken-build, flaky
> Fix For: Impala 3.1.0
>
>
> {noformat}
> F
> metadata/test_hdfs_encryption.py::TestHdfsEncryption::()::test_drop_partition_encrypt
> metadata/test_hdfs_encryption.py:202: in test_drop_partition_encrypt
> assert self.hdfs_client.exists(
> E assert <bound method PyWebHdfsClientWithChmod.exists of
> <tests.util.hdfs_util.PyWebHdfsClientWithChmod object at
> 0xba6ee90>>('/user/jenkins/.Trash/Current/test-warehouse/test_encryption_db.db/t1/j=1/j1.txt')
> E + where <bound method PyWebHdfsClientWithChmod.exists of
> <tests.util.hdfs_util.PyWebHdfsClientWithChmod object at 0xba6ee90>> =
> <tests.util.hdfs_util.PyWebHdfsClientWithChmod object at 0xba6ee90>.exists
> E + where <tests.util.hdfs_util.PyWebHdfsClientWithChmod object at
> 0xba6ee90> = <test_hdfs_encryption.TestHdfsEncryption object at
> 0xba6ed50>.hdfs_client
> E + and
> '/user/jenkins/.Trash/Current/test-warehouse/test_encryption_db.db/t1/j=1/j1.txt'
> = <built-in method format of str object at 0x3d6f780>('jenkins',
> 'test_encryption_db')
> E + where <built-in method format of str object at 0x3d6f780> =
> '/user/{0}/.Trash/Current/test-warehouse/{1}.db/t1/j=1/j1.txt'.format
> E + and 'jenkins' = <function getuser at 0xb722a8>()
> E + where <function getuser at 0xb722a8> = getpass.getuser
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
