[jira] [Created] (HIVE-24702) HiveServer2 local task leaves token crc file never gets deleted
dingshun created HIVE-24702: --- Summary: HiveServer2 local task leaves token crc file never gets deleted Key: HIVE-24702 URL: https://issues.apache.org/jira/browse/HIVE-24702 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: dingshun Attachments: 0001-update.patch in secure clusters, hiveserver2 creates a large number of /tmp/.hive_hadoop_delegation_token*.tmp.crc files, which related the Delegation Token and never gets deleted, when executes local tasks. {code:java} root@hostname:~ # ls -l /tmp/.hive_hadoop_delegation_token99*.tmp.crc -rw-r--r-- 1 hive hadoop 12 Jun 28 2020 /tmp/.hive_hadoop_delegation_token990009534922436653.tmp.crc -rw-r--r-- 1 hive hadoop 16 Nov 13 19:08 /tmp/.hive_hadoop_delegation_token990009600555210260.tmp.crc -rw-r--r-- 1 hive hadoop 16 Jan 11 11:07 /tmp/.hive_hadoop_delegation_token99002199141550942.tmp.crc -rw-r--r-- 1 hive hadoop 16 Jan 28 05:50 /tmp/.hive_hadoop_delegation_token990029730478148481.tmp.crc {code} {code:java} root@hostname:~ # ls -l /tmp/.hive_hadoop_delegation_token99*.tmp.crc|wc -l 4880 root@hostname:~ # ls -l /tmp/.hive_hadoop_delegation_token*.tmp.crc|wc -l -bash: /bin/ls: Argument list too long {code} It's created by SecureCmdDoAs when the local task is executed [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/SecureCmdDoAs.java#L67] never gets deleted [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/SecureCmdDoAs.java#L80] -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: Need help to create 2.3.9 release in Hive JIRA
Bump this, also cc Owen who helped me last time (sorry for directly emailing you). On Tue, Jan 19, 2021 at 4:07 PM Chao Sun wrote: > Hi, > > Can someone help me to create 2.3.9 release in Hive JIRA so that we can > use that as fixed or targeted version? Thanks. > > Best, > Chao >
[jira] [Created] (HIVE-24701) Remove String Manipulation from Date Parsing TimestampTZUtil
David Mollitor created HIVE-24701: - Summary: Remove String Manipulation from Date Parsing TimestampTZUtil Key: HIVE-24701 URL: https://issues.apache.org/jira/browse/HIVE-24701 Project: Hive Issue Type: Improvement Reporter: David Mollitor Assignee: David Mollitor This operation is pretty slow: {code:java} // Converts Date to TimestampTZ. public static TimestampTZ convert(Date date, ZoneId defaultTimeZone) { return parse(date.toString(), defaultTimeZone); } {code} To convert from Date to TimestampTZ, it creates a string, then parses it. Should be able to just look at the epoch time and do the conversion without all the string manipulation/parsing. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24700) Run Mssql integration tests during precommit
Zoltan Haindrich created HIVE-24700: --- Summary: Run Mssql integration tests during precommit Key: HIVE-24700 URL: https://issues.apache.org/jira/browse/HIVE-24700 Project: Hive Issue Type: Sub-task Reporter: Zoltan Haindrich add mssql to the jenkinsfile and run our metastore schema tests on it -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24699) Run Oracle integration tests during precommit
Zoltan Haindrich created HIVE-24699: --- Summary: Run Oracle integration tests during precommit Key: HIVE-24699 URL: https://issues.apache.org/jira/browse/HIVE-24699 Project: Hive Issue Type: Sub-task Reporter: Zoltan Haindrich this will need a working oracle docker image - and possibly some smaller changes to make sure that the tests could run reliable -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24698) Sync ACL's for the table directory during external table replication.
Ayush Saxena created HIVE-24698: --- Summary: Sync ACL's for the table directory during external table replication. Key: HIVE-24698 URL: https://issues.apache.org/jira/browse/HIVE-24698 Project: Hive Issue Type: Bug Reporter: Ayush Saxena Assignee: Ayush Saxena Set similar ACL's to destination table directory in case the source has ACL's enabled or set. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24697) DbNotificationListener Cleaner thread dies with NoSuchMethodError
Pravin Sinha created HIVE-24697: --- Summary: DbNotificationListener Cleaner thread dies with NoSuchMethodError Key: HIVE-24697 URL: https://issues.apache.org/jira/browse/HIVE-24697 Project: Hive Issue Type: Bug Reporter: Pravin Sinha Assignee: Pravin Sinha {code:java} java.lang.NoSuchMethodError: javax.jdo.Query.close()V at org.apache.hadoop.hive.metastore.ObjectStore.doCleanNotificationEvents(ObjectStore.java:11025) at org.apache.hadoop.hive.metastore.ObjectStore.cleanNotificationEvents(ObjectStore.java:10965) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24696) Drop procedure and drop package syntax for HPLSQL
Attila Magyar created HIVE-24696: Summary: Drop procedure and drop package syntax for HPLSQL Key: HIVE-24696 URL: https://issues.apache.org/jira/browse/HIVE-24696 Project: Hive Issue Type: Sub-task Components: hpl/sql Reporter: Attila Magyar -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24695) Clean up session resources, if TezSession is unable to start
Rajesh Balamohan created HIVE-24695: --- Summary: Clean up session resources, if TezSession is unable to start Key: HIVE-24695 URL: https://issues.apache.org/jira/browse/HIVE-24695 Project: Hive Issue Type: Improvement Reporter: Rajesh Balamohan There are cases when TezSessionState would not be able to start. (e.g resource constraints on YARN queues). However by this time, session directories & certain resources are localized. (e.g, hive-exec jars are stored in hdfs:///tmp/hive/hive/_tez_session_dir/*/hive-exec*.jar). When tezClient is not started, it does not clear up the resources. This leaks ~100MB data in HDFS per failure. -- This message was sent by Atlassian Jira (v8.3.4#803005)