Re: [VOTE] Mark Hive 2.x EOL
+1(non-binding) Thanks Mahesh Raju S On Fri, 10 May 2024, 06:15 Ayush Saxena, wrote: > Hi All, > Following the discussion at [1]. Starting the official vote thread to > mark Hive 2.x release line as EOL. > > Marking a release lines as EOL means there won't be any further > release made for that release line > > I will start with my +1 > > -Ayush > > > [1] https://lists.apache.org/thread/91wk3oy1qo953md7941ojg2q97ofsl2d >
[jira] [Created] (HIVE-27198) Delete directly aborted transactions instead of select and loading ids
Mahesh Raju Somalaraju created HIVE-27198: - Summary: Delete directly aborted transactions instead of select and loading ids Key: HIVE-27198 URL: https://issues.apache.org/jira/browse/HIVE-27198 Project: Hive Issue Type: Improvement Reporter: Mahesh Raju Somalaraju Assignee: Mahesh Raju Somalaraju in cleaning the aborted transaction , we can directly deletes the txns instead of selecting and process. method name: cleanEmptyAbortedAndCommittedTxns Code: String s = "SELECT \"TXN_ID\" FROM \"TXNS\" WHERE " + "\"TXN_ID\" NOT IN (SELECT \"TC_TXNID\" FROM \"TXN_COMPONENTS\") AND " + " (\"TXN_STATE\" = " + TxnStatus.ABORTED + " OR \"TXN_STATE\" = " + TxnStatus.COMMITTED + ") AND " + " \"TXN_ID\" < " + lowWaterMark; proposed code: String s = "DELETE \"TXN_ID\" FROM \"TXNS\" WHERE " + "\"TXN_ID\" NOT IN (SELECT \"TC_TXNID\" FROM \"TXN_COMPONENTS\") AND " + " (\"TXN_STATE\" = " + TxnStatus.ABORTED + " OR \"TXN_STATE\" = " + TxnStatus.COMMITTED + ") AND " + " \"TXN_ID\" < " + lowWaterMark; the select needs to be eliminated and the delete should work with the where clause instead of the built in clause we can see no reason for loading the ids into memory and then generate a huge sql Bathcing is also not necessary here, we can deletes the records directly -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27196) Upgrade jettision version to 1.5.4 due to CVEs
Mahesh Raju Somalaraju created HIVE-27196: - Summary: Upgrade jettision version to 1.5.4 due to CVEs Key: HIVE-27196 URL: https://issues.apache.org/jira/browse/HIVE-27196 Project: Hive Issue Type: Improvement Reporter: Mahesh Raju Somalaraju Assignee: Mahesh Raju Somalaraju [CVE-2023-1436|https://www.cve.org/CVERecord?id=CVE-2023-1436] [CWE-400|https://cwe.mitre.org/data/definitions/400.html] Need to update jettison version to 1.5.4 version due to above CVE issues. version 1.5.4 has no CVE issues. -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: [ANNOUNCE] New committer for Apache Hive: Alessandro Solimando
Congratulations Alessandro !! -Mahesh Raju S On Thu, Feb 9, 2023 at 1:31 AM Naveen Gangam wrote: > The Project Management Committee (PMC) for Apache Hive has invited > Alessandro Solimando (asolimando) to become a committer and is pleased > to announce that he has accepted. > > Contributions from Alessandro: > He has authored 30 patches for Hive, 18 for Apache Calcite and has > done many code reviews for other contributors. Vast experience and > knowledge in SQL Compiler and Optimization. His most recent work was > added support for histogram-based column stats in Hive. > > https://issues.apache.org/jira/issues/?filter=12352498 > > Being a committer enables easier contribution to the project since > there is no need to go via the patch submission process. This should > enable better productivity.A PMC member helps manage and guide the > direction of the project. > > Congratulations > Hive PMC >
[jira] [Created] (HIVE-27029) hive query fails with Filesystem closed error
Mahesh Raju Somalaraju created HIVE-27029: - Summary: hive query fails with Filesystem closed error Key: HIVE-27029 URL: https://issues.apache.org/jira/browse/HIVE-27029 Project: Hive Issue Type: Bug Reporter: Mahesh Raju Somalaraju Caused by: java.io.IOException: Filesystem closed at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:483) ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?] at org.apache.hadoop.hdfs.DFSClient.getEZForPath(DFSClient.java:2771) ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?] at org.apache.hadoop.hdfs.DistributedFileSystem$54.doCall(DistributedFileSystem.java:2796) ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?] at org.apache.hadoop.hdfs.DistributedFileSystem$54.doCall(DistributedFileSystem.java:2793) ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?] at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) ~[hadoop-common-3.1.1.7.1.8.11-3.jar:?] at org.apache.hadoop.hdfs.DistributedFileSystem.getEZForPath(DistributedFileSystem.java:2812) ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?] at org.apache.hadoop.hdfs.client.HdfsAdmin.getEncryptionZoneForPath(HdfsAdmin.java:374) ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?] at org.apache.hadoop.hive.shims.Hadoop23Shims$HdfsEncryptionShim.getEncryptionZoneForPath(Hadoop23Shims.java:1384) ~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3] at org.apache.hadoop.hive.shims.Hadoop23Shims$HdfsEncryptionShim.isPathEncrypted(Hadoop23Shims.java:1379) ~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3] at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.isPathEncrypted(SemanticAnalyzer.java:2484) ~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3] steps: 1. When using explicit queue name the tez.queue.access is used. If statistics gathering is enabled the second insert fails at the compute_stats() phase. beeline --hiveconf tez.queue.name=default -e " SET hive.query.results.cache.enabled=false; SET hive.fetch.task.conversion=none; SET hive.stats.autogather=true; drop table if exists default.bigd35368p100; create table default.bigd35368p100 (name string) partitioned by ( id int); insert into default.bigd35368p100 select * from default.bigd35368e100; drop table if exists default.bigd35368p100; create table default.bigd35368p100 (name string) partitioned by ( id int); insert into default.bigd35368p100 select * from default.bigd35368e100; " -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26983) Apache Hive website Getting started page showing 404 Error
Mahesh Raju Somalaraju created HIVE-26983: - Summary: Apache Hive website Getting started page showing 404 Error Key: HIVE-26983 URL: https://issues.apache.org/jira/browse/HIVE-26983 Project: Hive Issue Type: Bug Components: Hive Reporter: Mahesh Raju Somalaraju Assignee: Mahesh Raju Somalaraju [https://hive.apache.org/GettingStarted] When we click this page then we are getting 404 not found page. Need to check and fix the issue. -- This message was sent by Atlassian Jira (v8.20.10#820010)
