Re: Re: Next Hive 4.0.1 minor release

Hi, I'm posting some more suggestions. # We may label HIVE-28352 as "hive-4.0.1-must" I found that users were unable to upgrade some system tables from Hive 3 through schematool. It would be better to fix. https://issues.apache.org/jira/browse/HIVE-28352 # We may drop HIVE-24167 I am the ticket

[ANNOUNCE] Hive 2.x EOL

Hi All, The Apache Hive Community has voted to declare the 2.x release line as End of Life. This means no further updates or releases will be made for this release line. We urge all Hive 2.x users to upgrade to the latest versions promptly to benefit from new features and ongoing support.

Re:Re: Next Hive 4.0.1 minor release

Thank you for your feedback and testing, Okumin! I've tagged them with "hive-4.0.1-must". Thanks, Zhihua At 2024-05-15 10:43:59, "Okumin" wrote: >Hi Zhihua, > >Thanks for driving the next release. We are actively testing 4.0.0 and >would like to give some suggestions. > ># HIVE-27847:

Re: Next Hive 4.0.1 minor release

Hi Zhihua, Thanks for driving the next release. We are actively testing 4.0.0 and would like to give some suggestions. # HIVE-27847: Prevent query Failures on Numeric <-> Timestamp We hit the issue when we ran Hive 4 with the option. I believe it is worth resolving for those who want to try Hive

Next Hive 4.0.1 minor release

Hello Community, As you have noticed, we are going to propose the next 4.0.1 release on top of 4.0.0, with some critical bug fixes and improvements [1]. As of now we are putting the label "hive-4.0.1-must" on the tickets and we plan to make sure those get c-picked to branch-4.0 [2].

CVE-2023-35701: Apache Hive: Arbitrary command execution via JDBC driver

Severity: moderate Affected versions: - Apache Hive 4.0.0-alpha-1 before 4.0.0 Description: Improper Control of Generation of Code ('Code Injection') vulnerability in Apache Hive. The vulnerability affects the Hive JDBC driver component and it can potentially lead to arbitrary code

Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

Thanks again everyone :) On Fri, Apr 19, 2024, 2:15 AM Rajesh Balamohan wrote: > Congratulations Simhadri. :) > > ~Rajesh.B > > On Fri, Apr 19, 2024 at 2:02 AM Aman Sinha wrote: > >> Congrats Simhadri ! >> >> On Thu, Apr 18, 2024 at 12:25 PM Naveen Gangam >> wrote: >> >>> Congrats Simhadri.

Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

Congratulations Simhadri. :) ~Rajesh.B On Fri, Apr 19, 2024 at 2:02 AM Aman Sinha wrote: > Congrats Simhadri ! > > On Thu, Apr 18, 2024 at 12:25 PM Naveen Gangam > wrote: > >> Congrats Simhadri. Looking forward to many more contributions in the >> future. >> >> On Thu, Apr 18, 2024 at 12:25 

Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

Congrats Simhadri ! On Thu, Apr 18, 2024 at 12:25 PM Naveen Gangam wrote: > Congrats Simhadri. Looking forward to many more contributions in the > future. > > On Thu, Apr 18, 2024 at 12:25 PM Sai Hemanth Gantasala > wrote: > >> Congratulations Simhadri  well deserved >> >> On Thu, Apr 18,

Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

Congrats Simhadri. Looking forward to many more contributions in the future. On Thu, Apr 18, 2024 at 12:25 PM Sai Hemanth Gantasala wrote: > Congratulations Simhadri  well deserved > > On Thu, Apr 18, 2024 at 8:41 AM Pau Tallada wrote: > >> Congratulations >> >> Missatge de Alessandro

unsubscribe

-- Regards, Rajbir

Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

Congratulations Simhadri  well deserved On Thu, Apr 18, 2024 at 8:41 AM Pau Tallada wrote: > Congratulations > > Missatge de Alessandro Solimando del dia > dj., 18 d’abr. 2024 a les 17:40: > >> Great news, Simhadri, very well deserved! >> >> On Thu, 18 Apr 2024 at 15:07, Simhadri G

Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

Congratulations Missatge de Alessandro Solimando del dia dj., 18 d’abr. 2024 a les 17:40: > Great news, Simhadri, very well deserved! > > On Thu, 18 Apr 2024 at 15:07, Simhadri G wrote: > >> Thanks everyone! >> I really appreciate it, it means a lot to me :) >> The Apache Hive project and

Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

Great news, Simhadri, very well deserved! On Thu, 18 Apr 2024 at 15:07, Simhadri G wrote: > Thanks everyone! > I really appreciate it, it means a lot to me :) > The Apache Hive project and its community have truly inspired me . I'm > grateful for the chance to contribute to such a remarkable

Re: [ANNOUNCE] New Committer: Simhadri Govindappa

Congratulations Simhadri! Regards, Krisztian On Thu, Apr 18, 2024 at 3:25 PM kokila narayanan < kokilanarayana...@gmail.com> wrote: > Congratulations Simhadri  > > On Thu, 18 Apr, 2024, 17:22 Ayush Saxena, wrote: > >> Hi All, >> Apache Hive's Project Management Committee (PMC) has invited

Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

Thanks everyone! I really appreciate it, it means a lot to me :) The Apache Hive project and its community have truly inspired me . I'm grateful for the chance to contribute to such a remarkable project. Thanks! Simhadri Govindappa On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan wrote: >

RE: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

Congrats Simhadri! -Sankar From: Butao Zhang Sent: Thursday, April 18, 2024 5:39 PM To: user@hive.apache.org; dev Subject: [EXTERNAL] Re: [ANNOUNCE] New Committer: Simhadri Govindappa You don't often get email from butaozha...@163.com. Learn why this is

Re: [ANNOUNCE] New Committer: Simhadri Govindappa

Congratulations Simhadri !!! Thanks.  发件人: user-return-28075-butaozhang1=163@hive.apache.org 代表 Ayush Saxena 发送时间: 星期四, 四月 18, 2024 7:50 下午收件人: dev ; user@hive.apache.org 主题: [ANNOUNCE] New Committer: Simhadri Govindappa Hi All,Apache Hive's Project Management

[ANNOUNCE] New Committer: Simhadri Govindappa

Hi All, Apache Hive's Project Management Committee (PMC) has invited Simhadri Govindappa to become a committer, and we are pleased to announce that he has accepted. Please join me in congratulating him, Congratulations Simhadri, Welcome aboard!!! -Ayush Saxena (On behalf of Apache Hive PMC)

[ANNOUNCE] Hive 1.x EOL

Hi All, The Apache Hive Community has voted to declare the 1.x release line as End of Life (EOL). This means no further updates or releases will be made for this series. We urge all Hive 1.x users to upgrade to the latest versions promptly to benefit from new features and ongoing support.

Unsubscripe

Unsubscribe

Re: [ANNOUNCE] Apache Hive 4.0.0 Released

Congratulations and huge thanks to Apache Hive team and contributors for releasing Hive 4. We have been watching the development of Hive 4 since the release of Hive 3.1, and it's truly satisfying to witness the resolution of all the critical issues at last after 5 years. Hive 4 comes with a lot of

Participate in the ASF 25th Anniversary Campaign

Hi everyone, As part of The ASF’s 25th anniversary campaign[1], we will be celebrating projects and communities in multiple ways. We invite all projects and contributors to participate in the following ways: * Individuals - submit your first contribution:

Re: [ANNOUNCE] Apache Hive 4.0.0 Released

I'm really excited to see the news! I can easily imagine the difficulty of testing and shipping Hive 4.0.0 with more than 5k commits. I'm proud to have witnessed this moment here. Thank you! On Wed, Apr 3, 2024 at 3:07 AM Naveen Gangam wrote: > > Thank you for the tremendous amount of work put

Re: [ANNOUNCE] Apache Hive 4.0.0 Released

Thank you for the tremendous amount of work put in by many many folks to make this release happen, including projects hive is dependent upon like tez. Thank you to all the PMC members, committers and contributors for all the work over the past 5+ years in shaping this release. THANK YOU!!! On

RE: [EXTERNAL] Re: [ANNOUNCE] Apache Hive 4.0.0 Released

Absolutely exciting news! Congrats to the entire Hive community for making this release happen! -Sankar From: Pau Tallada Sent: Tuesday, April 2, 2024 2:31 PM To: user@hive.apache.org Cc: d...@hive.apache.org Subject: [EXTERNAL] Re: [ANNOUNCE] Apache Hive 4.0.0 Released You don't often get

Re: [ANNOUNCE] Apache Hive 4.0.0 Released

Congrats to all for the hard work Missatge de Butao Zhang del dia dt., 2 d’abr. 2024 a les 10:58: > I'm thrilled to see the official release of Apache Hive 4.0.0, marking > another milestone in the development of the Hive community. I want to > extend my gratitude to all the partners in the

Re: [ANNOUNCE] Apache Hive 4.0.0 Released

I'm thrilled to see the official release of Apache Hive 4.0.0, marking another milestone in the development of the Hive community. I want to extend my gratitude to all the partners in the community for their hard work. Also special thanks to Denys for your diligent code reviews and efforts in

Re: [ANNOUNCE] Apache Hive 4.0.0 Released

The new Apache Hive 4.0.0 release brings roughly 5K new commits (since Apache Hive 3.1.3) and it's probably the biggest release so far in the history of the project. The numbers clearly show that this is a collective effort that wouldn't be possible without a strong community and many volunteers

Re: [ANNOUNCE] Apache Hive 4.0.0 Released

Thank you for your hard work and dedication in releasing Apache Hive version 4.0.0. Congratulations to the entire team on this achievement. Keep up the great work! Does this consider as GA.? And Looks we need to update in the following location also.? https://hive.apache.org/general/downloads/

[ANNOUNCE] Apache Hive 4.0.0 Released

The Apache Hive team is proud to announce the release of Apache Hive version 4.0.0. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop (TM), it provides, among others: * Tools to enable easy

Community Over Code NA 2024 Travel Assistance Applications now open!

Hello to all users, contributors and Committers! [ You are receiving this email as a subscriber to one or more ASF project dev or user mailing lists and is not being sent to you directly. It is important that we reach all of our users and contributors/committers so that they may get a chance

Hive-MR3 1.10 released

Hello Hive users, We have released Hive on MR3 1.10. MR3 is an execution engine similar to MapReduce and Tez, and it supports Hadoop, Kubernetes, and standalone mode. Hive-MR3 uses MR3 for its execution backend in Hive 3.1.3. If you are interested, please give it a try. In MR3 1.10, we have

unsubscribe

Orange Restricted smime.p7s Description: S/MIME cryptographic signature

Some problems encountered when reading ICEBERG with vectorisation turned on

Hi. I am using HIVE 4.0.0 to read ICEBERG tables. I am having some problems with it, so if someone could guide me, that would be great. Env: hadoop3.3.6 hive4.0.0 tez0.10.2 iceberg1.4.3 iceberg-table: hadoop-catalog-table/location_based_table Question 1: How

Re: CachedStore for hive.metastore.rawstore.impl in Hive 3.0

I should have mentioned earlier, but we encountered our problem with queries between Trino and Hive3 MetaStore. The tests I reported were also querying Hive1/3 MetaStore using Trino. The problem might only exist between Trino and Hive3 MetaStore. - Takanobu 2024年3月1日(金) 14:53 Takanobu Asanuma :

Re: CachedStore for hive.metastore.rawstore.impl in Hive 3.0

Yes, for now, we believe that HIVE-14187 has caused performance degradation in Hive3 MetaStore. We also use HiveServer2, but our HiveServer2 directly accesses the backend DB without going through the Hive MetaStore, because it enhances performance to directly access the DB in a heavily loaded

Re: CachedStore for hive.metastore.rawstore.impl in Hive 3.0

Thank you for sharing the result. (Does your result imply that HIVE-14187 is introducing an intended bug?) Another issue that could be of your interest is the connection leak problem reported in HIVE-20600. Do you see the connection leak problem, or is it not relevant to your environment (e.g.,

Re: CachedStore for hive.metastore.rawstore.impl in Hive 3.0

Hi Pau and Sungwoo, Thanks for sharing the information. We tested a set of simple queries which just referenced the Hive table and didn't execute any Hive jobs. The result is below. No. Version rawstore.impl connectionPoolingType HIVE-14187 QueryTime

Re: CachedStore for hive.metastore.rawstore.impl in Hive 3.0

We didn't make any other attempt to fix the problem and just decided not to use CachedStore. However, I think our installation of Metastore based on Hive 3.1.3 is running without any serious problems. Could you share how long it takes to compile typical queries in your environment (with Hive 1

Re: CachedStore for hive.metastore.rawstore.impl in Hive 3.0

Hi, We also had to disable CachedStore as it was producing wrong results in our queries. I'm sorry I cannot provide more detailed info. Cheers, Pau. Missatge de Takanobu Asanuma del dia dc., 28 de febr. 2024 a les 13:59: > Thanks for your detailed answer! > > In the original email, you

Re: CachedStore for hive.metastore.rawstore.impl in Hive 3.0

Thanks for your detailed answer! In the original email, you reported "the query compilation takes long" in Hive 3.0, but has this issue been resolved in your fork of Hive 3.1.3? Thank you for sharing the issue with CachedStore and the JIRA tickets. I will also try out

Re: CachedStore for hive.metastore.rawstore.impl in Hive 3.0

Hello Takanobu, We did not test with vanilla Hive 3.1.3 and Metastore databases can be different, so I don't know why Metastore responses are very slow. I can only share some results of testing CachedStore in Metastore. Please note that we did not use vanilla Hive 3.1.3 and instead used our own

Re: CachedStore for hive.metastore.rawstore.impl in Hive 3.0

Hi Sungwoo Park, I'm sorry for the late reply to this old email. We are attempting to upgrade Hive MetaStore from Hive1 to Hive3, and noticed that the response of the Hive3 MetaStore is very slow. We suspect that HIVE-14187 might be causing this slowness. Could you tell me if you have resolved

Community Over Code Asia 2024 Travel Assistance Applications now open!

Hello to all users, contributors and Committers! The Travel Assistance Committee (TAC) are pleased to announce that travel assistance applications for Community over Code Asia 2024 are now open! We will be supporting Community over Code Asia, Hangzhou, China July 26th - 28th, 2024. TAC exists

Re: [EXTERNAL] Backport HIVE-21075 into 3.2.0 release

Hi , No HIVE-21075 was not planned as of now in the 3.2.0 release. But will check the feasibility and implications of the same and add it to the parent JIRA. Its difficult to quote an exact date for the release since we are working on backporting some important tickets (linked to parent JIRA)

Backport HIVE-21075 into 3.2.0 release

Hi, I saw that HIVE-21075 has a bug fix on a performance problem for drop partitions with PostgreSQL or MySQL, and the fix was merged only into the 4.0.0-alph-1 version. I also saw that you plan to release a 3.2.0 version with HIVE-26751

Community over Code EU 2024 Travel Assistance Applications now open!

Hello to all users, contributors and Committers! The Travel Assistance Committee (TAC) are pleased to announce that travel assistance applications for Community over Code EU 2024 are now open! We will be supporting Community over Code EU, Bratislava, Slovakia, June 3th - 5th, 2024. TAC exists

[no subject]

Hello to all users, contributors and Committers! The Travel Assistance Committee (TAC) are pleased to announce that travel assistance applications for Community over Code EU 2024 are now open! We will be supporting Community over Code EU, Bratislava, Slovakia, June 3th - 5th, 2024. TAC exists

?????? [Hive Support] Query about StandardStructObjectInspector converting field names to lowercase

Hi, I re-try my use-case on Apache Hive 4.0.0-beta-1 release. ??Just with create table statement.?? This behavior still exists. Best regards, Chang -- -- ??:

Re: [Hive Support] Query about StandardStructObjectInspector converting field names to lowercase

Hi Chang, The hive-hcatalog-core-1.1.0-cdh5.13.1.jar jar file is not something maintained by Apache. For vendor specific problems you should reach out to the respective support team from where you obtained the product. Apart from that the version that you are using (5.13.1) is quite old. Please

[Hive Support] Query about StandardStructObjectInspector converting field names to lowercase

Dear Hive Support Team, I hope you are doing well. I am writing to inquire about a specific behavior I encountered in Hive, related to the org.apache.hadoop.hive.serde2.objectinspector.StandardStructObjectInspector class. Sql to reply this behavior: ``` -- add JsonSerDe jar ADD JAR

TABLESAMPLE with buckets not working, it does not prune input

Hi all, We have a web platform in production[1] that uses Hive to facilitate access to massive cosmological datasets. When launched in 2016 over Hive 2.1.2 we used the TABLESAMPLE clause on clustered tables to allow quick subsampling of the data. However, we have been unable to get the same

Re: Hive on Docker

nevermind, I have to set these properties on hive metastore to resolve issue.I was setting these in HIveServer2 On Wed, Jan 17, 2024 at 11:38 PM Sanjay Gupta wrote: > > Hi, > I get exactly same issue as described here in Docker container which > is running Hive Metastore and HS2. > > Using Hive

Hive on Docker

Hi, I get exactly same issue as described here in Docker container which is running Hive Metastore and HS2. Using Hive version 3.1.3 ( inside docker container) https://issues.apache.org/jira/browse/HIVE-19740 It looks like close to above issue I have also set following in hive-site.xml as per

Re: Contributing doc

Hi Henri, I gave you the necessary permissions to the wiki. Please check and if you encounter any issues let us know. Best, Stamatus On Fri, Jan 12, 2024 at 10:56 AM Henri Biestro wrote: > > > My Apache Id is hen...@apache.org. > Cheers > > On 2024/01/12 09:52:20 Henri Biestro wrote: > >

Re: Contributing doc

My Apache Id is hen...@apache.org. Cheers On 2024/01/12 09:52:20 Henri Biestro wrote: > Hello; > I'd like to contribute some documentation on Hive 4 - ( > https://issues.apache.org/jira/browse/HIVE-27186 for instance) > May I get write access to the Wiki ( ie >

Contributing doc

Hello; I'd like to contribute some documentation on Hive 4 - ( https://issues.apache.org/jira/browse/HIVE-27186 for instance) May I get write access to the Wiki ( ie https://cwiki.apache.org/confluence/display/Hive/Apache+Hive+4.0.0 ) ? Thanks Henri

Re: "org.apache.thrift.transport.TTransportException: Invalid status -128" errors when SASL is enabled

For the benefit of anyone who comes across this error in future, it was solved by adding hive.metastore.sasl.enabled and hive.metastore.kerberos.principal to hive-site.xml on the client side, e.g. $SPARK_HOME/conf > On 8 Jan 2024, at 16:18, Austin Hackett wrote: > > Hi List > > I'm having

Re: Docker Hive using tez without hdfs

Thanks Attila & Ayush, I don't have permission to open Jira ticket yet but I have initiated process. I have tried with Tez 9.1 and also version 10.2 and same issue. I have noticed that when I change default hive.execution.engine=mr in hive-site.xml ( restart hive service ) and after that start

Re: Docker Hive using tez without hdfs

Agree with Ayush. Back to the original issue, is it not related to the latest Tez fix? As I remember there was an incompatibility issue, which the next tez release will fix. Maybe this is related to that. Sanjay could you please create a JIRA around it for the tracking, and the community or

Re: Docker Hive using tez without hdfs

Hi, I am not sure if the official built docker contains TEZ, but if you try to build it by yourself, you can have a look at here: https://github.com/apache/hive/blob/master/packaging/src/docker/Dockerfile#L41 To use TEZ you need to place it inside the docker container and configure it: Download

Re: Docker Hive using tez without hdfs

Hive on MR3 isn’t an official Apache Hive thing, not even an Apache OS thing, so, it is a vendor product just being tried to advertised in the ‘Apache’ Hive spaceSo, it can be all mess, filled with security issues or bugs & we Apache Hive for the record aren’t responsible for that neither do we

Re: Docker Hive using tez without hdfs

As far as I know, Hive-Tez supports local mode, but does not standalone mode (like Spark). Hive-MR3 supports standalone mode, so you can run it in any type of cluster. --- Sungwoo On Wed, Jan 10, 2024 at 4:22 PM Sanjay Gupta wrote: > I can run hive with mr engine in local mode. Does Hive + Tez

Re: Docker Hive using tez without hdfs

I can run hive with mr engine in local mode. Does Hive + Tez also works in standalone mode ? On Tue, Jan 9, 2024 at 11:08 PM Sungwoo Park wrote: > > Hello, > > I don't have an answer to your problem, but if your goal is to quickly test > Hive 3 using Docker, there is an alternative way which

Re: Docker Hive using tez without hdfs

Hello, I don't have an answer to your problem, but if your goal is to quickly test Hive 3 using Docker, there is an alternative way which uses Hive on MR3. https://mr3docs.datamonad.com/docs/quick/docker/ You can also run Hive on MR3 on Kubernetes. Thanks, --- Sungwoo On Wed, Jan 10, 2024

Docker Hive using tez without hdfs

Hi, Using following docker container to run meta , hiveserver2 https://hub.docker.com/r/apache/hive https://github.com/apache/hive/blob/master/packaging/src/docker/ I have configured hive-site.xml to se S3 When I set in hive.execution.engine to mr hive-site.xml, hive is running fine and I can

"org.apache.thrift.transport.TTransportException: Invalid status -128" errors when SASL is enabled

Hi List I'm having an issue where Hive Metastore operations (e.g. show databases) are failing with "org.apache.thrift.transport.TTransportException: Invalid status -128" errors when I enable SASL. I am a bit stuck on how to go about troubleshooting this further, and any pointers would be

MR3 1.9 and performance evaluation of Trino 435 and Hive-MR3 1.9 using TPC-DS

Hello Hive users, MR3 1.9 has been released. For changes, please see the release notes: https://mr3docs.datamonad.com/docs/release/ https://mr3docs.datamonad.com/docs/release/#patches-backported-in-mr3-19 We evaluated the performance of Trino 435 and Hive on MR3 1.9 using the TPC-DS benchmark.

Re: [DISCUSS] Tez 0.10.3 Release Planning

Thanx Laszlo, I faced some issue here [1], maybe if it is not just me, maybe we can either drop this ticket or maybe reduce the log level to debug -Ayush [1]

Re: [DISCUSS] Tez 0.10.3 Release Planning

Thanks for the feedback so far, I believe it's time to make the release. Please let me know about blockers if any, otherwise, I'm happy to volunteer to start making the release next week. (Just added user@tez now, as I added user@hive originally, accidentally...that was a feature in this context,

Re: [DISCUSS] Tez 0.10.3 Release Planning

+1 (non-binding) Thanks Laszlo ! Replied Message | From | Attila Turoczy | | Date | 1/2/2024 00:06 | | To | | | Cc | | | Subject | Re: [DISCUSS] Tez 0.10.3 Release Planning | +1 (non-binding) Thank you for the effort and happy new year! -Attila On Mon, 1 Jan 2024 at 14:22, Ayush

Re: [DISCUSS] Tez 0.10.3 Release Planning

+1 (non-binding) Thank you for the effort and happy new year! -Attila On Mon, 1 Jan 2024 at 14:22, Ayush Saxena wrote: > +1 (non-binding), > Thanx Laszlo for starting the thread. > > -Ayush > > On Mon, 1 Jan 2024 at 18:30, László Bodor > wrote: > > > > Hi Everyone! > > > > Happy New Year! > >

Re: [DISCUSS] Tez 0.10.3 Release Planning

+1 (non-binding), Thanx Laszlo for starting the thread. -Ayush On Mon, 1 Jan 2024 at 18:30, László Bodor wrote: > > Hi Everyone! > > Happy New Year! > > I think it's time to create a new Tez release. > It's not a secret: Hive 4.0 GA would benefit from the latest bug fixes since > 0.10.2, which

[DISCUSS] Tez 0.10.3 Release Planning

Hi Everyone! Happy New Year! I think it's time to create a new Tez release. It's not a secret: Hive 4.0 GA would benefit from the latest bug fixes since 0.10.2, which are:

Hive JDBC driver compatibility with Jakarta Servlet API 5.0 (Jetty 11)

Hi Hive developer community, I hope this message finds you well. I am encountering an issue while trying to establish a JDBC connection to Hive Server 2 using Java. I am currently working with Jetty 11, which requires Servlet classes to be instances of Jakarta instead of Javax. This is leading

Re: Hive 3.1.3 Hadoop Compatability

BigTop supports a specific version stack with some patches in place. It should be helpful for you. - Currently, the master branch consists of Hadoop-3.3.6, Hive-3.1.3, Tez-0.10.2. - https://github.com/apache/bigtop/blob/master/bigtop.bom - Hive patches:

Hive Tez llap creates/kills many containers after kerberized the cluster

Hi, I'm trying to setup LLAP on Hive 3.1.3, its been enable on non-secure cluster successfully and it prints out that llap daemon instead of container while running insert into table, although it allocates a separate Tez container for every simple insert (about +10 seconds for a simple

Hive Standalone Metastore dependency on Hadoop

Hi, https://repo1.maven.org/maven2/org/apache/hive/hive-standalone-metastore Does Hive Standalone Metastore depends on Hadoop ? I am building my own docker container to run Hive Metastore and I see my image size is 1.4GB. I did install Hadoop 3.3.6 and Standalone metastore 3.1.3 and metastore

Re: Blog article 'Performance Tuning for Single-table Queries'

 Replied Message | From | Sungwoo Park | | Date | 12/24/2023 00:06 | | To | user@hive.apache.org | | Cc | | | Subject | Blog article 'Performance Tuning for Single-table Queries' | Hello Hive users, I have published a new blog article 'Performance Tuning for Single-table

Blog article 'Performance Tuning for Single-table Queries'

Hello Hive users, I have published a new blog article 'Performance Tuning for Single-table Queries'. It shows how to change configuration parameters of Hive and Tez in order to make simple queries run faster than Spark. Although it uses Hive on MR3, the technique equally applies to Hive on Tez

Re: How to use SKIP_SCHEMA_INIT=TRUE from command line

Thanks, it solves issue. Much appreciated. Thanks Sanjay Gupta From: Akshat m Sent: Friday, December 22, 2023 5:55:38 AM To: user@hive.apache.org Subject: Re: How to use SKIP_SCHEMA_INIT=TRUE from command line Hi Sanjay, Instead of using --env

Re: Hive 3.1.3 Hadoop Compatability

Many thanks for clarifying Ayush - much appreciated > On 22 Dec 2023, at 08:41, Ayush Saxena wrote: > > Ideally the hadoop should be on 3.1.0 only, that is what we support, > rest if there are no incompatibilities it might or might not work with > higher versions of hadoop, we at "hive" don't

Re: How to use SKIP_SCHEMA_INIT=TRUE from command line

Hi Sanjay, Instead of using --env SKIP_SCHEMA_INIT=TRUE, Please use --env IS_RESUME="true" while running, docker run -it -d -p 9083:9083 --env SERVICE_NAME=metastore --add-host=host.docker.internal:host-gateway \ --env IS_RESUME="true" \ --env DB_DRIVER=mysql \ --env

Re: Hive 3.1.3 Hadoop Compatability

Ideally the hadoop should be on 3.1.0 only, that is what we support, rest if there are no incompatibilities it might or might not work with higher versions of hadoop, we at "hive" don't claim that it can work, mostly it will create issues with hadoop-3.3.x line due to thirdparty libs and stuff

How to use SKIP_SCHEMA_INIT=TRUE from command line

Hi All, If my metastore schema already exists with correct version so what I need to do so it doesn't do init or upgrade when starting metastore container I have tried following command line On MAC environment variables export HIVE_VERSION=3.1.3 and even SKIP_SCHEMA_INIT=TRUE docker run -it

Re: Hive 3.1.3 Hadoop Compatability

Hi Ayush Many thanks for your response. I’d really appreciate a clarification if that’s OK? Does this just mean that the Hadoop 3.1.0 libraries need to be deployed with Hive, or does it also mean the Hadoop cluster itself cannot be on a version later than 3.1.0 (if using Hive 3.1.3). For

Re: Hive 3.1.3 Hadoop Compatability

Hi Austin, Hive 3.1.3 & 4.0.0-alpha-1 works with Hadoop-3.1.0 HIve 4.0.0-alpha-2 & 4.0.0-beta-1 works with Hadoop-3.3.1 The upcoming Hive 4.0 GA release would be compatible with Hadoop-3.3.6 -Ayush On Thu, 21 Dec 2023 at 17:39, Austin Hackett wrote: > > Hi List > > I was hoping that someone

Hive 3.1.3 Hadoop Compatability

Hi List I was hoping that someone might be able to clarify which Hadoop versions Hive 3.1.3 is compatible with? https://hive.apache.org/general/downloads/ says that Hive release 3.1.3 works with Hadoop 3.x.y which is straightforward enough. However, I notice the 4.0.0 releases only work with

Re: Help with Docker Apache/Hive metastore using mysql remote database

Hi, You can download it from here: https://repo1.maven.org/maven2/mysql/mysql-connector-java/8.0.29/mysql-connector-java-8.0.29.jar Regards, Akshat On Thu, Dec 21, 2023 at 1:40 AM Sanjay Gupta wrote: > There is no mysql driver file in following repo > https://repo1.maven.org/maven2/org > > On

Re: Help with Docker Apache/Hive metastore using mysql remote database

There is no mysql driver file in following repo https://repo1.maven.org/maven2/org On Mon, Dec 18, 2023 at 3:10 AM Simhadri G wrote: > > We can modify the Dockerfile to wget the necessary driver and copy it to > /opt/hive/lib/ . This should make it work. The diff is attached below: > > > diff

when enable reducededuplication, count(distinct)+group by very slow

Hi team. I found that when I enable reduceduplication, count(distinct)+GroupBy becomes very slow. Is there a problem with reduceduplication? test query info: | CONFIG | SQL | TIME | | hive.optimize.reducededuplication=true | select count(1) from(select uni_shop_id,partner,count(distinct

Re: Help with Docker Apache/Hive metastore using mysql remote database

We can modify the Dockerfile to wget the necessary driver and copy it to /opt/hive/lib/ . This should make it work. The diff is attached below: diff --git a/packaging/src/docker/Dockerfile b/packaging/src/docker/Dockerfile --- a/packaging/src/docker/Dockerfile (revision

Re: Help with Docker Apache/Hive metastore using mysql remote database

I think the similar problem is being chased as part of https://github.com/apache/hive/pull/4948 On Mon, 18 Dec 2023 at 09:48, Sanjay Gupta wrote: > > > > > Issue with Docker container using mysql RDBMS ( Failed to load driver) > > https://hub.docker.com/r/apache/hive > > According to readme > >

Fwd: Help with Docker Apache/Hive metastore using mysql remote database

Issue with Docker container using mysql RDBMS ( Failed to load driver) https://hub.docker.com/r/apache/hive According to readme Launch Standalone Metastore With External RDBMS (Postgres/Oracle/MySql/MsSql) I want to use MySQL I tried com.mysql.jdbc.Driver or com.mysql.cj.jdbc.Driver docker

Re: MR3 1.8 released

For Chinese users, MR3 1.8 is now shipped in HiDataPlus (along with Celeborn). https://mp.weixin.qq.com/s/65bgrnFpXtORlb4FjlPMWA --- Sungwoo On Sat, Dec 9, 2023 at 9:08 PM Sungwoo Park wrote: > MR3 1.8 released > > On behalf of the MR3 team, I am pleased to announce the release of MR3 1.8. >

MR3 1.8 released

MR3 1.8 released On behalf of the MR3 team, I am pleased to announce the release of MR3 1.8. MR3 is an execution engine similar in spirit to MapReduce and Tez which has been under development since 2015. Its main application is Hive on MR3. You can run Hive on MR3 on Hadoop, on Kubernetes, in

A deadLock problem

Hi Team. [HIVE-27944] When HIVE-LLAP reads the ICEBERG table, a deadlock may occur. - ASF JIRA (apache.org) I submitted this ISSUE, if anyone can help me I would appreciate it. Tks.

Re:Re: hive can not read iceberg-parquet table

Hi. Following your suggestion, I created three ISSUE: [HIVE-27901] Hive's performance for querying the Iceberg table is very poor. - ASF JIRA (apache.org) [HIVE-27900] hive can not read iceberg-parquet table - ASF JIRA (apache.org) [HIVE-27898] HIVE4 can't use ICEBERG table in subqueries - ASF

Re:Re: hive can not read iceberg-parquet table

Sorry, I don't have an account with jira at the moment. I was rejected by the administrator when I applied for an account earlier. He thought that such issues could be discussed in an email. I'll try to apply for an account again.

  1   2   3   4   5   6   7   8   9   10   >