Hi Clinton,
I'd like you to start a new thread about the problem with MV. It is
far from the original syntax problem, and MV is a fairly advanced
feature. A new thread with a proper title would attract more
appropriate people.
You can also present the minimal SQLs that reproduce the problem on
th
hello Okumin.
After porting the patch HIVE-28428, I observed that the slow query problem
disappeared.Currently the query efficiency for orc+zstd table is basically the
same as orc+snappy.
Therefore I strongly recommend addingHIVE-28428to version 4.0.1.
Regards,
lisoda
At 2024-09-02 23:28
Thanks Lisoda for those insights.
@Okumin , this is what I observed when checking the log files.
Attached is a log file and the hive-site.xml file configuration.
I have observed this error comes when the execution engine is set to Tez ,
the moment i switch to MR the issue does not come up.
This
Hi Clinton,
Thanks for sharing your problem. If you provide more information, such
as a dataset or queries, we can reproduce it and file the problem.
Hi Lisoda,
Thanks for giving us real examples. Interesting. Can I understand the
first problem that happens when there is a big data file in an Ic
Hello Lisoda,
Thanks for this information.
On Sun, Sep 1, 2024 at 4:04 PM lisoda wrote:
> Hello Clinton:
>
> We have actually encountered the same issue where, in many cases, querying
> Iceberg does not meet expected efficiency, falling short of regular
> ORC/Parquet tables in speed. Since the
Thanks Okumin.
I am new to Hive and Tez and I have struggled to deploy a high-performance
Dockerized Hive setup. I followed the documentation for setting up a remote
Metastore. I have a single node with 32 GB of RAM and 8 cores, but I have a
dataset of about 2 GB (Iceberg table partitioned on on
Hi Clinton,
I tested MERGE INTO with minimal reproduction. I saw the same error.
```
CREATE TABLE src (col1 INT, col2 INT);
CREATE TABLE dst (id BIGINT DEFAULT SURROGATE_KEY(), col1 INT, col2
INT, PRIMARY KEY (id) DISABLE NOVALIDATE) STORED BY ICEBERG;
MERGE INTO dst d USING src s ON s.col1 = d.
Hi all,
We have written a blog article that compares Hive 4 on MR3 and Trino 453
(the latest release of Trino) using the 10TB TPC-DS benchmark. While it
does not evaluate vanilla Hive, the results might be useful to those
interested in the overall speed of Hive 4 in LLAP mode.
https://www.datamon
Congratulations, Sungwoo. I look forward to trying out Hive 4.0.0 on
MR3 when my time allows.
David
On Tue, Jul 30, 2024 at 11:29:02PM +0900, Sungwoo Park wrote:
> Hi all,
>
> We would like to announce the release of Hive 4.0.0 on MR3. It is based on
> Hive 4.0.0 (together with 17 commits from
Error message, as per log form hive server docker container
I am not sure how this is showing, “hive.jdbc.client.authentication”, I do not
have this in hive-site.xml.
2024-07-15T23:14:49,022 ERROR [HiveServer2-Handler-Pool: Thread-78]
thrift.ThriftCLIService: Login attempt failed for user : <
see `HadoopInputFile` as an example
Hi lisoda,
We keep hive-iceberg catalog and handler modules inside of Hive itself +
provide a possibility to patch iceberg native core and api modules.
If you'd like to continue using iceberg-hadoop-catalog, you could try to move
relevant classes into iceberg/patched-iceberg-core.
Regards,
Den
Thank you for your reply.Thank you for letting me know about this.
At 2024-07-10 16:16:16, "Ayush Saxena" wrote:
>I know about that, I only flagged that [1] :-)
>
>That got sorted by upgrading the protobuf to 3.23, [2], & merging [3]
>
>Hadoop can't even compile JDK-8+, there are bunch
I know about that, I only flagged that [1] :-)
That got sorted by upgrading the protobuf to 3.23, [2], & merging [3]
Hadoop can't even compile JDK-8+, there are bunch of issue, Jersey
being the biggest one, All the JDK upgrade tickets are open
https://issues.apache.org/jira/browse/HADOOP-16795
ht
We are working towards supporting JDK-17, should take couple of months, we
don’t have a planned deadline for that as of now
Btw. hadoop didn’t drop support for JDK-8….
-Ayush
> On 10 Jul 2024, at 12:52 PM, lisoda wrote:
>
>
> Hi. Currently, Iceberg/hadoop/spark and the rest of the third-par
Hi,
I'm posting some more suggestions.
# We may label HIVE-28352 as "hive-4.0.1-must"
I found that users were unable to upgrade some system tables from Hive
3 through schematool. It would be better to fix.
https://issues.apache.org/jira/browse/HIVE-28352
# We may drop HIVE-24167
I am the ticket
Hi Zhihua,
Thanks for driving the next release. We are actively testing 4.0.0 and
would like to give some suggestions.
# HIVE-27847: Prevent query Failures on Numeric <-> Timestamp
We hit the issue when we ran Hive 4 with the option. I believe it is
worth resolving for those who want to try Hive
ally appreciate it, it means a lot to me :)
>>>>>>> The Apache Hive project and its community have truly inspired me .
>>>>>>> I'm grateful for the chance to contribute to such a remarkable project.
>>>>>>>
>>>>&g
remarkable project.
>>>>>>
>>>>>> Thanks!
>>>>>> Simhadri Govindappa
>>>>>>
>>>>>> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
>>>>>> wrote:
>>>>>>
>>
27;m
>>>>> grateful for the chance to contribute to such a remarkable project.
>>>>>
>>>>> Thanks!
>>>>> Simhadri Govindappa
>>>>>
>>>>> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
>>>
ppa
>>>>
>>>> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
>>>> wrote:
>>>>
>>>>> Congrats Simhadri!
>>>>>
>>>>>
>>>>>
>>>>> -Sankar
>>>>>
>>>>>
oject.
>>>
>>> Thanks!
>>> Simhadri Govindappa
>>>
>>> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
>>> wrote:
>>>
>>>> Congrats Simhadri!
>>>>
>>>>
>>>>
>>>> -Sanka
t;>
>>> Congrats Simhadri!
>>>
>>>
>>>
>>> -Sankar
>>>
>>>
>>>
>>> *From:* Butao Zhang
>>> *Sent:* Thursday, April 18, 2024 5:39 PM
>>> *To:* user@hive.apache.org; dev
>>&
such a remarkable project.
>
> Thanks!
> Simhadri Govindappa
>
> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
> wrote:
>
>> Congrats Simhadri!
>>
>>
>>
>> -Sankar
>>
>>
>>
>> *From:* Butao Zhang
>> *Sent:* Thursday,
Congratulations Simhadri!
Regards,
Krisztian
On Thu, Apr 18, 2024 at 3:25 PM kokila narayanan <
kokilanarayana...@gmail.com> wrote:
> Congratulations Simhadri 🎉
>
> On Thu, 18 Apr, 2024, 17:22 Ayush Saxena, wrote:
>
>> Hi All,
>> Apache Hive's Project Management Committee (PMC) has invited Simh
wrote:
> Congrats Simhadri!
>
>
>
> -Sankar
>
>
>
> *From:* Butao Zhang
> *Sent:* Thursday, April 18, 2024 5:39 PM
> *To:* user@hive.apache.org; dev
> *Subject:* [EXTERNAL] Re: [ANNOUNCE] New Committer: Simhadri Govindappa
>
>
>
> You don't o
Congrats Simhadri!
-Sankar
From: Butao Zhang
Sent: Thursday, April 18, 2024 5:39 PM
To: user@hive.apache.org; dev
Subject: [EXTERNAL] Re: [ANNOUNCE] New Committer: Simhadri Govindappa
You don't often get email from butaozha...@163.com<mailto:butaozha...@163.com>.
Learn why this i
Congratulations Simhadri !!!
Thanks.
发件人: user-return-28075-butaozhang1=163@hive.apache.org 代表 Ayush Saxena 发送时间: 星期四, 四月 18, 2024 7:50 下午收件人: dev ; user@hive.apache.org 主题: [ANNOUNCE] New Committer: Simhadri Govindappa Hi All,Apache Hive's Project Management Commit
Congratulations and huge thanks to Apache Hive team and contributors for
releasing Hive 4. We have been watching the development of Hive 4 since the
release of Hive 3.1, and it's truly satisfying to witness the resolution of
all the critical issues at last after 5 years. Hive 4 comes with a lot of
I'm really excited to see the news! I can easily imagine the
difficulty of testing and shipping Hive 4.0.0 with more than 5k
commits. I'm proud to have witnessed this moment here.
Thank you!
On Wed, Apr 3, 2024 at 3:07 AM Naveen Gangam wrote:
>
> Thank you for the tremendous amount of work put i
Thank you for the tremendous amount of work put in by many many folks to
make this release happen, including projects hive is dependent upon like
tez.
Thank you to all the PMC members, committers and contributors for all the
work over the past 5+ years in shaping this release.
THANK YOU!!!
On Su
Absolutely exciting news! Congrats to the entire Hive community for making this
release happen!
-Sankar
From: Pau Tallada
Sent: Tuesday, April 2, 2024 2:31 PM
To: user@hive.apache.org
Cc: d...@hive.apache.org
Subject: [EXTERNAL] Re: [ANNOUNCE] Apache Hive 4.0.0 Released
You don't ofte
ork!
>
>
> Thanks,
> Butao Zhang
>
>
> Replied Message
> From Stamatis Zampetakis
> Date 4/2/2024 16:39
> To
> Cc user@hive.apache.org
> Subject Re: [ANNOUNCE] Apache Hive 4.0.0 Released
> The new Apache Hive 4.0.0 release brings roughly 5K new commi
user@hive.apache.org |
| Subject | Re: [ANNOUNCE] Apache Hive 4.0.0 Released |
The new Apache Hive 4.0.0 release brings roughly 5K new commits (since
Apache Hive 3.1.3) and it's probably the biggest release so far in the
history of the project. The numbers clearly show that this is a
collective effort tha
The new Apache Hive 4.0.0 release brings roughly 5K new commits (since
Apache Hive 3.1.3) and it's probably the biggest release so far in the
history of the project. The numbers clearly show that this is a
collective effort that wouldn't be possible without a strong community
and many volunteers al
Thank you for your hard work and dedication in releasing Apache Hive version
4.0.0.
Congratulations to the entire team on this achievement. Keep up the great work!
Does this consider as GA.?
And Looks we need to update in the following location also.?
https://hive.apache.org/general/downloads/
I should have mentioned earlier, but we encountered our problem with
queries between Trino and Hive3 MetaStore.
The tests I reported were also querying Hive1/3 MetaStore using Trino. The
problem might only exist between Trino and Hive3 MetaStore.
- Takanobu
2024年3月1日(金) 14:53 Takanobu Asanuma :
Yes, for now, we believe that HIVE-14187 has caused performance degradation
in Hive3 MetaStore.
We also use HiveServer2, but our HiveServer2 directly accesses the backend
DB without going through the Hive MetaStore, because it enhances
performance to directly access the DB in a heavily loaded clus
Thank you for sharing the result. (Does your result imply that HIVE-14187
is introducing an intended bug?)
Another issue that could be of your interest is the connection leak problem
reported in HIVE-20600. Do you see the connection leak problem, or is it
not relevant to your environment (e.g., be
Hi Pau and Sungwoo,
Thanks for sharing the information.
We tested a set of simple queries which just referenced the Hive table and
didn't execute any Hive jobs. The result is below.
No. Version rawstore.impl connectionPoolingType HIVE-14187 QueryTime
-
We didn't make any other attempt to fix the problem and just decided not to
use CachedStore. However, I think our installation of Metastore based on
Hive 3.1.3 is running without any serious problems.
Could you share how long it takes to compile typical queries in your
environment (with Hive 1 and
Hi,
We also had to disable CachedStore as it was producing wrong results in our
queries.
I'm sorry I cannot provide more detailed info.
Cheers,
Pau.
Missatge de Takanobu Asanuma del dia dc., 28 de febr.
2024 a les 13:59:
> Thanks for your detailed answer!
>
> In the original email, you report
Thanks for your detailed answer!
In the original email, you reported "the query compilation takes long" in
Hive 3.0, but has this issue been resolved in your fork of Hive 3.1.3?
Thank you for sharing the issue with CachedStore and the JIRA tickets.
I will also try out metastore.stats.fetch.bitvect
Hello Takanobu,
We did not test with vanilla Hive 3.1.3 and Metastore databases can be
different, so I don't know why Metastore responses are very slow. I can
only share some results of testing CachedStore in Metastore. Please note
that we did not use vanilla Hive 3.1.3 and instead used our own fo
Hi Sungwoo Park,
I'm sorry for the late reply to this old email.
We are attempting to upgrade Hive MetaStore from Hive1 to Hive3, and
noticed that the response of the Hive3 MetaStore is very slow.
We suspect that HIVE-14187 might be causing this slowness.
Could you tell me if you have resolved thi
Hi ,
No HIVE-21075 was not planned as of now in the 3.2.0 release. But will check
the feasibility and implications of the same and add it to the parent JIRA.
Its difficult to quote an exact date for the release since we are working on
backporting some important tickets (linked to parent JIRA) b
re-try your use-case with the latest Apache Hive 4.0.0-beta-1
release [1] and report back if you still observe unexpected behavior.
Best,
Stamatis
[1] https://hive.apache.org/general/downloads/
On Mon, Jan 29, 2024 at 5:52 AM chang.wd wrote:
>
> Dear Hive Support Team,
>
> I hope y
nevermind, I have to set these properties on hive metastore to resolve
issue.I was setting these in HIveServer2
On Wed, Jan 17, 2024 at 11:38 PM Sanjay Gupta wrote:
>
> Hi,
> I get exactly same issue as described here in Docker container which
> is running Hive Metastore and HS2.
>
> Using Hive v
Hi Henri,
I gave you the necessary permissions to the wiki. Please check and if
you encounter any issues let us know.
Best,
Stamatus
On Fri, Jan 12, 2024 at 10:56 AM Henri Biestro wrote:
>
>
> My Apache Id is hen...@apache.org.
> Cheers
>
> On 2024/01/12 09:52:20 Henri Biestro wrote:
> > Hello;
My Apache Id is hen...@apache.org.
Cheers
On 2024/01/12 09:52:20 Henri Biestro wrote:
> Hello;
> I'd like to contribute some documentation on Hive 4 - (
> https://issues.apache.org/jira/browse/HIVE-27186 for instance)
> May I get write access to the Wiki ( ie
> https://cwiki.apache.org/confluen
For the benefit of anyone who comes across this error in future, it was solved
by adding hive.metastore.sasl.enabled and hive.metastore.kerberos.principal to
hive-site.xml on the client side, e.g. $SPARK_HOME/conf
> On 8 Jan 2024, at 16:18, Austin Hackett wrote:
>
> Hi List
>
> I'm having a
Thanks Attila & Ayush,
I don't have permission to open Jira ticket yet but I have initiated process.
I have tried with Tez 9.1 and also version 10.2 and same issue.
I have noticed that when I change default hive.execution.engine=mr in
hive-site.xml ( restart hive service ) and after that start hiv
Agree with Ayush.
Back to the original issue, is it not related to the latest Tez fix? As I
remember there was an incompatibility issue, which the next tez release
will fix. Maybe this is related to that. Sanjay could you please create a
JIRA around it for the tracking, and the community or someon
Hi,
I am not sure if the official built docker contains TEZ, but if you try to
build it by yourself, you can have a look at here:
https://github.com/apache/hive/blob/master/packaging/src/docker/Dockerfile#L41
To use TEZ you need to place it inside the docker container and configure
it:
Download f
Hive on MR3 isn’t an official Apache Hive thing, not even an Apache OS thing, so, it is a vendor product just being tried to advertised in the ‘Apache’ Hive spaceSo, it can be all mess, filled with security issues or bugs & we Apache Hive for the record aren’t responsible for that neither do we end
As far as I know, Hive-Tez supports local mode, but does not standalone
mode (like Spark). Hive-MR3 supports standalone mode, so you can run it in
any type of cluster.
--- Sungwoo
On Wed, Jan 10, 2024 at 4:22 PM Sanjay Gupta wrote:
> I can run hive with mr engine in local mode. Does Hive + Tez
I can run hive with mr engine in local mode. Does Hive + Tez also
works in standalone mode ?
On Tue, Jan 9, 2024 at 11:08 PM Sungwoo Park wrote:
>
> Hello,
>
> I don't have an answer to your problem, but if your goal is to quickly test
> Hive 3 using Docker, there is an alternative way which use
Hello,
I don't have an answer to your problem, but if your goal is to quickly test
Hive 3 using Docker, there is an alternative way which uses Hive on MR3.
https://mr3docs.datamonad.com/docs/quick/docker/
You can also run Hive on MR3 on Kubernetes.
Thanks,
--- Sungwoo
On Wed, Jan 10, 2024 a
t; | From | Attila Turoczy |
>> | Date | 1/2/2024 00:06 |
>> | To | |
>> | Cc | |
>> | Subject | Re: [DISCUSS] Tez 0.10.3 Release Planning |
>> +1 (non-binding)
>> Thank you for the effort and happy new year!
>> -Attila
>>
>> On Mon, 1 Jan 202
is context, not a bug.)
Butao Zhang ezt írta (időpont: 2024. jan. 2., K,
7:13):
> +1 (non-binding) Thanks Laszlo !
> Replied Message
> | From | Attila Turoczy |
> | Date | 1/2/2024 00:06 |
> | To | |
> | Cc | |
> | Subject | Re: [DISCUSS] Tez 0.10.3 Releas
+1 (non-binding) Thanks Laszlo !
Replied Message
| From | Attila Turoczy |
| Date | 1/2/2024 00:06 |
| To | |
| Cc | |
| Subject | Re: [DISCUSS] Tez 0.10.3 Release Planning |
+1 (non-binding)
Thank you for the effort and happy new year!
-Attila
On Mon, 1 Jan 2024 at 14:22, Ayush
+1 (non-binding)
Thank you for the effort and happy new year!
-Attila
On Mon, 1 Jan 2024 at 14:22, Ayush Saxena wrote:
> +1 (non-binding),
> Thanx Laszlo for starting the thread.
>
> -Ayush
>
> On Mon, 1 Jan 2024 at 18:30, László Bodor
> wrote:
> >
> > Hi Everyone!
> >
> > Happy New Year!
> >
+1 (non-binding),
Thanx Laszlo for starting the thread.
-Ayush
On Mon, 1 Jan 2024 at 18:30, László Bodor wrote:
>
> Hi Everyone!
>
> Happy New Year!
>
> I think it's time to create a new Tez release.
> It's not a secret: Hive 4.0 GA would benefit from the latest bug fixes since
> 0.10.2, which
BigTop supports a specific version stack with some patches in place. It
should be helpful for you.
- Currently, the master branch consists of Hadoop-3.3.6, Hive-3.1.3,
Tez-0.10.2.
- https://github.com/apache/bigtop/blob/master/bigtop.bom
- Hive patches:
https://github.com/apache/bigtop/tree/ma
🎉🚀
Replied Message
| From | Sungwoo Park |
| Date | 12/24/2023 00:06 |
| To | user@hive.apache.org |
| Cc | |
| Subject | Blog article 'Performance Tuning for Single-table Queries' |
Hello Hive users,
I have published a new blog article 'Performance Tuning for Single-table
Queries'.
Thanks, it solves issue. Much appreciated.
Thanks
Sanjay Gupta
From: Akshat m
Sent: Friday, December 22, 2023 5:55:38 AM
To: user@hive.apache.org
Subject: Re: How to use SKIP_SCHEMA_INIT=TRUE from command line
Hi Sanjay,
Instead of using --env
Many thanks for clarifying Ayush - much appreciated
> On 22 Dec 2023, at 08:41, Ayush Saxena wrote:
>
> Ideally the hadoop should be on 3.1.0 only, that is what we support,
> rest if there are no incompatibilities it might or might not work with
> higher versions of hadoop, we at "hive" don't
Hi Sanjay,
Instead of using --env SKIP_SCHEMA_INIT=TRUE,
Please use --env IS_RESUME="true" while running,
docker run -it -d -p 9083:9083 --env SERVICE_NAME=metastore
--add-host=host.docker.internal:host-gateway \
--env IS_RESUME="true" \
--env DB_DRIVER=mysql \
--env
SERVICE_OPTS
Ideally the hadoop should be on 3.1.0 only, that is what we support,
rest if there are no incompatibilities it might or might not work with
higher versions of hadoop, we at "hive" don't claim that it can work,
mostly it will create issues with hadoop-3.3.x line due to thirdparty
libs and stuff like
Hi Ayush
Many thanks for your response.
I’d really appreciate a clarification if that’s OK?
Does this just mean that the Hadoop 3.1.0 libraries need to be deployed with
Hive, or does it also mean the Hadoop cluster itself cannot be on a version
later than 3.1.0 (if using Hive 3.1.3).
For exam
Hi Austin,
Hive 3.1.3 & 4.0.0-alpha-1 works with Hadoop-3.1.0
HIve 4.0.0-alpha-2 & 4.0.0-beta-1 works with Hadoop-3.3.1
The upcoming Hive 4.0 GA release would be compatible with Hadoop-3.3.6
-Ayush
On Thu, 21 Dec 2023 at 17:39, Austin Hackett wrote:
>
> Hi List
>
> I was hoping that someone mi
Hi,
You can download it from here:
https://repo1.maven.org/maven2/mysql/mysql-connector-java/8.0.29/mysql-connector-java-8.0.29.jar
Regards,
Akshat
On Thu, Dec 21, 2023 at 1:40 AM Sanjay Gupta wrote:
> There is no mysql driver file in following repo
> https://repo1.maven.org/maven2/org
>
> On
There is no mysql driver file in following repo
https://repo1.maven.org/maven2/org
On Mon, Dec 18, 2023 at 3:10 AM Simhadri G wrote:
>
> We can modify the Dockerfile to wget the necessary driver and copy it to
> /opt/hive/lib/ . This should make it work. The diff is attached below:
>
>
> diff -
We can modify the Dockerfile to wget the necessary driver and copy it to
/opt/hive/lib/ . This should make it work. The diff is attached below:
diff --git a/packaging/src/docker/Dockerfile
b/packaging/src/docker/Dockerfile
--- a/packaging/src/docker/Dockerfile (revision
dceaf810b32fc266e3e657fda
I think the similar problem is being chased as part of
https://github.com/apache/hive/pull/4948
On Mon, 18 Dec 2023 at 09:48, Sanjay Gupta wrote:
>
>
>
>
> Issue with Docker container using mysql RDBMS ( Failed to load driver)
>
> https://hub.docker.com/r/apache/hive
>
> According to readme
>
> L
For Chinese users, MR3 1.8 is now shipped in HiDataPlus (along with
Celeborn).
https://mp.weixin.qq.com/s/65bgrnFpXtORlb4FjlPMWA
--- Sungwoo
On Sat, Dec 9, 2023 at 9:08 PM Sungwoo Park wrote:
> MR3 1.8 released
>
> On behalf of the MR3 team, I am pleased to announce the release of MR3 1.8.
>
>
Hi lisoda,
Thank you for trying the Hive4-beta and reporting this issue. Based
on the current information you provided, i can not reproduce this issue. Could
you please give more clues? e.g.
1) Which Tez version are you using? Hive4-beta uses Tez 0.10.2 by
default.
Congratulations Butao Zhang, Very well deserved. Your contributions to the
Data connector feature are very impressive and much appreciated. Looking
forward to much more!!
Thanks,
Sai.
On Tue, Nov 21, 2023 at 1:06 PM Stamatis Zampetakis
wrote:
> Congratulations Butao, well deserved! Very glad to
Congratulations Butao, well deserved! Very glad to see another Iceberg
expert joining the team.
Best,
Stamatis
On Tue, Nov 21, 2023, 4:47 PM Butao Zhang wrote:
> Thank you to the Hive community for this honor. I will continue to
> contribute to the community with my efforts.
> Thanks all!
>
>
Thank you to the Hive community for this honor. I will continue to contribute
to the community with my efforts.
Thanks all!
Thanks,
Butao Zhang
Replied Message
| From | Ayush Saxena |
| Date | 11/21/2023 15:02 |
| To | dev ,
,
Butao Zhang |
| Subject | [ANNOUNCE] New committer: Butao
Hi Eugene,
Hive has a feature called automatic query rewrite [1]. This feature needs
up-to-date information about the materialized views available. [2]
The feature can be disable by the
setting: hive.materializedview.rewriting [3]
Hope this helps.
regards,
Krisztian
[1]
https://cwiki.apache.org
Sorry, I'm not sure of the final released time, but I think it will be soon. :)
Maybe some other folks of Hive community know more about the GA release.
Thanks,
Butao Zhang
Replied Message
| From | lisoda |
| Date | 11/17/2023 12:31 |
| To | user |
| Subject | Re: [EXTERNA
Hi, maybe you can check this ticket
https://issues.apache.org/jira/browse/HIVE-26227
Thanks,
Butao Zhang
Replied Message
| From | Flavio Junqueira |
| Date | 11/15/2023 17:26 |
| To | |
| Subject | Question on Hive Metastore catalog support |
Hello there,
I'm interested in underst
May I ask when hive4 can be released?
Replied Message
| From | Butao Zhang |
| Date | 11/17/2023 12:24 |
| To | user@hive.apache.org |
| Cc | |
| Subject | Re: [EXTERNAL] Re: Slow Hive query with a lot of
'get_materialized_views_for_rewriting' |
Thanks for the info.
Iceberg integration, enhanced materialized view, etc.
Thanks,
Butao Zhang
Replied Message
| From | Eugene Miretsky |
| Date | 11/17/2023 09:06 |
| To | |
| Subject | Re: [EXTERNAL] Re: Slow Hive query with a lot of
'get_materialized_views_for_rewriting' |
Hey!
Hive versio
Hey!
Hive version is 3.1.3
On Wed, Nov 15, 2023 at 9:23 PM Butao Zhang wrote:
> Hi, which version of hms are you using now? I have checked the master
> branch and beta-1 branch source code, but I can't find the place where
> this method *get_materialized_views_for_rewriting* is called by mist
Hi, which version of hms are you using now? I have checked the master branch
and beta-1 branch source code, but I can't find the place where this method
get_materialized_views_for_rewriting is called by mistake.
Thanks,
Butao Zhang
Replied Message
| From | Eugene Miretsky |
| Dat
Please ensure hive.stats.autogather is enabled as well.
On Fri, Nov 10, 2023, 2:57 PM Denys Kuzmenko wrote:
> `hive.iceberg.stats.source` controls where the stats should be sourced
> from. When it's set to iceberg (default), we should go directly to iceberg
> and bypass HMS.
>
`hive.iceberg.stats.source` controls where the stats should be sourced from.
When it's set to iceberg (default), we should go directly to iceberg and bypass
HMS.
this location_based_table table in hive. Does it also launch the tez
task to scan table?
Thanks,
Butao Zhang
Replied Message
| From | lisoda |
| Date | 11/9/2023 15:50 |
| To | |
| Subject | Re:Re: Re: Hive's performance for querying the Iceberg table is
very poor. |
STEP1:
CREATE TABLE US
3-11-09 15:36:50，"Butao Zhang" 写道：
Could you please provide detailed steps to reproduce this issue? e.g. how do
you create the table?
Thanks,
Butao Zhang
Replied Message
| From | lisoda |
| Date | 11/9/2023 14:25 |
| To | |
| Subject | Re:Re: Re: Hive's performance for
Could you please provide detailed steps to reproduce this issue? e.g. how do
you create the table?
Thanks,
Butao Zhang
Replied Message
| From | lisoda |
| Date | 11/9/2023 14:25 |
| To | |
| Subject | Re:Re: Re: Hive's performance for querying the Iceberg table is
very
x27;t take effect if having delete
files.
Thanks,
Butao Zhang
Replied Message
| From | lisoda |
| Date | 11/9/2023 10:43 |
| To | |
| Subject | Re:Re: Re: Hive's performance for querying the Iceberg table is
very poor. |
HI.
I am testing with HIVE-4.0.0-BETA
10:43 |
| To | |
| Subject | Re:Re: Re: Hive's performance for querying the Iceberg table is
very poor. |
HI.
I am testing with HIVE-4.0.0-BETA-1 version and I am using location_based_table.
So far I found that HIVE still can't push some queries down to METADATA, e.g.
COUNT(*).
Is HI
g to use starrocks.
mpp architecture databases have natural limitations, and starrocks does not
necessarily perform better than hive llap.
Replied Message
| From | Albert Wong |
| Date | 10/24/2023 01:39 |
| To | user@hive.apache.org |
| Cc | |
| Subject | Re: Hive's performance
Celeborn and Uniffle can also be seen as a move to separate local storage
from compute nodes.
1. In the old days, Hadoop was based on the idea of collocating compute and
storage.
2. Later a new paradigm of separating compute and storage emerged and got
popularized.
3. Now people want to not just s
I think both Celeborn and Uniffle are good alternatives as a general shuffle
service.
I recommend that you try them : ). For any question about Celeborn, we're very
glad
to discuss in Celeborn's mail lists[1][2] or slack[3].
[1] u...@celeborn.apache.org
[2] d...@celeborn.apache.org
[3]
https://
On Thu, Nov 2, 2023 at 1:43 PM Sungwoo Park wrote:
> Have you done comparison between uniffle and celeborn..?
>>
>
> We did not compare the performance of Uniffle and Celeborn (because
> Hive-MR3-Celeborn has been released but Hive-MR3-Uniffle is not complete
> yet). Much of the code in Hive-MR3-
>
> Have you done comparison between uniffle and celeborn..?
>
We did not compare the performance of Uniffle and Celeborn (because
Hive-MR3-Celeborn has been released but Hive-MR3-Uniffle is not complete
yet). Much of the code in Hive-MR3-Celeborn is currently reused in
Hive-MR3-Uniffle, so we thi
Thanks for bringing up this. Good to see that it supports spark and flink.
Have you done comparison between uniffle and celeborn..?
On 30/10/23, 8:01 AM, "Keyong Zhou" mailto:zho...@apache.org>> wrote:
Great to hear this! It's encouraging that Celeborn helps MR3.
Celeborn is a general purpo
1 - 100 of 1689 matches
Mail list logo
