Re: [DISCUSS] Nightly snaphot builds

2023-05-26 Thread Zoltan Haindrich
On 5/25/23 19:58, vihang karajgaonkar wrote: I just tried the job and it worked as expected. Thanks! If I understand correctly, the job retains builds for 180 days. Does it mean if there were no commits to a branch for more than 180 days, we will lose the build artifacts eventually? not

Re: [DISCUSS] Nightly snaphot builds

2023-05-25 Thread vihang karajgaonkar
I just tried the job and it worked as expected. Thanks! If I understand correctly, the job retains builds for 180 days. Does it mean if there were no commits to a branch for more than 180 days, we will lose the build artifacts eventually? On Thu, May 25, 2023 at 1:50 AM Zoltan Haindrich wrote:

Question on hive.merge.nway.joins,

2023-05-25 Thread Sungwoo Park
Hello, In HIVE-21189 [1], the default value for hive.merge.nway.joins is set to false. There is no record of why it was set to false, and I would like to understand the background for the decision. Specifically I wonder if the following situation is relevant to the decision. Example) MapJoinOp_1

Re: [DISCUSS] Nightly snaphot builds

2023-05-25 Thread Zoltan Haindrich
Hey Vihang, I've added you as an admin; and I've copied the job as http://ci.hive.apache.org/job/hive-nightly-branch-3/ other option could be to trigger the original job or use parameterized-scheduler but that would configure a real unconditional nightly build - which will just build the same

Re: [DISCUSS] Nightly snaphot builds

2023-05-24 Thread vihang karajgaonkar
I created https://issues.apache.org/jira/browse/HIVE-27371 to have nightly builds for branch-3. Once that is merged, I think we can have scheduled builds for branch-3 as well. Although, I don't have permissions to create a new job for branch-3. Does anyone know how to do it? Thanks, Vihang On

Re: [DISCUSS] Nightly snaphot builds

2023-05-24 Thread vihang karajgaonkar
The nightly job http://ci.hive.apache.org/job/hive-nightly/ is great. Can we have this for branch-3 as well since we have been backporting a lot of PRs to branch-3 lately. Thanks, Vihang On Wed, May 24, 2023 at 6:56 AM Zoltan Haindrich wrote: > Hey, > > > We already have nightly builds

Re: [DISCUSS] Nightly snaphot builds

2023-05-24 Thread Zoltan Haindrich
Hey, > We already have nightly builds for Hive [1]. > [1] http://ci.hive.apache.org/job/hive-nightly/ ...and hive-dev-box can launch such archives; either by using it like this: https://www.mail-archive.com/dev@hive.apache.org/msg142420.html or with a somewhat longer command you could launch

Re: Apache Hive on Twitter

2023-05-24 Thread Stamatis Zampetakis
Thanks for driving this Ayush! It's great to see Hive alive again on twitter. Best, Stamatis On Tue, May 23, 2023 at 3:58 AM Ayush Saxena wrote: > > Hi All, > I am happy to announce: We have got the Apache Hive Twitter account active > again or maybe in other words we have got creds to use it

Re: [DISCUSS] Nightly snaphot builds

2023-05-24 Thread Stamatis Zampetakis
Hey all, We already have nightly builds for Hive [1]. Do we need something more than that? Best, Stamatis [1] http://ci.hive.apache.org/job/hive-nightly/ On Tue, May 23, 2023 at 9:03 AM vihang karajgaonkar wrote: > > I think there are many benefits like others in this thread suggested which

Re: [DISCUSS] Nightly snaphot builds

2023-05-23 Thread vihang karajgaonkar
I think there are many benefits like others in this thread suggested which can be built on top of nightly builds. Having docker images is great but for now I think we can start simple and publish the jars. Many users still just deploy using jars and it would be useful to them. Once we have a

Re: [DISCUSS] Nightly snaphot builds

2023-05-23 Thread Sungwoo Park
I think such nightly builds will be useful for testing and debugging in the future. I also wonder if we can somehow create builds even from previous commits (e.g., for the past few years). Such builds from previous commits don't have to be daily builds, and I think weekly builds (or even monthly

Apache Hive on Twitter

2023-05-22 Thread Ayush Saxena
Hi All, I am happy to announce: We have got the Apache Hive Twitter account active again or maybe in other words we have got creds to use it now. The twitter account stays here: https://twitter.com/ApacheHive The account belongs to all of us at Hive. As we decided, if anyone wants to get

Re: [DISCUSS] Nightly snaphot builds

2023-05-22 Thread Ayush Saxena
Hi Vihang, +1, We were even exploring publishing the docker images of the snapshot version as well per commit or maybe weekly, so just shoot 2 docker commands and you get a Hive cluster running with master code. Sai, I think to spin up an env via Docker with all these things should be doable for

Re: [DISCUSS] Nightly snaphot builds

2023-05-22 Thread Sai Hemanth Gantasala
Hi Vihang, +1 on the idea. This is a great idea to quickly test if a certain feature is working as expected on a certain branch. This way we test data loss, correctness, or any other unexpected scenarios that are Hive specific only. However, I'm wondering if it is possible to deploy/test in a

[DISCUSS] Nightly snaphot builds

2023-05-22 Thread vihang karajgaonkar
Hello Team, I have observed that it is a common use-case where users would like to test out unreleased features/bug fixes either to unblock them or test out if the bug fixes really work as intended in their environments. Today in the case of Apache Hive, this is not very user friendly because it

Re: Request to join Hive slack channel

2023-05-19 Thread Ayush Saxena
Have added all the people who requested here + Attila Turoczy and Simhadri G (received offline requests). I hope everyone uses the medium of contact in the correct way and just for "Apache" Hive related stuff. I won't be personally following that channel much but in case someone needs help in

Re: Updating the Hive Committer Guide Wiki

2023-05-19 Thread Attila Turoczy
I prefer using a Slack / discord channel, which has become a common trend in the open source community. Unlike a formal and broadcasting communication like a mailing list, Slack/Discord/IRC allows for more peer-level interactions. While it's not mandatory to check another communication channel,

Re: Updating the Hive Committer Guide Wiki

2023-05-19 Thread Ayush Saxena
I won't even suggest people to get into any dev related discussions on slack, some casual stuff/conversations is ok, It was there in the doc around irc channel, I just updated it and didn't want to say no to anyone interested to join. The channel already had some ~140 people. I just added the

Re: Updating the Hive Committer Guide Wiki

2023-05-19 Thread Stamatis Zampetakis
Thanks for updating the wiki Ayush! Definitely very helpful and hopefully we can do it for other pages as well. Slack is a very useful tool but personally I don't have much time to monitor yet another channel of communication. I don't know if we should encourage people to start discussions there

Re: Request to join Hive slack channel

2023-05-19 Thread Butao Zhang
Thanks Ayush. The invitation is valid. I have joined the hive slack channel. Thanks, Butao Zhang Replied Message | From | Soumyakanti Das | | Date | 5/19/2023 14:43 | | To | | | Subject | Re: Request to join Hive slack channel | Hey Ayush, Please add me to the channel as well. My

Re: Request to join Hive slack channel

2023-05-19 Thread Soumyakanti Das
Hey Ayush, Please add me to the channel as well. My email is soumyakanti.das...@gmail.com Thanks! On Thu, May 18, 2023 at 23:34 Ayush Saxena wrote: > Sure Sungwoo, I will add you as well. > > Butao Zhang was added to the channel, I can see him in the list of > members and I received a

Re: Request to join Hive slack channel

2023-05-19 Thread Ayush Saxena
Sure Sungwoo, I will add you as well. Butao Zhang was added to the channel, I can see him in the list of members and I received a notification as well that his account has been approved by the infra team, I think I am not the only one to approve, it has to be approved by Infra as well. Let me

Re: Request to join Hive slack channel

2023-05-19 Thread Sungwoo Park
I am sorry for spamming -- My email address is: glap...@gmail.com Thanks, --- Sungwoo Park On Fri, May 19, 2023 at 3:11 PM Sungwoo Park wrote: > If non-committers can join the slack channel, I would like to join, too. > An invitation will be appreciated very much (glapa...@gmail.com). > >

Re: Request to join Hive slack channel

2023-05-19 Thread Ayush Saxena
Hi Butao, I have sent you an invite, please check, you must have received a mail. I have done it for the first time, so I might have messed it up. Lemme know if it works. For others the doc on how to add lies here: https://infra.apache.org/slack.html -Ayush On Fri, 19 May 2023 at 11:19, Butao

Re: Request to join Hive slack channel

2023-05-19 Thread Sungwoo Park
If non-committers can join the slack channel, I would like to join, too. An invitation will be appreciated very much (glapa...@gmail.com). Thanks, --- Sungwoo Park On Fri, May 19, 2023 at 2:49 PM Butao Zhang wrote: > Hi, Hive dev > > > I just saw this updated page: >

Request to join Hive slack channel

2023-05-18 Thread Butao Zhang
Hi, Hive dev I just saw this updated page: https://cwiki.apache.org/confluence/display/Hive/HowToCommit. It seems we individual can request to join the slack channel. If that is possible, I want to join the slack, please give me a invitation, Thanks. My Gmail address:

Updating the Hive Committer Guide Wiki

2023-05-18 Thread Ayush Saxena
Hi All, I recently observed that our Hive Committer guide is pretty outdated and has mentioned legacy ways of committing, but still has a lot of relevant information. After discussing with some friends offline, I have updated the doc. Feel free to share feedback or improvements. Committers to

Re: [DISCUSS] HIVE 4.0 GA Release Proposal

2023-05-16 Thread Stamatis Zampetakis
The umbrella ticket is HIVE-26654 [1]. I am currently looking into HIVE-26968 and probably gonna merge this in the following days. Help in reviewing or fixing the remaining tickets would be much appreciated. Best, Stamatis [1] https://issues.apache.org/jira/browse/HIVE-26654 On Tue, May 16,

Re: [DISCUSS] HIVE 4.0 GA Release Proposal

2023-05-16 Thread Attila Turoczy
+2. Who is working now on the TPCDS regression? Can I / We help him/ her? -Attila On Tue, May 16, 2023 at 11:04 AM Stamatis Zampetakis wrote: > I agree with Attila we should do our best to come out with the next GA > soon. In order to do that we should treat the TPCDS regressions that are >

Re: [DISCUSS] HIVE 4.0 GA Release Proposal

2023-05-16 Thread Stamatis Zampetakis
I agree with Attila we should do our best to come out with the next GA soon. In order to do that we should treat the TPCDS regressions that are already reported. It doesn't make much sense to give out a GA that cannot run the whole TPCDS suite without crashing or returning wrong results. If

Re: [DISCUSS] Disable JIRA worklog for GitHub PRs

2023-05-15 Thread Stamatis Zampetakis
Thanks everyone for the feedback! Merged under https://issues.apache.org/jira/browse/HIVE-27341 Best, Stamatis On Fri, May 12, 2023 at 9:43 PM Ayush Saxena wrote: > > +1 > > Thanx Stamatis, makes sense > > -Ayush > > > On 12-May-2023, at 10:14 PM, Attila Turoczy > > wrote: > > > > +1 > > >

Re: [DISCUSS] Disable JIRA worklog for GitHub PRs

2023-05-12 Thread Ayush Saxena
+1 Thanx Stamatis, makes sense -Ayush > On 12-May-2023, at 10:14 PM, Attila Turoczy > wrote: > > +1 > >> On Fri, May 12, 2023 at 4:01 PM Alessandro Solimando < >> alessandro.solima...@gmail.com> wrote: >> Hi Stamatis, >> I am experiencing the same too, so +1 from me. >> Best regards, >>

Re: Kill the Pig 

2023-05-12 Thread Guy Bayes
thank you Attila for all that you do On Fri, May 12, 2023 at 9:30 AM Attila Turoczy wrote: > This decision must be made based on consensus. As we can see, there is > still usage within the community. Despite the personal challenges it > presents to me, I believe we should all agree to maintain

Re: [DISCUSS] Disable JIRA worklog for GitHub PRs

2023-05-12 Thread Attila Turoczy
+1 On Fri, May 12, 2023 at 4:01 PM Alessandro Solimando < alessandro.solima...@gmail.com> wrote: > Hi Stamatis, > I am experiencing the same too, so +1 from me. > > Best regards, > Alessandro > > On Fri, 12 May 2023 at 15:58, Stamatis Zampetakis > wrote: > > > Hello, > > > > Everything that

Hive is on Dockerhub

2023-05-12 Thread Attila Turoczy
Dear All, I am thrilled to share some exciting news with you! The Hive project is now available on DockerHub - https://hub.docker.com/r/apache/hive, making it easier than ever to explore our latest and greatest features. By simply executing two commands,

Re: [DISCUSS] HIVE 4.0 GA Release Proposal

2023-05-12 Thread Attila Turoczy
Could we please give some attention to this topic? I strongly believe that we should put in every effort to release Hive 4. The Hive community needs to demonstrate that we are active and accomplishing exciting developments. It is quite disheartening to note that our last major GA release was a

Re: Kill the Pig 

2023-05-12 Thread Attila Turoczy
This decision must be made based on consensus. As we can see, there is still usage within the community. Despite the personal challenges it presents to me, I believe we should all agree to maintain support for Apache Pig, and unfortunately, there won't be any bacon soon :) Thank you to everyone

Re: [DISCUSS] Disable JIRA worklog for GitHub PRs

2023-05-12 Thread Alessandro Solimando
Hi Stamatis, I am experiencing the same too, so +1 from me. Best regards, Alessandro On Fri, 12 May 2023 at 15:58, Stamatis Zampetakis wrote: > Hello, > > Everything that happens in a GitHub PR creates a worklog entry under > the respective JIRA ticket. > For every worklog entry we receive a

[DISCUSS] Disable JIRA worklog for GitHub PRs

2023-05-12 Thread Stamatis Zampetakis
Hello, Everything that happens in a GitHub PR creates a worklog entry under the respective JIRA ticket. For every worklog entry we receive a notification from j...@apache.org when we are watching an issue. The worklog entry and email notification usually appear messy. Moreover, if we are

Re: Can we get someone to review the PR for HIVE-24915?

2023-05-12 Thread Sungwoo Park
Hi, HIVE-25170 fixes the same bug as in your pull request. Thanks, --- Sungwoo On Fri, May 12, 2023 at 4:04 PM Suprith Chandrashekharachar < suprith.chandrashekharac...@treasure-data.com> wrote: > Hi, > > I opened this ticket about 2 years ago hoping to get a review. I didn't > hear any

Can we get someone to review the PR for HIVE-24915?

2023-05-12 Thread Suprith Chandrashekharachar
Hi, I opened this ticket about 2 years ago hoping to get a review. I didn't hear any feedback for sometime and later it fell off my radar as I started working on other projects. Recently, I wanted to open another issue and I bumped into the old ticket that I had created

Re: [EXTERNAL] Re: Branch-3 backports and build stability

2023-05-10 Thread Aman Raj
Hi Vihang, Only three tickets remain now to be backported : 5ea9a9ca13 HIVE-25726: Upgrade velocity to 2.3 due to CVE-2020-13936 (Sourabh Goyal via Naveen Gangam) 164486f9c6 HIVE-25468: Authorization for Create/Drop functions in HMS(Saihemanth Gantasala via Naveen Gangam) 135cfe6c2f HIVE-25547:

Call for Presentations, Community Over Code 2023

2023-05-09 Thread Rich Bowen
(Note: You are receiving this because you are subscribed to the dev@ list for one or more Apache Software Foundation projects.) The Call for Presentations (CFP) for Community Over Code (formerly Apachecon) 2023 is open at https://communityovercode.org/call-for-presentations/, and will close Thu,

Controlling number of mappers or queueing some

2023-05-09 Thread Anmol Ahuja
Hi, We have a hive connector library we're having some issues with. Given N input splits we have N mappers spawned, but the number of write requests these mappers end up making end up exceeding the peak allowed write throughput. Is it possible to dynamically merge some input splits in some

Re: [EXTERNAL] Re: Branch-3 backports and build stability

2023-05-09 Thread Vihang Karajgaonkar
Thanks Aman. I thought all the changes in release 3.2.0 were listed under https://issues.apache.org/jira/browse/HIVE-26751 and I saw them all resolved. Do you know which additional tickets need to go in branch-3 after we backport the branch-3.1 fixes in branch-3? On Tue, May 9, 2023 at 11:20 AM

Re: [DISCUSS] HIVE 4.0 GA Release Proposal

2023-05-09 Thread Kirti Ruge
I see a few tickets like HIVE-26400 which is a major milestone, are resolved . Can we reevaluate priorities of other JIRAs so that It may give us clarity GO/NO-GO for 4.0.0 GA release and its timeline? Thanks, Kirti On Sat, Mar 25, 2023 at 3:27 PM Stamatis Zampetakis wrote: > Regarding

Re: [EXTERNAL] Re: Branch-3 backports and build stability

2023-05-09 Thread Aman Raj
Hi Vihang, We only have 4 tickets remaining to be backported from branch-3.1 to branch-3. It will be completed next week. But there are a lot of new tickets that will go into release 3.2.0 on top of this. I was thinking of not cutting a release candidate now since it would mean that we only

Re: [EXTERNAL] Re: Branch-3 backports and build stability

2023-05-07 Thread vihang karajgaonkar
Hi Aman, I know you are backporting the branch-3.1 commits to branch-3. How close are you with finishing with them. Is there anything that we can help with to get it over the finish line? I am interested to know how close are we to cutting the branch for 3.2.0? Do you think we can have a release

Re: Kill the Pig 

2023-04-28 Thread Ugur Yardimci
I totally agree +1 On Thu, 20 Apr 2023, 10:50 Attila Turoczy, wrote: > Hi All, > > In Hive we have a pretty old component from 1972 and this is the Pig. Pig > was cool somewhere in 2008, but nowadays it does not have any value in the > big data world. Even the last small release of big was 6

Re: Kill the Pig 

2023-04-28 Thread Stamatis Zampetakis
I checked the Pig repo and I see some recent activity. Rohini is actively leading the effort towards a new Pig release. Given that there is proven interest to maintain and contribute to this module I would prefer to keep it for the time being unless there are major issues that I am not aware of.

Re: I will subscript to this

2023-04-27 Thread Ayush Saxena
Send a mail to dev-subscr...@hive.apache.org -Ayush On Fri, 28 Apr 2023 at 9:54 AM, Carlos Guerrero wrote: >

I will subscript to this

2023-04-27 Thread Carlos Guerrero

Re: [EXTERNAL] RE: Branch-3 backports and build stability

2023-04-25 Thread Aman Raj
Hi Cheng, I had started the poll for deprecating Hive on Spark but we decided not to go with it. Kindly refer to the mail threads for the reason. Thanks, Aman. From: Cheng Pan Sent: Monday, April 24, 2023 6:52 PM To: dev@hive.apache.org Subject: [EXTERNAL] RE:

RE: Branch-3 backports and build stability

2023-04-24 Thread Cheng Pan
+1 for removing Hive on Spark from 3.2. Hive on Spark has been out of maintenance for a long time, the related tests are broken in branch-2.3, and branch-3.1. The known Hadoop releases including CDP[1] HDP[2] MR3[3] removed the HoS in Hive3 too. Thus, I suppose HoS is deprecated since Hive 2.3

Re: Kill the Pig 

2023-04-20 Thread Rohini Palaniswamy
Hi Attila, We still use HCatLoader and HCatStorer heavily and would like to retain the support. We are also fixing it to work with Iceberg tables and will be contributing patches for both Hive 3 and Hive 4. So would like the support to be continued with Hive 4. Regards, Rohini On Thu, Apr 20,

Re: Kill the Pig 

2023-04-20 Thread Alessandro Solimando
+1 from me, let's just make sure we make a good salame out of it :) Best regards, Alessandro On Thu, 20 Apr 2023 at 10:50, Attila Turoczy wrote: > Hi All, > > In Hive we have a pretty old component from 1972 and this is the Pig. Pig > was cool somewhere in 2008, but nowadays it does not have

Kill the Pig 

2023-04-20 Thread Attila Turoczy
Hi All, In Hive we have a pretty old component from 1972 and this is the Pig. Pig was cool somewhere in 2008, but nowadays it does not have any value in the big data world. Even the last small release of big was 6 years ago in 2017, also the pig community has pretty much died. Because this

Re: Introducing a DI framework in Hive?

2023-04-20 Thread Attila Turoczy
Cool! Can't wait the first DI specific commit and the review :) On 2023. Apr 19., Wed at 14:24, Stamatis Zampetakis wrote: > I think we all agree that DI can be beneficial in general. > > However, it's hard to say yes or no on something before having a > concrete case to discuss; it doesn't

Re: Introducing a DI framework in Hive?

2023-04-19 Thread Stamatis Zampetakis
I think we all agree that DI can be beneficial in general. However, it's hard to say yes or no on something before having a concrete case to discuss; it doesn't have to be a PR but we need to work on a specific Hive use-case and list advantages/disadvantages of the proposal. Best, Stamatis On

RE: Introducing a DI framework in Hive?

2023-04-17 Thread Laszlo Vegh
Hi all, Sorry for not answering for so far, for some reason I did not receive your answers in my gmail account. I’m happy to see that there’s a conversation around the topic, so let me add my opinion on your points. First of all, introducing a DI framework does not mean a large scale

Re: Introducing a DI framework in Hive?

2023-04-13 Thread László Bodor
Thanks Sungwoo. Regarding the correctness issue, can you post it to the proper thread? I guess it was not intentional to post here. Regards, Laszlo Bodor Sungwoo Park ezt írta (időpont: 2023. ápr. 13., Cs, 12:39): > I would like to add another question to the list of Laszlo. > > 4) When a

Re: Introducing a DI framework in Hive?

2023-04-13 Thread Sungwoo Park
I would like to add another question to the list of Laszlo. 4) When a specific DI framework is chosen, what kinds of new dependencies will be introduced? (Are they conflicting with existing dependencies of Hive?) Regards, --- Sungwoo Park On Thu, Apr 13, 2023 at 4:43 PM László Bodor wrote:

Re: Introducing a DI framework in Hive?

2023-04-13 Thread Sungwoo Park
Hi Stamatis, For the correctness issue, we wanted to solve the problem ourselves and have made a few pull requests in [1] so far. (We would like to kindly request Hive committers to review the pull requests.) For HIVE-27226, we are working on a solution and will create a pull request when a

Re: Introducing a DI framework in Hive?

2023-04-13 Thread László Bodor
Thanks, guys for putting DI into scope, sounds very interesting, just a couple of questions to help me understand and move this forward (and maybe involve more folks with DI experience): 1) Can we have some examples, even with dummy code snippet-level, about what we want to achieve? I mean,

Re: Introducing a DI framework in Hive?

2023-04-13 Thread Stamatis Zampetakis
Just to be clear, I am in favor of introducing DI frameworks in Hive where it makes sense. As Attila said, we don't want to get stuck with legacy code forever. When a concrete proposal comes up we can discuss benefits vs drawbacks. Regarding stability I agree it is a pressing issue but Hive is an

Re: Introducing a DI framework in Hive?

2023-04-12 Thread Attila Turoczy
Hi Stamatis and Sungwoo, Agree with several points. Hive has millions of LOC which is here and will be with us in the same way, it is not a question. But we need to think about the future of the project. There are no engineers in the world who want to use old and legacy technologies, every

Re: Introducing a DI framework in Hive?

2023-04-12 Thread Sungwoo Park
Hello, I am not a committer, but I would like to add my opinion. At this stage of development, I think it is quite risky to switch to a DI framework for a couple of reasons. 1. A DI framework would have been a powerful tool if it had been incorporated into the project from the early stage. Now,

Re: [DISCUSS] Move Jira notification emails out of dev@hive

2023-04-12 Thread Stamatis Zampetakis
INFRA-24440 is resolved so all JIRA traffic now goes to issues@hive. Don't forget to subscribe to that list if you wish to follow the creation of new tickets etc. Best, Stamatis On Fri, Apr 7, 2023 at 9:55 AM Stamatis Zampetakis wrote: > > Just logged

Re: Introducing a DI framework in Hive?

2023-04-12 Thread Stamatis Zampetakis
Hey Laszlo, Dependency injection is a very powerful and useful tool/design pattern. I don't think there is a particular reason for which Hive does not use DI framework apart maybe from the fact that we have lots of legacy code that existed before DI became that popular. I am open to ideas and

Thoughts on extracting out parts of CalcitePlanner

2023-04-10 Thread Stephen Carlin
Hi all, I'm in the process of trying to allow CBO to work for lateral views. Personally, I find myself allergic to 5000+ line java files (heh, turning a blind eye to SemanticAnalyzer for now), If I add code to genLateralViewPlans(), I'm gonna be making it even worse. I kinda feel like I should

Serialization support for Regex SerDe

2023-04-10 Thread Riju Trivedi
Hi Everyone, I am working on HIVE-26276 , Idea is to to deprecate contrib RegexSerDe and merge any functionality difference in serde2 Regex

Re: Lateral views and CBO

2023-04-09 Thread Stamatis Zampetakis
Hi Steve, The way that we currently represent lateral views on the physical plan is not great. I'm sure there are good reasons of why people went forward with the approach of introducing specialized operators for that purpose but as the history has shown the current representation is causing us

Re: [DISCUSS] Move Jira notification emails out of dev@hive

2023-04-07 Thread Stamatis Zampetakis
Just logged https://issues.apache.org/jira/browse/INFRA-24440 to move this forward. Best, Stamatis On Thu, Mar 30, 2023 at 11:12 AM Stamatis Zampetakis wrote: > > I will proceed with the changes needed to move the Jira traffic out of the > dev list sometime next week. > > If there are reasons

Lateral views and CBO

2023-04-06 Thread Stephen Carlin
Hi, I noticed recently that for most lateral views, we do not convert to a CBO plan. I was hoping to make some changes to make this possible. I was wondering if anyone out there had any thoughts on how to do this. If not, I did have one in mind and wanted to bring it up just to start the

[jira] [Created] (HIVE-27228) Add missing upgrade SQL statements after CQ_NUMBER_OF_BUCKETS column being introduced in HIVE-26719

2023-04-06 Thread Sourabh Badhya (Jira)
Sourabh Badhya created HIVE-27228: - Summary: Add missing upgrade SQL statements after CQ_NUMBER_OF_BUCKETS column being introduced in HIVE-26719 Key: HIVE-27228 URL:

[jira] [Created] (HIVE-27227) Provide config to re-enable partitions discovery on external tables

2023-04-06 Thread Taraka Rama Rao Lethavadla (Jira)
Taraka Rama Rao Lethavadla created HIVE-27227: - Summary: Provide config to re-enable partitions discovery on external tables Key: HIVE-27227 URL: https://issues.apache.org/jira/browse/HIVE-27227

[jira] [Created] (HIVE-27226) FullOuterJoin with filter expressions is not computed correctly

2023-04-06 Thread Seonggon Namgung (Jira)
Seonggon Namgung created HIVE-27226: --- Summary: FullOuterJoin with filter expressions is not computed correctly Key: HIVE-27226 URL: https://issues.apache.org/jira/browse/HIVE-27226 Project: Hive

Re: Will hive support storing all queries in the future?

2023-04-06 Thread Attila Turoczy
Hi Wish, I personally don't think so. Of course it is a community decision, but to store the sql query history is mainly belong to the client side from the domain perspective. For example the HUE does it. If you have a custom application in that case the application domain determine it and it is

[jira] [Created] (HIVE-27225) Speedup build by skipping SBOM generation by default

2023-04-06 Thread Stamatis Zampetakis (Jira)
Stamatis Zampetakis created HIVE-27225: -- Summary: Speedup build by skipping SBOM generation by default Key: HIVE-27225 URL: https://issues.apache.org/jira/browse/HIVE-27225 Project: Hive

[jira] [Created] (HIVE-27224) Enhance drop table/partition command

2023-04-06 Thread Taraka Rama Rao Lethavadla (Jira)
Taraka Rama Rao Lethavadla created HIVE-27224: - Summary: Enhance drop table/partition command Key: HIVE-27224 URL: https://issues.apache.org/jira/browse/HIVE-27224 Project: Hive

[jira] [Created] (HIVE-27223) Show Compactions failing with NPE

2023-04-05 Thread Ayush Saxena (Jira)
Ayush Saxena created HIVE-27223: --- Summary: Show Compactions failing with NPE Key: HIVE-27223 URL: https://issues.apache.org/jira/browse/HIVE-27223 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-27222) New functionality to show compactions information for a specific table/partition of a given database

2023-04-05 Thread Taraka Rama Rao Lethavadla (Jira)
Taraka Rama Rao Lethavadla created HIVE-27222: - Summary: New functionality to show compactions information for a specific table/partition of a given database Key: HIVE-27222 URL:

[jira] [Created] (HIVE-27221) Backport of HIVE-25726: Upgrade velocity to 2.3 due to CVE-2020-13936

2023-04-05 Thread Apoorva Aggarwal (Jira)
Apoorva Aggarwal created HIVE-27221: --- Summary: Backport of HIVE-25726: Upgrade velocity to 2.3 due to CVE-2020-13936 Key: HIVE-27221 URL: https://issues.apache.org/jira/browse/HIVE-27221 Project:

[jira] [Created] (HIVE-27220) Backport Upgrade commons,httpclient,jackson,jetty,log4j binaries from branch-3.1

2023-04-05 Thread Apoorva Aggarwal (Jira)
Apoorva Aggarwal created HIVE-27220: --- Summary: Backport Upgrade commons,httpclient,jackson,jetty,log4j binaries from branch-3.1 Key: HIVE-27220 URL: https://issues.apache.org/jira/browse/HIVE-27220

[jira] [Created] (HIVE-27219) Backport of HIVE-25616: Hive-24741 backport to 3.1

2023-04-05 Thread Apoorva Aggarwal (Jira)
Apoorva Aggarwal created HIVE-27219: --- Summary: Backport of HIVE-25616: Hive-24741 backport to 3.1 Key: HIVE-27219 URL: https://issues.apache.org/jira/browse/HIVE-27219 Project: Hive Issue

[jira] [Created] (HIVE-27218) Hive-3 set hive.materializedview.rewriting default to false

2023-04-04 Thread Yi Zhang (Jira)
Yi Zhang created HIVE-27218: --- Summary: Hive-3 set hive.materializedview.rewriting default to false Key: HIVE-27218 URL: https://issues.apache.org/jira/browse/HIVE-27218 Project: Hive Issue Type:

[jira] [Created] (HIVE-27217) addWriteNotificationLogInBatch can silently fail

2023-04-04 Thread John Sherman (Jira)
John Sherman created HIVE-27217: --- Summary: addWriteNotificationLogInBatch can silently fail Key: HIVE-27217 URL: https://issues.apache.org/jira/browse/HIVE-27217 Project: Hive Issue Type: Bug

Introducing a DI framework in Hive?

2023-04-04 Thread Laszlo Vegh
Hi all, I would like to start a conversation about introducing some Dependency Injection framework (like Spring, Guice, Weld, etc.) in Hive. IMHO the lack of such framework makes the codebase way less organised, and harder to maintain. Moreover, I think it also lead to introducing a huge

[jira] [Created] (HIVE-27216) Upgrade postgresql to 42.5.1 from 9.x

2023-04-04 Thread Aman Raj (Jira)
Aman Raj created HIVE-27216: --- Summary: Upgrade postgresql to 42.5.1 from 9.x Key: HIVE-27216 URL: https://issues.apache.org/jira/browse/HIVE-27216 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-27215) On DB with defaultTableType property, create external table with transactional property as true creates a managed table

2023-04-03 Thread Venugopal Reddy K (Jira)
Venugopal Reddy K created HIVE-27215: Summary: On DB with defaultTableType property, create external table with transactional property as true creates a managed table Key: HIVE-27215 URL:

[jira] [Created] (HIVE-27214) Backport of HIVE-24414: Backport HIVE-19662 to branch-3.1

2023-04-03 Thread Diksha (Jira)
Diksha created HIVE-27214: - Summary: Backport of HIVE-24414: Backport HIVE-19662 to branch-3.1 Key: HIVE-27214 URL: https://issues.apache.org/jira/browse/HIVE-27214 Project: Hive Issue Type:

[jira] [Created] (HIVE-27213) parquet logical decimal type to INT32 is not working while compute statastics

2023-04-03 Thread KIRTI RUGE (Jira)
KIRTI RUGE created HIVE-27213: - Summary: parquet logical decimal type to INT32 is not working while compute statastics Key: HIVE-27213 URL: https://issues.apache.org/jira/browse/HIVE-27213 Project: Hive

[jira] [Created] (HIVE-27212) Backport of HIVE-24316: Upgrade ORC from 1.5.6 to 1.5.8 in branch-3.1

2023-04-03 Thread Diksha (Jira)
Diksha created HIVE-27212: - Summary: Backport of HIVE-24316: Upgrade ORC from 1.5.6 to 1.5.8 in branch-3.1 Key: HIVE-27212 URL: https://issues.apache.org/jira/browse/HIVE-27212 Project: Hive Issue

[jira] [Created] (HIVE-27211) Backport HIVE-22453: Describe table unnecessarily fetches partitions

2023-04-02 Thread Nikhil Gupta (Jira)
Nikhil Gupta created HIVE-27211: --- Summary: Backport HIVE-22453: Describe table unnecessarily fetches partitions Key: HIVE-27211 URL: https://issues.apache.org/jira/browse/HIVE-27211 Project: Hive

[jira] [Created] (HIVE-27210) Backport HIVE-23338: Bump jackson version to 2.10.0

2023-04-02 Thread Nikhil Gupta (Jira)
Nikhil Gupta created HIVE-27210: --- Summary: Backport HIVE-23338: Bump jackson version to 2.10.0 Key: HIVE-27210 URL: https://issues.apache.org/jira/browse/HIVE-27210 Project: Hive Issue Type:

[jira] [Created] (HIVE-27209) Backport HIVE-24569: LLAP daemon leaks file descriptors/log4j appenders

2023-04-02 Thread Nikhil Gupta (Jira)
Nikhil Gupta created HIVE-27209: --- Summary: Backport HIVE-24569: LLAP daemon leaks file descriptors/log4j appenders Key: HIVE-27209 URL: https://issues.apache.org/jira/browse/HIVE-27209 Project: Hive

[jira] [Created] (HIVE-27208) Iceberg: Add support for rename table

2023-04-01 Thread Ayush Saxena (Jira)
Ayush Saxena created HIVE-27208: --- Summary: Iceberg: Add support for rename table Key: HIVE-27208 URL: https://issues.apache.org/jira/browse/HIVE-27208 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-27207) Backport of HIVE-26530: HS2 OOM-OperationManager.queryIdOperation does not properly clean up multiple queryIds

2023-03-31 Thread Aman Raj (Jira)
Aman Raj created HIVE-27207: --- Summary: Backport of HIVE-26530: HS2 OOM-OperationManager.queryIdOperation does not properly clean up multiple queryIds Key: HIVE-27207 URL:

[jira] [Created] (HIVE-27206) Backport of HIVE-20179

2023-03-31 Thread Aman Raj (Jira)
Aman Raj created HIVE-27206: --- Summary: Backport of HIVE-20179 Key: HIVE-27206 URL: https://issues.apache.org/jira/browse/HIVE-27206 Project: Hive Issue Type: Sub-task Reporter: Aman

[jira] [Created] (HIVE-27205) Update jackson-databind for CVE fix for CVE-2022-42003

2023-03-31 Thread Diksha (Jira)
Diksha created HIVE-27205: - Summary: Update jackson-databind for CVE fix for CVE-2022-42003 Key: HIVE-27205 URL: https://issues.apache.org/jira/browse/HIVE-27205 Project: Hive Issue Type: Task

<    1   2   3   4   5   6   7   8   9   10   >