Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0 pipeline

[Aman Raj]

Thanks Pravin for your support. Can someone please help me merge this PR to 
branch-3 HIVE-26816 : Add Jenkins file for branch-3 by amanraj2520 · Pull 
Request #3841 · apache/hive 
(github.com). I do not have access to 
do that. Then we will start development on it.

Thanks,
Aman.



From: Pravin Sinha 
Sent: Friday, December 9, 2022 1:55 AM
To: dev@hive.apache.org 
Subject: Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0 pipeline

[You don't often get email from mailpravi...@gmail.com. Learn why this is 
important at https://aka.ms/LearnAboutSenderIdentification ]

Hi Aman,
 I also think that we can merge the PR to enable the test pipeline if the
change looks fine and subsequently we can fix the tests to bring it to
green state (hopefully by cherry picking a few commits from branch-3.1
which is already in green state) . Looks like currently the tests are
broken in branch-3.

Thanks,
Pravin

On Thu, Dec 8, 2022 at 3:59 PM Aman Raj 
wrote:

> Hi team,
>
> For the addition of Jenkins file for branch-3, branch-3 has some existing
> tests failing which was because Jenkins was not running on branch-3. We are
> planning to merge this Jenkins file irrespective of this PR having test
> failures, since this does not change the code. We will create separate
> tasks for ensuring that branch-3 has a green build.
>
> Link to the PR : 
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhive%2Fpull%2F3841&data=05%7C01%7Crajaman%40microsoft.com%7C738136aa69b6430606aa08dad95a7347%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638061279801260647%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=qPeXrvSr8Zt2o9fKIlDR3FGfACWfFVx7hidwqORq0e8%3D&reserved=0
>
> Fyi, branch-3.1 has a green build.
>
> Thanks,
> Aman.
> 
> From: Aman Raj 
> Sent: Wednesday, December 7, 2022 3:19 PM
> To: dev@hive.apache.org 
> Subject: Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0
> pipeline
>
> Hi Ayush,
>
> Thanks for clarifying. Will wait for it to turn green.
>
> Thanks,
> Aman.
> 
> From: Ayush Saxena 
> Sent: Wednesday, December 7, 2022 3:11 PM
> To: dev@hive.apache.org 
> Subject: Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0
> pipeline
>
> Hi Aman,
> The build is already running for your PR:
>
> https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fci.hive.apache.org%2Fblue%2Forganizations%2Fjenkins%2Fhive-precommit%2Fdetail%2FPR-3841%2F1%2Fpipeline&data=05%7C01%7Crajaman%40microsoft.com%7C738136aa69b6430606aa08dad95a7347%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638061279801260647%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=MfP8MfNR5bd5c2HhbDO35pBuDC6M9JUczTOegdvbbFk%3D&reserved=0
>
> The JenkinsFile is picked from the PR while running rather than the target
> branch.
>
> -Ayush
>
> > On 07-Dec-2022, at 3:03 PM, Aman Raj 
> wrote:
> >
> > Hi Stamatis,
> >
> > How can we ensure that unless the PR is merged. Please suggest.
> > I was thinking of merging this and raising a sample PR on branch-3 to
> check whether it works or not. Is there some other way?
> >
> > Thanks,
> > Aman.
> > 
> > From: Stamatis Zampetakis 
> > Sent: Wednesday, December 7, 2022 2:51 PM
> > To: dev@hive.apache.org 
> > Subject: Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0
> pipeline
> >
> > Hey Aman,
> >
> > Before checking in the PR we should ensure that it works as expected;
> i.e.,
> > having a green run in a reasonable time.
> >
> > Best,
> > Stamatis
> >
> >> On Wed, Dec 7, 2022 at 9:29 AM Aman Raj 
> >> wrote:
> >>
> >> Hi Stamatis,
> >>
> >> I have raised a Pull Request for the same -
> >>
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhive%2Fpull%2F3841&data=05%7C01%7Crajaman%40microsoft.com%7C738136aa69b6430606aa08dad95a7347%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638061279801260647%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=qPeXrvSr8Zt2o9fKIlDR3FGfACWfFVx7hidwqORq0e8%3D&reserved=0.
> Can you please check this and
> >> merge it.
> >>
> >> Thanks,
> >> Aman.
> >>
> >> 
> >> From: Aman Raj 
> >> Sent: Wednesday, December 7, 2022 1:50 PM
> >> To: dev@hive.apache.org 
> >> Subject: Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0
> >> pipeline
> >>
> >> Hi Stamatis,
> >>
> >> Sure, thanks a lot for your help. Will make that change and update this
> >> mail thread.
> >>
> >> Thanks,
> >> Aman.
> >> 
> >> From: Stamatis Zampetakis 
> >> Sent: Wednesday, December 7, 2022 1:42 PM
> >> To: dev@hive.apache.org 
> >> Subject: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0 pipeli

[jira] [Created] (HIVE-26825) Compactor: Cleaner shouldn't fetch table details again and again for partitioned tables

[KIRTI RUGE (Jira)]

KIRTI RUGE created HIVE-26825:
-

 Summary: Compactor: Cleaner shouldn't fetch table details again 
and again for partitioned tables
 Key: HIVE-26825
 URL: https://issues.apache.org/jira/browse/HIVE-26825
 Project: Hive
  Issue Type: Improvement
  Components: Transactions
Reporter: KIRTI RUGE


Cleaner shouldn't be fetch table/partition details for all its partitions. When 
there are large number of databases/tables, it takes lot of time for Initiator 
to complete its initial iteration and load on DB also goes higher.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0 pipeline

[Pravin Sinha]

Hi Aman,
 I also think that we can merge the PR to enable the test pipeline if the
change looks fine and subsequently we can fix the tests to bring it to
green state (hopefully by cherry picking a few commits from branch-3.1
which is already in green state) . Looks like currently the tests are
broken in branch-3.

Thanks,
Pravin

On Thu, Dec 8, 2022 at 3:59 PM Aman Raj 
wrote:

> Hi team,
>
> For the addition of Jenkins file for branch-3, branch-3 has some existing
> tests failing which was because Jenkins was not running on branch-3. We are
> planning to merge this Jenkins file irrespective of this PR having test
> failures, since this does not change the code. We will create separate
> tasks for ensuring that branch-3 has a green build.
>
> Link to the PR : https://github.com/apache/hive/pull/3841
>
> Fyi, branch-3.1 has a green build.
>
> Thanks,
> Aman.
> 
> From: Aman Raj 
> Sent: Wednesday, December 7, 2022 3:19 PM
> To: dev@hive.apache.org 
> Subject: Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0
> pipeline
>
> Hi Ayush,
>
> Thanks for clarifying. Will wait for it to turn green.
>
> Thanks,
> Aman.
> 
> From: Ayush Saxena 
> Sent: Wednesday, December 7, 2022 3:11 PM
> To: dev@hive.apache.org 
> Subject: Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0
> pipeline
>
> Hi Aman,
> The build is already running for your PR:
>
> https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fci.hive.apache.org%2Fblue%2Forganizations%2Fjenkins%2Fhive-precommit%2Fdetail%2FPR-3841%2F1%2Fpipeline&data=05%7C01%7Crajaman%40microsoft.com%7C4beeb2a178774ae320db08dad8386d36%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638060034129929499%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=29%2BOXXGM%2BuArowRGRO8gHtE6L8axnnlchKCMrE0H22Q%3D&reserved=0
>
> The JenkinsFile is picked from the PR while running rather than the target
> branch.
>
> -Ayush
>
> > On 07-Dec-2022, at 3:03 PM, Aman Raj 
> wrote:
> >
> > Hi Stamatis,
> >
> > How can we ensure that unless the PR is merged. Please suggest.
> > I was thinking of merging this and raising a sample PR on branch-3 to
> check whether it works or not. Is there some other way?
> >
> > Thanks,
> > Aman.
> > 
> > From: Stamatis Zampetakis 
> > Sent: Wednesday, December 7, 2022 2:51 PM
> > To: dev@hive.apache.org 
> > Subject: Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0
> pipeline
> >
> > Hey Aman,
> >
> > Before checking in the PR we should ensure that it works as expected;
> i.e.,
> > having a green run in a reasonable time.
> >
> > Best,
> > Stamatis
> >
> >> On Wed, Dec 7, 2022 at 9:29 AM Aman Raj 
> >> wrote:
> >>
> >> Hi Stamatis,
> >>
> >> I have raised a Pull Request for the same -
> >>
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhive%2Fpull%2F3841&data=05%7C01%7Crajaman%40microsoft.com%7C4beeb2a178774ae320db08dad8386d36%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638060034129929499%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=h2clHBrW3CxgjDTEL1QJDx6fSSai3OOFg5Q9DclVd6c%3D&reserved=0.
> Can you please check this and
> >> merge it.
> >>
> >> Thanks,
> >> Aman.
> >>
> >> 
> >> From: Aman Raj 
> >> Sent: Wednesday, December 7, 2022 1:50 PM
> >> To: dev@hive.apache.org 
> >> Subject: Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0
> >> pipeline
> >>
> >> Hi Stamatis,
> >>
> >> Sure, thanks a lot for your help. Will make that change and update this
> >> mail thread.
> >>
> >> Thanks,
> >> Aman.
> >> 
> >> From: Stamatis Zampetakis 
> >> Sent: Wednesday, December 7, 2022 1:42 PM
> >> To: dev@hive.apache.org 
> >> Subject: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0 pipeline
> >>
> >> Hi team,
> >>
> >> I don't think you need any kind of special permissions to enable
> pre-commit
> >> tests for branch-3. I have the impression that just committing an
> >> appropriate Jenkinsfile (e.g., HIVE-24331 [1]) should do the trick.
> >>
> >> Best,
> >> Stamatis
> >>
> >> [1]
> >>
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FHIVE-24331&data=05%7C01%7Crajaman%40microsoft.com%7C4beeb2a178774ae320db08dad8386d36%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638060034129929499%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=6QXqEJmGGSdac7I1K4XE6fSLiILpY1PbV2W1mZKdG7g%3D&reserved=0
> >>
> >> On Wed, Dec 7, 2022 at 8:41 AM Sankar Hariappan
> >>  wrote:
> >>
> >>> Hi folks,
> >>>
> >>> It is a blocker for us to start the Hive 3.2 release efforts. Can
> someone
> >>> help adding Jenkins pipeline for "branch-3" or pls add "sankarh",
> >> "mahesh"
> >>> as admin?
> >>>
> >>> Thanks,
> >

[jira] [Created] (HIVE-26823) Port spotlessApply changes

[Zsolt Miskolczi (Jira)]

Zsolt Miskolczi created HIVE-26823:
--

 Summary: Port spotlessApply changes
 Key: HIVE-26823
 URL: https://issues.apache.org/jira/browse/HIVE-26823
 Project: Hive
  Issue Type: Sub-task
Reporter: Zsolt Miskolczi






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

[jira] [Created] (HIVE-26824) Port changes after spotlessApply

[Zsolt Miskolczi (Jira)]

Zsolt Miskolczi created HIVE-26824:
--

 Summary: Port changes after spotlessApply
 Key: HIVE-26824
 URL: https://issues.apache.org/jira/browse/HIVE-26824
 Project: Hive
  Issue Type: Sub-task
Reporter: Zsolt Miskolczi






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

[jira] [Created] (HIVE-26822) Port changes before spotlessApply

[Zsolt Miskolczi (Jira)]

Zsolt Miskolczi created HIVE-26822:
--

 Summary: Port changes before spotlessApply
 Key: HIVE-26822
 URL: https://issues.apache.org/jira/browse/HIVE-26822
 Project: Hive
  Issue Type: Sub-task
Reporter: Zsolt Miskolczi






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

[jira] [Created] (HIVE-26821) Fetch task caching should only depend on fetch task conversion

[Sourabh Badhya (Jira)]

Sourabh Badhya created HIVE-26821:
-

 Summary: Fetch task caching should only depend on fetch task 
conversion
 Key: HIVE-26821
 URL: https://issues.apache.org/jira/browse/HIVE-26821
 Project: Hive
  Issue Type: Bug
Reporter: Sourabh Badhya
Assignee: Sourabh Badhya


Currently, fetch task is caching results irrespective of whether fetch task 
conversion is enabled or not. This can lead to situation wherein the queries 
have fetch task conversion disabled but the results are cached. Fetch task must 
be aware if it is used for fetch task conversion or not. In the latter case, 
caching should be disabled.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

[jira] [Created] (HIVE-26820) Disable hybridgrace_hashjoin_2 flaky qtest

[Alessandro Solimando (Jira)]

Alessandro Solimando created HIVE-26820:
---

 Summary: Disable hybridgrace_hashjoin_2 flaky qtest
 Key: HIVE-26820
 URL: https://issues.apache.org/jira/browse/HIVE-26820
 Project: Hive
  Issue Type: Test
  Components: Test
Affects Versions: 4.0.0-alpha-2
Reporter: Alessandro Solimando
Assignee: Alessandro Solimando


Had this test failing many times in the last months, let's disable it for the 
moment:

[http://ci.hive.apache.org/blue/organizations/jenkins/hive-flaky-check/detail/hive-flaky-check/597/tests]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0 pipeline

[Aman Raj]

Hi team,

For the addition of Jenkins file for branch-3, branch-3 has some existing tests 
failing which was because Jenkins was not running on branch-3. We are planning 
to merge this Jenkins file irrespective of this PR having test failures, since 
this does not change the code. We will create separate tasks for ensuring that 
branch-3 has a green build.

Link to the PR : https://github.com/apache/hive/pull/3841

Fyi, branch-3.1 has a green build.

Thanks,
Aman.

From: Aman Raj 
Sent: Wednesday, December 7, 2022 3:19 PM
To: dev@hive.apache.org 
Subject: Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0 pipeline

Hi Ayush,

Thanks for clarifying. Will wait for it to turn green.

Thanks,
Aman.

From: Ayush Saxena 
Sent: Wednesday, December 7, 2022 3:11 PM
To: dev@hive.apache.org 
Subject: Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0 pipeline

Hi Aman,
The build is already running for your PR:
https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fci.hive.apache.org%2Fblue%2Forganizations%2Fjenkins%2Fhive-precommit%2Fdetail%2FPR-3841%2F1%2Fpipeline&data=05%7C01%7Crajaman%40microsoft.com%7C4beeb2a178774ae320db08dad8386d36%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638060034129929499%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=29%2BOXXGM%2BuArowRGRO8gHtE6L8axnnlchKCMrE0H22Q%3D&reserved=0

The JenkinsFile is picked from the PR while running rather than the target 
branch.

-Ayush

> On 07-Dec-2022, at 3:03 PM, Aman Raj  wrote:
>
> Hi Stamatis,
>
> How can we ensure that unless the PR is merged. Please suggest.
> I was thinking of merging this and raising a sample PR on branch-3 to check 
> whether it works or not. Is there some other way?
>
> Thanks,
> Aman.
> 
> From: Stamatis Zampetakis 
> Sent: Wednesday, December 7, 2022 2:51 PM
> To: dev@hive.apache.org 
> Subject: Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0 pipeline
>
> Hey Aman,
>
> Before checking in the PR we should ensure that it works as expected; i.e.,
> having a green run in a reasonable time.
>
> Best,
> Stamatis
>
>> On Wed, Dec 7, 2022 at 9:29 AM Aman Raj 
>> wrote:
>>
>> Hi Stamatis,
>>
>> I have raised a Pull Request for the same -
>> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhive%2Fpull%2F3841&data=05%7C01%7Crajaman%40microsoft.com%7C4beeb2a178774ae320db08dad8386d36%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638060034129929499%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=h2clHBrW3CxgjDTEL1QJDx6fSSai3OOFg5Q9DclVd6c%3D&reserved=0.
>>  Can you please check this and
>> merge it.
>>
>> Thanks,
>> Aman.
>>
>> 
>> From: Aman Raj 
>> Sent: Wednesday, December 7, 2022 1:50 PM
>> To: dev@hive.apache.org 
>> Subject: Re: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0
>> pipeline
>>
>> Hi Stamatis,
>>
>> Sure, thanks a lot for your help. Will make that change and update this
>> mail thread.
>>
>> Thanks,
>> Aman.
>> 
>> From: Stamatis Zampetakis 
>> Sent: Wednesday, December 7, 2022 1:42 PM
>> To: dev@hive.apache.org 
>> Subject: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0 pipeline
>>
>> Hi team,
>>
>> I don't think you need any kind of special permissions to enable pre-commit
>> tests for branch-3. I have the impression that just committing an
>> appropriate Jenkinsfile (e.g., HIVE-24331 [1]) should do the trick.
>>
>> Best,
>> Stamatis
>>
>> [1]
>> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FHIVE-24331&data=05%7C01%7Crajaman%40microsoft.com%7C4beeb2a178774ae320db08dad8386d36%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638060034129929499%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=6QXqEJmGGSdac7I1K4XE6fSLiILpY1PbV2W1mZKdG7g%3D&reserved=0
>>
>> On Wed, Dec 7, 2022 at 8:41 AM Sankar Hariappan
>>  wrote:
>>
>>> Hi folks,
>>>
>>> It is a blocker for us to start the Hive 3.2 release efforts. Can someone
>>> help adding Jenkins pipeline for "branch-3" or pls add "sankarh",
>> "mahesh"
>>> as admin?
>>>
>>> Thanks,
>>> Sankar
>>>
>>> -Original Message-
>>> From: Aman Raj 
>>> Sent: Monday, December 5, 2022 12:10 PM
>>> To: dev@hive.apache.org
>>> Subject: [EXTERNAL] Re: Sync of Branch-3 & Branch-3.1 for 3.2.0 pipeline
>>>
>>> [You don't often get email from raja...@microsoft.com.invalid. Learn why
>>> this is important at https://aka.ms/LearnAboutSenderIdentification ]
>>>
>>> Hi team,
>>>
>>> Can someone please help me set up the Jenkins pipeline for branch-3 of
>>> Hive. I do not have access to do the same and it is essential to raise
>> PR's
>>> for the 3.2.0 release. Please refer to the email thread for more detail