[jira] [Created] (HIVE-24907) Wrong results with LEFT JOIN and subqueries with UNION and GROUP BY

2021-03-18 Thread Stamatis Zampetakis (Jira)
Stamatis Zampetakis created HIVE-24907:
--

 Summary: Wrong results with LEFT JOIN and subqueries with UNION 
and GROUP BY
 Key: HIVE-24907
 URL: https://issues.apache.org/jira/browse/HIVE-24907
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Affects Versions: 2.4.0, 3.2.0, 4.0.0
Reporter: Stamatis Zampetakis
Assignee: Stamatis Zampetakis


The following SQL query returns wrong results when run in TEZ/LLAP:

{code:sql}
SET hive.auto.convert.sortmerge.join=true;

CREATE TABLE tbl (key int,value int);
INSERT INTO tbl VALUES (1, 2000);
INSERT INTO tbl VALUES (2, 2001);
INSERT INTO tbl VALUES (3, 2005);

SELECT sub1.key, sub2.key
FROM
  (SELECT a.key FROM tbl a GROUP BY a.key) sub1
LEFT OUTER JOIN (
  SELECT b.key FROM tbl b WHERE b.value = 2001 GROUP BY b.key
  UNION
  SELECT c.key FROM tbl c WHERE c.value = 2005 GROUP BY c.key) sub2 
ON sub1.key = sub2.key;
{code}

Actual results:
||SUB1.KEY||SUB2.KEY||
|1|NULL|
|2|NULL|
|3|NULL|

Expected results:
||SUB1.KEY||SUB2.KEY||
|1|NULL|
|2|2|
|3|3|

Tested can be reproduced with {{TestMiniLlapLocalCliDriver}} or 
{{TestMiniTezCliDriver}} in older versions of Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24906) Suffix the table location with UUID/txnId

2021-03-18 Thread Denys Kuzmenko (Jira)
Denys Kuzmenko created HIVE-24906:
-

 Summary: Suffix the table location with UUID/txnId
 Key: HIVE-24906
 URL: https://issues.apache.org/jira/browse/HIVE-24906
 Project: Hive
  Issue Type: Sub-task
Reporter: Denys Kuzmenko






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24905) only CURRENT ROW end frame is supported for RANGE

2021-03-18 Thread Jira
László Bodor created HIVE-24905:
---

 Summary: only CURRENT ROW end frame is supported for RANGE
 Key: HIVE-24905
 URL: https://issues.apache.org/jira/browse/HIVE-24905
 Project: Hive
  Issue Type: Improvement
Reporter: László Bodor






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: [EXTERNAL] Re: Hive meetup on March 17

2021-03-18 Thread Zoltan Haindrich

Hey All!

Thank you all for attending - it was really great!

I've just uploaded the recording(s) to youtube:
https://www.youtube.com/playlist?list=PLHJ96xYLz1yrz1Y_GF2bt14R68-_3UZJY

I think we will improve on a few things next time :D


I've also learned a lot - thank you all!

cheers,
Zoltan

On 3/18/21 2:40 PM, Matt McCline wrote:

Yes, thank you Zoltan! I learned a lot, too. I see lots of potential in more 
meetings.

Not all of my team could attend -- please publish the recording.

-Original Message-
From: Stamatis Zampetakis 
Sent: Thursday, March 18, 2021 1:16 AM
To: dev 
Subject: [EXTERNAL] Re: Hive meetup on March 17

Thanks for organising this Zoltan, and many thanks to all the speakers for the 
nice presentations.

I certainly learned some new stuff for the project, looking forward to the next 
one.

Best,
Stamatis

On Wed, Mar 17, 2021 at 4:05 PM Zoltan Haindrich  wrote:


Hey All!

We have our first online Hive meetup today!

We will start at 5pm UTC for other timezones see on this site:

https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.
timeanddate.com%2Fworldclock%2Fmeetingdetails.html%3Fyear%3D2021%26mon
th%3D3%26day%3D17%26hour%3D17%26min%3D0%26sec%3D0%26p1%3D50%26p2%3D137
%26p3%3D136%26p4%3D70%26p5%3D176data=04%7C01%7Cmatt.mccline%40mic
rosoft.com%7Cd80a11344dea49e60da408d8e9e62526%7C72f988bf86f141af91ab2d
7cd011db47%7C1%7C0%7C637516521984090461%7CUnknown%7CTWFpbGZsb3d8eyJWIj
oiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000
p;sdata=m5hEvDc9g%2FCrTyt6DY5JDPfcrrjCsieIFtLqVAqB%2Bbg%3Dreserve
d=0

If you don't yet have the meeting url - it will be held in a zoom room at:
https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fclou
dera.zoom.us%2Fj%2F91452267238data=04%7C01%7Cmatt.mccline%40micro
soft.com%7Cd80a11344dea49e60da408d8e9e62526%7C72f988bf86f141af91ab2d7c
d011db47%7C1%7C0%7C637516521984090461%7CUnknown%7CTWFpbGZsb3d8eyJWIjoi
MC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000
sdata=m6nuxdXVXbdJKp187s8FesPug2Hsi51osP82GuMGGPI%3Dreserved=0
Most likely there will be a recording of it - which will be shared
afterwards.

I was thinking to use Github discussions to (also) ask questions
during the event - because it could help untangle "question time" from
"answer time"; we may of course choose not to use it - but I've
experimented with it and if we add discussions to the "Q" section we
may even answer it - and people thinking about the same thing may
extend the question by adding further comments...or just vote on the
question...
not sure how well it will work - might worth a try!
I've set it up on my own fork for now:
https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith
ub.com%2Fkgyrtkirk%2Fhive%2Fdiscussionsdata=04%7C01%7Cmatt.mcclin
e%40microsoft.com%7Cd80a11344dea49e60da408d8e9e62526%7C72f988bf86f141a
f91ab2d7cd011db47%7C1%7C0%7C637516521984100458%7CUnknown%7CTWFpbGZsb3d
8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C
1000sdata=RRFY4ujn69%2FTiGtmbw936NsnRrsVIgwBhRK4%2FxmEFpo%3D
reserved=0

The meetup url is here:
https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.
meetup.com%2FHive-User-Group-Meeting%2Fevents%2F276886707data=04%
7C01%7Cmatt.mccline%40microsoft.com%7Cd80a11344dea49e60da408d8e9e62526
%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637516521984100458%7CUnk
nown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWw
iLCJXVCI6Mn0%3D%7C1000sdata=QYJ6dj4%2F9SxWhopph2BvWMh1ngoEnQ4DelF
CtVj7c6M%3Dreserved=0

Meet you there!

cheers,
Zoltan

On 3/16/21 3:29 PM, Zoltan Haindrich wrote:

Hey All!

Our meetup is also available as a meetup.com event:
https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fww
w.meetup.com%2FHive-User-Group-Meeting%2Fevents%2F276886707%2Fd
ata=04%7C01%7Cmatt.mccline%40microsoft.com%7Cd80a11344dea49e60da408d
8e9e62526%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C6375165219841
00458%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLC
JBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000sdata=myaJ8nZKBNJ0QDcwukBnYi
xxqvalB8trd3BMM%2Bvsn30%3Dreserved=0

In case you want to add it to the calendar or something... :)

cheers,
Zoltan


On 3/11/21 3:00 PM, Zoltan Haindrich wrote:

Hey All!

I would like to invite you to our (first?) online Hive meetup! It
will

be held on March 17. 17:00 UTC

I'll send out a zoom url before the event starts!

The planned topics are accessible here:


https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs
.google.com%2Fdocument%2Fd%2F12jaWa7e6jvVjUaxoMWNJcjvTjnNoqwdCAMyswY1O
iUg%2Fedit%3Fusp%3Dsharingdata=04%7C01%7Cmatt.mccline%40microsoft
.com%7Cd80a11344dea49e60da408d8e9e62526%7C72f988bf86f141af91ab2d7cd011
db47%7C1%7C0%7C637516521984100458%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4w
LjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000sdat
a=gpN63jFVNE%2BUAI2pf0DGjIg8ofdlT08NH1yta9giIWg%3Dreserved=0


Meet you there!

cheers,
Zoltan








RE: [EXTERNAL] Re: Hive meetup on March 17

2021-03-18 Thread Matt McCline
Yes, thank you Zoltan! I learned a lot, too. I see lots of potential in more 
meetings.

Not all of my team could attend -- please publish the recording.

-Original Message-
From: Stamatis Zampetakis  
Sent: Thursday, March 18, 2021 1:16 AM
To: dev 
Subject: [EXTERNAL] Re: Hive meetup on March 17

Thanks for organising this Zoltan, and many thanks to all the speakers for the 
nice presentations.

I certainly learned some new stuff for the project, looking forward to the next 
one.

Best,
Stamatis

On Wed, Mar 17, 2021 at 4:05 PM Zoltan Haindrich  wrote:

> Hey All!
>
> We have our first online Hive meetup today!
>
> We will start at 5pm UTC for other timezones see on this site:
>
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.
> timeanddate.com%2Fworldclock%2Fmeetingdetails.html%3Fyear%3D2021%26mon
> th%3D3%26day%3D17%26hour%3D17%26min%3D0%26sec%3D0%26p1%3D50%26p2%3D137
> %26p3%3D136%26p4%3D70%26p5%3D176data=04%7C01%7Cmatt.mccline%40mic
> rosoft.com%7Cd80a11344dea49e60da408d8e9e62526%7C72f988bf86f141af91ab2d
> 7cd011db47%7C1%7C0%7C637516521984090461%7CUnknown%7CTWFpbGZsb3d8eyJWIj
> oiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000
> p;sdata=m5hEvDc9g%2FCrTyt6DY5JDPfcrrjCsieIFtLqVAqB%2Bbg%3Dreserve
> d=0
>
> If you don't yet have the meeting url - it will be held in a zoom room at:
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fclou
> dera.zoom.us%2Fj%2F91452267238data=04%7C01%7Cmatt.mccline%40micro
> soft.com%7Cd80a11344dea49e60da408d8e9e62526%7C72f988bf86f141af91ab2d7c
> d011db47%7C1%7C0%7C637516521984090461%7CUnknown%7CTWFpbGZsb3d8eyJWIjoi
> MC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000
> sdata=m6nuxdXVXbdJKp187s8FesPug2Hsi51osP82GuMGGPI%3Dreserved=0
> Most likely there will be a recording of it - which will be shared 
> afterwards.
>
> I was thinking to use Github discussions to (also) ask questions 
> during the event - because it could help untangle "question time" from 
> "answer time"; we may of course choose not to use it - but I've 
> experimented with it and if we add discussions to the "Q" section we 
> may even answer it - and people thinking about the same thing may 
> extend the question by adding further comments...or just vote on the 
> question...
> not sure how well it will work - might worth a try!
> I've set it up on my own fork for now:
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith
> ub.com%2Fkgyrtkirk%2Fhive%2Fdiscussionsdata=04%7C01%7Cmatt.mcclin
> e%40microsoft.com%7Cd80a11344dea49e60da408d8e9e62526%7C72f988bf86f141a
> f91ab2d7cd011db47%7C1%7C0%7C637516521984100458%7CUnknown%7CTWFpbGZsb3d
> 8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C
> 1000sdata=RRFY4ujn69%2FTiGtmbw936NsnRrsVIgwBhRK4%2FxmEFpo%3D
> reserved=0
>
> The meetup url is here:
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.
> meetup.com%2FHive-User-Group-Meeting%2Fevents%2F276886707data=04%
> 7C01%7Cmatt.mccline%40microsoft.com%7Cd80a11344dea49e60da408d8e9e62526
> %7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637516521984100458%7CUnk
> nown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWw
> iLCJXVCI6Mn0%3D%7C1000sdata=QYJ6dj4%2F9SxWhopph2BvWMh1ngoEnQ4DelF
> CtVj7c6M%3Dreserved=0
>
> Meet you there!
>
> cheers,
> Zoltan
>
> On 3/16/21 3:29 PM, Zoltan Haindrich wrote:
> > Hey All!
> >
> > Our meetup is also available as a meetup.com event:
> > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fww
> > w.meetup.com%2FHive-User-Group-Meeting%2Fevents%2F276886707%2Fd
> > ata=04%7C01%7Cmatt.mccline%40microsoft.com%7Cd80a11344dea49e60da408d
> > 8e9e62526%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C6375165219841
> > 00458%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLC
> > JBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000sdata=myaJ8nZKBNJ0QDcwukBnYi
> > xxqvalB8trd3BMM%2Bvsn30%3Dreserved=0
> >
> > In case you want to add it to the calendar or something... :)
> >
> > cheers,
> > Zoltan
> >
> >
> > On 3/11/21 3:00 PM, Zoltan Haindrich wrote:
> >> Hey All!
> >>
> >> I would like to invite you to our (first?) online Hive meetup! It 
> >> will
> be held on March 17. 17:00 UTC
> >> I'll send out a zoom url before the event starts!
> >>
> >> The planned topics are accessible here:
> >>
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs
> .google.com%2Fdocument%2Fd%2F12jaWa7e6jvVjUaxoMWNJcjvTjnNoqwdCAMyswY1O
> iUg%2Fedit%3Fusp%3Dsharingdata=04%7C01%7Cmatt.mccline%40microsoft
> .com%7Cd80a11344dea49e60da408d8e9e62526%7C72f988bf86f141af91ab2d7cd011
> db47%7C1%7C0%7C637516521984100458%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4w
> LjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000sdat
> a=gpN63jFVNE%2BUAI2pf0DGjIg8ofdlT08NH1yta9giIWg%3Dreserved=0
> >>
> >> Meet you there!
> >>
> >> cheers,
> >> Zoltan
> >>
> >>
> >>
> >>
>


CVE-2019-10172,CVE-2019-10202 vulnerabilities in jackson-mapper-asl-1.9.13.jar

2021-03-18 Thread Oleksiy S
Guys please take a look here.
https://issues.apache.org/jira/browse/HIVE-24904

Any ideas of how to fix this?

-- 
Oleksiy


[jira] [Created] (HIVE-24904) CVE-2019-10172,CVE-2019-10202 vulnerabilities in jackson-mapper-asl-1.9.13.jar

2021-03-18 Thread Oleksiy Sayankin (Jira)
Oleksiy Sayankin created HIVE-24904:
---

 Summary: CVE-2019-10172,CVE-2019-10202 vulnerabilities in 
jackson-mapper-asl-1.9.13.jar
 Key: HIVE-24904
 URL: https://issues.apache.org/jira/browse/HIVE-24904
 Project: Hive
  Issue Type: Bug
Reporter: Oleksiy Sayankin


CVE list: CVE-2019-10172,CVE-2019-10202

CVSS score: High

{code}
./packaging/target/apache-hive-4.0.0-SNAPSHOT-bin/apache-hive-4.0.0-SNAPSHOT-bin/lib/jackson-mapper-asl-1.9.13.jar
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: Hive meetup on March 17

2021-03-18 Thread Stamatis Zampetakis
Thanks for organising this Zoltan, and many thanks to all the speakers for
the nice presentations.

I certainly learned some new stuff for the project, looking forward to the
next one.

Best,
Stamatis

On Wed, Mar 17, 2021 at 4:05 PM Zoltan Haindrich  wrote:

> Hey All!
>
> We have our first online Hive meetup today!
>
> We will start at 5pm UTC for other timezones see on this site:
>
> https://www.timeanddate.com/worldclock/meetingdetails.html?year=2021=3=17=17=0=0=50=137=136=70=176
>
> If you don't yet have the meeting url - it will be held in a zoom room at:
> https://cloudera.zoom.us/j/91452267238
> Most likely there will be a recording of it - which will be shared
> afterwards.
>
> I was thinking to use Github discussions to (also) ask questions during
> the event - because it could help untangle "question time" from "answer
> time"; we may of course
> choose not to use it - but I've experimented with it and if we add
> discussions to the "Q" section we may even answer it - and people
> thinking about the same thing may
> extend the question by adding further comments...or just vote on the
> question...
> not sure how well it will work - might worth a try!
> I've set it up on my own fork for now:
> https://github.com/kgyrtkirk/hive/discussions
>
> The meetup url is here:
> https://www.meetup.com/Hive-User-Group-Meeting/events/276886707
>
> Meet you there!
>
> cheers,
> Zoltan
>
> On 3/16/21 3:29 PM, Zoltan Haindrich wrote:
> > Hey All!
> >
> > Our meetup is also available as a meetup.com event:
> > https://www.meetup.com/Hive-User-Group-Meeting/events/276886707/
> >
> > In case you want to add it to the calendar or something... :)
> >
> > cheers,
> > Zoltan
> >
> >
> > On 3/11/21 3:00 PM, Zoltan Haindrich wrote:
> >> Hey All!
> >>
> >> I would like to invite you to our (first?) online Hive meetup! It will
> be held on March 17. 17:00 UTC
> >> I'll send out a zoom url before the event starts!
> >>
> >> The planned topics are accessible here:
> >>
> https://docs.google.com/document/d/12jaWa7e6jvVjUaxoMWNJcjvTjnNoqwdCAMyswY1OiUg/edit?usp=sharing
> >>
> >> Meet you there!
> >>
> >> cheers,
> >> Zoltan
> >>
> >>
> >>
> >>
>