Re: hive 3.1 mapjoin with complex predicate produce incorrect results

2018-12-24 Thread Andrey Zinovyev
| | ListSink | || ++ On Sun, Dec 23, 2018 at 4:11 AM Gopal Vijayaraghavan wrote: > Hi, > > > Subject: Re: hive 3.1 mapjoin with complex predicate produce incorrect > results > ... > > |

Re: hive 3.1 mapjoin with complex predicate produce incorrect results

2018-12-22 Thread Gopal Vijayaraghavan
Hi, > Subject: Re: hive 3.1 mapjoin with complex predicate produce incorrect results ... > |                         0 if(_col0 is null, 44, _col0) (type: int) | > |                         1 _col0 (type: int)        | That rewrite is pretty neat, but I feel like the IF expressio

Re: hive 3.1 mapjoin with complex predicate produce incorrect results

2018-12-22 Thread Andrey Zinovyev
Hi, We use hive 3.1 from hdp 3.0.1 Here is explain output ++ | Explain | ++ | STAGE DEPENDENCIES:| | Stage-1 is a

Re: hive 3.1 mapjoin with complex predicate produce incorrect results

2018-12-21 Thread Vineet Garg
Hi Andrey, I tried this on latest master and wasn’t able to reproduce. Would you mind sharing explain plan output? (after setting hive.user.explain = false). Vineet > On Dec 20, 2018, at 11:37 AM, Andrey Zinovyev > wrote: > > Hi, > We stumbled on some weird behaviour of mapjoin in hive 3.1

hive 3.1 mapjoin with complex predicate produce incorrect results

2018-12-20 Thread Andrey Zinovyev
Hi, We stumbled on some weird behaviour of mapjoin in hive 3.1 Sample schema: > create table table_data(key int, a int); > insert into table_data values (1, 1), (2, 2), (1, 3), (2, 4), (3, 5); > create table table_dict(key int, b int); > insert into table_dict values (1, 42), (2, 43); Query: