anybody run up against this one? hive 2.1.0 + using a "not in" on a list
+ the column is a partition key participant.
* using not
query:
explain
SELECT count(*)
FROM bi.fact_email_funnel
WHERE
event_date_key = 20160824
AND etl_source_database *not* in ('foo')
output frag:
Map Opera
> anybody run up against this one? hive 2.1.0 + using a "not in" on a
>list + the column is a partition key participant.
The partition filters are run before the plan is generated.
>AND etl_source_database not in ('foo')
Is there a 'foo' in etl_source_database?
> predicate: f
Hi Gopal,
Thank you for this insight. good stuff. The thing is there is no 'foo'
for etl_database_source so that filter if anything should be
short-circuited to 'true'. ie. double nots. 1. not in 2. and foo not
present.
it doesn't matter what what i put in that "not in" clause the filter al
e.org<mailto:user@hive.apache.org>"
mailto:user@hive.apache.org>>
Subject: Re: hive 2.1.0 and "NOT IN ( list )" and column is a partition_key
Hi Gopal,
Thank you for this insight. good stuff. The thing is there is no 'foo' for
etl_database_source so that filter if any
s on master. I’ll file a bug...
>
> From: Stephen Sprague
> Reply-To: "user@hive.apache.org"
> Date: Thursday, August 25, 2016 at 13:34
> To: "user@hive.apache.org"
> Subject: Re: hive 2.1.0 and "NOT IN ( list )" and column is a
> partition_key
&
> not array_contains(array('foo'), partition_key)
And this is why that works.
https://issues.apache.org/jira/browse/HIVE-13951 :(
Cheers,
Gopal
