Aman Sinha created IMPALA-10008:
-----------------------------------

             Summary: Optimize planning and code generation to leverage 
non-nullable slots
                 Key: IMPALA-10008
                 URL: https://issues.apache.org/jira/browse/IMPALA-10008
             Project: IMPALA
          Issue Type: Improvement
    Affects Versions: Impala 3.4.0
            Reporter: Aman Sinha


The nullability property of a column/slot should be leveraged to improve both 
planning and code generation.  During planning, a few different optimizations 
could be done.  One example is: for predicates like  'a1 IS NOT DISTINCT FROM 
a2',  if both a1 and a2 are non-nullable, then this predicate can be converted 
to an equality predicate.   During runtime, this will avoid extra null checks 
in the hash join's build and probe side which would normally have been done on 
the presumption that the data could have nulls.  The generated code has null 
checks in various places (for any SlotRef expr) which could be simplified and 
hence reduce overhead.

In general, the propagation of nullability property in the plan would make 
processing of other predicates ( IS NULL, IS NOT NULL) and expressions (e.g 
NULLIF) much more efficient.




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org

Reply via email to