Zoltan Haindrich created HIVE-22238:
---------------------------------------

             Summary: PK/FK selectivity estimation underscales estimations
                 Key: HIVE-22238
                 URL: https://issues.apache.org/jira/browse/HIVE-22238
             Project: Hive
          Issue Type: Bug
            Reporter: Zoltan Haindrich
            Assignee: Zoltan Haindrich


at [this 
point|https://github.com/apache/hive/blob/5098d155a1e6a164253f5fa98755273bc34085df/ql/src/java/org/apache/hadoop/hive/ql/optimizer/stats/annotation/StatsRulesProcFactory.java#L2182]
 the parent operators rownum is scaled according to pkfkselectivity

however [pkfkselectivity is 
computed|https://github.com/apache/hive/blob/5098d155a1e6a164253f5fa98755273bc34085df/ql/src/java/org/apache/hadoop/hive/ql/optimizer/stats/annotation/StatsRulesProcFactory.java#L2157]
 on a whole subtree.

Scaling it by that amount will count in estimation already used when 
parentstats was calculated...so depending on the number of upstream joins - 
this may lead to severe underestimations



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to