[ 
https://issues.apache.org/jira/browse/DRILL-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jacques Nadeau resolved DRILL-2723.
-----------------------------------
          Resolution: Fixed
       Fix Version/s:     (was: 1.2.0)
    Target Version/s: 1.0.0

Fixed in 5de7d6e

> Inaccurate row count estimate for text files results in BroadcastExchange
> -------------------------------------------------------------------------
>
>                 Key: DRILL-2723
>                 URL: https://issues.apache.org/jira/browse/DRILL-2723
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Query Planning & Optimization
>            Reporter: Steven Phillips
>            Assignee: Jacques Nadeau
>
> The current method for estimating row count in text files is to divide the 
> size of the file in bytes by 1024. This row count estimate is used by 
> optimizer to decide if BroadcastExchange should be used.
> This results in massive memory consumption when using BroadCast exchange on a 
> large table.
> We need a better way of estimating row count, or use a different metric when 
> deciding to use BroadcastExchange.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to