[ https://issues.apache.org/jira/browse/DRILL-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jacques Nadeau resolved DRILL-2723. ----------------------------------- Resolution: Fixed Fix Version/s: (was: 1.2.0) Target Version/s: 1.0.0 Fixed in 5de7d6e > Inaccurate row count estimate for text files results in BroadcastExchange > ------------------------------------------------------------------------- > > Key: DRILL-2723 > URL: https://issues.apache.org/jira/browse/DRILL-2723 > Project: Apache Drill > Issue Type: Bug > Components: Query Planning & Optimization > Reporter: Steven Phillips > Assignee: Jacques Nadeau > > The current method for estimating row count in text files is to divide the > size of the file in bytes by 1024. This row count estimate is used by > optimizer to decide if BroadcastExchange should be used. > This results in massive memory consumption when using BroadCast exchange on a > large table. > We need a better way of estimating row count, or use a different metric when > deciding to use BroadcastExchange. -- This message was sent by Atlassian JIRA (v6.3.4#6332)