[ https://issues.apache.org/jira/browse/SPARK-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14060894#comment-14060894 ]
Michael Armbrust commented on SPARK-2443: ----------------------------------------- [~jerrylam] since Spark SQL is an Alpha component we have been pretty aggressive about back porting to the 1.0 branch. This patch will likely be included in the 1.0.2 release if/when we make one. > Reading from Partitioned Tables is Slow > --------------------------------------- > > Key: SPARK-2443 > URL: https://issues.apache.org/jira/browse/SPARK-2443 > Project: Spark > Issue Type: Bug > Components: SQL > Reporter: Michael Armbrust > Assignee: Zongheng Yang > > Here are some numbers, all queries return ~20million: > {code} > SELECT COUNT(*) FROM <non partitioned table> > 5.496467726 s > SELECT COUNT(*) FROM <partitioned table stored in parquet> > 50.266666947 s > SELECT COUNT(*) FROM <same table as previous but loaded with parquetFile > instead of through hive> > 2s > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)