jin xing created SPARK-22384:
--------------------------------
Summary: Refine partition pruning when attribute is wrapped in Cast
Key: SPARK-22384
URL: https://issues.apache.org/jira/browse/SPARK-22384
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.2.0
Reporter: jin xing
Sql below will get all partitions from metastore, which put much burden on
metastore;
{{CREATE TABLE test (value INT) PARTITIONED BY (dt STRING)}}
{{SELECT * from test where dt=2017}}
The reason is that the the analyzed attribute {{dt}} is wrapped in {{Cast}} and
{{HiveShim}} fails to generate a proper partition filter.
Could we fix this? Sql like {{SELECT * from test where dt=2017}} is common in
my warehouse.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
