Yuming Wang created SPARK-24937: ----------------------------------- Summary: Datasource partition table should load empty partitions Key: SPARK-24937 URL: https://issues.apache.org/jira/browse/SPARK-24937 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 2.4.0 Reporter: Yuming Wang
{code:sql} spark-sql> CREATE TABLE tbl AS SELECT 1; 18/07/26 22:48:11 WARN HiveMetaStore: Location: file:/Users/yumwang/tmp/spark/spark-warehouse/tbl specified for non-external table:tbl 18/07/26 22:48:15 WARN ObjectStore: Failed to get database global_temp, returning NoSuchObjectException spark-sql> CREATE TABLE tbl1 (c1 BIGINT, day STRING, hour STRING) > USING parquet > PARTITIONED BY (day, hour); spark-sql> INSERT INTO TABLE tbl1 PARTITION (day = '2018-07-25', hour='01') SELECT * FROM tbl where 1=0; spark-sql> SHOW PARTITIONS tbl1; spark-sql> CREATE TABLE tbl2 (c1 BIGINT) > PARTITIONED BY (day STRING, hour STRING); 18/07/26 22:49:20 WARN HiveMetaStore: Location: file:/Users/yumwang/tmp/spark/spark-warehouse/tbl2 specified for non-external table:tbl2 spark-sql> INSERT INTO TABLE tbl2 PARTITION (day = '2018-07-25', hour='01') SELECT * FROM tbl where 1=0; 18/07/26 22:49:36 WARN log: Updating partition stats fast for: tbl2 18/07/26 22:49:36 WARN log: Updated size to 0 spark-sql> SHOW PARTITIONS tbl2; day=2018-07-25/hour=01 spark-sql> {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org