[ https://issues.apache.org/jira/browse/SPARK-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cheng Lian updated SPARK-7763: ------------------------------ Component/s: SQL Description: Partition columns of {{HadoopFsRelation}} should be persisted into Hive metastore together with relation schema. However, storing paths of all partitions into metastore might become a bottleneck. Instead, we always do a partition discovery while loading back the relation. Target Version/s: 1.4.0 Affects Version/s: 1.4.0 Assignee: Cheng Lian > Partition columns of data source tables should be persisted into metastore > when creating persisted tables > --------------------------------------------------------------------------------------------------------- > > Key: SPARK-7763 > URL: https://issues.apache.org/jira/browse/SPARK-7763 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 1.4.0 > Reporter: Cheng Lian > Assignee: Cheng Lian > Priority: Blocker > > Partition columns of {{HadoopFsRelation}} should be persisted into Hive > metastore together with relation schema. However, storing paths of all > partitions into metastore might become a bottleneck. Instead, we always do a > partition discovery while loading back the relation. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org