[ https://issues.apache.org/jira/browse/SPARK-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cheng Lian updated SPARK-6575: ------------------------------ Description: Consider a metastore Parquet table that # doesn't have schema evolution issue # has lots of data files and/or partitions In this case, driver schema merging can be both slow and unnecessary. Would be good to have a configuration to let the use disable schema merging when coverting such a metastore Parquet table. was: Consider a metastore Parquet table that # doesn't have schema evolution issue # has lots of data files and/or partitions In this case, driver schema merging can be both slow and unnecessary. Would be good to have a configuration to let the use disable schema merging when coverting such a metastore Parquet table. > Add configuration to disable schema merging while converting metastore > Parquet tables > ------------------------------------------------------------------------------------- > > Key: SPARK-6575 > URL: https://issues.apache.org/jira/browse/SPARK-6575 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 1.3.0 > Reporter: Cheng Lian > Assignee: Cheng Lian > > Consider a metastore Parquet table that > # doesn't have schema evolution issue > # has lots of data files and/or partitions > In this case, driver schema merging can be both slow and unnecessary. Would > be good to have a configuration to let the use disable schema merging when > coverting such a metastore Parquet table. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org