Evan Chan created SPARK-13662: --------------------------------- Summary: [SQL][Hive] Have SHOW TABLES return additional fields from Hive MetaStore Key: SPARK-13662 URL: https://issues.apache.org/jira/browse/SPARK-13662 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 1.6.0, 1.5.2 Environment: All Reporter: Evan Chan
Currently, the SHOW TABLES command in Spark's Hive ThriftServer, or equivalently the HiveContext.tables method, returns a DataFrame with only two columns: the name of the table and whether it is temporary. It would be really nice to add support to return some extra information, such as: - Whether this table is Spark-only or a native Hive table - If spark-only, the name of the data source - potentially other properties The first two is really useful for BI environments connecting to multiple data sources and that work with both Hive and Spark. Some thoughts: - The SQL/HiveContext Catalog API might need to be expanded to return something like a TableEntry, rather than just a tuple of (name, temporary). - I believe there is a Hive Catalog/client API to get information about each table. I suppose one concern would be the speed of using this API. Perhaps there are other APis that can get this info faster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org