GitHub user dilipbiswal opened a pull request: https://github.com/apache/spark/pull/19215
[MINOR][SQL] Only populate type metadata for required types such as CHAR/VARCHAR. ## What changes were proposed in this pull request? When reading column descriptions from hive catalog, we currently populate the metadata for all types to record the raw hive type string. In terms of processing , we need this additional metadata information for CHAR/VARCHAR types or complex type containing the CHAR/VARCHAR types. Its a minor cleanup. I haven't created a JIRA for it. ## How was this patch tested? Test added in HiveMetastoreCatalogSuite You can merge this pull request into a Git repository by running: $ git pull https://github.com/dilipbiswal/spark column_metadata Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/19215.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #19215 ---- commit d29c6ff158ad2da52c95d1073726f6f5763b3187 Author: Dilip Biswal <dbis...@us.ibm.com> Date: 2017-08-05T00:08:09Z Only populate type metadata for required types such as CHAR/VARCHAR. ---- --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org