GitHub user andrewor14 opened a pull request: https://github.com/apache/spark/pull/11573
[SPARK-13139][SQL] Parse Hive DDL commands ourselves ## What changes were proposed in this pull request? This patch is ported over from @viirya's changes in #11048. Currently for most DDLs we just pass the query text directly to Hive. Instead, we should parse these commands ourselves and in the future (not part of this patch) use the `HiveCatalog` to process these DDLs. This is a pretext to merging `SQLContext` and `HiveContext`. Note: As of this patch we still pass the query text to Hive. The difference is that we now parse the commands ourselves so in the future we can just use our own catalog. ## How was this patch tested? Jenkins, new `DDLCommandSuite`, which comprises of about 40% of the changes here. You can merge this pull request into a Git repository by running: $ git pull https://github.com/andrewor14/spark parser-plus-plus Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/11573.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #11573 ---- commit fc3c1684ad8e24ab9b05f0f7e02659ea2e365ebd Author: Andrew Or <and...@databricks.com> Date: 2016-03-04T22:20:07Z Move things into new ParserUtils object commit adcb561a6bcb91a946448b8a5601155c9d714675 Author: Andrew Or <and...@databricks.com> Date: 2016-03-07T22:40:48Z Merge branch 'master' of github.com:apache/spark into parser-plus-plus commit 010afddf40d776b3009cee98057e74d499c45012 Author: Andrew Or <and...@databricks.com> Date: 2016-03-07T23:56:09Z Port over viirya's changes in #11048 commit 007907460d72a3aa82b222567c08589c62efb614 Author: Andrew Or <and...@databricks.com> Date: 2016-03-08T04:43:31Z Address comments from #11408 + fix style commit 02de9b771cc74abb6f1971081411bd6d8c4c4b5f Author: Andrew Or <and...@databricks.com> Date: 2016-03-08T04:45:43Z Merge branch 'master' of github.com:apache/spark into parser-plus-plus Conflicts: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/bucket.scala commit 3766f83bb5551c0fd978117c3f41efb99257c984 Author: Andrew Or <and...@databricks.com> Date: 2016-03-08T04:49:22Z Minor fixes ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org