[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-14 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/11048#discussion_r52864016 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/bucket.scala --- @@ -35,7 +36,8 @@ import org.apache.spark.sql.types.StructType

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-11 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-182784626 btw @viirya can we create a execution.commands package for this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11048#discussion_r52612493 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkQl.scala --- @@ -52,7 +56,7 @@ private[sql] class SparkQl(conf: ParserConf =

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11048#discussion_r52611305 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SparkQlSuite.scala --- @@ -0,0 +1,149 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-11 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-183012248 @viirya I have made an initial pass. This PR is large enough as it is, lets not more commands to it. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11048#discussion_r52620118 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SparkQlSuite.scala --- @@ -0,0 +1,149 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11048#discussion_r52622161 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkQl.scala --- @@ -62,6 +66,458 @@ private[sql] class SparkQl(conf: ParserConf =

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11048#discussion_r52616927 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/commands.scala --- @@ -418,3 +419,312 @@ case class SetDatabaseCommand(databaseName:

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11048#discussion_r52617996 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkQl.scala --- @@ -62,6 +66,458 @@ private[sql] class SparkQl(conf: ParserConf =

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11048#discussion_r52623977 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkQl.scala --- @@ -52,7 +56,7 @@ private[sql] class SparkQl(conf: ParserConf =

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11048#discussion_r52616686 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/bucket.scala --- @@ -35,7 +36,8 @@ import

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11048#discussion_r52644696 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkQl.scala --- @@ -62,6 +66,458 @@ private[sql] class SparkQl(conf: ParserConf =

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-10 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-182633680 @viirya yes we can do this incrementally. Let's just create subtasks under https://issues.apache.org/jira/browse/SPARK-13139 --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-10 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/11048#discussion_r52544458 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkQl.scala --- @@ -62,6 +66,458 @@ private[sql] class SparkQl(conf: ParserConf =

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-181774944 **[Test build #50965 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50965/consoleFull)** for PR 11048 at commit

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-181819018 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-181818773 **[Test build #50965 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50965/consoleFull)** for PR 11048 at commit

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-181819020 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-181437574 **[Test build #50922 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50922/consoleFull)** for PR 11048 at commit

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-181437761 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-181437759 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-181370236 **[Test build #50919 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50919/consoleFull)** for PR 11048 at commit

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-181370928 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-181370933 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-181370915 **[Test build #50919 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50919/consoleFull)** for PR 11048 at commit

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-08 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-181365000 @rxin I've added alter table command support. As this command and corresponding change is big, I think we should let this PR only cover these three commands and do

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-181394362 **[Test build #50922 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50922/consoleFull)** for PR 11048 at commit

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-179150064 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-179149432 **[Test build #50658 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50658/consoleFull)** for PR 11048 at commit

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-03 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/11048 [SPARK-13139][SQL][WIP] Create native DDL commands JIRA: https://issues.apache.org/jira/browse/SPARK-13139 From JIRA: We currently delegate most DDLs directly to Hive, through

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-179150053 **[Test build #50658 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50658/consoleFull)** for PR 11048 at commit

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-179150071 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-03 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-179479022 Thanks - this looks pretty good as a start. We will need to add many other ddls, including alter/drop table, etc. --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-179298837 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-179249273 **[Test build #50660 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50660/consoleFull)** for PR 11048 at commit

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-179298832 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-179297684 **[Test build #50660 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50660/consoleFull)** for PR 11048 at commit