[GitHub] spark pull request: [SPARK-14182] [SQL] Parse DDL Command: Alter V...

2016-03-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11987#discussion_r57946641 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/ng/SqlBase.g4 --- @@ -102,6 +102,15 @@ statement (PARTITIONED

[GitHub] spark pull request: [SPARK-14184][SQL] Support native execution of...

2016-03-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11991#discussion_r57946967 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/ng/SqlBase.g4 --- @@ -838,6 +839,8 @@ OUTPUTFORMAT: 'OUTPUTFORMAT

[GitHub] spark pull request: [SPARK-14133][SQL] Throws exception for unsupp...

2016-03-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12069#discussion_r57934860 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/ng/SqlBase.g4 --- @@ -861,6 +866,7 @@ ROLES: 'ROLES'; COMPACTIONS

[GitHub] spark pull request: [SPARK-14133][SQL] Throws exception for unsupp...

2016-03-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12069#discussion_r57936230 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/ng/SqlBase.g4 --- @@ -167,6 +167,11 @@ unsupportedHiveNativeCommands

[GitHub] spark pull request: [SPARK-14133][SQL] Throws exception for unsupp...

2016-03-30 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/12069#issuecomment-203563226 @sureshthalamati thanks for working on this. The `ALTER TABLE table TOUCH [PARTITION spec]` command has already been implemented. --- If your project is set up

[GitHub] spark pull request: [SPARK-14211][SQL] Remove ANTLR3 based parser

2016-03-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12071#discussion_r57971100 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveQl.scala --- @@ -1,749 +0,0 @@ -/* - * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-14211][SQL] Remove ANTLR3 based parser

2016-03-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12071#discussion_r57972363 --- Diff: dev/deps/spark-deps-hadoop-2.2 --- @@ -2,7 +2,8 @@ JavaEWAH-0.3.2.jar RoaringBitmap-0.5.11.jar ST4-4.0.4.jar activation-1.1.jar

[GitHub] spark pull request: [SPARK-12610][SQL] Left Anti Join

2016-04-06 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/12214 [SPARK-12610][SQL] Left Anti Join ### What changes were proposed in this pull request? This PR adds support for `LEFT ANTI JOIN` to Spark SQL. A `LEFT ANTI JOIN` is the exact opposite

[GitHub] spark pull request: [SPARK-14426][SQL] Merge PerserUtils and Parse...

2016-04-06 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12199#discussion_r58688523 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/parser/ParseUtils.java --- @@ -1,135 +0,0 @@ -/** - * Licensed to the Apache

[GitHub] spark pull request: use https while downloading binaries

2016-04-05 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/12182#issuecomment-205979054 @infynyxx could you add a JIRA ticket and create a ticket like `[SPARK-][BUILD] use https while downloading binaries` (see the titles of other PRs

[GitHub] spark pull request: [SPARK-14398] [SQL] Audit non-reserved keyword...

2016-04-06 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/12191#issuecomment-206222927 @bomeng what is the point of adding non-reserved keywords if they are not used in parser rules? The main point of this ticket is that we need to make sure

[GitHub] spark pull request: [SPARK-14426][SQL] Merge PerserUtils and Parse...

2016-04-06 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12199#discussion_r58667228 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ParserUtilsSuite.scala --- @@ -0,0 +1,65 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-14383] [SQL] missing "|" in the g4 file

2016-04-06 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/12156#issuecomment-206223273 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-14388][SQL] Implement CREATE TABLE

2016-04-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12271#discussion_r59501466 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveSqlParser.scala --- @@ -488,7 +488,7 @@ class HiveSqlAstBuilder extends

[GitHub] spark pull request: [SPARK-14388][SQL] Implement CREATE TABLE

2016-04-12 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12271#discussion_r59445656 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveSqlParser.scala --- @@ -121,84 +123,114 @@ class HiveSqlAstBuilder extends

[GitHub] spark pull request: [SPARK-14388][SQL] Implement CREATE TABLE

2016-04-12 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/12271#issuecomment-209086376 LGTM - pending jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-14388][SQL] Implement CREATE TABLE

2016-04-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12271#discussion_r59501698 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveSqlParser.scala --- @@ -435,13 +480,15 @@ class HiveSqlAstBuilder extends

[GitHub] spark pull request: [SPARK-14548][SQL] Support not greater than an...

2016-04-13 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/12316#issuecomment-209244788 I am not nessecarily against this but I find these quite confusing. Why not just write `>=` or `<=`? The PR itself looks pretty solid. --- If your p

[GitHub] spark pull request: [SPARK-14481] [SQL] Issue Exceptions for All U...

2016-04-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12255#discussion_r59054745 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -143,10 +143,10 @@ class SparkSqlAstBuilder extends

[GitHub] spark pull request: [SPARK-14398] [SQL] Audit non-reserved keyword...

2016-04-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12191#discussion_r59036188 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 --- @@ -653,6 +653,7 @@ nonReserved | STATISTICS

[GitHub] spark pull request: [SPARK-14388][SQL][WIP] Implement CREATE TABLE

2016-04-09 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12271#discussion_r59113861 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 --- @@ -271,8 +271,7 @@ createFileFormat

[GitHub] spark pull request: [SPARK-14388][SQL][WIP] Implement CREATE TABLE

2016-04-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12271#discussion_r59132688 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveSqlParser.scala --- @@ -134,82 +136,117 @@ class HiveSqlAstBuilder extends

[GitHub] spark pull request: [SPARK-14388][SQL][WIP] Implement CREATE TABLE

2016-04-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12271#discussion_r59132734 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveSqlParser.scala --- @@ -134,82 +136,117 @@ class HiveSqlAstBuilder extends

[GitHub] spark pull request: [SPARK-14388][SQL][WIP] Implement CREATE TABLE

2016-04-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12271#discussion_r59132476 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveSqlParser.scala --- @@ -134,82 +136,117 @@ class HiveSqlAstBuilder extends

[GitHub] spark pull request: [SPARK-14388][SQL][WIP] Implement CREATE TABLE

2016-04-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12271#discussion_r59132489 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveSqlParser.scala --- @@ -134,82 +136,117 @@ class HiveSqlAstBuilder extends

[GitHub] spark pull request: [SPARK-14388][SQL][WIP] Implement CREATE TABLE

2016-04-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12271#discussion_r59132631 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveSqlParser.scala --- @@ -397,11 +429,28 @@ class HiveSqlAstBuilder extends

[GitHub] spark pull request: [SPARK-14396] [Build] [HOT] Fix compilation ag...

2016-04-06 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/12201#issuecomment-206379394 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-14426][SQL] Merge PerserUtils and Parse...

2016-04-06 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/12199#issuecomment-206210010 Yay! LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-14398] [SQL] Audit non-reserved keyword...

2016-04-06 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/12191#issuecomment-206383005 @bomeng No worries. Please focus on the keywords that are reserved in the ANTLR4 parser, but were not in the ANTLR3 parser. The exception being join keywords

[GitHub] spark pull request: [SPARK-14396] [Build] [HOT] Fix compilation ag...

2016-04-06 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/12201#issuecomment-206380656 Merging to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-4226][SQL] Support Correlated Sub-queri...

2016-04-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12306#discussion_r59289073 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -665,7 +665,7 @@ class Analyzer( def apply

[GitHub] spark pull request: [SPARK-4226][SQL] Support Correlated Sub-queri...

2016-04-11 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/12306 [SPARK-4226][SQL] Support Correlated Sub-queries ### What changes were proposed in this pull request? This PR adds support for correlated subqueries to Spark. Correlated sub-queries

[GitHub] spark pull request: [SPARK-13934][SQL] Fixed table name parsing

2016-03-19 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11762#discussion_r56330360 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/CatalystQlSuite.scala --- @@ -171,6 +171,7 @@ class CatalystQlSuite extends

[GitHub] spark pull request: [SPARK-13325][SQL] Create a 64-bit hashcode ex...

2016-03-22 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11209#discussion_r56971763 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/misc.scala --- @@ -423,6 +345,121 @@ case class Murmur3Hash(children

[GitHub] spark pull request: [SPARK-13325][SQL] Create a 64-bit hashcode ex...

2016-03-22 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11209#discussion_r56972303 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/HashByteArrayBenchmark.scala --- @@ -0,0 +1,145 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-13579][build][wip][test-maven] Stop bui...

2016-03-23 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11796#discussion_r57238010 --- Diff: sql/hive/pom.xml --- @@ -238,36 +238,13 @@ v${hive.version.short}/src/main/scala

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-23 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57226227 --- Diff: LICENSE --- @@ -238,6 +238,7 @@ The text of each license is also included at licenses/LICENSE-[project].txt. (BSD 3 Clause) netlib

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-23 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57226156 --- Diff: project/plugins.sbt --- @@ -23,3 +23,9 @@ libraryDependencies += "org.ow2.asm" % "asm" % "5.0.3" libra

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-23 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/11557#issuecomment-200527025 @cloud-fan I have created a gist of the generated files: https://gist.github.com/hvanhovell/2ee2149efd6cab79e880 --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-13325][SQL] Create a 64-bit hashcode ex...

2016-03-23 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/11209#issuecomment-200516145 Thanks for the review! merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-22 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57077678 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/ng/AstBuilder.scala --- @@ -0,0 +1,1450 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-14086][SQL] Add DDL commands to ANTLR4 ...

2016-03-22 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/11905 [SPARK-14086][SQL] Add DDL commands to ANTLR4 Parser [WIP] ## What changes were proposed in this pull request? This PR is built on top of https://github.com/apache/spark/pull/11557

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-22 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57077787 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/dsl/package.scala --- @@ -161,6 +161,10 @@ package object dsl { def lower(e

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-23 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57149953 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/CatalystQlSuite.scala --- @@ -21,15 +21,18 @@ import

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-23 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57149320 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/ng/SqlBase.g4 --- @@ -0,0 +1,742 @@ +/* + * Licensed under

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-23 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57147327 --- Diff: project/plugins.sbt --- @@ -23,3 +23,9 @@ libraryDependencies += "org.ow2.asm" % "asm" % "5.0.3" libra

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-24 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57354160 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ng/ExpressionParserSuite.scala --- @@ -0,0 +1,494 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-14119][SPARK-14120][SPARK-14122][SQL] T...

2016-03-26 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/11948#issuecomment-201755230 @andrewor14 I thought we passed these on to Hive and would execute these for us. Is this not working at? As for better messaging: You could do some

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-23 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/11557#issuecomment-200368863 @srowen thanks for the heads-up. I'll add an entry to `LICENSE`. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-23 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57168260 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SessionState.scala --- @@ -80,7 +80,7 @@ private[sql] class SessionState(ctx: SQLContext

[GitHub] spark pull request: [SPARK-13427][SQL] Support USING clause in JOI...

2016-03-19 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11297#discussion_r56426148 --- Diff: sql/catalyst/src/main/antlr3/org/apache/spark/sql/catalyst/parser/FromClauseParser.g --- @@ -91,10 +91,17 @@ fromClause joinSource

[GitHub] spark pull request: [SPARK-12789]Support order by index and group ...

2016-03-19 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/10731#issuecomment-198032884 GROUP BY position is supported by a few major analytical databases: Terradata & Netezza I am not sure if you should even allow the combination of a `SE

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-24 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57278951 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ng/PlanParserSuite.scala --- @@ -0,0 +1,408 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-24 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57279440 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ng/ExpressionParserSuite.scala --- @@ -0,0 +1,494 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-24 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57279420 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ng/ExpressionParserSuite.scala --- @@ -0,0 +1,494 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-24 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57279657 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ng/PlanParserSuite.scala --- @@ -0,0 +1,408 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-24 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57279846 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ng/PlanParserSuite.scala --- @@ -0,0 +1,408 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13934][SQL] fixed table identifier

2016-03-24 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/11929#issuecomment-200699057 @wangyang1992 what is the problem with using backticks? I am not really in favor of backporting features. --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-24 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57279097 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ng/ExpressionParserSuite.scala --- @@ -0,0 +1,494 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-24 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57279041 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-24 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57279310 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ng/ExpressionParserSuite.scala --- @@ -0,0 +1,494 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-24 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57279658 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ng/PlanParserSuite.scala --- @@ -0,0 +1,408 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13934][SQL] fixed table identifier

2016-03-24 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11929#discussion_r57280163 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/AbstractSparkSQLParser.scala --- @@ -129,7 +129,7 @@ class SqlLexical extends

[GitHub] spark pull request: [SPARK-14086][SQL] Add DDL commands to ANTLR4 ...

2016-03-24 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/11905#issuecomment-200699373 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-24 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r57281018 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ng/PlanParserSuite.scala --- @@ -0,0 +1,408 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r55195410 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r55195499 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -1953,7 +1954,6 @@ object functions extends LegacyFunctions

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r55185915 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/ng/AstBuilder.scala --- @@ -0,0 +1,1128 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r55195847 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/JoinSuite.scala --- @@ -331,8 +331,8 @@ class JoinSuite extends QueryTest with SharedSQLContext

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r55186195 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/ng/ParseDriver.scala --- @@ -0,0 +1,205 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r55185301 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/ng/AstBuilder.scala --- @@ -0,0 +1,1128 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r55195953 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/ng/AstBuilder.scala --- @@ -0,0 +1,1128 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11573#discussion_r55334443 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AlterTableCommandParser.scala --- @@ -0,0 +1,410 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11573#discussion_r55352952 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkQl.scala --- @@ -64,6 +85,53 @@ private[sql] class SparkQl(conf: ParserConf

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11573#discussion_r55332214 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkQl.scala --- @@ -64,6 +85,53 @@ private[sql] class SparkQl(conf: ParserConf

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11573#discussion_r55335079 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AlterTableCommandParser.scala --- @@ -0,0 +1,410 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11573#discussion_r55335131 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AlterTableCommandParser.scala --- @@ -0,0 +1,410 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11573#discussion_r55336099 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AlterTableCommandParser.scala --- @@ -0,0 +1,410 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11573#discussion_r55337949 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -0,0 +1,197 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11573#discussion_r5511 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkQl.scala --- @@ -64,6 +85,53 @@ private[sql] class SparkQl(conf: ParserConf

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11573#discussion_r55333881 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AlterTableCommandParser.scala --- @@ -0,0 +1,410 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11573#discussion_r55333529 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AlterTableCommandParser.scala --- @@ -0,0 +1,410 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11573#discussion_r55335240 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AlterTableCommandParser.scala --- @@ -0,0 +1,410 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11573#discussion_r55336439 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AlterTableCommandParser.scala --- @@ -0,0 +1,410 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11573#discussion_r55336977 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AlterTableCommandParser.scala --- @@ -0,0 +1,410 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11573#discussion_r55337179 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/bucket.scala --- @@ -29,7 +32,8 @@ package

[GitHub] spark pull request: [SPARK-12727][SQL] support SQL generation for ...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/11579#issuecomment-193810297 This seems like the most sensible approach in order to get SQL generation working. In the initial implementation we applied the multi-distinct rewriter during

[GitHub] spark pull request: [SPARK-13637][SQL] use more information to sim...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/11485#issuecomment-193811516 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11557#discussion_r55368124 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/JoinSuite.scala --- @@ -331,8 +331,8 @@ class JoinSuite extends QueryTest with SharedSQLContext

[GitHub] spark pull request: [SPARK-13633] [SQL] Move things into catalyst....

2016-03-03 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/11506#issuecomment-192116711 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-13535] [SQL] Fix Analysis Exceptions wh...

2016-03-02 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/11415#issuecomment-191454136 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-13535] [SQL] Fix Analysis Exceptions wh...

2016-03-02 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/11415#issuecomment-191455100 Merging this to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-13637][SQL] use more information to sim...

2016-03-02 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11485#discussion_r54842640 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicOperators.scala --- @@ -473,41 +473,44 @@ private[sql] object

[GitHub] spark pull request: [SPARK-13637][SQL] use more information to sim...

2016-03-02 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11485#discussion_r54843612 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicOperators.scala --- @@ -473,41 +473,44 @@ private[sql] object

[GitHub] spark pull request: [SPARK-13637][SQL] use more information to sim...

2016-03-03 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11485#discussion_r54940911 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicOperators.scala --- @@ -473,41 +473,44 @@ private[sql] object

[GitHub] spark pull request: [SPARK-13637][SQL] use more information to sim...

2016-03-03 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11485#discussion_r54940996 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicOperators.scala --- @@ -473,41 +473,44 @@ private[sql] object

[GitHub] spark pull request: [SPARK-13657] [SQL] Support parsing very long ...

2016-03-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11501#discussion_r55246967 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/CatalystQl.scala --- @@ -661,6 +664,36 @@ https://cwiki.apache.org

[GitHub] spark pull request: [SPARK-13689] [SQL] Move helper things in Cata...

2016-03-07 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/11529#issuecomment-193487536 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-07 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/11557 [SPARK-13713][SQL] Migrate parser from ANTLR3 to ANTLR4 [WIP] ### What changes were proposed in this pull request? The current ANTLR3 parser is quite complex to maintain and suffers from

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-07 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/11557#issuecomment-193182056 cc @rxin @davies @andrewor14 @viirya This will probably fail unit tests. --- If your project is set up for it, you can reply to this email and have your

<    5   6   7   8   9   10   11   12   13   14   >