[GitHub] spark issue #13604: [SPARK-15856][SQL] Revert API breaking changes made in D...

2016-06-10 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13604 I'd prefer change `SparkSession.range`'s return type to `Dataset[Row]` for better consistency, also there's an annoying nullability issue regarding to `Dataset[java.lang.Long]` (boxed types

[GitHub] spark issue #13496: [SPARK-15753][SQL] Move Analyzer stuff to Analyzer from ...

2016-06-10 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13496 LGTM, merging to master and branch-2.0. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-10 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/12836 @NarineK @shivaram Sorry for the late reply. Overriding `stringArgs` is the correct solution for this issue. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #13592: [SPARK-15863][SQL][DOC] Initial SQL programming g...

2016-06-10 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/13592 [SPARK-15863][SQL][DOC] Initial SQL programming guide update for Spark 2.0 ## What changes were proposed in this pull request? Initial SQL programming guide update for Spark 2.0

[GitHub] spark issue #13535: [SPARK-15792][SQL] Allows operator to change the verbosi...

2016-06-06 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13535 LGTM, merging to master and branch-2.0. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #13529: [SPARK-15632][SQL]Typed Filter should NOT change the Dat...

2016-06-06 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13529 Merging to master and branch-2.0. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #13529: [SPARK-15632][SQL]Typed Filter should NOT change the Dat...

2016-06-06 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13529 @cloud-fan I think we can also disable `EmbedSerializerInFilter` now? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #13529: [SPARK-15632][SQL]Typed Filter should NOT change the Dat...

2016-06-06 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13529 LGTM except for a minor comment, and pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #13529: [SPARK-15632][SQL]Typed Filter should NOT change ...

2016-06-06 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13529#discussion_r65991558 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/TypedFilterOptimizationSuite.scala --- @@ -57,7 +57,9 @@ class

[GitHub] spark issue #13535: [SPARK-15792][SQL] Allows operator to change the verbosi...

2016-06-06 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13535 The PR description says the verbosity mark affects output of "physical plan", but actually only aggregate operators are affected. Please correct the PR description and add that expl

[GitHub] spark pull request #13535: [SPARK-15792][SQL] Allows operator to change the ...

2016-06-06 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13535#discussion_r65987602 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala --- @@ -190,6 +190,9 @@ abstract class Expression

[GitHub] spark issue #13529: [SPARK-15632][SQL]Typed Filter should NOT change the Dat...

2016-06-06 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13529 @rxin By "ignore" did you mean remove the rule from the batch but keep the code lines of the rule? --- If your project is set up for it, you can reply to this email and have your re

[GitHub] spark pull request #13535: [SPARK-15792][SQL] Allows operator to change the ...

2016-06-06 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13535#discussion_r65986824 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/QueryExecution.scala --- @@ -201,24 +201,26 @@ class QueryExecution(val sparkSession

[GitHub] spark pull request #13529: [SPARK-15632][SQL]Typed Filter should NOT change ...

2016-06-06 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13529#discussion_r65986359 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1961,11 +1961,11 @@ class Dataset[T] private[sql

[GitHub] spark pull request #13529: [SPARK-15632][SQL]Typed Filter should NOT change ...

2016-06-06 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13529#discussion_r65986406 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1961,11 +1961,11 @@ class Dataset[T] private[sql

[GitHub] spark issue #13401: [SPARK-15657][SQL] RowEncoder should validate the data t...

2016-06-05 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13401 LGTM, merging to master and branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13469: [SPARK-15140][SQL] make the semantics of null input obje...

2016-06-03 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13469 Merging to master and branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13474: [SPARK-15547][SQL] nested case class in encoder can have...

2016-06-03 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13474 Merging to master and branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13469: [SPARK-15140][SQL] make the semantics of null input obje...

2016-06-03 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13469 LGTM pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-03 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13269 So there will be a follow-up for replacing `BoundReference` in serializer expressions with `GetColumnByOrdinal`, right? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request #13469: [SPARK-15140][SQL] make the semantics of null inp...

2016-06-03 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13469#discussion_r65751003 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -519,7 +519,7 @@ case class

[GitHub] spark issue #13474: [SPARK-15547][SQL] nested case class in encoder can have...

2016-06-03 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13474 LGTM pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-03 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13269 Merging to master and branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13469: [SPARK-15140][SQL] make the semantics of null input obje...

2016-06-03 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13469 Let's wait for #13269 first. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13474: [SPARK-15547][SQL] nested case class in encoder can have...

2016-06-03 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13474 Let's wait for #13269 first. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13463: [SPARK-14959][SQL] handle partitioned table directories ...

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13463 LGTM, merging to master and branch-2.0. Thanks for fixing this! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #13470: [SPARK-15733][SQL] Makes the explain output less verbose...

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13470 Merging to master and branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13269 Just rebased this branch. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13485: [SPARK-15732][SQL] better error message when use java re...

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13485 Merging to master and branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #13485: [SPARK-15732][SQL] better error message when use ...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13485#discussion_r65644479 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala --- @@ -582,6 +582,11 @@ object ScalaReflection extends

[GitHub] spark issue #13474: [SPARK-15547][SQL] nested case class in encoder can have...

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13474 LGTM, but shall we merge #13269 first? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13469: [SPARK-15140][SQL] make the semantics of null input obje...

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13469 LGTM except for minor comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #13469: [SPARK-15140][SQL] make the semantics of null inp...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13469#discussion_r65643574 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -519,7 +519,7 @@ case class

[GitHub] spark pull request #13469: [SPARK-15140][SQL] make the semantics of null inp...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13469#discussion_r65643583 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -675,7 +675,7 @@ case class AssertNotNull

[GitHub] spark pull request #13469: [SPARK-15140][SQL] make the semantics of null inp...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13469#discussion_r65643344 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/ExpressionEncoder.scala --- @@ -52,8 +52,15 @@ object ExpressionEncoder

[GitHub] spark issue #13470: [SPARK-15733][SQL] Makes the explain output less verbose...

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13470 ... pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13470: [SPARK-15733][SQL] Makes the explain output less verbose...

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13470 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #13485: [SPARK-15732][SQL] better error message when use java re...

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13485 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #11632: [SPARK-13801][SQL] DataFrame.col should return unresolve...

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/11632 Shall we close this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13269#discussion_r65638928 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1884,10 +1884,63 @@ class Analyzer

[GitHub] spark pull request #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13269#discussion_r65638864 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1884,10 +1884,63 @@ class Analyzer

[GitHub] spark pull request #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13269#discussion_r65639249 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/ExpressionEncoder.scala --- @@ -191,6 +189,26 @@ case class

[GitHub] spark pull request #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13269#discussion_r65637841 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1884,10 +1884,63 @@ class Analyzer

[GitHub] spark pull request #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13269#discussion_r65637799 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1884,10 +1884,63 @@ class Analyzer

[GitHub] spark pull request #13470: [SPARK-15733][SQL] Makes the explain output less ...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13470#discussion_r65636002 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -427,13 +427,20 @@ abstract class TreeNode[BaseType

[GitHub] spark issue #13471: [SPARK-15734][SQL] Avoids printing internal row in expla...

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13471 Merging to master and branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13455: [SPARK-15719][SQL] Disables writing Parquet summary file...

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13455 Merging to master and branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USING AS S...

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13451 @andrewor14 Could you please help sign off this one? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #13471: [SPARK-15734][SQL] Avoids printing internal row i...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13471#discussion_r65613435 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LocalRelation.scala --- @@ -57,7 +57,13 @@ case class LocalRelation

[GitHub] spark pull request #13463: [SPARK-14959][SQL] handle partitioned table direc...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13463#discussion_r65612485 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala --- @@ -84,39 +84,12 @@ class ListingFileCatalog

[GitHub] spark pull request #13463: [SPARK-14959][SQL] handle partitioned table direc...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13463#discussion_r65612284 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala --- @@ -84,39 +84,12 @@ class ListingFileCatalog

[GitHub] spark pull request #13463: [SPARK-14959][SQL] handle partitioned table direc...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13463#discussion_r65611847 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala --- @@ -84,39 +84,12 @@ class ListingFileCatalog

[GitHub] spark pull request #13470: [SPARK-15733][SQL] Makes the explain output less ...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13470#discussion_r65610289 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -427,13 +427,21 @@ abstract class TreeNode[BaseType

[GitHub] spark issue #13471: [SPARK-15734][SQL] Avoids printing internal row in expla...

2016-06-02 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13471 LGTM except for minor naming issue. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #13471: [SPARK-15734][SQL] Avoids printing internal row i...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13471#discussion_r65609750 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/LocalTableScanExec.scala --- @@ -48,6 +48,14 @@ private[sql] case class

[GitHub] spark pull request #13471: [SPARK-15734][SQL] Avoids printing internal row i...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13471#discussion_r65609589 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LocalRelation.scala --- @@ -57,7 +57,13 @@ case class LocalRelation

[GitHub] spark pull request #13470: [SPARK-15733][SQL] Makes the explain output less ...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13470#discussion_r65604769 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -427,13 +427,21 @@ abstract class TreeNode[BaseType

[GitHub] spark pull request #13470: [SPARK-15733][SQL] Makes the explain output less ...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13470#discussion_r65604658 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -427,13 +427,21 @@ abstract class TreeNode[BaseType

[GitHub] spark pull request #13470: [SPARK-15733][SQL] Makes the explain output less ...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13470#discussion_r65596454 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -427,13 +427,21 @@ abstract class TreeNode[BaseType

[GitHub] spark pull request #13470: [SPARK-15733][SQL] Makes the explain output less ...

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13470#discussion_r65595938 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -427,13 +427,21 @@ abstract class TreeNode[BaseType

[GitHub] spark pull request #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13269#discussion_r65492813 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1884,10 +1884,62 @@ class Analyzer

[GitHub] spark pull request #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13269#discussion_r65492290 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1884,10 +1884,62 @@ class Analyzer

[GitHub] spark pull request #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-01 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13269#discussion_r65485798 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/Encoders.scala --- @@ -208,7 +209,7 @@ object Encoders { BoundReference(0

[GitHub] spark issue #13290: [SPARK-13484] [SQL] Prevent illegal NULL propagation whe...

2016-06-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13290 Merging to master and branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-01 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13269#discussion_r65460601 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/Encoders.scala --- @@ -208,7 +209,7 @@ object Encoders { BoundReference(0

[GitHub] spark issue #13425: [SPARK-15441][SQL] support null object in Dataset outer-...

2016-06-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13425 LGTM, merging to master and branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13450: [SPARK-9876] [BRANCH-2.0] Revert "[SPARK-9876][SQL] Upda...

2016-06-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13450 Merging to branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13270: [SPARK-15269][SQL] Removes unexpected empty table direct...

2016-06-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13270 Merging to master and branch-2.0. @xwu0226 @yhuai Thanks for the review! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark pull request #13455: [SPARK-15719][SQL] Disables writing Parquet summa...

2016-06-01 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/13455 [SPARK-15719][SQL] Disables writing Parquet summary files by default ## What changes were proposed in this pull request? This PR disables writing Parquet summary files by default (i.e

[GitHub] spark issue #13433: [SPARK-15692][SQL]Improves the explain output of several...

2016-06-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13433 LGTM except for two minor issues, and pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #13433: [SPARK-15692][SQL]Improves the explain output of ...

2016-06-01 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13433#discussion_r65450866 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -467,9 +470,11 @@ abstract class TreeNode[BaseType

[GitHub] spark pull request #13433: [SPARK-15692][SQL]Improves the explain output of ...

2016-06-01 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13433#discussion_r65450329 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -424,9 +424,12 @@ abstract class TreeNode[BaseType

[GitHub] spark issue #13450: [SPARK-9876] [BRANCH-2.0] Revert "[SPARK-9876][SQL] Upda...

2016-06-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13450 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #13280: [SPARK-9876][SQL]: Update Parquet to 1.8.1.

2016-06-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13280 I'm working on verifying the regression using the micro benchmark I did before. Sorry for the troubles. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-14343][SQL] Proper column pruning for text data s...

2016-06-01 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/13431 Thanks for the review! Merging to master and branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-14343][SQL] Proper column pruning for text data s...

2016-05-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13431#discussion_r65305773 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/text/TextFileFormat.scala --- @@ -96,16 +96,23 @@ class TextFileFormat

[GitHub] spark pull request: [SPARK-14343][SQL] Proper column pruning for text data s...

2016-05-31 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/13431 [SPARK-14343][SQL] Proper column pruning for text data source ## What changes were proposed in this pull request? Text data source ignores requested schema, and may give wrong result

[GitHub] spark pull request: [SPARK-13484] [SQL] Prevent illegal NULL propagation whe...

2016-05-31 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/13290 LGTM except for a few minor comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-13484] [SQL] Prevent illegal NULL propagation whe...

2016-05-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13290#discussion_r65283090 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1448,6 +1450,38 @@ class Analyzer

[GitHub] spark pull request: [SPARK-13484] [SQL] Prevent illegal NULL propagation whe...

2016-05-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13290#discussion_r65278189 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1448,6 +1450,38 @@ class Analyzer

[GitHub] spark pull request: [SPARK-13484] [SQL] Prevent illegal NULL propagation whe...

2016-05-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13290#discussion_r65278045 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1448,6 +1450,38 @@ class Analyzer

[GitHub] spark pull request: [SPARK-15269][SQL] Removes unexpected empty table direct...

2016-05-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13270#discussion_r65271869 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala --- @@ -368,14 +371,27 @@ private[hive] class HiveClientImpl

[GitHub] spark pull request: [SPARK-15269][SQL] Removes unexpected empty table direct...

2016-05-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13270#discussion_r65271411 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala --- @@ -368,14 +371,27 @@ private[hive] class HiveClientImpl

[GitHub] spark pull request: [SPARK-15269][SQL] Removes unexpected empty table direct...

2016-05-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13270#discussion_r65271233 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -147,7 +152,41 @@ private[spark] class HiveExternalCatalog

[GitHub] spark pull request: [SPARK-15269][SQL] Removes unexpected empty table direct...

2016-05-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13270#discussion_r65270931 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -68,12 +72,13 @@ private[spark] class HiveExternalCatalog

[GitHub] spark pull request: [SPARK-15269][SQL] Removes unexpected empty ta...

2016-05-30 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13270#discussion_r65123201 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -212,11 +212,46 @@ class SessionCatalog

[GitHub] spark pull request: [SPARK-15112][SQL] Disables EmbedSerializerInF...

2016-05-30 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/13362#issuecomment-222419209 Merging to master and branch-2.0. Thanks for the review! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-9876][SQL]: Update Parquet to 1.8.1.

2016-05-27 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/13280#issuecomment-77051 Great, I'm merging this to master and branch-2.0. Thanks for working on this! --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-15495][SQL]Improve the explain output f...

2016-05-27 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13363#discussion_r64975446 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregate.scala --- @@ -760,16 +760,29 @@ case class TungstenAggregate

[GitHub] spark pull request: [SPARK-15495][SQL]Improve the explain output f...

2016-05-27 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13363#discussion_r64975380 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/SortBasedAggregateExec.scala --- @@ -101,11 +101,23 @@ case class

[GitHub] spark pull request: [SPARK-15495][SQL]Improve the explain output f...

2016-05-27 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13363#discussion_r64975341 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/QueryExecution.scala --- @@ -201,24 +201,26 @@ class QueryExecution(val sparkSession

[GitHub] spark pull request: [SPARK-15495][SQL]Improve the explain output f...

2016-05-27 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13363#discussion_r64974857 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -424,23 +424,50 @@ abstract class TreeNode[BaseType

[GitHub] spark pull request: [SPARK-15495][SQL]Improve the explain output f...

2016-05-27 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13363#discussion_r64974784 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -424,23 +424,50 @@ abstract class TreeNode[BaseType

[GitHub] spark pull request: [SPARK-15495][SQL]Improve the explain output f...

2016-05-27 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13363#discussion_r64974455 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -424,23 +424,50 @@ abstract class TreeNode[BaseType

[GitHub] spark pull request: [SPARK-15495][SQL]Improve the explain output f...

2016-05-27 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13363#discussion_r64974366 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -424,23 +424,50 @@ abstract class TreeNode[BaseType

[GitHub] spark pull request: [SPARK-15495][SQL]Improve the explain output f...

2016-05-27 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13363#discussion_r64974333 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -424,23 +424,50 @@ abstract class TreeNode[BaseType

[GitHub] spark pull request: [SPARK-15495][SQL]Improve the explain output f...

2016-05-27 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/13363#issuecomment-67371 Seems that the examples listed in the PR description is inconsistent with the actual changes? For example, PR description says `count(1)(Partial)` while the actual

[GitHub] spark pull request: [SPARK-15495][SQL]Improve the explain output f...

2016-05-27 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13363#discussion_r64974098 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/interfaces.scala --- @@ -126,7 +126,14 @@ private[sql] case

[GitHub] spark pull request: [SPARK-15112][SQL] Allows query plan schema an...

2016-05-27 Thread liancheng
Github user liancheng closed the pull request at: https://github.com/apache/spark/pull/12952 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: [SPARK-15112][SQL] Allows query plan schema an...

2016-05-27 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/12952#issuecomment-62951 While investigating and fixing this issue, hit several other Dataset / encoder issues along the way, which are included in this umbrella ticket: [SPARK-15631][1

<    2   3   4   5   6   7   8   9   10   11   >