[GitHub] spark pull request #17175: [SPARK-19468][SQL][WIP] Rewrite physical Project ...

2017-03-12 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17175#discussion_r105584772 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryTableScanExec.scala --- @@ -42,10 +42,34 @@ case class InMemoryTableScanEx

[GitHub] spark pull request #17175: [SPARK-19468][SQL][WIP] Rewrite physical Project ...

2017-03-11 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17175#discussion_r105529199 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryTableScanExec.scala --- @@ -42,10 +42,34 @@ case class InMemoryTableScanEx

[GitHub] spark pull request #17175: [SPARK-19468][SQL][WIP] Rewrite physical Project ...

2017-03-10 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17175#discussion_r105517336 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryTableScanExec.scala --- @@ -42,10 +42,34 @@ case class InMemoryTableScanEx

[GitHub] spark pull request #17175: [SPARK-19468][SQL][WIP] Rewrite physical Project ...

2017-03-10 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17175#discussion_r105463771 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryTableScanExec.scala --- @@ -42,10 +42,34 @@ case class InMemoryTableSca

[GitHub] spark pull request #17175: [SPARK-19468][SQL][WIP] Rewrite physical Project ...

2017-03-06 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/17175 [SPARK-19468][SQL][WIP] Rewrite physical Project operator's output partitioning and ordering to ensure no unnecessary shuffle/sort in Datasets ## What changes were proposed in this pull request?