[GitHub] spark issue #21447: [SPARK-24339][SQL]Add project for transform/map/reduce s...

2018-07-17 Thread xdcjie
Github user xdcjie commented on the issue: https://github.com/apache/spark/pull/21447 Ok! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

[GitHub] spark pull request #21447: [SPARK-24339][SQL]Add project for transform/map/r...

2018-07-17 Thread xdcjie
Github user xdcjie closed the pull request at: https://github.com/apache/spark/pull/21447 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #21447: [SPARK-24339][SQL]Add project for transform/map/reduce s...

2018-07-16 Thread xdcjie
Github user xdcjie commented on the issue: https://github.com/apache/spark/pull/21447 @HyukjinKwon Our project is based on the branch-2.2, we will merge the patch to local branch manually if it is against master. we prefer following community to local branch. If you don't

[GitHub] spark issue #21447: [SPARK-24339][SQL]Add project for transform/map/reduce s...

2018-07-12 Thread xdcjie
Github user xdcjie commented on the issue: https://github.com/apache/spark/pull/21447 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

[GitHub] spark issue #21447: [SPARK-24339][SQL]Add project for transform/map/reduce s...

2018-07-12 Thread xdcjie
Github user xdcjie commented on the issue: https://github.com/apache/spark/pull/21447 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

[GitHub] spark issue #21447: [SPARK-24339][SQL]Add project for transform/map/reduce s...

2018-07-12 Thread xdcjie
Github user xdcjie commented on the issue: https://github.com/apache/spark/pull/21447 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

[GitHub] spark issue #21447: [SPARK-24339][SQL]Add project for transform/map/reduce s...

2018-06-04 Thread xdcjie
Github user xdcjie commented on the issue: https://github.com/apache/spark/pull/21447 @maropu @gatorsmile Can you help me review this pr ? Thanks。 # --- - To unsubscribe, e-mail: reviews-unsubscr

[GitHub] spark pull request #21447: [SPARK-24339][SQL]Add project for transform/map/r...

2018-05-31 Thread xdcjie
Github user xdcjie commented on a diff in the pull request: https://github.com/apache/spark/pull/21447#discussion_r192068576 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -338,6 +338,17 @@ class AstBuilder(conf: SQLConf

[GitHub] spark issue #21447: [SPARK-24339][SQL]Add project for transform/map/reduce s...

2018-05-30 Thread xdcjie
Github user xdcjie commented on the issue: https://github.com/apache/spark/pull/21447 @maropu @gatorsmile Do you have any comment/suggestion for this PR? Thanks. --- - To unsubscribe, e-mail: reviews-unsubscr

[GitHub] spark issue #21447: [SPARK-24339][SQL]Add project for transform/map/reduce s...

2018-05-29 Thread xdcjie
Github user xdcjie commented on the issue: https://github.com/apache/spark/pull/21447 jenkins, test this, please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail

[GitHub] spark pull request #21447: [SPARK-24339][SQL]Add project for transform/map/r...

2018-05-29 Thread xdcjie
Github user xdcjie commented on a diff in the pull request: https://github.com/apache/spark/pull/21447#discussion_r191330544 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -338,6 +338,17 @@ class AstBuilder(conf: SQLConf

[GitHub] spark pull request #21447: [SPARK-24339][SQL]Add project for transform/map/r...

2018-05-29 Thread xdcjie
Github user xdcjie commented on a diff in the pull request: https://github.com/apache/spark/pull/21447#discussion_r191321436 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -338,6 +338,17 @@ class AstBuilder(conf: SQLConf

[GitHub] spark issue #21447: [SPARK-24339][SQL]Add project for transform/map/reduce s...

2018-05-29 Thread xdcjie
Github user xdcjie commented on the issue: https://github.com/apache/spark/pull/21447 @maropu I updated the commet. In summary, with this pr can reduce the time of scan and assemble data. In our scenario, the relation(table) have 700 columns

[GitHub] spark pull request #21447: [SPARK-24339][SQL]Add project for transform/map/r...

2018-05-29 Thread xdcjie
GitHub user xdcjie opened a pull request: https://github.com/apache/spark/pull/21447 [SPARK-24339][SQL]Add project for transform/map/reduce sql to prune column ## What changes were proposed in this pull request? Transform query do not have Project Node, so that it will scan