GitHub user uzadude opened a pull request:
https://github.com/apache/spark/pull/22964
[SPARK-25963] Optimize generate followed by window
## What changes were proposed in this pull request?
I've added an optimizer rule to add Repartition operator when we have a
Generate operator followed by a Window function
## How was this patch tested?
I've added a plan unittest
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/uzadude/spark
RepartitionBeforeGenerateandWindow
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22964.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22964
----
commit f722cb379b148a4062c14737b920fb8489093a6f
Author: oraviv <oraviv@...>
Date: 2018-11-07T12:13:44Z
added Optimizer rule and test
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
