[jira] [Commented] (SPARK-33070) Optimizer rules for HigherOrderFunctions
[ https://issues.apache.org/jira/browse/SPARK-33070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17254910#comment-17254910 ] Apache Spark commented on SPARK-33070: -- User 'tanelk' has created a pull request for this issue: https://github.com/apache/spark/pull/30930 > Optimizer rules for HigherOrderFunctions > > > Key: SPARK-33070 > URL: https://issues.apache.org/jira/browse/SPARK-33070 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.2.0 >Reporter: Tanel Kiis >Priority: Minor > > SimpleHigherOrderFunction like ArrayTransform, ArrayFilter, etc, can be > combined and reordered to achieve more optimal plan. > Possible rules: > * Combine 2 consecutive array transforms > * Combine 2 consecutive array filters > * Push array filter through array sort > * Remove array sort before array exists and array forall. > * Combine 2 consecutive map filters -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-33070) Optimizer rules for HigherOrderFunctions
[ https://issues.apache.org/jira/browse/SPARK-33070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17254909#comment-17254909 ] Apache Spark commented on SPARK-33070: -- User 'tanelk' has created a pull request for this issue: https://github.com/apache/spark/pull/30930 > Optimizer rules for HigherOrderFunctions > > > Key: SPARK-33070 > URL: https://issues.apache.org/jira/browse/SPARK-33070 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.2.0 >Reporter: Tanel Kiis >Priority: Minor > > SimpleHigherOrderFunction like ArrayTransform, ArrayFilter, etc, can be > combined and reordered to achieve more optimal plan. > Possible rules: > * Combine 2 consecutive array transforms > * Combine 2 consecutive array filters > * Push array filter through array sort > * Remove array sort before array exists and array forall. > * Combine 2 consecutive map filters -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
