[ https://issues.apache.org/jira/browse/SPARK-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636546#comment-14636546 ]
Apache Spark commented on SPARK-9083: ------------------------------------- User 'cloud-fan' has created a pull request for this issue: https://github.com/apache/spark/pull/7593 > If order by clause has non-deterministic expressions, we should add a project > to materialize results of these expressions > -------------------------------------------------------------------------------------------------------------------------- > > Key: SPARK-9083 > URL: https://issues.apache.org/jira/browse/SPARK-9083 > Project: Spark > Issue Type: Sub-task > Components: SQL > Reporter: Yin Huai > Assignee: Wenchen Fan > > When a order by clause has a non-deterministic expression, we actually > evaluate it twice, once in the exchange operator when we try to figure out > the range partitioner's boundaries and once in the sort operator. We should > use a project to materialize the result first. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org