Github user tejasapatil commented on a diff in the pull request:
https://github.com/apache/spark/pull/16985#discussion_r101905768
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala
---
@@ -33,8 +33,8 @@ import org.apache.spark.util.collection.BitSet
* Performs a sort merge join of two child relations.
*/
case class SortMergeJoinExec(
- leftKeys: Seq[Expression],
- rightKeys: Seq[Expression],
+ var leftKeys: Seq[Expression],
--- End diff --
This seems ugly but I can't think of a better way. The problem is: I want
to mutate this ordering at some point in the query planning. I cannot do that
when `SortMergeJoinExec` object is generated because there wont be ample
information available at that time.
I tried to add class attributes which would be altered and don't mutate
this. Doing that, I saw that that tasks on executor do not see the updated
values of the local class attributes.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
