[
https://issues.apache.org/jira/browse/SPARK-24657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763808#comment-16763808
]
Dongjoon Hyun commented on SPARK-24657:
---
Hi, [~wangzjie1], [~maropu], [~taoluo].
I close this
[
https://issues.apache.org/jira/browse/SPARK-24657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763243#comment-16763243
]
Tao Luo commented on SPARK-24657:
-
If SortMergeJoinScanner doesn't consume UnsafeExternalRowSorter
[
https://issues.apache.org/jira/browse/SPARK-24657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762280#comment-16762280
]
Tao Luo commented on SPARK-24657:
-
Just reproduced it in standalone mode using
[
https://issues.apache.org/jira/browse/SPARK-24657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761607#comment-16761607
]
Tao Luo commented on SPARK-24657:
-
Sure:
{code:java}
from pyspark.sql.functions import rand, col
[
https://issues.apache.org/jira/browse/SPARK-24657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760444#comment-16760444
]
Takeshi Yamamuro commented on SPARK-24657:
--
Can you put a simple example query for the issue?
[
https://issues.apache.org/jira/browse/SPARK-24657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760328#comment-16760328
]
Tao Luo commented on SPARK-24657:
-
Nice find. This looks like