Yuming Wang created SPARK-47459:
-----------------------------------
Summary: Cancel running stage if the result is empty relation
Key: SPARK-47459
URL: https://issues.apache.org/jira/browse/SPARK-47459
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.5.1
Reporter: Yuming Wang
Attachments: task stack trace.png
How to reproduce:
bin/spark-sql --master yarn --conf spark.driver.host=10.211.174.53
{code:sql}
set spark.sql.adaptive.enabled=true;
select a from (select id as a, id as b, id as z from range(100000000)) t1
join (select id as c, id as d from range(200000000)) t2 on t1.a = t2.c
join (select id as e, id as f from range(300000000)) t3 on t2.d = t3.e
where z % 10 < 0
group by 1;
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
