Allison Wang created SPARK-35545: ------------------------------------ Summary: Split SubqueryExpression's children field into outer attributes and join conditions Key: SPARK-35545 URL: https://issues.apache.org/jira/browse/SPARK-35545 Project: Spark Issue Type: Task Components: SQL Affects Versions: 3.2.0 Reporter: Allison Wang
Currently the children field of a subquery expression is used to store both collected outer references inside the subquery plan, and also join conditions after correlated predicates are pulled up. For example SELECT (SELECT max(c1) FROM t1 WHERE t1.c1 = t2.c1) FROM t2 After analysis phase: scalar-subquery [t2.c1] After PullUpCorrelatedPredicates: scalar-subquery [t1.c1 = t2.c1] The references for a subquery expressions is also confusing: override lazy val references: AttributeSet = if (plan.resolved) super.references -- plan.outputSet else super.references We should split this children field into outer attribute references and join conditions. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org