wuyi created SPARK-35454: ---------------------------- Summary: Ambiguous self-join doesn't fail after transfroming the dataset to dataframe Key: SPARK-35454 URL: https://issues.apache.org/jira/browse/SPARK-35454 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 3.1.1, 3.1.0 Reporter: wuyi
{code:java} test("SPARK-28344: fail ambiguous self join - Dataset.colRegex as column ref") { val df1 = spark.range(3) val df2 = df1.filter($"id" > 0) withSQLConf( SQLConf.FAIL_AMBIGUOUS_SELF_JOIN_ENABLED.key -> "true", SQLConf.CROSS_JOINS_ENABLED.key -> "true") { assertAmbiguousSelfJoin(df1.join(df2, df1.colRegex("id") > df2.colRegex("id"))) } } {code} For this unit test, if we append `.toDF()` to both df1 and df2, the query won't fail. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org