Wenli Looi created SPARK-40117: ---------------------------------- Summary: Convert condition to java in DataFrameWriterV2.overwrite Key: SPARK-40117 URL: https://issues.apache.org/jira/browse/SPARK-40117 Project: Spark Issue Type: Bug Components: PySpark, SQL Affects Versions: 3.2.2, 3.3.0, 3.1.3 Reporter: Wenli Looi
DataFrameWriterV2.overwrite() fails to convert the condition parameter to java. This prevents the function from being called. It is caused by the following commit that deleted the `_to_java_column` call instead of fixing it: [https://github.com/apache/spark/commit/a1e459ed9f6777fb8d5a2d09fda666402f9230b9] -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org