Hi Community,

I get the following error when using Spark Connect in PySpark 3.5.1
and writing with DataFrameWriterV2.overwrite.

```
> df.writeTo('db.table').overwrite(F.col('id')==F.lit(1))
...
SparkConnectGrpcException:
(org.apache.spark.sql.connect.common.InvalidPlanInput) Expression with
ID: 0 is not supported
```

I believe this is caused by the following code:
https://github.com/apache/spark/blob/6e371e1df50e35d807065015525772c3c02a5995/python/pyspark/sql/connect/plan.py#L1760-L1763

Is there a JIRA issue or PR regarding this error?
If not, create one.

Thanks,
Toki Takahashi

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Reply via email to