Toki Takahashi,
Thanks for reporting this, I created
https://issues.apache.org/jira/browse/SPARK-47828 to track this bug.
I will take a look.
On Thu, Apr 11, 2024 at 10:11 PM Toki Takahashi <thstyanst...@gmail.com>
wrote:
> Hi Community,
>
> I get the following error when using Spark Connect in PySpark 3.5.1
> and writing with DataFrameWriterV2.overwrite.
>
> ```
> > df.writeTo('db.table').overwrite(F.col('id')==F.lit(1))
> ...
> SparkConnectGrpcException:
> (org.apache.spark.sql.connect.common.InvalidPlanInput) Expression with
> ID: 0 is not supported
> ```
>
> I believe this is caused by the following code:
>
> https://github.com/apache/spark/blob/6e371e1df50e35d807065015525772c3c02a5995/python/pyspark/sql/connect/plan.py#L1760-L1763
>
> Is there a JIRA issue or PR regarding this error?
> If not, create one.
>
> Thanks,
> Toki Takahashi
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>
--
Ruifeng Zheng
E-mail: zrfli...@gmail.com
