[
https://issues.apache.org/jira/browse/SPARK-62039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-62039:
-----------------------------------
Labels: pull-request-available (was: )
> Split the Rust migration notes into the 4.3 line and the unreleased 4.4 line,
> and qualify the claim that the Rust API mirrors PySpark's surface
> -----------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-62039
> URL: https://issues.apache.org/jira/browse/SPARK-62039
> Project: Spark
> Issue Type: Improvement
> Components: Connect
> Affects Versions: 5.0.0
> Reporter: Hyukjin Kwon
> Priority: Major
> Labels: pull-request-available
>
> docs/compatibility.md's "Rust migration for the 4.3 line" mixes what v4.3.0
> shipped with the Rust-API changes made after v4.3.0 (tagged 2026-11-16),
> which ship in 4.4.0, and some of its 4.3-line passages state what is no
> longer true of v4.3.0's API (the interval map keys, the new Value variants,
> the Pipeline stages). The docs also say that the native Rust API mirrors the
> same surface as PySpark's, which overstates it.
> Split the section into the 4.3 line, at v4.3.0's meaning with its
> corrections, and a "Rust migration for the 4.4 line (unreleased)" of every
> Rust-API change since v4.3.0, and qualify the surface claim with the APIs
> that need Python itself (of Python functions, pandas or Python's implicit
> session).
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]