[
https://issues.apache.org/jira/browse/SPARK-61634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-61634.
-----------------------------------
Resolution: Fixed
Issue resolved by pull request 639
[https://github.com/apache/spark-connect-rust/pull/639]
> Connect Rust: implement native ML feature stages
> ------------------------------------------------
>
> Key: SPARK-61634
> URL: https://issues.apache.org/jira/browse/SPARK-61634
> Project: Spark
> Issue Type: Improvement
> Components: Connect
> Affects Versions: connect-rust-4.3.0
> Reporter: Ruifeng Zheng
> Assignee: Ruifeng Zheng
> Priority: Major
> Labels: pull-request-available
> Fix For: connect-rust-4.3.0
>
>
> Add native Rust and Python execution for all 38 standard pyspark.ml.feature
> estimators and transformers, following standard pyspark.ml over Spark
> Connect. Add 34 missing Rust stages and complete the existing four, with
> constructor parameters, named setters, server-backed fit/transform and
> cached-model ownership. Expose all stages in the native Python feature
> namespace, including standard Spark DataFrame-only scalers. Validate with
> official PySpark 4.3.0 parameter fixtures and live output tests for all
> stages. Specialized model inspection, persistence, LSH similarity methods and
> pipeline/tuning execution remain separate.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]