Ruifeng Zheng created SPARK-61634:
-------------------------------------
Summary: Connect Rust: implement native ML feature stages
Key: SPARK-61634
URL: https://issues.apache.org/jira/browse/SPARK-61634
Project: Spark
Issue Type: Improvement
Components: Connect
Affects Versions: connect-rust-4.3.0
Reporter: Ruifeng Zheng
Add native Rust and Python execution for all 38 standard pyspark.ml.feature
estimators and transformers, following standard pyspark.ml over Spark Connect.
Add 34 missing Rust stages and complete the existing four, with constructor
parameters, named setters, server-backed fit/transform and cached-model
ownership. Expose all stages in the native Python feature namespace, including
standard Spark DataFrame-only scalers. Validate with official PySpark 4.3.0
parameter fixtures and live output tests for all stages. Specialized model
inspection, persistence, LSH similarity methods and pipeline/tuning execution
remain separate.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]