[
https://issues.apache.org/jira/browse/SPARK-61717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-61717:
---------------------------------
Fix Version/s: connect-rust-4.3.0
> Add PySpark's Params API, typed models and persistence to the native feature
> estimators and their models
> --------------------------------------------------------------------------------------------------------
>
> Key: SPARK-61717
> URL: https://issues.apache.org/jira/browse/SPARK-61717
> Project: Spark
> Issue Type: Improvement
> Components: Connect
> Affects Versions: connect-rust-4.3.0
> Reporter: Hyukjin Kwon
> Priority: Major
> Fix For: connect-rust-4.3.0
>
>
> Part of completing the native ML classes of pyspark.ml.connect to the full
> pyspark.ml 4.3.0 surface, after the feature transformers (SPARK-61710).
> The 20 native feature estimators and their 19 typed models get PySpark's API
> of pyspark.ml.feature:
> - the Params API, every getter and setter, setParams, fitMultiple and param
> maps;
> - the typed models of their members: the LSH joins and nearest neighbours,
> Word2Vec's vectors and synonyms, the category maps of VectorIndexerModel,
> from_vocabulary, from_labels and from_arrays_of_labels;
> - QuantileDiscretizer, whose fit is a Bucketizer of a new uid, as PySpark's;
> - write, save, read and load, as RemoteMLWriter and RemoteMLReader save and
> load them.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]