Hyukjin Kwon created SPARK-61713:
------------------------------------

             Summary: Add PySpark's Params API, typed models and persistence to 
the native FPGrowth, PrefixSpan and ALS
                 Key: SPARK-61713
                 URL: https://issues.apache.org/jira/browse/SPARK-61713
             Project: Spark
          Issue Type: Improvement
          Components: Connect
    Affects Versions: connect-rust-4.3.0
            Reporter: Hyukjin Kwon


Part of completing the native ML classes of pyspark.ml.connect to the full 
pyspark.ml 4.3.0 surface, after the PyO3 base (SPARK-61697).

The native FPGrowth, PrefixSpan and ALS get PySpark's API of pyspark.ml.fpm and 
pyspark.ml.recommendation:
- FPGrowth and ALS: the Params API, setParams, fitMultiple, param maps, and 
save and load;
- FPGrowthModel (freqItemsets, associationRules) and ALSModel (rank, 
userFactors, itemFactors, the recommendations): typed models of their members, 
their setters, the defaults of their estimators, and save and load;
- PrefixSpan: the Params API, as a class of Params;
- the use of a fitted model with a DataFrame of another session follows 
PySpark's (the error of a transform is the server's, of its collect), instead 
of an eager error of the client.




--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to