Ruifeng Zheng created SPARK-61784:
-------------------------------------

             Summary: Support configurable intermediate storage levels in 
GaussianMixture
                 Key: SPARK-61784
                 URL: https://issues.apache.org/jira/browse/SPARK-61784
             Project: Spark
          Issue Type: Improvement
          Components: ML
    Affects Versions: 5.0.0
            Reporter: Ruifeng Zheng


GaussianMixture currently persists its training instances with a hard-coded 
MEMORY_AND_DISK storage level when the input dataset is not already cached.

Expose the existing intermediateStorageLevel parameter in the Scala and PySpark 
GaussianMixture APIs so users can choose another supported storage level for 
these intermediate instances. Keep MEMORY_AND_DISK as the default and preserve 
the existing behavior for cached input datasets.

Include PySpark constructor, setParams, and setter support, and extend the 
existing Scala and Python tests.




--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to