Ruifeng Zheng created SPARK-61076:
-------------------------------------
Summary: Accept intermediate storage level keyword arguments in
PySpark KMeans
Key: SPARK-61076
URL: https://issues.apache.org/jira/browse/SPARK-61076
Project: Spark
Issue Type: Bug
Components: ML
Affects Versions: 5.0.0
Reporter: Ruifeng Zheng
PySpark KMeans exposes intermediateStorageLevel through a shared parameter and
setIntermediateStorageLevel, but does not accept it in __init__ or setParams.
KMeans(intermediateStorageLevel="DISK_ONLY") and
KMeans().setParams(intermediateStorageLevel="DISK_ONLY") therefore raise
TypeError.
Add the keyword to both Python API signatures and their documentation,
preserving MEMORY_AND_DISK as the default. Extend the existing KMeans test to
cover the default, constructor configuration, setParams updates, and
propagation to the fitted model.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]