[
https://issues.apache.org/jira/browse/SPARK-17448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15474374#comment-15474374
]
Sean Owen commented on SPARK-17448:
-----------------------------------
That's true in a thousand contexts: if you make an array that's too big you run
out of memory.
There's no real way to know what the limit of k is. The error is appropriate
and clear. I don't see a change to make here.
> There should a limit of k in mllib.Kmeans
> -----------------------------------------
>
> Key: SPARK-17448
> URL: https://issues.apache.org/jira/browse/SPARK-17448
> Project: Spark
> Issue Type: Bug
> Components: MLlib
> Affects Versions: 2.0.0
> Reporter: WangJianfei
> Labels: patch
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> In the mllib.Kmeans, there are no limit to the param k, if we pass a big K,
> then because of he array(k), java outofmemory error will occur.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
