[
https://issues.apache.org/jira/browse/SPARK-25219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-25219.
----------------------------------
Resolution: Incomplete
> KMeans Clustering - Text Data - Results are incorrect
> -----------------------------------------------------
>
> Key: SPARK-25219
> URL: https://issues.apache.org/jira/browse/SPARK-25219
> Project: Spark
> Issue Type: Bug
> Components: ML
> Affects Versions: 2.3.0
> Reporter: Vasanthkumar Velayudham
> Priority: Major
> Labels: bulk-closed
> Attachments: Apache_Logs_Results.xlsx, SKLearn_Kmeans.txt,
> Spark_Kmeans.txt
>
>
> Hello Everyone,
> I am facing issues with the usage of KMeans Clustering on my text data. When
> I apply clustering on my text data, after performing various transformations
> such as RegexTokenizer, Stopword Processing, HashingTF, IDF, generated
> clusters are not proper and one cluster is found to have lot of data points
> assigned to it.
> I am able to perform clustering with similar kind of processing and with the
> same attributes on the SKLearn KMeans algorithm.
> Upon searching in internet, I observe many have reported the same issue with
> KMeans clustering library of Spark.
> Request your help in fixing this issue.
> Please let me know if you require any additional details.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
