[ 
https://issues.apache.org/jira/browse/SPARK-5566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308733#comment-14308733
 ] 

yuhao yang commented on SPARK-5566:
-----------------------------------

I mean only the underlying implementation. 

> Tokenizer for mllib package
> ---------------------------
>
>                 Key: SPARK-5566
>                 URL: https://issues.apache.org/jira/browse/SPARK-5566
>             Project: Spark
>          Issue Type: New Feature
>          Components: ML, MLlib
>    Affects Versions: 1.3.0
>            Reporter: Joseph K. Bradley
>
> There exist tokenizer classes in the spark.ml.feature package and in the 
> LDAExample in the spark.examples.mllib package.  The Tokenizer in the 
> LDAExample is more advanced and should be made into a full-fledged public 
> class in spark.mllib.feature.  The spark.ml.feature.Tokenizer class should 
> become a wrapper around the new Tokenizer.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to