Re: LDA prediction on new document

2015-05-22 Thread Ken Geis
Dani, this appears to be addressed in SPARK-5567, scheduled for Spark 1.5.0. Ken On May 21, 2015, at 11:12 PM, user-digest-h...@spark.apache.org wrote: From: Dani Qiu zongmin@gmail.com Subject: LDA prediction on new document Date: May 21, 2015 at 8:48:40 PM PDT To: user

Re: LDA prediction on new document

2015-05-22 Thread Dani Qiu
to be addressed in SPARK-5567 https://issues.apache.org/jira/browse/SPARK-5567, scheduled for Spark 1.5.0. Ken On May 21, 2015, at 11:12 PM, user-digest-h...@spark.apache.org wrote: *From: *Dani Qiu zongmin@gmail.com *Subject: **LDA prediction on new document* *Date: *May 21, 2015 at 8:48:40 PM PDT

LDA prediction on new document

2015-05-22 Thread Charles Earl
: *From: *Dani Qiu zongmin@gmail.com *Subject: **LDA prediction on new document* *Date: *May 21, 2015 at 8:48:40 PM PDT *To: *user@spark.apache.org Hi, guys, I'm pretty new to LDA. I notice spark 1.3.0 mllib provide EM based LDA implementation. It returns both topics and topic

LDA prediction on new document

2015-05-21 Thread Dani Qiu
Hi, guys, I'm pretty new to LDA. I notice spark 1.3.0 mllib provide EM based LDA implementation. It returns both topics and topic distribution. My question is how can I use these parameters to predict on new document ? And I notice there is an Online LDA implementation in spark master branch,