spark-item-similarity incremental update

2015-03-10 Thread Kevin Zhang
Hi, Does anybody have any idea about how to do incremental update for the item similarity? I mean how I can apply latest user action data for example today's data? Do I have to run it again for the entire dataset? Thanks, Kevin

Re: spark-item-similarity incremental update

2015-03-10 Thread Kevin Zhang
. There is no incremental way to update the model (yet) but it can be rerun in a few minutes and as I said you get recs with realtime user history, even for new users not in the training data. On Mar 10, 2015, at 3:07 PM, Kevin Zhang zhangyongji...@yahoo.com.INVALID wrote: Hi, Does anybody have any

spark-itemsimilarity question: what's the difference between indicator-matrix and cross-indicator-matrix

2015-03-06 Thread Kevin Zhang
May I say indicator-matrix is for the main action for example purchase and the cross-indicator-matrix is for the secondary action? Thanks a lot, Kevin

spark-itemsimilarity cross-indicator-matrix and indicator-matrix

2015-03-02 Thread Kevin Zhang
Hi Pat, Thanks for the spark-itemsimilarity. I just ran it against my csv file which looks like below. My two actions are Liked and AddToCart. AddToCart is the main action. usr000d3ca6655-c132-11e4-ac0a-0cc47a03334d Liked prdb5bc44b-fca8-4462-ba19-b9b2b823beb6

spark-itemsimilarity: Exception in thread main com.typesafe.config.ConfigException$Missing: No configuration setting found for key 'akka.event-handlers'

2015-01-27 Thread Kevin Zhang
Hi, I'm new to Spark, Mahout. Just tried to run the spark-itemsimilarity but no luck. Here is what I did. 1. clone git Mahout git project 2. run mvn install 3. set $MAHOUT_HOME to the project path 4. added $MAHOUT_HOME/bin to the PATH variable 5. download Spark, extract it to a dir 6. set

java.lang.UnsatisfiedLinkError: no snappyjava in java.library.path

2015-01-27 Thread Kevin Zhang
Thanks to Dmitriy for answering my previous question regarding the Spark version. I just downgraded the version to spark-1.1.0-bin-hadoop2.4 and run my commane mahout spark-itemsimilarity -i ./mahout-input/order_item.tsv -o ./output -f1 purchase -f2 view -os -ic 2 -fc 1 -td , again. This time I