Re: Software stack for Recommendation engine with spark mlib

2015-03-19 Thread Shashidhar Rao
Hi , Just 2 follow up questions, please suggest 1. Is there any commercial recommendation engine apart from the open source tools(Mahout,Spark) that are available that anybody can suggest ? 2. In this case only the purchase transaction is captured. There are no ratings and no feedback availabl

Re: Software stack for Recommendation engine with spark mlib

2015-03-15 Thread Shashidhar Rao
Thanks Nick, for your suggestions. On Sun, Mar 15, 2015 at 10:41 PM, Nick Pentreath wrote: > As Sean says, precomputing recommendations is pretty inefficient. Though > with 500k items its easy to get all the item vectors in memory so > pre-computing is not too bad. > > Still, since you plan to s

Re: Software stack for Recommendation engine with spark mlib

2015-03-15 Thread Nick Pentreath
As Sean says, precomputing recommendations is pretty inefficient. Though with 500k items its easy to get all the item vectors in memory so pre-computing is not too bad. Still, since you plan to serve these via a REST service anyway, computing on demand via a serving layer such as Oryx or Pre

Re: Software stack for Recommendation engine with spark mlib

2015-03-15 Thread Shashidhar Rao
Thanks Sean, your suggestions and the links provided are just what I needed to start off with. On Sun, Mar 15, 2015 at 6:16 PM, Sean Owen wrote: > I think you're assuming that you will pre-compute recommendations and > store them in Mongo. That's one way to go, with certain tradeoffs. You > can

Re: Software stack for Recommendation engine with spark mlib

2015-03-15 Thread Sean Owen
I think you're assuming that you will pre-compute recommendations and store them in Mongo. That's one way to go, with certain tradeoffs. You can precompute offline easily, and serve results at large scale easily, but, you are forced to precompute everything -- lots of wasted effort, not completely

Software stack for Recommendation engine with spark mlib

2015-03-15 Thread Shashidhar Rao
Hi, Can anyone who has developed recommendation engine suggest what could be the possible software stack for such an application. I am basically new to recommendation engine , I just found out Mahout and Spark Mlib which are available . I am thinking the below software stack. 1. The user is goin