Changing in-memory DataModel to a DB dependent only DataModel after building recommender

2013-01-21 Thread Ceyhun Can ÜLKER
Hello, In our application we are using ReloadFromJDBCDataModel for its speed advantage of in-memory representation and being able to update periodically to pull in new data from a database source. However, once the recommender is build we do not want to keep the ratings data in memory (we would

Re: Changing in-memory DataModel to a DB dependent only DataModel after building recommender

2013-01-21 Thread Sean Owen
You would have to write this yourself, yes. If you're not keeping the data in memory, you're not updating the results in real-time. So there's no real need to keep any DataModel around at all. Just pre-compute and store recommendations and update them periodically. Nothing has to be on-line then.

Re: Changing in-memory DataModel to a DB dependent only DataModel after building recommender

2013-01-21 Thread Ceyhun Can ÜLKER
Hi again, Thank you for your quick reply, Sean. I couldn't understand one point. What do you mean by pre-compute and store recommendations? Doesn't it mean having a dense (rather filled?) rating matrix? So it would make memory usage much worse, even if it is possible. Wouldn't it better to keep

Re: Changing in-memory DataModel to a DB dependent only DataModel after building recommender

2013-01-21 Thread Sean Owen
If you don't have the data in memory you can't compute anything. The recommender itself doesn't do anything without data. That's why it seemed like you really just wanted to compute everything offline first, in which case the simplest solution is to store it however you like and fetch that result

Re: Changing in-memory DataModel to a DB dependent only DataModel after building recommender

2013-01-21 Thread Osman Başkaya
Hey Sean, Once you compute user and item factors, you don't need to create a dense matrix in which all the user's predicted ratings contains. Of course, one dependency remains: you may want to know which user rates which movies. Otherwise you recommend movies which are rated already. However,

Re: Changing in-memory DataModel to a DB dependent only DataModel after building recommender

2013-01-21 Thread Ceyhun Can ÜLKER
Hello Sean, Thank you for your reply. What I understand from your reply is we are fine with the proposed solution in the first mail. Thanks again. Regards. Ceyhun Can Ulker On Mon, Jan 21, 2013 at 10:59 PM, Sean Owen sro...@gmail.com wrote: That's all right, but it's not something