[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-12-01 Thread Sebastian Schelter (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836052#comment-13836052 ] Sebastian Schelter commented on MAHOUT-1286: I wasn't able to load the

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-12-01 Thread Gokhan Capan (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836102#comment-13836102 ] Gokhan Capan commented on MAHOUT-1286: -- Let's Won't Fix this issue. I think what we

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-09-05 Thread Gokhan Capan (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13759021#comment-13759021 ] Gokhan Capan commented on MAHOUT-1286: -- There was a thread on updating int indices

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-09-04 Thread Gokhan Capan (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757801#comment-13757801 ] Gokhan Capan commented on MAHOUT-1286: -- Here is what I think: 1- We should

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-09-04 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758103#comment-13758103 ] Peng Cheng commented on MAHOUT-1286: The existing open addressing hash table is for

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-08-29 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754269#comment-13754269 ] Peng Cheng commented on MAHOUT-1286: Hi Gokhan, No problem, but it only has two

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-08-27 Thread Gokhan Capan (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13751049#comment-13751049 ] Gokhan Capan commented on MAHOUT-1286: -- Hi Peng, could you submit the diff files

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-08-27 Thread Gokhan Capan (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13751053#comment-13751053 ] Gokhan Capan commented on MAHOUT-1286: -- By the way, it seems the link to the paper

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-08-16 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13742714#comment-13742714 ] Peng Cheng commented on MAHOUT-1286: Hi Dr Dunning, Great appreciation, I watched

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-08-12 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13736962#comment-13736962 ] Peng Cheng commented on MAHOUT-1286: The idea of ArrayMap has been discarded due to

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-08-12 Thread Ted Dunning (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13736984#comment-13736984 ] Ted Dunning commented on MAHOUT-1286: - Peng, You should be able to create a

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-08-12 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13736992#comment-13736992 ] Peng Cheng commented on MAHOUT-1286: Here is my final solution after numerous

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-08-12 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13737019#comment-13737019 ] Peng Cheng commented on MAHOUT-1286: Hi Dr Dunning, Indeed both Gokhan and me have

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-08-12 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13737023#comment-13737023 ] Peng Cheng commented on MAHOUT-1286: Well, I mean, I partially agree that the effort

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-08-12 Thread Ted Dunning (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13737116#comment-13737116 ] Ted Dunning commented on MAHOUT-1286: - The hopscotch hashing still looks pretty

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-08-12 Thread Gokhan Capan (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13737267#comment-13737267 ] Gokhan Capan commented on MAHOUT-1286: -- Peng, With a SparseRowMatrix, column access

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-08-12 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13737553#comment-13737553 ] Peng Cheng commented on MAHOUT-1286: Hi Gentlemen, Thanks a lot for proving my point

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-08-12 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13737563#comment-13737563 ] Peng Cheng commented on MAHOUT-1286: Also, please be noted that the first patch is

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-08-12 Thread Ted Dunning (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13737606#comment-13737606 ] Ted Dunning commented on MAHOUT-1286: - Recommendation as search is just one model. I

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-07-23 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13717659#comment-13717659 ] Peng Cheng commented on MAHOUT-1286: Aye aye, I just did, turns out that instances of

Re: [jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-07-23 Thread Sebastian Schelter
IMHO you will always have memory issues if you try to provide constant time random access. Thats why I proposed to created a special memory efficient DataModel for sequential access. 2013/7/23 Peng Cheng (JIRA) j...@apache.org [

Re: [jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-07-23 Thread Peng Cheng
That's exactly what I'm trying to do right now :) (I'm testing FastByIDArrayMap), but we probably have more problems than just HashMap, based on the heap dump analysis result, PreferenceArray probably will be our next target. This is awesome, as your FactorizablePreferences didn't use it in

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-07-22 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13715885#comment-13715885 ] Peng Cheng commented on MAHOUT-1286: On second thought, hash map is very likely not

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-07-22 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13715906#comment-13715906 ] Peng Cheng commented on MAHOUT-1286: In another hand, I try to solve the problem by

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-07-22 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13715912#comment-13715912 ] Peng Cheng commented on MAHOUT-1286: Hi Sebastian, Gokhan, how do you feel about the

[jira] [Commented] (MAHOUT-1286) Memory-efficient DataModel, supporting fast online updates and element-wise iteration

2013-07-22 Thread Ted Dunning (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13716025#comment-13716025 ] Ted Dunning commented on MAHOUT-1286: - It is pretty easy to do a differential heap