Re: Collaborative filtering help needed
Use what, your data? surely. You can run many instances of a non-disributed algorithms on Hadoop this way. It does not really lose performance. But you don't have to code anything either way. And unless you need to move to Hadoop at all, don't. I'm not sure what you're asking. On Tue, Nov 15, 2011 at 3:53 AM, Akshay Jain jaks...@gmail.com wrote: Is there any way I can use this through the Pseudo-distributed algo? I dont mind loosing some performance if I dont have to code the entire thing (which I do not know how to) On Wed, Nov 9, 2011 at 4:36 PM, Akshay Jain jaks...@gmail.com wrote: @Sean, I am just testing with a small dataset. I have some large datasets which I am planning to use on Hadoop. Thanks. Akshay
Re: Collaborative filtering help needed
I want to get the predicted rating predicted rating for users that I specify for specific items (which will vary from user to user) E.g. User1 : I want to get predicted rating for Item_67 user1: i Want to get predicted rating for Item_23 user1: i Want to get predicted rating for Item_456 user2: i Want to get predicted rating for Item_12 user97: i Want to get predicted rating for Item_34 user97: i Want to get predicted rating for Item_11 user97: i Want to get predicted rating for Item_ 45 I want to specify user and some items corresponding to that user. Then I want to get a predicted rating for those items for that user. This is not possible using the fully distributed algorithm in mahout.My question was: can i use the pseudo distributed algo to do this? is there some built in function like Recommender.estimatePreference? On Tue, Nov 15, 2011 at 4:42 PM, Sean Owen sro...@gmail.com wrote: Use what, your data? surely. You can run many instances of a non-disributed algorithms on Hadoop this way. It does not really lose performance. But you don't have to code anything either way. And unless you need to move to Hadoop at all, don't. I'm not sure what you're asking. On Tue, Nov 15, 2011 at 3:53 AM, Akshay Jain jaks...@gmail.com wrote: Is there any way I can use this through the Pseudo-distributed algo? I dont mind loosing some performance if I dont have to code the entire thing (which I do not know how to) On Wed, Nov 9, 2011 at 4:36 PM, Akshay Jain jaks...@gmail.com wrote: @Sean, I am just testing with a small dataset. I have some large datasets which I am planning to use on Hadoop. Thanks. Akshay
Re: Collaborative filtering help needed
Yes, of course, you've identified the method you want to call. Just use it; Hadoop has nothing to do with this. On Tue, Nov 15, 2011 at 8:50 AM, Akshay Jain jaks...@gmail.com wrote: I want to specify user and some items corresponding to that user. Then I want to get a predicted rating for those items for that user. This is not possible using the fully distributed algorithm in mahout.My question was: can i use the pseudo distributed algo to do this? is there some built in function like Recommender.estimatePreference?
Re: Collaborative filtering help needed
Is there any way I can use this through the Pseudo-distributed algo? I dont mind loosing some performance if I dont have to code the entire thing (which I do not know how to) On Wed, Nov 9, 2011 at 4:36 PM, Akshay Jain jaks...@gmail.com wrote: @Sean, I am just testing with a small dataset. I have some large datasets which I am planning to use on Hadoop. Thanks. Akshay On Wed, Nov 9, 2011 at 12:49 PM, Sean Owen sro...@gmail.com wrote: @Steven this is in the distributed part. There is no such method. But Akshay if your data is not large, yeah, you could save a whole lot of time and trouble by not using the Hadoop-based code. @Lance I am not sure there's any evidence he's running into a bug. I don't know that the general there may be bugs comment is useful. I do think it's good to use the latest in SVN. On Wed, Nov 9, 2011 at 5:28 AM, Akshay Jain jaks...@gmail.com wrote: @Steven- Can you please tell me how to use Recommender.estimatePreference? @lance - Thanks for letting me know. I will update it to the latest version. Thanks Akshay
Re: Collaborative filtering help needed
@Sean, I am just testing with a small dataset. I have some large datasets which I am planning to use on Hadoop. Thanks. Akshay On Wed, Nov 9, 2011 at 12:49 PM, Sean Owen sro...@gmail.com wrote: @Steven this is in the distributed part. There is no such method. But Akshay if your data is not large, yeah, you could save a whole lot of time and trouble by not using the Hadoop-based code. @Lance I am not sure there's any evidence he's running into a bug. I don't know that the general there may be bugs comment is useful. I do think it's good to use the latest in SVN. On Wed, Nov 9, 2011 at 5:28 AM, Akshay Jain jaks...@gmail.com wrote: @Steven- Can you please tell me how to use Recommender.estimatePreference? @lance - Thanks for letting me know. I will update it to the latest version. Thanks Akshay
Re: Collaborative filtering help needed
I think you have to modify the source code by incorporating some filters. -邮件原件- 发件人: Akshay Jain [mailto:jaks...@gmail.com] 发送时间: 2011年11月8日 17:24 收件人: user@mahout.apache.org 主题: Collaborative filtering help needed Hi. Let me first say a BIG THANKS to the Mahout community and the authors of the book Mahout In Action. I have just started with Hadoop and Mahout and am finding them extremely useful. I am running the following code: hadoop jar mahout-core-0.5-job.jar org.apache.mahout.cf.taste.hadoop.item.RecommenderJob -Dmapred.input.dir=input/input.txt -Dmapred.output.dir=output --userFile input/users.txt --BooleanData How do I specify that I want to get predictions for only specific items and not the top 10 recommedations for the specified users in the usersFile file? I want to enter the file as following: User1,Item23 User1,item344 User2,item12 user56,236 etc and want to get results like: User1,Item23,Predictd_Rating=4.5 User1,item344, Predictd_Rating=8 User2,item12, Predictd_Rating=1 user56,236, Predictd_Rating=2 etc I can specify a itemsFile but that would not serve the purpose as I do not want to specify a ItemsList from where to get the recommendations. I want only one recommendation for the User*Item combination that I have to be predicted. Thank you.
Re: Collaborative filtering help needed
I think specifying an item file with one item does it? You should get one rec for most users that is that item. On Nov 8, 2011 9:25 AM, Akshay Jain jaks...@gmail.com wrote: Hi. Let me first say a BIG THANKS to the Mahout community and the authors of the book Mahout In Action. I have just started with Hadoop and Mahout and am finding them extremely useful. I am running the following code: hadoop jar mahout-core-0.5-job.jar org.apache.mahout.cf.taste.hadoop.item.RecommenderJob -Dmapred.input.dir=input/input.txt -Dmapred.output.dir=output --userFile input/users.txt --BooleanData How do I specify that I want to get predictions for only specific items and not the top 10 recommedations for the specified users in the usersFile file? I want to enter the file as following: User1,Item23 User1,item344 User2,item12 user56,236 etc and want to get results like: User1,Item23,Predictd_Rating=4.5 User1,item344, Predictd_Rating=8 User2,item12, Predictd_Rating=1 user56,236, Predictd_Rating=2 etc I can specify a itemsFile but that would not serve the purpose as I do not want to specify a ItemsList from where to get the recommendations. I want only one recommendation for the User*Item combination that I have to be predicted. Thank you.
Re: Collaborative filtering help needed
Sean, that can be done, but I don't want to get the same item's prediction for all the users. Is there no other way than to manually code it? (I dont know java, so I dont think that would be possible for me :( ) On Tue, Nov 8, 2011 at 3:02 PM, Sean Owen sro...@gmail.com wrote: I think specifying an item file with one item does it? You should get one rec for most users that is that item. On Nov 8, 2011 9:25 AM, Akshay Jain jaks...@gmail.com wrote: Hi. Let me first say a BIG THANKS to the Mahout community and the authors of the book Mahout In Action. I have just started with Hadoop and Mahout and am finding them extremely useful. I am running the following code: hadoop jar mahout-core-0.5-job.jar org.apache.mahout.cf.taste.hadoop.item.RecommenderJob -Dmapred.input.dir=input/input.txt -Dmapred.output.dir=output --userFile input/users.txt --BooleanData How do I specify that I want to get predictions for only specific items and not the top 10 recommedations for the specified users in the usersFile file? I want to enter the file as following: User1,Item23 User1,item344 User2,item12 user56,236 etc and want to get results like: User1,Item23,Predictd_Rating=4.5 User1,item344, Predictd_Rating=8 User2,item12, Predictd_Rating=1 user56,236, Predictd_Rating=2 etc I can specify a itemsFile but that would not serve the purpose as I do not want to specify a ItemsList from where to get the recommendations. I want only one recommendation for the User*Item combination that I have to be predicted. Thank you.
Re: Collaborative filtering help needed
I'm not sure what you are asking then. Taking your first email literally it sounds like you want to estimate the ratings you already know! Do you want 1 rec per user? On Nov 8, 2011 9:47 AM, Akshay Jain jaks...@gmail.com wrote: Sean, that can be done, but I don't want to get the same item's prediction for all the users. Is there no other way than to manually code it? (I dont know java, so I dont think that would be possible for me :( ) On Tue, Nov 8, 2011 at 3:02 PM, Sean Owen sro...@gmail.com wrote: I think specifying an item file with one item does it? You should get one rec for most users that is that item. On Nov 8, 2011 9:25 AM, Akshay Jain jaks...@gmail.com wrote: Hi. Let me first say a BIG THANKS to the Mahout community and the authors of the book Mahout In Action. I have just started with Hadoop and Mahout and am finding them extremely useful. I am running the following code: hadoop jar mahout-core-0.5-job.jar org.apache.mahout.cf.taste.hadoop.item.RecommenderJob -Dmapred.input.dir=input/input.txt -Dmapred.output.dir=output --userFile input/users.txt --BooleanData How do I specify that I want to get predictions for only specific items and not the top 10 recommedations for the specified users in the usersFile file? I want to enter the file as following: User1,Item23 User1,item344 User2,item12 user56,236 etc and want to get results like: User1,Item23,Predictd_Rating=4.5 User1,item344, Predictd_Rating=8 User2,item12, Predictd_Rating=1 user56,236, Predictd_Rating=2 etc I can specify a itemsFile but that would not serve the purpose as I do not want to specify a ItemsList from where to get the recommendations. I want only one recommendation for the User*Item combination that I have to be predicted. Thank you.
Re: Collaborative filtering help needed
I think he means that he want to get an estimated score for specific item corresponding to each user, thus the item is not scored by the user. -邮件原件- 发件人: Sean Owen [mailto:sro...@gmail.com] 发送时间: 2011年11月8日 17:52 收件人: user@mahout.apache.org 主题: Re: Collaborative filtering help needed I'm not sure what you are asking then. Taking your first email literally it sounds like you want to estimate the ratings you already know! Do you want 1 rec per user? On Nov 8, 2011 9:47 AM, Akshay Jain jaks...@gmail.com wrote: Sean, that can be done, but I don't want to get the same item's prediction for all the users. Is there no other way than to manually code it? (I dont know java, so I dont think that would be possible for me :( ) On Tue, Nov 8, 2011 at 3:02 PM, Sean Owen sro...@gmail.com wrote: I think specifying an item file with one item does it? You should get one rec for most users that is that item. On Nov 8, 2011 9:25 AM, Akshay Jain jaks...@gmail.com wrote: Hi. Let me first say a BIG THANKS to the Mahout community and the authors of the book Mahout In Action. I have just started with Hadoop and Mahout and am finding them extremely useful. I am running the following code: hadoop jar mahout-core-0.5-job.jar org.apache.mahout.cf.taste.hadoop.item.RecommenderJob -Dmapred.input.dir=input/input.txt -Dmapred.output.dir=output --userFile input/users.txt --BooleanData How do I specify that I want to get predictions for only specific items and not the top 10 recommedations for the specified users in the usersFile file? I want to enter the file as following: User1,Item23 User1,item344 User2,item12 user56,236 etc and want to get results like: User1,Item23,Predictd_Rating=4.5 User1,item344, Predictd_Rating=8 User2,item12, Predictd_Rating=1 user56,236, Predictd_Rating=2 etc I can specify a itemsFile but that would not serve the purpose as I do not want to specify a ItemsList from where to get the recommendations. I want only one recommendation for the User*Item combination that I have to be predicted. Thank you.
Re: Collaborative filtering help needed
Sorry for the bad english. I want to get the predicted rating predicted rating for users that I specify for specific items (which will vary from user to user) E.g. User1 : I want to get predicted rating for Item_67 user1: i Want to get predicted rating for Item_23 user1: i Want to get predicted rating for Item_456 user2: i Want to get predicted rating for Item_12 user97: i Want to get predicted rating for Item_34 user97: i Want to get predicted rating for Item_11 user97: i Want to get predicted rating for Item_ 45 I want to specify user and some items corresponding to that user. Then I want to get a predicted rating for those items for that user. I hope I was able to clarify it. On Tue, Nov 8, 2011 at 3:25 PM, 张玉东 zhangyud...@vancl.cn wrote: I think he means that he want to get an estimated score for specific item corresponding to each user, thus the item is not scored by the user. -邮件原件- 发件人: Sean Owen [mailto:sro...@gmail.com] 发送时间: 2011年11月8日 17:52 收件人: user@mahout.apache.org 主题: Re: Collaborative filtering help needed I'm not sure what you are asking then. Taking your first email literally it sounds like you want to estimate the ratings you already know! Do you want 1 rec per user? On Nov 8, 2011 9:47 AM, Akshay Jain jaks...@gmail.com wrote: Sean, that can be done, but I don't want to get the same item's prediction for all the users. Is there no other way than to manually code it? (I dont know java, so I dont think that would be possible for me :( ) On Tue, Nov 8, 2011 at 3:02 PM, Sean Owen sro...@gmail.com wrote: I think specifying an item file with one item does it? You should get one rec for most users that is that item. On Nov 8, 2011 9:25 AM, Akshay Jain jaks...@gmail.com wrote: Hi. Let me first say a BIG THANKS to the Mahout community and the authors of the book Mahout In Action. I have just started with Hadoop and Mahout and am finding them extremely useful. I am running the following code: hadoop jar mahout-core-0.5-job.jar org.apache.mahout.cf.taste.hadoop.item.RecommenderJob -Dmapred.input.dir=input/input.txt -Dmapred.output.dir=output --userFile input/users.txt --BooleanData How do I specify that I want to get predictions for only specific items and not the top 10 recommedations for the specified users in the usersFile file? I want to enter the file as following: User1,Item23 User1,item344 User2,item12 user56,236 etc and want to get results like: User1,Item23,Predictd_Rating=4.5 User1,item344, Predictd_Rating=8 User2,item12, Predictd_Rating=1 user56,236, Predictd_Rating=2 etc I can specify a itemsFile but that would not serve the purpose as I do not want to specify a ItemsList from where to get the recommendations. I want only one recommendation for the User*Item combination that I have to be predicted. Thank you.
Re: Collaborative filtering help needed
OK, for that, you'd have to modify the code. You are not talking about getting ratings for the ratings you already know right? so, user 1 does not already express any rating for item 67 in your example. On Tue, Nov 8, 2011 at 10:05 AM, Akshay Jain jaks...@gmail.com wrote: Sorry for the bad english. I want to get the predicted rating predicted rating for users that I specify for specific items (which will vary from user to user) E.g. User1 : I want to get predicted rating for Item_67 user1: i Want to get predicted rating for Item_23 user1: i Want to get predicted rating for Item_456 user2: i Want to get predicted rating for Item_12 user97: i Want to get predicted rating for Item_34 user97: i Want to get predicted rating for Item_11 user97: i Want to get predicted rating for Item_ 45 I want to specify user and some items corresponding to that user. Then I want to get a predicted rating for those items for that user. I hope I was able to clarify it.
Re: Collaborative filtering help needed
Yes. I want to predict ratings for new things which the user has not rated yet. On Tue, Nov 8, 2011 at 4:00 PM, Sean Owen sro...@gmail.com wrote: OK, for that, you'd have to modify the code. You are not talking about getting ratings for the ratings you already know right? so, user 1 does not already express any rating for item 67 in your example. On Tue, Nov 8, 2011 at 10:05 AM, Akshay Jain jaks...@gmail.com wrote: Sorry for the bad english. I want to get the predicted rating predicted rating for users that I specify for specific items (which will vary from user to user) E.g. User1 : I want to get predicted rating for Item_67 user1: i Want to get predicted rating for Item_23 user1: i Want to get predicted rating for Item_456 user2: i Want to get predicted rating for Item_12 user97: i Want to get predicted rating for Item_34 user97: i Want to get predicted rating for Item_11 user97: i Want to get predicted rating for Item_ 45 I want to specify user and some items corresponding to that user. Then I want to get a predicted rating for those items for that user. I hope I was able to clarify it.
Re: Collaborative filtering help needed
Akshay- The Mahout 0.5 release has bugs. We advise everyone to use the Mahout 0.6 trunk. Lance On Tue, Nov 8, 2011 at 2:53 AM, Akshay Jain jaks...@gmail.com wrote: Yes. I want to predict ratings for new things which the user has not rated yet. On Tue, Nov 8, 2011 at 4:00 PM, Sean Owen sro...@gmail.com wrote: OK, for that, you'd have to modify the code. You are not talking about getting ratings for the ratings you already know right? so, user 1 does not already express any rating for item 67 in your example. On Tue, Nov 8, 2011 at 10:05 AM, Akshay Jain jaks...@gmail.com wrote: Sorry for the bad english. I want to get the predicted rating predicted rating for users that I specify for specific items (which will vary from user to user) E.g. User1 : I want to get predicted rating for Item_67 user1: i Want to get predicted rating for Item_23 user1: i Want to get predicted rating for Item_456 user2: i Want to get predicted rating for Item_12 user97: i Want to get predicted rating for Item_34 user97: i Want to get predicted rating for Item_11 user97: i Want to get predicted rating for Item_ 45 I want to specify user and some items corresponding to that user. Then I want to get a predicted rating for those items for that user. I hope I was able to clarify it. -- Lance Norskog goks...@gmail.com
Re: Collaborative filtering help needed
Should you not be using Recommender.estimatePreference? On Wed, Nov 9, 2011 at 12:19 AM, Lance Norskog goks...@gmail.com wrote: Akshay- The Mahout 0.5 release has bugs. We advise everyone to use the Mahout 0.6 trunk. Lance On Tue, Nov 8, 2011 at 2:53 AM, Akshay Jain jaks...@gmail.com wrote: Yes. I want to predict ratings for new things which the user has not rated yet. On Tue, Nov 8, 2011 at 4:00 PM, Sean Owen sro...@gmail.com wrote: OK, for that, you'd have to modify the code. You are not talking about getting ratings for the ratings you already know right? so, user 1 does not already express any rating for item 67 in your example. On Tue, Nov 8, 2011 at 10:05 AM, Akshay Jain jaks...@gmail.com wrote: Sorry for the bad english. I want to get the predicted rating predicted rating for users that I specify for specific items (which will vary from user to user) E.g. User1 : I want to get predicted rating for Item_67 user1: i Want to get predicted rating for Item_23 user1: i Want to get predicted rating for Item_456 user2: i Want to get predicted rating for Item_12 user97: i Want to get predicted rating for Item_34 user97: i Want to get predicted rating for Item_11 user97: i Want to get predicted rating for Item_ 45 I want to specify user and some items corresponding to that user. Then I want to get a predicted rating for those items for that user. I hope I was able to clarify it. -- Lance Norskog goks...@gmail.com
Re: Collaborative filtering help needed
@Steven- Can you please tell me how to use Recommender.estimatePreference? @lance - Thanks for letting me know. I will update it to the latest version. Thanks Akshay On Wed, Nov 9, 2011 at 5:51 AM, Steven Bourke sbou...@gmail.com wrote: Should you not be using Recommender.estimatePreference? On Wed, Nov 9, 2011 at 12:19 AM, Lance Norskog goks...@gmail.com wrote: Akshay- The Mahout 0.5 release has bugs. We advise everyone to use the Mahout 0.6 trunk. Lance On Tue, Nov 8, 2011 at 2:53 AM, Akshay Jain jaks...@gmail.com wrote: Yes. I want to predict ratings for new things which the user has not rated yet. On Tue, Nov 8, 2011 at 4:00 PM, Sean Owen sro...@gmail.com wrote: OK, for that, you'd have to modify the code. You are not talking about getting ratings for the ratings you already know right? so, user 1 does not already express any rating for item 67 in your example. On Tue, Nov 8, 2011 at 10:05 AM, Akshay Jain jaks...@gmail.com wrote: Sorry for the bad english. I want to get the predicted rating predicted rating for users that I specify for specific items (which will vary from user to user) E.g. User1 : I want to get predicted rating for Item_67 user1: i Want to get predicted rating for Item_23 user1: i Want to get predicted rating for Item_456 user2: i Want to get predicted rating for Item_12 user97: i Want to get predicted rating for Item_34 user97: i Want to get predicted rating for Item_11 user97: i Want to get predicted rating for Item_ 45 I want to specify user and some items corresponding to that user. Then I want to get a predicted rating for those items for that user. I hope I was able to clarify it. -- Lance Norskog goks...@gmail.com
Re: Collaborative filtering help needed
@Steven this is in the distributed part. There is no such method. But Akshay if your data is not large, yeah, you could save a whole lot of time and trouble by not using the Hadoop-based code. @Lance I am not sure there's any evidence he's running into a bug. I don't know that the general there may be bugs comment is useful. I do think it's good to use the latest in SVN. On Wed, Nov 9, 2011 at 5:28 AM, Akshay Jain jaks...@gmail.com wrote: @Steven- Can you please tell me how to use Recommender.estimatePreference? @lance - Thanks for letting me know. I will update it to the latest version. Thanks Akshay
