[ 
https://issues.apache.org/jira/browse/SPARK-5854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324374#comment-14324374
 ] 

Baoxu Shi commented on SPARK-5854:
----------------------------------

Oh sure, there are lots of paper talking about personalized page rank, for 
example:

The fundamental one is:

Haveliwala TH (2002) Topic-sensitive PageRank. WWW 517–526. doi: 
10.1145/511446.511513
This has been cited by 1412 papers (according to google)

And there are some implementations on MapReduce

Bahmani B, Chakrabarti K, Xin D (2011) Fast personalized PageRank on MapReduce. 
SIGMOD 973–984. doi: 10.1145/1989323.1989425

Also, the most recent industry usage would be Twitter's WTF system

Gupta P, Goel A, Lin J, et al. (2013) WTF: the who to follow service at 
Twitter. WWW 505–514.

The difference between PageRank and Personalized PageRank are how we initialize 
score for each node, and how we do teleporting. 

In PageRank, every node has an initial score of 1, whereas for Personalized 
PageRank, only source node has a score of 1 and others have a score of 0 at the 
beginning.

In PageRank, a random surfer has a probability of \alpha to jump to another 
random surfer. Whereas in Personalized PageRank, all jumping must end at source 
node.


BTW, I thought this may just be a simple method of a Graph object, since 
PageRank is also a method of Graph object.

> Implement Personalized PageRank with GraphX
> -------------------------------------------
>
>                 Key: SPARK-5854
>                 URL: https://issues.apache.org/jira/browse/SPARK-5854
>             Project: Spark
>          Issue Type: New Feature
>          Components: GraphX
>            Reporter: Baoxu Shi
>            Priority: Minor
>              Labels: Feature
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> I'm wondering if you would like to add personalized page rank to GraphX? I 
> have implemented it by modifying existing PageRank algorithm in GraphX, and I 
> would like to share it with others.
> It is pretty simple and straightforward since the only change I need to make 
> is only teleport to source node. 
> I did some google searching and seems there are a few guys want to have it in 
> GraphX :-)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to