[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2016-02-22 Thread Robin East (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156641#comment-15156641 ] Robin East commented on SPARK-10945: [~ankurd] Did you get a chance to look at this? > GraphX

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2016-02-22 Thread Robin East (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156639#comment-15156639 ] Robin East commented on SPARK-10945: It's not obvious how to reproduce this from the datasets

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119167#comment-15119167 ] Apache Spark commented on SPARK-10945: -- User 'dmarcous' has created a pull request for this issue:

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-09 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950095#comment-14950095 ] Khaled Ammar commented on SPARK-10945: -- Hi [~ankurd], I wonder if you had a chance to work on this

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947249#comment-14947249 ] Sean Owen commented on SPARK-10945: --- I mean that and edge from 2 to 3 should appear as "2 3" not "3 2".

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-07 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947095#comment-14947095 ] Khaled Ammar commented on SPARK-10945: -- Hi, I apologize for the delay but I ran several experiments

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-07 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947387#comment-14947387 ] Khaled Ammar commented on SPARK-10945: -- Thank you ~Ankur and ~Sean, I really appreciate your help.

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-07 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947330#comment-14947330 ] Ankur Dave commented on SPARK-10945: Thanks [~kammar] and [~srowen] for the careful analysis. It does

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947171#comment-14947171 ] Sean Owen commented on SPARK-10945: --- (The sort operation you show is just sorting the entries of the

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-07 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947202#comment-14947202 ] Khaled Ammar commented on SPARK-10945: -- One more followup, In order to further investigate why

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-07 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947211#comment-14947211 ] Khaled Ammar commented on SPARK-10945: -- The sort operation sort edges based on the source vertex

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945127#comment-14945127 ] Khaled Ammar commented on SPARK-10945: -- Actually, I am not sure. I did not know this is a condition

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945097#comment-14945097 ] Khaled Ammar commented on SPARK-10945: -- Hi, I found what might seem as a good starting point.

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945155#comment-14945155 ] Khaled Ammar commented on SPARK-10945: -- Thank you Sean, The file looks like sorted, based on first

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945136#comment-14945136 ] Sean Owen commented on SPARK-10945: --- I'm not 100% sure it's required, but I see the reader does not

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945001#comment-14945001 ] Khaled Ammar commented on SPARK-10945: -- Thank you Sean for your reply. I run the pagerank code

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945057#comment-14945057 ] Khaled Ammar commented on SPARK-10945: -- Thank you Sean for your comment again. I apologize if the

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945045#comment-14945045 ] Khaled Ammar commented on SPARK-10945: -- Thank you Sean for your comment again. I apologize if the

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945029#comment-14945029 ] Sean Owen commented on SPARK-10945: --- You've just quoted the Spark code. Which Twitter data set did you

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945002#comment-14945002 ] Khaled Ammar commented on SPARK-10945: -- As I mentioned in the description, NaN values appear as

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945299#comment-14945299 ] Khaled Ammar commented on SPARK-10945: -- I am sorry, it looks like I am confusing you. The input

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945267#comment-14945267 ] Sean Owen commented on SPARK-10945: --- Hm, do some vertices somehow have 0 out degree? I don't see how if

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945313#comment-14945313 ] Khaled Ammar commented on SPARK-10945: -- I did sort the input file and try it again. I can still see

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945316#comment-14945316 ] Sean Owen commented on SPARK-10945: --- Are you talking about the input (Twitter data set)? or an internal

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945292#comment-14945292 ] Khaled Ammar commented on SPARK-10945: -- There are several vertices with 0 out degree. There are also

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945290#comment-14945290 ] Sean Owen commented on SPARK-10945: --- Some values in the input have infinite weight? that's a problem

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-06 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945345#comment-14945345 ] Khaled Ammar commented on SPARK-10945: -- input dataset has no weights. I expect this to be the