[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-16 Thread ankurdave
Github user ankurdave commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12453849 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/EdgePartition.scala --- @@ -17,39 +17,86 @@ package org.apache.spark.graphx.impl

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42394655 Build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42480505 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-15 Thread ankurdave
Github user ankurdave commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12456738 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/RoutingTablePartition.scala --- @@ -0,0 +1,158 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42487496 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-15 Thread ankurdave
Github user ankurdave commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12456417 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/RoutingTablePartition.scala --- @@ -0,0 +1,158 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42491309 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42753687 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42489551 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14786/ --- If your project is set up for it, you can

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-15 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42755314 Thanks everyone - I'm going to pull this in. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-15 Thread ankurdave
Github user ankurdave commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12453687 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/VertexRDD.scala --- @@ -276,14 +286,31 @@ class VertexRDD[@specialized VD: ClassTag]( */

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42480525 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42491311 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14787/ --- If your project is set up for it, you can

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-14 Thread ankurdave
Github user ankurdave commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12455215 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/GraphImpl.scala --- @@ -89,105 +81,79 @@ class GraphImpl[VD: ClassTag, ED: ClassTag] protected

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-14 Thread ankurdave
Github user ankurdave commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12454278 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/EdgePartition.scala --- @@ -212,9 +275,34 @@ class EdgePartition[@specialized(Char, Int,

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-14 Thread jegonzal
Github user jegonzal commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42618546 I went through this PR with Ankur and it looks good to me. There are a few minor changes but those can be moved to a second PR. --- If your project is set up for it,

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42755276 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42755277 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14874/ --- If your project

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42753772 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42753685 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42753773 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14873/ --- If your project is set up for it, you can

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-12 Thread ankurdave
Github user ankurdave commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12456334 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/RoutingTablePartition.scala --- @@ -0,0 +1,158 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42489547 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42483855 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-11 Thread ankurdave
Github user ankurdave commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12456034 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/ReplicatedVertexView.scala --- @@ -21,192 +21,102 @@ import scala.reflect.{classTag, ClassTag}

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42487477 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-11 Thread ankurdave
Github user ankurdave commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12456652 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/RoutingTablePartition.scala --- @@ -0,0 +1,158 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42483842 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-11 Thread ankurdave
Github user ankurdave commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12456744 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/RoutingTablePartition.scala --- @@ -0,0 +1,158 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42484874 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14783/ --- If your project is set up for it, you can

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42484873 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-10 Thread ankurdave
Github user ankurdave commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12454050 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/EdgePartition.scala --- @@ -100,7 +147,23 @@ class EdgePartition[@specialized(Char, Int,

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-10 Thread ankurdave
Github user ankurdave commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12453694 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/VertexRDD.scala --- @@ -276,14 +286,31 @@ class VertexRDD[@specialized VD: ClassTag]( */

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/497 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-10 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42753649 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-10 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42453595 @ankurdave also - do you mind writing a brief upgrade guide in the GraphX docs with the major user-facing interface changes from 0.9? --- If your project is set up for

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-07 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42397518 Thanks for the comments! I implemented your suggestions as well as some cleanups I'd discussed with @rxin, then benchmarked it on 16 m2.4xlarge machines with the

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42394658 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14757/ --- If your project is set up for it, you can

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42391060 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42391053 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42340917 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-06 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12340674 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/Serializers.scala --- @@ -26,6 +26,33 @@ import org.apache.spark.serializer._ import

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42340933 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-06 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12340669 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/Serializers.scala --- @@ -26,6 +26,33 @@ import org.apache.spark.serializer._ import

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-06 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12340534 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/EdgeTriplet.scala --- @@ -63,4 +63,6 @@ class EdgeTriplet[VD, ED] extends Edge[ED] { if (srcId

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-06 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12341175 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/VertexPartitionBaseOps.scala --- @@ -0,0 +1,237 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-06 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12341257 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/RoutingTablePartition.scala --- @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-06 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12341223 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/VertexPartitionBaseOps.scala --- @@ -0,0 +1,237 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-06 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12341328 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/VertexPartitionBase.scala --- @@ -0,0 +1,91 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-06 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12341289 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/VertexPartitionBase.scala --- @@ -0,0 +1,91 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42351663 Build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42351668 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14726/ --- If your project is set up for it, you can

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-41127458 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14358/ --- If your project is set up for it, you can

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-04-22 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-41124574 cc @rxin @jegonzal --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-04-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-41124613 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-04-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-41124619 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-04-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-41124706 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-04-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-41124707 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14355/ --- If your project is set up for it, you can

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-04-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-41125076 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-04-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-41126018 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-04-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-41126010 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-04-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-41126494 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14356/ --- If your project is set up for it, you can