Brennon York created SPARK-6022: ----------------------------------- Summary: GraphX `diff` test incorrectly operating on values (not VertexId's) Key: SPARK-6022 URL: https://issues.apache.org/jira/browse/SPARK-6022 Project: Spark Issue Type: Bug Components: GraphX Reporter: Brennon York
The current GraphX {{diff}} test operates on values rather than the VertexId's and, if {{diff}} were working properly (per [SPARK-4600|https://issues.apache.org/jira/browse/SPARK-4600]), it should fail this test. The code to test {{diff}} should look like the below as it correctly generates {{VertexRDD}}'s with different {{VertexId}}'s to {{diff}} against. {code} test("diff functionality with small concrete values") { withSpark { sc => val setA: VertexRDD[Int] = VertexRDD(sc.parallelize(0L until 2L).map(id => (id, id.toInt))) // setA := Set((0L, 0), (1L, 1)) val setB: VertexRDD[Int] = VertexRDD(sc.parallelize(1L until 3L).map(id => (id, id.toInt+2))) // setB := Set((1L, 3), (2L, 4)) val diff = setA.diff(setB) assert(diff.collect.toSet == Set((2L, 4))) } } {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org