Re: Reindexing in graphx

2016-02-25 Thread Karl Higley
ou In advance. > > > > Udbhav. > > *From:* Robin East [mailto:robin.e...@xense.co.uk] > *Sent:* Thursday, February 25, 2016 7:42 PM > > > *To:* Udbhav Agarwal <udbhav.agar...@syncoms.com> > *Cc:* user@spark.apache.org > *Subject:* Re: Reindexing in graphx &

RE: Reindexing in graphx

2016-02-25 Thread Udbhav Agarwal
gar...@syncoms.com> Cc: user@spark.apache.org Subject: Re: Reindexing in graphx So first up GraphX is not really designed for real-time graph mutation time situations. That’s not to say it can’t be done but you may be butting up against some of the design limitations in that area. As a first

RE: Reindexing in graphx

2016-02-24 Thread Udbhav Agarwal
<udbhav.agar...@syncoms.com> Cc: user@spark.apache.org Subject: Re: Reindexing in graphx It looks like you adding vertices one-by-one, you definitely don’t want to do that. What happens when you batch together 400 vertices into an RDD and then add 400 in

Re: Reindexing in graphx

2016-02-24 Thread Robin East
East [mailto:robin.e...@xense.co.uk] > Sent: Tuesday, February 23, 2016 8:15 PM > To: Udbhav Agarwal <udbhav.agar...@syncoms.com> > Subject: Re: Reindexing in graphx > > Hi > > Well this is the line that is failing in VertexRDDImpl: > > require(partitionsR

RE: Reindexing in graphx

2016-02-23 Thread Udbhav Agarwal
v.agar...@syncoms.com> Subject: Re: Reindexing in graphx Hi Well this is the line that is failing in VertexRDDImpl: require(partitionsRDD.partitioner.isDefined) But really you shouldn’t need to be calling the reindex() function as it deals with some internals of the GraphX implementation - it looks t

Reindexing in graphx

2016-02-23 Thread Udbhav Agarwal
Hi, I am trying to add vertices to a graph in graphx and I want to do reindexing in the graph. I can see there is an option of vertices.reindex() in graphX. But when I am doing graph.vertices.reindex() am getting Java.lang.IllegalArgumentException: requirement failed. Please help me know what I