Is it now possible to incrementally update a graph in GraphX

2015-07-07 Thread Hellen
I found this post back in March 2014. http://apache-spark-user-list.1001560.n3.nabble.com/Incrementally-add-remove-vertices-in-GraphX-td2227.html I was wondering if there is any progress on GraphX Streaming/incremental graph update in GraphX. Or is there a place where I can track the progress on

Re: Spark got stuck with BlockManager after computing connected components using GraphX

2015-07-05 Thread Hellen
Sorry for the silly question. I'm fairly new to Spark. Because of the cleanup log messages, I didn't see scala, so I thought it's still working on something. If I press Enter, I got disconnected. I finally tried typing the variable name, which actually worked. -- View this message in context:

Spark got stuck with BlockManager after computing connected components using GraphX

2015-07-04 Thread Hellen
I'm computing connected components using Spark GraphX on AWS EC2. I believe the computation was successful, as I saw the type information of the final result. However, it looks like Spark was doing some cleanup. The BlockManager removed a bunch of blocks and stuck at 15/07/04 21:53:06 INFO