We are seeing this issue as well. We run on YARN and see logs about lost executor. Looks like some stages had to be re-run to compute RDD partitions lost in the executor.
We were able to complete 20 iterations with 20% full matrix but not beyond that (total > 100GB). On Tue, Jun 10, 2014 at 8:32 PM, coderxiang <shuoxiang...@gmail.com> wrote: > The executors shown "CANNOT FIND ADDRESS" are not listed in the Executors > Tab > on the top of the Spark UI. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Information-on-Spark-UI-tp7354p7355.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >
