Re: Strongly Connected Components

2016-11-13 Thread Nicholas Chammas
> > at > org.apache.spark.rpc.RpcTimeout$$anonfun$addMessageIfTimeout$1.applyOrElse(RpcTimeout.scala:59) > > at scala.PartialFunction$OrElse.apply(PartialFunction.scala:167) > > at org.apache.spark.rpc.RpcTimeout.awaitResult(RpcTimeout.scala:83) > >

Re: Strongly Connected Components

2016-11-12 Thread Koert Kuipers
>>> 308) >>> >>> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFu >>> tureTask.access$301(ScheduledThreadPoolExecutor.java:180) >>> >>> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFu >>>

Re: Strongly Connected Components

2016-11-12 Thread Koert Kuipers
;> >> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo >> lExecutor.java:617) >> >> at java.lang.Thread.run(Thread.java:745) >> >> Caused by: org.apache.spark.rpc.RpcTimeoutException: Futures timed out >> after [10 seconds].

RE: Strongly Connected Components

2016-11-11 Thread Shreya Agarwal
g; Denny Lee <denny@microsoft.com> Subject: Re: Strongly Connected Components Hi Shreya, GraphFrames just calls the GraphX strongly connected components code. (https://github.com/graphframes/graphframes/blob/release-0.2.0/src/main/scala/org/graphframes/lib/StronglyConnectedCo

Re: Strongly Connected Components

2016-11-11 Thread Daniel Darabos
la:167) > > at org.apache.spark.rpc.RpcTimeout.awaitResult( > RpcTimeout.scala:83) > > at org.apache.spark.rpc.RpcEndpointRef.askWithRetry( > RpcEndpointRef.scala:102) > > ... 13 more > > Caused by: java.util.concurrent.TimeoutException: Futur

RE: Strongly Connected Components

2016-11-11 Thread Shreya Agarwal
:50 PM To: user@spark.apache.org<mailto:user@spark.apache.org>; Shreya Agarwal <shrey...@microsoft.com<mailto:shrey...@microsoft.com>> Subject: Re: Strongly Connected Components It is possible it is dead. Could you check the Spark UI to see if there is any progress? __

RE: Strongly Connected Components

2016-11-10 Thread Shreya Agarwal
; Shreya Agarwal <shrey...@microsoft.com> Subject: Re: Strongly Connected Components It is possible it is dead. Could you check the Spark UI to see if there is any progress? _ From: Shreya Agarwal <shrey...@microsoft.com<mailto:shrey...@microsoft.com>&

Re: Strongly Connected Components

2016-11-10 Thread Felix Cheung
It is possible it is dead. Could you check the Spark UI to see if there is any progress? _ From: Shreya Agarwal <shrey...@microsoft.com<mailto:shrey...@microsoft.com>> Sent: Thursday, November 10, 2016 12:45 AM Subject: RE: Strongly Connected Componen

RE: Strongly Connected Components

2016-11-10 Thread Shreya Agarwal
Bump. Anyone? Its been running for 10 hours now. No results. From: Shreya Agarwal Sent: Tuesday, November 8, 2016 9:05 PM To: user@spark.apache.org Subject: Strongly Connected Components Hi, I am running this on a graph with >5B edges and >3B edges and have 2 questions - 1. What is the