Re: Is that normal spark performance?

2016-06-15 Thread Deepak Goel
etManager] > Finished task 1.0 in stage 1.0 (TID 6) in 199 ms on node1 (4/5) > [2016-06-15 09:26:01.599] [INFO ] [task-result-getter-2] [TaskSetManager] > Finished task 3.0 in stage 1.0 (TID 8) in 200 ms on node1 (5/5) > [2016-06-15 09:26:01.599] [INFO ] [task-result-getter-2] [TaskS

Re: Is that normal spark performance?

2016-06-15 Thread Jörn Franke
(TID 6) in 199 ms on node1 (4/5) > [2016-06-15 09:26:01.599] [INFO ] [task-result-getter-2] [TaskSetManager] > Finished task 3.0 in stage 1.0 (TID 8) in 200 ms on node1 (5/5) > [2016-06-15 09:26:01.599] [INFO ] [task-result-getter-2] [TaskSchedulerImpl] > Removed TaskSet 1.0, whose tasks have all completed, from pool > [2016-06-15 09:26:01.599] [INFO ] [dag-scheduler-event-loop] [DAGScheduler] > ResultStage 1 (collect at EquityTCAAnalytics.java:88) finished in 0.202 s > [2016-06-15 09:26:01.612] [INFO ] [main] [DAGScheduler] Job 0 finished: > collect at EquityTCAAnalytics.java:88, took 32.496470 s > [2016-06-15 09:26:01.634] [INFO ] [main] [EquityTCAAnalytics] [((2016-06-10 > 13:45:00.0,DA),6944), ((2016-06-10 14:25:00.0,B),5241), ..., ((2016-06-10 > 10:55:00.0,QD),109080), ((2016-06-10 14:55:00.0,A),1300)] > [2016-06-15 09:26:01.641] [INFO ] [main] [EquityTCAAnalytics] finish > 32.5 s is normal? > View this message in context: Is that normal spark performance? > Sent from the Apache Spark User List mailing list archive at Nabble.com.

Is that normal spark performance?

2016-06-15 Thread nikita.dobryukha
). I've created an example:32.5 s is normal? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Is-that-normal-spark-performance-tp27174.html Sent from the Apache Spark User List mailing list archive at Nabble.com.