3.nabble.com/Why-does-spark-take-so-much-time-for-simple-task-without-calculation-tp27628p27657.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> -
> To unsubscribe e-
; --
> View this message in context: http://apache-spark-user-list.
> 1001560.n3.nabble.com/Why-does-spark-take-so-much-time-
> for-simple-task-without-calculation-tp27628p27657.html
> Sent from the Apache Spark User Lis
The spark context will be reused, so the spark context initialization won't
affect the throughput test.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Why-does-spark-take-so-much-time-for-simple-task-without-calculation-tp27628p27657.html
Sent from
job initialization and dispatch.
Add more workers can’t help improve this situation. Is anyone can explain
this?
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Why-does-spark-take-so-much-time-for-simple-task-without-calculation-tp27628p27656.html
Sent f
!
-Original Message-
From: Bedrytski Aliaksandr [mailto:sp...@bedryt.ski]
Sent: Wednesday, August 31, 2016 8:45 PM
To: Xie, Feng
Cc: user@spark.apache.org
Subject: Re: Why does spark take so much time for simple task without
calculation?
Hi xiefeng,
Spark Context initialization takes
> public static String simpleRDDTest()
> {
> JavaRDD rddData = simpleRDDs.get("MyRDD");
> return rddData.first();
> }
>
>
>
>
> --
> View this message in co
}
public static String simpleRDDTest()
{
JavaRDD rddData = simpleRDDs.get("MyRDD");
return rddData.first();
}
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Why-does-spark-take-so-mu
