Re: Spark basicOperators

2015-12-18 Thread Akhil Das
You can pretty much measure it from the Event timeline listed in the driver
ui, You can click on jobs/tasks and get the time that it took for each of
it from there.

Thanks
Best Regards

On Thu, Dec 17, 2015 at 7:27 AM, sara mustafa <eng.sara.must...@gmail.com>
wrote:

> Hi,
>
> The class org.apache.spark.sql.execution.basicOperators.scala contains the
> implementation of multiple operators, how could I measure the execution
> time
> of any operator?
>
> thanks,
>
>
>
> --
> View this message in context:
> http://apache-spark-developers-list.1001551.n3.nabble.com/Spark-basicOperators-tp15672.html
> Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
> For additional commands, e-mail: dev-h...@spark.apache.org
>
>


Spark basicOperators

2015-12-16 Thread sara mustafa
Hi,

The class org.apache.spark.sql.execution.basicOperators.scala contains the
implementation of multiple operators, how could I measure the execution time
of any operator?

thanks,



--
View this message in context: 
http://apache-spark-developers-list.1001551.n3.nabble.com/Spark-basicOperators-tp15672.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org