Thanks for the response!! Will try to see the behaviour with Cache()
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Task-size-variation-while-using-Range-Vs-List-tp18243p18318.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
sts in the Executor's memory, and only
> the
> code is pushed from driver to executor ) ??
>
> 2) Why does Range not increase the task size, where as any other collection
> increases the size exponentially ??
>
>
>
>
>
> --
> View this message in context
1560.n3.nabble.com/Task-size-variation-while-using-Range-Vs-List-tp18243.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional c