Re: Task size variation while using Range Vs List

2014-11-06 Thread nsareen
Thanks for the response!! Will try to see the behaviour with Cache() -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Task-size-variation-while-using-Range-Vs-List-tp18243p18318.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: Task size variation while using Range Vs List

2014-11-05 Thread Shixiong Zhu
sts in the Executor's memory, and only > the > code is pushed from driver to executor ) ?? > > 2) Why does Range not increase the task size, where as any other collection > increases the size exponentially ?? > > > > > > -- > View this message in context

Task size variation while using Range Vs List

2014-11-05 Thread nsareen
1560.n3.nabble.com/Task-size-variation-while-using-Range-Vs-List-tp18243.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional c