Re: what determine the task size?

2015-08-21 Thread Robineast
The OP wants to understand what determines the size of the task code that is 
shipped to each executor so it can run the task. I don't know the answer to but 
would be interested to know too.

Sent from my iPhone

 On 21 Aug 2015, at 08:26, oubrik [via Apache Spark User List] 
 ml-node+s1001560n24380...@n3.nabble.com wrote:
 
 Hi 
 You mean user code ? 
 
 
 
 If you reply to this email, your message will be added to the discussion 
 below:
 http://apache-spark-user-list.1001560.n3.nabble.com/what-determine-the-task-size-tp24363p24380.html
 To start a new topic under Apache Spark User List, email 
 ml-node+s1001560n1...@n3.nabble.com 
 To unsubscribe from Apache Spark User List, click here.
 NAML




--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/what-determine-the-task-size-tp24363p24384.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: what determine the task size?

2015-08-20 Thread ambujhbti
cwz wrote
 sorry, my question is not clear.
 I mean what determine the one task size? not how many tasks

one task size= one HDFS block size.



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/what-determine-the-task-size-tp24363p24375.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org