RE: Understanding spark concepts cluster, master, slave, job, stage, worker, executor, task

e. I suppose google translate suck on the translation. From: Taotao.Li [mailto:charles.up...@gmail.com] Sent: 21 July 2016 04:04 To: Jean Georges Perrin <j...@jgp.net> Cc: Sachin Mittal <sjmit...@gmail.com>; user <user@spark.apache.org> Subject: Re: Understanding spark concep

Re: Understanding spark concepts cluster, master, slave, job, stage, worker, executor, task

Hi, Sachin, there is no planning on translate these into english currently, sorry for that, but you can check databrick's blog, there are lots of high-quality and easy-understanding posts. or you can check the list in this post of mine, choose the English version: -

Re: Understanding spark concepts cluster, master, slave, job, stage, worker, executor, task

Hi, Thanks for the links, is there any english translation for the same? Sachin On Thu, Jul 21, 2016 at 8:34 AM, Taotao.Li wrote: > Hi, Sachin, here are two posts about the basic concepts about spark: > > >- spark-questions-concepts >

Re: Understanding spark concepts cluster, master, slave, job, stage, worker, executor, task

Hi, Sachin, here are two posts about the basic concepts about spark: - spark-questions-concepts - deep-into-spark-exection-model And, I fully recommend

Re: Understanding spark concepts cluster, master, slave, job, stage, worker, executor, task

Hey, I love when questions are numbered, it's easier :) 1) Yes (but I am not an expert) 2) You don't control... One of my process is going to 8k tasks, so... 3) Yes, if you have HT, it double. My servers have 12 cores, but HT, so it makes 24. 4) From my understanding: Slave is the logical

Understanding spark concepts cluster, master, slave, job, stage, worker, executor, task

Hi, I was able to build and run my spark application via spark submit. I have understood some of the concepts by going through the resources at https://spark.apache.org but few doubts still remain. I have few specific questions and would be glad if someone could share some light on it. So I

Re: Spark Concepts

, dissemination, distribution, copying or the taking of any action in reliance on the information herein is prohibited. -- Forwarded message -- From: Kamal Banga ka...@sigmoidanalytics.com Date: Mon, Oct 20, 2014 at 4:20 PM Subject: Re: Spark Concepts To: nsar...@gmail.com Cc

Spark Concepts

Executing Jobs ? How do these handle the partitioning parallelism. Help in these questions would be really appreciated, to get a better sense of Apache Spark.Thanks,Nitin -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Concepts-tp16477.html Sent from

Re: Spark Concepts

Anybody with good hands on with Spark, please do reply. It would help us a lot!! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Concepts-tp16477p16536.html Sent from the Apache Spark User List mailing list archive at Nabble.com