Re: Question about Parallel Stages in Spark

2017-06-27 Thread satish lalam
; wrote: >>> >>>> My words cause misunderstanding. >>>> Step 1:A is submited to spark. >>>> Step 2:B is submitted to spark. >>>> >>>> Spark gets two independent jobs.The FAIR is used to schedule A and B. >>>> >>

Re: Question about Parallel Stages in Spark

2017-06-27 Thread Bryan Jeffrey
---Original---From: "Pralabh Kumar"Date: 2017/6/27 12:09:27To: "萝卜丝炒饭"<1427357...@qq.com>;Cc: "user";"satishl";"Bryan Jeffrey";Subject: Re: Question about Parallel Stages in Spark Hi  I don't think so spark submit ,will receive tw

Re: Question about Parallel Stages in Spark

2017-06-26 Thread satish lalam
gt; ---Original--- >> *From:* "Pralabh Kumar" >> *Date:* 2017/6/27 12:09:27 >> *To:* "萝卜丝炒饭"<1427357...@qq.com>; >> *Cc:* "user";"satishl";"Bryan >> Jeffrey"; >> *Subject:* Re: Question about Parallel Stages in

Re: Question about Parallel Stages in Spark

2017-06-26 Thread Pralabh Kumar
ot cause two submit. > > > > ---Original--- > *From:* "Pralabh Kumar" > *Date:* 2017/6/27 12:09:27 > *To:* "萝卜丝炒饭"<1427357...@qq.com>; > *Cc:* "user";"satishl";"Bryan > Jeffrey"; > *Subject:* Re: Question about P

Re: Question about Parallel Stages in Spark

2017-06-26 Thread ??????????
/27 12:09:27 To: "??"<1427357...@qq.com>; Cc: "user";"satishl";"Bryan Jeffrey"; Subject: Re: Question about Parallel Stages in Spark Hi I don't think so spark submit ,will receive two submits . Its will execute one submit and then to next one .

Re: Question about Parallel Stages in Spark

2017-06-26 Thread Pralabh Kumar
hink the spark cluster receives two submits, A and B. > The FAIR is used to schedule A and B. > I am not sure about this. > > ---Original--- > *From:* "Bryan Jeffrey" > *Date:* 2017/6/27 08:55:42 > *To:* "satishl"; > *Cc:* "user"; > *Subject:

Re: Question about Parallel Stages in Spark

2017-06-26 Thread ??????????
I think the spark cluster receives two submits, A and B. The FAIR is used to schedule A and B. I am not sure about this. ---Original--- From: "Bryan Jeffrey" Date: 2017/6/27 08:55:42 To: "satishl"; Cc: "user"; Subject: Re: Question about Parallel Stages in

Re: Question about Parallel Stages in Spark

2017-06-26 Thread Bryan Jeffrey
println("first: " + rdd1.sum()) > for (i <- (1 to 100)) > println("second" + rdd2.sum()) > > > > -- > View this message in context: http://apache-spark-user-list. > 1001560.n3.nabble.com/Ques

Question about Parallel Stages in Spark

2017-06-26 Thread satishl
)) println("second" + rdd2.sum()) -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Question-about-Parallel-Stages-in-Spark-tp28793.html Sent from the Apache Spark User List mailing list archive at Nabble.com. -