Re: a stage can belong to more than one job please?

2017-06-06 Thread Mark Hamstra 
Yes, a Stage can be part of more than one Job. The jobIds field of Stage is
used repeatedly in the DAGScheduler.

On Tue, Jun 6, 2017 at 5:04 AM, 萝卜丝炒饭 <1427357...@qq.com> wrote:

> Hi all,
>
> I read same code of spark about stage.
>
> The constructor of stage keep the first job  ID the stage was part of.
> does that means a stage can belong to more than one job
> please? And I find the member jobIds is never used. It looks strange.
>
>
> thanks adv
>

Re: a stage can belong to more than one job please?

2017-06-06 Thread ?????????? 
Hi  Mark,


Thanks.






 
---Original---
From: "Mark Hamstra"
Date: 2017/6/6 23:27:43
To: "dev";
Cc: "user";
Subject: Re: a stage can belong to more than one job please?


Yes, a Stage can be part of more than one Job. The jobIds field of Stage is 
used repeatedly in the DAGScheduler.

On Tue, Jun 6, 2017 at 5:04 AM, ?? <1427357...@qq.com> wrote:
Hi all,

I read same code of spark about stage.

The constructor of stage keep the first job  ID the stage was part of.
does that means a stage can belong to more than one job please? And I find the 
member jobIds is never used. It looks strange.


thanks adv