Re: what does Submitting ... missing tasks from Stage mean?

2015-02-23 Thread shahab
Thanks Imran, but I do appreciate if you explain what this mean and what
are the reasons make it happening. I do need it.
If there is any documentation somewhere you can simply direct me there so
 I can try to understand it myself.

best,
/Shahab

On Sat, Feb 21, 2015 at 12:26 AM, Imran Rashid iras...@cloudera.com wrote:

 yeah, this is just the totally normal message when spark executes
 something.  The first time something is run, all of its tasks are
 missing.  I would not worry about cases when all tasks aren't missing
 if you're new to spark, its probably an advanced concept that you don't
 care about.  (and would take me some time to explain :)

 On Fri, Feb 20, 2015 at 8:20 AM, shahab shahab.mok...@gmail.com wrote:

 Hi,

 Probably this is silly question, but I couldn't find any clear
 documentation explaining why  one  should submitting... missing tasks from
 Stage ... in the logs?

 Specially in my case when I do not have any failure in job execution, I
 wonder why this should happen?
 Does it have any relation to lazy evaluation?

 best,
 /Shahab





what does Submitting ... missing tasks from Stage mean?

2015-02-20 Thread shahab
Hi,

Probably this is silly question, but I couldn't find any clear
documentation explaining why  one  should submitting... missing tasks from
Stage ... in the logs?

Specially in my case when I do not have any failure in job execution, I
wonder why this should happen?
Does it have any relation to lazy evaluation?

best,
/Shahab


Re: what does Submitting ... missing tasks from Stage mean?

2015-02-20 Thread Imran Rashid
yeah, this is just the totally normal message when spark executes
something.  The first time something is run, all of its tasks are
missing.  I would not worry about cases when all tasks aren't missing
if you're new to spark, its probably an advanced concept that you don't
care about.  (and would take me some time to explain :)

On Fri, Feb 20, 2015 at 8:20 AM, shahab shahab.mok...@gmail.com wrote:

 Hi,

 Probably this is silly question, but I couldn't find any clear
 documentation explaining why  one  should submitting... missing tasks from
 Stage ... in the logs?

 Specially in my case when I do not have any failure in job execution, I
 wonder why this should happen?
 Does it have any relation to lazy evaluation?

 best,
 /Shahab