Re: Skipped Jobs

2015-04-19 Thread Mark Hamstra
Almost.  Jobs don't get skipped.  Stages and Tasks do if the needed results
are already available.

On Sun, Apr 19, 2015 at 3:18 PM, Denny Lee denny.g@gmail.com wrote:

 The job is skipped because the results are available in memory from a
 prior run.  More info at:
 http://mail-archives.apache.org/mod_mbox/spark-user/201501.mbox/%3ccakx7bf-u+jc6q_zm7gtsj1mihagd_4up4qxpd9jfdjrfjax...@mail.gmail.com%3E.
 HTH!

 On Sun, Apr 19, 2015 at 1:43 PM James King jakwebin...@gmail.com wrote:

 In the web ui i can see some jobs as 'skipped' what does that mean? why
 are these jobs skipped? do they ever get executed?

 Regards
 jk




Re: Skipped Jobs

2015-04-19 Thread Denny Lee
Thanks for the correction Mark :)

On Sun, Apr 19, 2015 at 3:45 PM Mark Hamstra m...@clearstorydata.com
wrote:

 Almost.  Jobs don't get skipped.  Stages and Tasks do if the needed
 results are already available.

 On Sun, Apr 19, 2015 at 3:18 PM, Denny Lee denny.g@gmail.com wrote:

 The job is skipped because the results are available in memory from a
 prior run.  More info at:
 http://mail-archives.apache.org/mod_mbox/spark-user/201501.mbox/%3ccakx7bf-u+jc6q_zm7gtsj1mihagd_4up4qxpd9jfdjrfjax...@mail.gmail.com%3E.
 HTH!

 On Sun, Apr 19, 2015 at 1:43 PM James King jakwebin...@gmail.com wrote:

 In the web ui i can see some jobs as 'skipped' what does that mean? why
 are these jobs skipped? do they ever get executed?

 Regards
 jk





Skipped Jobs

2015-04-19 Thread James King
In the web ui i can see some jobs as 'skipped' what does that mean? why are
these jobs skipped? do they ever get executed?

Regards
jk