Thank you Silvio for the update.
On Sat, Dec 26, 2015 at 1:14 PM, Silvio Fiorito <
silvio.fior...@granturing.com> wrote:
> Skipped stages result from existing shuffle output of a stage when
> re-running a transformation. The executors will have the output of the
> stage in their local dirs and
Skipped stages result from existing shuffle output of a stage when re-running a
transformation. The executors will have the output of the stage in their local
dirs and Spark recognizes that, so rather than re-computing, it will start from
the following stage. So, this is a good thing in that
Whats does the below Skipped Stage means. can anyone help in clarifying?
I was expecting 3 stages to get Succeeded but only 2 of them getting
completed while one is skipped.
Status: SUCCEEDED
Completed Stages: 2
Skipped Stages: 1
Scala REPL Code Used:
accounts is a basic RDD contains
