This problem appears to be a regression on HEAD/master: when running
against 2.0.2 the pyspark job completes successfully including running
predictions.
2016-11-23 19:36 GMT-08:00 Stephen Boesch :
>
> For a pyspark job with 54 executors all of the task outputs have a single
> line in both the st
For a pyspark job with 54 executors all of the task outputs have a single
line in both the stderr and stdout similar to:
Error: invalid log directory /shared/sparkmaven/work/app-20161119222540-/0/
Note: the directory /shared/sparkmaven/work exists and is owned by the same
user running the jo
