Congrats Tom and Prashant :)
Cheers,
Karthik
On Nov 13, 2013 7:37 PM, "Matei Zaharia" wrote:
> Hi folks,
>
> The Apache Spark PPMC is happy to welcome two new PPMC members and
> committers: Tom Graves and Prashant Sharma.
>
> Tom has been maintaining and expanding the YARN support in Spark over
Hi Hussam,
Have you looked at the stdout and stderr files from the worker process? You can
find them in the “work” directory under SPARK_HOME on the slave node. They
might have some information about why it crashed. Otherwise, I’d recommend
profiling the workers with tools like jmap or jstack t
Hi folks,
The Apache Spark PPMC is happy to welcome two new PPMC members and committers:
Tom Graves and Prashant Sharma.
Tom has been maintaining and expanding the YARN support in Spark over the past
few months, including adding big features such as support for YARN security,
and recently cont
By the way, there are a few places one can look for logs while testing:
Unit test runner logs (should contain driver and worker
logs): core/target/unit-tests.log
Executor logs: work/app-*
This should help find the root exception when you see one caught by the
DAGScheduler, such as in this case.
