Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21977
@holdenk, I attempted to write a YARN unit test for this, but evidently the
MiniYARNCluster doesn't run python workers. The task is run, but a worker is
never started. If you have any idea how to fix this, I think we could have an
easy test. Here's what I have so far:
https://gist.github.com/rdblue/9848a00f49eaad6126fbbcfa1b039e19
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
