That does sound like it could be it - I checked our libmesos version and it
is 1.4.1. I'll try upgrading libmesos.
Thanks.
On Mon, Jul 23, 2018 at 12:13 PM Susan X. Huynh
wrote:
> Hi Nimi,
>
> This sounds similar to a bug I have come across before. See:
>
Hi Nimi,
This sounds similar to a bug I have come across before. See:
https://jira.apache.org/jira/browse/SPARK-22342?focusedCommentId=16429950=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16429950
It turned out to be a bug in libmesos (the client library used to
I've come across an issue with Mesos 1.4.1 and Spark 2.2.1. We launch Spark
tasks using the MesosClusterDispatcher in cluster mode. On a couple of
occasions, we have noticed that when the Spark Driver crashes (to various
causes - human error, network error), sometimes, when the Driver is