Re: spark master process shutdown for timeout

[Akhil Das]

Did you happened to have a look at this
https://issues.apache.org/jira/browse/SPARK-9629

Thanks
Best Regards

On Thu, Dec 17, 2015 at 12:02 PM, yaoxiaohua  wrote:

> Hi guys,
>
> I have two nodes used as spark master, spark1,spark2
>
> Spark1.4.0
>
> Jdk 1.7 sunjdk
>
>
>
> Now these days I found that spark2 master process may shutdown , I found
> that in log file:
>
> 15/12/17 13:09:58 INFO ClientCnxn: Client session timed out, have not
> heard from server in 40020ms for sessionid 0x351a889694144b1, closing
> socket connection and attempting reconnect
>
> 15/12/17 13:09:58 INFO ConnectionStateManager: State change: SUSPENDED
>
> 15/12/17 13:09:58 INFO ZooKeeperLeaderElectionAgent: We have lost
> leadership
>
> 15/12/17 13:09:58 ERROR Master: Leadership has been revoked -- master
> shutting down.
>
> 15/12/17 13:09:58 INFO Utils: Shutdown hook called
>
>
>
> It looks like timeout , I don’t know how to change the configure to avoid
> this case happened, please help me.
>
> Thanks.
>
>
>
> Best Regards,
>
> Evan Yao
>

spark master process shutdown for timeout

[yaoxiaohua]

Hi guys,

I have two nodes used as spark master, spark1,spark2

Spark1.4.0

Jdk 1.7 sunjdk

 

Now these days I found that spark2 master process may shutdown , I found
that in log file:

15/12/17 13:09:58 INFO ClientCnxn: Client session timed out, have not heard
from server in 40020ms for sessionid 0x351a889694144b1, closing socket
connection and attempting reconnect

15/12/17 13:09:58 INFO ConnectionStateManager: State change: SUSPENDED

15/12/17 13:09:58 INFO ZooKeeperLeaderElectionAgent: We have lost leadership

15/12/17 13:09:58 ERROR Master: Leadership has been revoked -- master
shutting down.

15/12/17 13:09:58 INFO Utils: Shutdown hook called

 

It looks like timeout , I don't know how to change the configure to avoid
this case happened, please help me.

Thanks.

 

Best Regards,

Evan Yao