We are experiencing crash of beam.smp on one of nodes in 3-node cluster (ring
128)
Distro is Ubuntu 12.04 with 16GB of memory (almost exclusive for Riak)
===== Sun Feb 15 10:02:23 UTC 2015
Erlang has closed/usr/lib/riak/lib/os_mon-2.2.9/priv/bin/memsup:
Erlang has closed.
Hi I've got following error in syslog
Feb 15 10:02:23 node2 kernel: [157782.787481] beam.smp[2023]: segfault at
800005239d0 ip 00000800005239d0 sp 00007f47e3fe6d68 error 14 in
000061.log[7f463e32f000+1400000]
I'm not sure which causes the other.
000061.log was from leveldb folder but it ahs been deleted after restart of
Riak I believe
Last thing I could find in console log is AAE activity
2015-02-14 15:24:18.329 [info]
<0.7258.26>@riak_kv_exchange_fsm:key_exchange:204 Repaired 3 keys during
active anti-entropy exchange of
{251195593916248939066258330623111144003363405824,3} between
{251195593916248939066258330623111144003363405824,'riak@10.173.240.2'} and
{262613575457896618114724618378707105094425378816,'riak@10.173.240.3'}
2015-02-14 15:31:03.594 [info]
<0.10920.26>@riak_kv_exchange_fsm:key_exchange:204 Repaired 58 keys during
active anti-entropy exchange of
{376793390874373408599387495934666716005045108736,3} between
{376793390874373408599387495934666716005045108736,'riak@10.173.240.2'} and
{388211372416021087647853783690262677096107081728,'riak@10.173.240.2'}
2015-02-14 15:33:48.637 [info]
<0.12367.26>@riak_kv_exchange_fsm:key_exchange:204 Repaired 37 keys during
active anti-entropy exchange of
{422465317040964124793252646957050560369293000704,3} between
{422465317040964124793252646957050560369293000704,'riak@10.173.240.2'} and
{445301280124259482890185222468242482551416946688,'riak@10.173.240.3'}
2015-02-14 15:34:03.454 [info]
<0.12546.26>@riak_kv_exchange_fsm:key_exchange:204 Repaired 37 keys during
active anti-entropy exchange of
{422465317040964124793252646957050560369293000704,3} between
{433883298582611803841718934712646521460354973696,'riak@10.173.240.2'} and
{445301280124259482890185222468242482551416946688,'riak@10.173.240.3'}
2015-02-14 15:55:18.518 [info]
<0.23498.26>@riak_kv_exchange_fsm:key_exchange:204 Repaired 1 keys during
active anti-entropy exchange of
{1061872283373234151507364761270424381468763488256,3} between
{1061872283373234151507364761270424381468763488256,'riak@10.173.240.2'} and
{1073290264914881830555831049026020342559825461248,'riak@10.173.240.3'}
2015-02-14 15:59:33.522 [info]
<0.25935.26>@riak_kv_exchange_fsm:key_exchange:204 Repaired 1 keys during
active anti-entropy exchange of
{1187470080331358621040493926581979953470445191168,3} between
{1198888061873006300088960214337575914561507164160,'riak@10.173.240.2'} and
{1210306043414653979137426502093171875652569137152,'riak@10.173.240.3'}
2015-02-14 15:59:48.513 [info]
<0.26044.26>@riak_kv_exchange_fsm:key_exchange:204 Repaired 1 keys during
active anti-entropy exchange of
{1198888061873006300088960214337575914561507164160,3} between
{1198888061873006300088960214337575914561507164160,'riak@10.173.240.2'} and
{1210306043414653979137426502093171875652569137152,'riak@10.173.240.3'}
2015-02-14 20:08:49.674 [info]
<0.29386.30>@riak_kv_exchange_fsm:key_exchange:204 Repaired 5 keys during
active anti-entropy exchange of
{148433760041419827630061740822747494183805648896,3} between
{148433760041419827630061740822747494183805648896,'riak@10.173.240.2'} and
{171269723124715185726994316333939416365929594880,'riak@10.173.240.3'}
2015-02-14 20:09:04.516 [info]
<0.29501.30>@riak_kv_exchange_fsm:key_exchange:204 Repaired 5 keys during
active anti-entropy exchange of
{148433760041419827630061740822747494183805648896,3} between
{159851741583067506678528028578343455274867621888,'riak@10.173.240.2'} and
{171269723124715185726994316333939416365929594880,'riak@10.173.240.3'}
Is it possible that AAE is causing the problems here.
Regards
Daniel
--
View this message in context:
http://riak-users.197444.n3.nabble.com/Riak-1-3-1-crashing-with-segfault-tp4032638.html
Sent from the Riak Users mailing list archive at Nabble.com.
_______________________________________________
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
