Unfortunately one of our servers crashed last night. Now riak isn't starting
anymore. There are no errors logged.
Here is the console.log:
2015-11-09 11:31:45.142 [info] <0.7.0> Application lager started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.188 [info] <0.7.0> Application sasl started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.188 [info] <0.7.0> Application asn1 started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.190 [info] <0.7.0> Application crypto started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.190 [info] <0.7.0> Application public_key started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.226 [info] <0.7.0> Application ssl started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.229 [info] <0.7.0> Application riak_sysmon started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.258 [info] <0.7.0> Application os_mon started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.263 [info] <0.73.0> alarm_handler:
{set,{{disk_almost_full,"/"},[]}}
2015-11-09 11:31:45.284 [info] <0.7.0> Application runtime_tools started on
node 'riak@127.0.0.1'
2015-11-09 11:31:45.326 [info] <0.7.0> Application erlang_js started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.326 [info] <0.7.0> Application xmerl started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.434 [info] <0.7.0> Application inets started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.443 [info] <0.7.0> Application mochiweb started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.464 [info] <0.7.0> Application webmachine started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.465 [info] <0.7.0> Application basho_stats started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.478 [info] <0.7.0> Application bitcask started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.504 [info] <0.7.0> Application clique started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.504 [info] <0.7.0> Application eleveldb started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.504 [info] <0.7.0> Application pbkdf2 started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.504 [info] <0.7.0> Application poolboy started on node
'riak@127.0.0.1'
2015-11-09 11:31:45.526 [notice] <0.47.0>@lager_app:132 Deprecated
lager_file_backend config detected, please consider updating it
2015-11-09 11:31:45.568 [info] <0.164.0>@exometer_report:do_start_reporters:613
Starting reporters with []
2015-11-09 11:31:45.568 [info] <0.7.0> Application exometer_core started on
node 'riak@127.0.0.1'
2015-11-09 11:31:46.017 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_core,vnode_routing} = proxy
2015-11-09 11:31:46.026 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_core,staged_joins} = true
2015-11-09 11:31:46.028 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_core,resizable_ring} = true
2015-11-09 11:31:46.030 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_core,fold_req_version} = v2
2015-11-09 11:31:46.031 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_core,security} = true
2015-11-09 11:31:46.033 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_core,bucket_types} = true
2015-11-09 11:31:46.034 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_core,net_ticktime} = true
2015-11-09 11:31:46.143 [info] <0.7.0> Application riak_core started on node
'riak@127.0.0.1'
2015-11-09 11:31:46.177 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_pipe,trace_format} = ordsets
2015-11-09 11:31:46.226 [info] <0.7.0> Application riak_pipe started on node
'riak@127.0.0.1'
2015-11-09 11:31:46.229 [info] <0.7.0> Application sidejob started on node
'riak@127.0.0.1'
2015-11-09 11:31:46.229 [info] <0.7.0> Application riak_dt started on node
'riak@127.0.0.1'
2015-11-09 11:31:46.229 [info] <0.7.0> Application protobuffs started on node
'riak@127.0.0.1'
2015-11-09 11:31:46.229 [info] <0.7.0> Application riak_pb started on node
'riak@127.0.0.1'
2015-11-09 11:31:46.294 [warning] <0.303.0>@riak_api_web:get_listeners:40
Setting riak_core/http is deprecated, please use riak_api/http
2015-11-09 11:31:46.317 [info] <0.7.0> Application riak_api started on node
'riak@127.0.0.1'
2015-11-09 11:31:46.463 [info] <0.329.0>@riak_kv_env:doc_env:46 Environment and
OS variables:
2015-11-09 11:31:46.509 [info] <0.382.0>@riak_core:wait_for_service:489 Waiting
for service riak_kv to start (0 seconds)
2015-11-09 11:31:46.524 [info]
<0.392.0>@riak_kv_entropy_manager:set_aae_throttle_limits:790 Setting AAE
throttle limits: [{-1,0},{200,10},{500,50},{750,250},{900,1000},{1100,5000}]
2015-11-09 11:31:46.586 [info] <0.401.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_map) host starting
(<0.401.0>)
2015-11-09 11:31:46.587 [info] <0.402.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_map) host starting
(<0.402.0>)
2015-11-09 11:31:46.589 [info] <0.403.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_map) host starting
(<0.403.0>)
2015-11-09 11:31:46.590 [info] <0.404.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_map) host starting
(<0.404.0>)
2015-11-09 11:31:46.592 [info] <0.405.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_map) host starting
(<0.405.0>)
2015-11-09 11:31:46.594 [info] <0.406.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_map) host starting
(<0.406.0>)
2015-11-09 11:31:46.595 [info] <0.407.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_map) host starting
(<0.407.0>)
2015-11-09 11:31:46.597 [info] <0.408.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_map) host starting
(<0.408.0>)
2015-11-09 11:31:46.598 [info] <0.410.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_reduce) host starting
(<0.410.0>)
2015-11-09 11:31:46.600 [info] <0.411.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_reduce) host starting
(<0.411.0>)
2015-11-09 11:31:46.601 [info] <0.412.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_reduce) host starting
(<0.412.0>)
2015-11-09 11:31:46.603 [info] <0.415.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_reduce) host starting
(<0.415.0>)
2015-11-09 11:31:46.604 [info] <0.416.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_reduce) host starting
(<0.416.0>)
2015-11-09 11:31:46.606 [info] <0.417.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_reduce) host starting
(<0.417.0>)
2015-11-09 11:31:46.607 [info] <0.419.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_hook) host starting
(<0.419.0>)
2015-11-09 11:31:46.609 [info] <0.420.0>@riak_kv_js_vm:init:73 Spidermonkey VM
(thread stack: 16MB, max heap: 8MB, pool: riak_kv_js_hook) host starting
(<0.420.0>)
2015-11-09 11:31:46.611 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_kv,vnode_vclocks} = true
2015-11-09 11:31:46.612 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_kv,legacy_keylisting} = false
2015-11-09 11:31:46.613 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_kv,listkeys_backpressure} = true
2015-11-09 11:31:46.614 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_kv,index_backpressure} = true
2015-11-09 11:31:46.616 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_kv,mapred_system} = pipe
2015-11-09 11:31:46.617 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_kv,mapred_2i_pipe} = true
2015-11-09 11:31:46.619 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_kv,anti_entropy} = enabled_v1
2015-11-09 11:31:46.620 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_kv,handoff_data_encoding} = encode_raw
2015-11-09 11:31:46.621 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_kv,object_format} = v1
2015-11-09 11:31:46.622 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_kv,secondary_index_version} = v3
2015-11-09 11:31:46.623 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_kv,vclock_data_encoding} = encode_zlib
2015-11-09 11:31:46.624 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_kv,crdt} = [pncounter,riak_dt_pncounter,riak_dt_orswot,riak_dt_map]
2015-11-09 11:31:46.625 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_kv,crdt_epoch_versions} =
[{riak_dt_map,2},{riak_dt_orswot,2},{riak_dt_pncounter,2}]
2015-11-09 11:31:46.626 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_kv,put_fsm_ack_execute} = enabled
2015-11-09 11:31:46.717 [info]
<0.200.0>@riak_core_capability:process_capability_changes:555 New capability:
{riak_control,member_info_version} = v1
2015-11-09 11:31:59.372 [info]
<0.96.0>@riak_core_sysmon_handler:handle_event:92 monitor long_schedule
<0.1202.0>
[{initial_call,{riak_core_vnode,init,1}},{almost_current_function,{gen,do_call,4}},{message_queue_len,1}]
[{timeout,1788},{in,{eleveldb,get,3}},{out,{gen,do_call,4}}]
2015-11-09 11:32:47.112 [info] <0.382.0>@riak_core:wait_for_service:489 Waiting
for service riak_kv to start (60 seconds)
2015-11-09 11:33:47.712 [info] <0.382.0>@riak_core:wait_for_service:489 Waiting
for service riak_kv to start (120 seconds)
2015-11-09 11:34:48.312 [info] <0.382.0>@riak_core:wait_for_service:489 Waiting
for service riak_kv to start (180 seconds)
2015-11-09 11:35:48.912 [info] <0.382.0>@riak_core:wait_for_service:489 Waiting
for service riak_kv to start (240 seconds)
2015-11-09 11:36:49.512 [info] <0.382.0>@riak_core:wait_for_service:489 Waiting
for service riak_kv to start (300 seconds)
2015-11-09 11:37:50.112 [info] <0.382.0>@riak_core:wait_for_service:489 Waiting
for service riak_kv to start (360 seconds)
2015-11-09 11:38:50.712 [info] <0.382.0>@riak_core:wait_for_service:489 Waiting
for service riak_kv to start (420 seconds)
2015-11-09 11:39:51.312 [info] <0.382.0>@riak_core:wait_for_service:489 Waiting
for service riak_kv to start (480 seconds)
2015-11-09 11:40:51.912 [info] <0.382.0>@riak_core:wait_for_service:489 Waiting
for service riak_kv to start (540 seconds)
2015-11-09 11:41:52.512 [info] <0.382.0>@riak_core:wait_for_service:489 Waiting
for service riak_kv to start (600 seconds)
2015-11-09 11:42:53.112 [info] <0.382.0>@riak_core:wait_for_service:489 Waiting
for service riak_kv to start (660 seconds)
2015-11-09 11:43:53.712 [info] <0.382.0>@riak_core:wait_for_service:489 Waiting
for service riak_kv to start (720 seconds)
2015-11-09 11:44:54.312 [info] <0.382.0>@riak_core:wait_for_service:489 Waiting
for service riak_kv to start (780 seconds)
2015-11-09 11:45:54.912 [info] <0.382.0>@riak_core:wait_for_service:489 Waiting
for service riak_kv to start (840 seconds)
Any idea?
_______________________________________________
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
