Thanks Kelly. You were spot-on. I had upgraded app.config on my other two
nodes but had missed one.
So, I updated app.config, restarted all cluster nodes, and reran the same
query. It now looks like a pipe error:
22:56:37.697 [error] Supervisor riak_pipe_builder_sup had child undefined
started with {riak_pipe_builder,start_link,undefined} at <0.449.0> exit with
reason killed in context child_terminated
22:56:37.701 [error] Supervisor riak_pipe_fitting_sup had child undefined
started with {riak_pipe_fitting,start_link,undefined} at <0.450.0> exit with
reason killed in context child_terminated
22:56:37.703 [error] gen_fsm <0.452.0> in state wait_pipeline_shutdown
terminated with reason: {sink_died,killed}
22:56:37.705 [error] CRASH REPORT Process <0.452.0> with 1 neighbours
crashed with reason: {sink_died,killed}
22:56:37.711 [error] Supervisor riak_pipe_fitting_sup had child undefined
started with {riak_pipe_fitting,start_link,undefined} at <0.453.0> exit with
reason {sink_died,killed} in context child_terminated
22:56:37.712 [error] Supervisor riak_pipe_builder_sup had child undefined
started with {riak_pipe_builder,start_link,undefined} at <0.452.0> exit with
reason {sink_died,killed} in context child_terminated
Ideas?
Jim
From: Kelly McLaughlin <[email protected]>
Date: Sun, 23 Oct 2011 14:13:09 -0600
To: Jim Adler <[email protected]>
Cc: "[email protected]" <[email protected]>
Subject: Re: Key Filter Timeout
Jim,
Looks like you are possibly using both the legacy key listing option and the
legacy map reduce. Assuming all your nodes are on Riak 1.0, check your
app.config files on all nodes and make sure mapred_system is set to pipe and
legacy_keylisting is set to false. If that's not already the case you should
see better performance. If you are still getting the same or similar errors
with those setting in place, please respond with what they are so we can
look into it more. Thanks.
Kelly
On Oct 23, 2011, at 12:38 PM, Jim Adler wrote:
> I'm trying to run a very simplified key filter that's timing out. I've got
> about 8M keys in a 3-node cluster, 15 GB memory, num_partitions=256, LevelDB
> backend.
>
> I'm thinking this should be pretty quick. What am I doing wrong?
>
> Jim
>
> Here's the query:
>
> curl -v -d
> '{"inputs":{"bucket":"nodes","key_filters":[["eq","user_id-xxxxxxx-info"]]},"q
> uery":[{"reduce":{"language":"erlang","module":"riak_kv_mapreduce","function":
> "reduce_identity"}}]}' -H "Content-Type: application/json"
> http://xx.xx.xx.xx:8098/mapred
>
> Here's the log:
>
> 18:25:08.892 [error] gen_fsm <0.20795.0> in state executing terminated with
> reason: {error,flow_timeout}
> 18:25:08.961 [error] CRASH REPORT Process <0.20795.0> with 2 neighbours
> crashed with reason: {error,flow_timeout}
> 18:25:08.963 [error] Supervisor luke_flow_sup had child undefined started with
> {luke_flow,start_link,undefined} at <0.20795.0> exit with reason
> {error,flow_timeout} in context child_terminated
> 18:25:08.966 [error] gen_fsm <0.20798.0> in state waiting_kl terminated with
> reason: {error,flow_timeout}
> 18:25:08.971 [error] CRASH REPORT Process <0.20798.0> with 0 neighbours
> crashed with reason: {error,flow_timeout}
> 18:25:08.980 [error] Supervisor riak_kv_keys_fsm_legacy_sup had child
> undefined started with {riak_kv_keys_fsm_legacy,start_link,undefined} at
> <0.20798.0> exit with reason {error,flow_timeout} in context child_terminated
> 18:25:08.983 [error] Supervisor luke_phase_sup had child undefined started
> with {luke_phase,start_link,undefined} at <0.20797.0> exit with reason
> {error,flow_timeout} in context child_terminated
> 18:25:08.996 [error] Supervisor luke_phase_sup had child undefined started
> with {luke_phase,start_link,undefined} at <0.20796.0> exit with reason
> {error,flow_timeout} in context child_terminated
>
>
> _______________________________________________
> riak-users mailing list
> [email protected]
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
_______________________________________________
riak-users mailing list
[email protected]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
