Felix -
You can adjust the timeout for a map/reduce job in the JSON job descriptor.
This might fix the problem you're experiencing since it looks like Riak is
stopping the job because the job ran out of time. The default timeout is 60
seconds and is actually specified in milliseconds. You can adjust the timeout
like so:
{ "inputs": "some_bucket",
"timeout": 90000,
"query": ... }
--Kevin
On Aug 13, 2010, at 8:27 AM, Felix Ritter wrote:
> Hello,
>
> I'm currently testing RIAK (on Mac OS X) and it looks really promising.
> Currently I'm looking for a good way to implement something like
> 'LIMIT 10, 100' to retrieve 10 results starting at offset 100.
> Most web applications have some sort of paging implemented for bigger
> lists, and I'm interested to hear what's the best way to implement it
> with RIAK.
> Any ideas are really appreciated.
>
> And I have one data loss issue:
> for testing I created one bucket with 10.000 JSON-Objects (really
> small and simple objects) and run some MapReduce jobs.
> Everything worked as expected.
> Then I created another 90.000 Objects in the same bucket.
> The first query after the data creation just returned a strange
> 'bucket not found' message, all following queries are now returning an
> empty result list.
> In the sasl-error.log file I found a message that points to a timeout problem:
>
> =SUPERVISOR REPORT==== 13-Aug-2010::14:14:49 ===
> Supervisor: {local,luke_phase_sup}
> Context: child_terminated
> Reason: flow_timeout
> Offender: [{pid,<0.12957.21>},
> {name,undefined},
> {mfa,
> {luke_phase,start_link,
> [riak_kv_map_phase,0,
> [accumulate],
> [<0.12956.21>,<0.12955.21>],
> <0.12954.21>,66000,
> [{javascript,
> {map,
> {jsanon,
> <<"function (value,keydata,arg) {
> ejsLog('/riakcluster/mapred.log', JSON.stringify(arg)); var website =
> Riak.mapValuesJson(value)[0]; if (website.name.indexOf('12345')>=0)
> return [website]; else return []; }">>},
> none,true}}]]}},
> {restart_type,temporary},
> {shutdown,brutal_kill},
> {child_type,worker}]
>
> Any idea? Are there any known limitations regarding the maximum bucket size?
>
> Thanks,
> Felix
>
> _______________________________________________
> riak-users mailing list
> [email protected]
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
_______________________________________________
riak-users mailing list
[email protected]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
