Debugging mapreduce

2013-09-24 Thread Charl Matthee
Hi, I am trying to run the following mapreduce query across my cluster: # curl -XPOST http://10.179.229.209:8098/mapred -H Content-Type: application/json -d '{inputs:tweets, query:[{map:{language:javascript, source:function(value, keyData, arg) {t = JSON.parse(value.values[0].data)[0]; if ((new

Re: Very high CPU usage by bean.smp

2013-09-24 Thread Thomas Stein
Am 24.09.13 07:03, schrieb xsanch: I had the same issue, when I straced the beam i saw a very high number of read/write to entropy files, I just disabled the entropy in configuration file app.config: %% Enable active anti-entropy subsystem + optional debug messages:

RE: Debugging mapreduce

2013-09-24 Thread Erik Søe Sørensen
You're using single quotes in a JS program which is itself in single quotes - so they don't get to be part of the program, so the /tmp/m... part looks to JS like a bad regex. Hence the error message. Oprindelig meddelelse Fra: Charl Matthee ch...@matthee.org.za Dato: Til:

Re: Riak won't start when configured for Riak-CS

2013-09-24 Thread Darren Govoni
Hi! I did build Riak-CS from source, but there is no 'install' target in the make so I wasn't sure how that got done. There was no 'install' readme also. I then installed the .deb instead. I installed erlang from ubuntu 13.04 repo.

Re: Very high CPU usage by bean.smp

2013-09-24 Thread Jared Morrow
Interesting. Someone knows what this entropy thing is doing exactly? Can it be switched off by default maybe? Here is a description of AAE when it was released in Riak 1.3 http://basho.com/introducing-riak-1-3/ You can turn off AAE in your config files if you want it off. With Riak (and

Re: Very high CPU usage by bean.smp

2013-09-24 Thread Guido Medina
Jared, Is it possible to elaborate more on meet me in the middle settings/scenarios?, let me explain, let's say the quorum is configured with low values, say, R=W=1 and N=3, doesn't that add more work to AAE background process? Could there be ways to sacrifice some client performance with

Node not leaving cluster

2013-09-24 Thread David Greenstein
I'm performing a rolling upgrade to 1.4.2 (from 1.3.1). The first two nodes that I replaced left the cluster without an issue and the new nodes joined without an issue. Now, the next node seams to be in a state where it won't leave the cluster. The status is leaving but it has been pending for

Re: Node not leaving cluster

2013-09-24 Thread Dmitry Demeshchuk
Seems like a potential problem with handoff. We had similar problems upgrading from 1.2.1 to 1.4.0. Check the logs for handoff errors (something like unknown_msg or similar). If that's the case, leave that node be, and do in-place upgrade for the rest of the nodes, without making them leave the

Re: Node not leaving cluster

2013-09-24 Thread David Greenstein
I'm not receiving any errors actually. I'm far from an expert in riak logs, but the console.log messages seem to indicate the handoff is working… just extremely slowly. Here's a snippet from the console.log of the node that is attempting to leave… 2013-09-24 20:59:43.991 [info]

Re: Node not leaving cluster

2013-09-24 Thread David Greenstein
I take that back, a 1.4.2 node handing off data to an older node during rebalancing is in fact reporting an unknown_msg error. I'll try your suggestion. 2013-09-24 21:02:35.337 [error] 0.15962.4@riak_core_handoff_sender:start_fold:269 ownership_transfer transfer of riak_kv_vnode from

Re: Deleting data from bitcask backend

2013-09-24 Thread Brian Sparrow
Hello Charl, Everything looks as expected in the vnode status and the logs. Feel free to run `bitcask:merge(/PATH/TO/PARTITION)` for other partitions on the node(s) to reclaim space. Let us know how things go. Thanks, -- Brian Sparrow Developer Advocate Basho Technologies Sent with

Re: Node not leaving cluster

2013-09-24 Thread David Greenstein
I'm actually joining new nodes that have the latest version to the cluster. Once I join the nodes I have the old nodes leave. This has worked great in the past. I'll use the recommended method next time :) Dave On Sep 24, 2013, at 5:05 PM, Brian Sparrow bspar...@basho.com wrote: David,

Re: Node not leaving cluster

2013-09-24 Thread Brian Sparrow
Ahh, gotcha. Let us know how things go and if we can offer any more assistance. Thanks! -- Brian Sparrow Developer Advocate Basho Technologies Sent with Sparrow (http://www.sparrowmailapp.com/?sig) On Tuesday, September 24, 2013 at 5:10 PM, David Greenstein wrote: I'm actually

Re: Node not leaving cluster

2013-09-24 Thread David Greenstein
Looks like Dmitry's + your suggestion did the trick. I upgraded the rest of the nodes in-place using the method you suggested and the hanging leave finally handed off it's data. Thank you! Dave On Sep 24, 2013, at 5:14 PM, Brian Sparrow bspar...@basho.com wrote: Ahh, gotcha. Let us

Debugging mapreduce

2013-09-24 Thread Charl Matthee
Hi, I am trying to run the following mapreduce query across my cluster: # curl -XPOST http://10.179.229.209:8098/mapred -H Content-Type: application/json -d '{inputs:tweets, query:[{map:{language:javascript, source:function(value, keyData, arg) {t = JSON.parse(value.values[0].data)[0]; if ((new

Re: Debugging mapreduce

2013-09-24 Thread Toby Corkindale
On 25/09/13 11:20, Charl Matthee wrote: Hi, I am trying to run the following mapreduce query across my cluster: # curl -XPOST http://10.179.229.209:8098/mapred -H Content-Type: application/json -d '{inputs:tweets, query:[{map:{language:javascript, source:function(value, keyData, arg) {t =

Re: Debugging mapreduce

2013-09-24 Thread Charl Matthee
Hi, On 25 September 2013 03:44, Toby Corkindale toby.corkind...@strategicdata.com.au wrote: Have you tried executing your javascript outside of Riak? ie. paste the function into the Chrome debugger, then call it with a Riak-like data structure. The problem with this approach is I need to