store/delete of key possible in MR

2014-12-09 Thread niedomnie
is it possible to delete or store new key alongside MR job? in JavaScript? any example? is it possible to determine if key still exists (not deleted) in MR job? how ? example? -- View this message in context: http://riak-users.197444.n3.nabble.com/store-delete-of-key-possible-in-MR-tp4032242.h

Re: system metrics monitoring

2014-12-09 Thread Shane McEwan
G'day! I use Zabbix[1] which will monitor most of those metrics out of the box (and much, much more). Cacti, Munin, Nagios and Collectd are also good alternatives. [1] http://www.zabbix.com/ Shane. On 09/12/14 06:23, pragya jain wrote: > hello all! > > As mentioned at statistics and monitorin

How you are dealing with spikes?

2014-12-09 Thread Alexander Popov
I have Riak 2.0.1 cluster with 5 nodes ( ec2 m3-large ) with elnm in front sometimes I got spikes up to 10 seconds I can't say that I have huge load at this time, max 200 requests per second for all 5 nodes. Most expensive queries is * list by secondary index ( usually returns from 0 to 100 re

Re: store/delete of key possible in MR

2014-12-09 Thread Christopher Meiklejohn
> On Dec 9, 2014, at 11:55 AM, niedomnie wrote: > > is it possible to delete or store new key alongside MR job? > in JavaScript? > any example? Do you mean and write keys from within a MapReduce job? - Christopher Christopher Meiklejohn Senior Software Engineer Basho Technologies, Inc. cmeikle

Re: How you are dealing with spikes?

2014-12-09 Thread Luke Bakken
Hi Alexander, Can you comment on the read vs. write load of this cluster/ Could you please run the following command and reply with the output? sysctl -a | fgrep vm.dirty_ We've seen cases where dirty pages get written in a synchronous manner all at once, causing latency spikes due to I/O block

Re: Questions about how I want to use riak

2014-12-09 Thread Luke Bakken
Hi Paige, > - First of all I want to create a bucket for every user that signs up on my > website. I see in the documentation it says: > > "If you want to avoid setting a limit on per-user bucket creation, you can > setmax_buckets_per_user to unlimited." That statement is from the Riak CS docum

Re: system metrics monitoring

2014-12-09 Thread Kyle Marek-Spartz
Riemann is another option. http://riemann.io/ Shane McEwan writes: > G'day! > > I use Zabbix[1] which will monitor most of those metrics out of the box > (and much, much more). > > Cacti, Munin, Nagios and Collectd are also good alternatives. > > [1] http://www.zabbix.com/ > > Shane. > > On 09/1

Re: How you are dealing with spikes?

2014-12-09 Thread Alexander Popov
Stats when recent spike happens for 15 minutes around it get (826) save (341) listByIndex (1161) mapReduce (621) //Input is IDs list SOLR (4294) 6 Solr requests was longer than 9sec ( all returns 0 rows ) 4 Solr requests was longer within 4-5s ( both returns 0 rows ) 11 listByIndex re

Re: How you are dealing with spikes?

2014-12-09 Thread Bryan Hunt
Hey Alexander, The times are missing from the leftmost graph (requests). We also don't recommend mapreduce and 2i for user initiated requests. You would have much more stable response times if you precalculated that stuff (just as when using a relational database). mapreduce and 2i are coverage qu

How to re-index bucket for Riak Search

2014-12-09 Thread Jeffrey Peck
I have a bucket with about 5 million objects, associated with a search index. I recently made a change to the schema and I would like Riak to re-index all data in the bucket. Is this possible? This is not for production. I am just experimenting, so it is not a major problem if I need to re-pro