Re: find() Suddenly Works on Quorum Change

2013-02-14 Thread Brian Sparrow
Hi Ian, Did you retry the request with R=3 immediately after the failed read. What most likely happened was read-repair kicked in after the unsuccessful read and fixed all 3 replicas of the object. Generally it is a good idea to retry all r_val_unsatisfied requests as read-repair should fix t

Riak Java client v1.1.0

2013-02-14 Thread Brian Roach
Greetings! Today we have released the latest version of the Java client for Riak, v1.1.0 This is available immediately from Maven Central by adding the following to your project's pom.xml: com.basho.riak riak-client 1.1.0 pom For those not using maven we provide a single .jar

erlang riak connection pool by Unison Technologies

2013-02-14 Thread Igor Karymov
https://github.com/unisontech/uriak_pool Main features Graceful handling of riak nodes starts and shutdowns simultaneous work with different riak clusters parse_transform generation for interfaces from the client code simple configuring using erlang configuration files reconfiguration in runtime te

Re: Riak Data-UI

2013-02-14 Thread Christopher Meiklejohn
Hi Chad, I've started sketching out contribution instructions and guidelines here: https://github.com/basho/riak_control/wiki/Contributing-to-Riak-Control I'd appreciate any feedback on how this could be clearer, or more helpful. - Chris -- Christopher Meiklejohn Software Engineer Basho

Re: Riak Java client 100% CPU

2013-02-14 Thread Brian Roach
Daniel - Yes, sorry about that. This has been corrected in the current master on github and version 1.1.0 of the client will be released today. https://github.com/basho/riak-java-client/pull/212 Thanks! Brian Roach On Thu, Feb 14, 2013 at 9:31 AM, Daniel Iwan wrote: > I see 100% CPU very regula

Riak Java client 100% CPU

2013-02-14 Thread Daniel Iwan
I see 100% CPU very regularly on one of the Riak client (v1.0.7) threads. I think the place where it spins is connection reaper in RiakConnectionPool I looked at it briefly and it seems that when it finds first connection using peek but that does not expired it can spin in tight while loop. I gues

Re: ListKeys or MapReduce

2013-02-14 Thread Jeremiah Peschka
Thanks for the insight into this. --- Jeremiah Peschka - Founder, Brent Ozar Unlimited MCITP: SQL Server 2008, MVP Cloudera Certified Developer for Apache Hadoop On Thu, Feb 14, 2013 at 4:40 AM, Christian Dahlqvist wrote: > Hi OJ, > > The do_prereduce parameter makes it possible to have the fir

Deutsch Riak meet-ups: Muenchen und Hamburg

2013-02-14 Thread Matthew Revell
Hallo! We have two Riak meet-ups in Germany next week: * Monday 18th Feb in Munich: http://www.meetup.com/Riak-Munchen/events/100799492/ * Wednesday 20th Feb in Hamburg: http://www.meetup.com/Riak-Hamburg/events/102504802/ Both events are also on Xing: * Munich: https://www.xing.com/e

Re: ListKeys or MapReduce

2013-02-14 Thread Christian Dahlqvist
Hi OJ, The do_prereduce parameter makes it possible to have the first iteration of the reduce phase execute where the preceding map phase generated output. This can, as in the example I provided, be used to reduce the amount of data that needs to be sent across the network. This is described in

Re: ListKeys or MapReduce

2013-02-14 Thread OJ Reeves
Chris, I've never heard of do_prereduce before. What kind of effect does this have? That is, if someone were to use it all the time, regardless of the amount of data being returned, would this be a bad thing? Thanks. OJ On Thu, Feb 14, 2013 at 6:19 PM, Christian Dahlqvist wrote: > Hi, > > For b

Re: Tune Riak for fast inserts - populate DB

2013-02-14 Thread Bogdan Flueras
On 02/14/2013 12:19 PM, Erik Søe Sørensen wrote: Those 18.4MB/s is utilized bandwidth, I presume? Yes. What I find odd is that riak is writing max 6-700KB/sec on disk. And how about the net between client and Riak? They're on the same machine: the Java client and the riak process (one node).

Re: Tune Riak for fast inserts - populate DB

2013-02-14 Thread Erik Søe Sørensen
Those 18.4MB/s is utilized bandwidth, I presume? And how about the net between client and Riak? Further questions: - Which backend are you using - LevelDB? (If LevelDB: how does it look over time - is it faster at first, but slowing down?) - And how many writes do you do in parallel? If you

Re: Tune Riak for fast inserts - populate DB

2013-02-14 Thread Bogdan Flueras
What I have is: Network bandwidth between nodes: 18.4 MB/sec Network cards: 1.000Mbps full duplex Riak process: IO: avg 600 K/s for disk write, 7% RAM used, 17% CPU used Doesn't seem notwork bottleneck. ing. Bogdan Flueras On Thu, Feb 14, 2013 at 11:21 AM, Bogdan Flueras wrote: > What I have

Re: ListKeys or MapReduce

2013-02-14 Thread Christian Dahlqvist
Hi, For buckets with a significant number of records, it makes a lot of sense to run the example I provided with 'do_prereduce' enabled as it will result in considerably less data being sent between the nodes. This can be enabled as follows: curl -XPOST http://localhost:8098/mapred -H 'Cont

Re: Tune Riak for fast inserts - populate DB

2013-02-14 Thread Erik Søe Sørensen
Just to rule something out: what is the capacity of the network between the cluster and the client - and among the cluster nodes? Oprindelig meddelelse Fra: Shuhao Dato: Til: riak-users@lists.basho.com Emne: Re: Tune Riak for fast inserts - populate DB Hi, I've had similar

Re: ListKeys or MapReduce

2013-02-14 Thread Christian Dahlqvist
Hi Jeremiah, It does indeed not seem to be documented on the main docs site, and I will try to correct this. The only place I have found it described is on the wiki for the Ruby client (https://github.com/basho/riak-ruby-client/wiki/Secondary-Indexes). Below is also an example of a simple map