Re: last_write_wins

2014-01-30 Thread Edgar Veiga
Also, Using last_write_wins = true, do I need to always send the vclock while on a PUT request? In the official documention it says that riak will look only at the timestamp of the requests. Best regards, On 29 January 2014 10:29, Edgar Veiga wrote: > Hi Russel, > > No, it doesn't depend. It'

Re: last_write_wins

2014-01-30 Thread Russell Brown
On 30 Jan 2014, at 10:37, Edgar Veiga wrote: > Also, > > Using last_write_wins = true, do I need to always send the vclock while on a > PUT request? In the official documention it says that riak will look only at > the timestamp of the requests. Ok, from what you’ve said it sounds like you a

Re: last_write_wins

2014-01-30 Thread Guido Medina
Hi, Now I'm curious too, according to http://docs.basho.com/riak/latest/ops/advanced/configs/configuration-files/ the default value for Erlang property last_write_wins is false, now, if 95% of the buckets/keys have no siblings (or conflict resolution), does that mean that for such buckets las

Re: last_write_wins

2014-01-30 Thread Russell Brown
On 30 Jan 2014, at 10:58, Guido Medina wrote: > Hi, > > Now I'm curious too, according to > http://docs.basho.com/riak/latest/ops/advanced/configs/configuration-files/ > the default value for Erlang property last_write_wins is false, now, if 95% > of the buckets/keys have no siblings (or con

Re: last_write_wins

2014-01-30 Thread Guido Medina
Hi Russell, Thanks for your response, I understand most of it, I know LWW=true and allow_multi=true won't make any sense, but look at this scenario: All of our buckets have allow_multi=false except for the one bucket we have for CRDT counters, our application requires certain some level of c

Re: last_write_wins

2014-01-30 Thread Edgar Veiga
I'll try to explain this the best I can, although it's a simples architecture I'm not describing it in my native language :) I have a set of node.js workers (64 for now) that serve as a cache/middleware layer for a dozen of php applications. Each worker deals with a set of documents (it's not a di

Failed: This node is already a member of a cluster

2014-01-30 Thread Naveen Tamanam
Hi All, I am getting the following error even through the node is not a member of cluster. The cluster is not prepared yet. First time I ran the nodes and I was trying to join them in the cluster. [root@node1 riak]# bin/riak-admin cluster join node3@172.31.6.244 Failed: This node is already a me

Re: Failed: This node is already a member of a cluster

2014-01-30 Thread Brian Roach
>From your prompt you're in node1's install directory and node1 *is* already a member of a cluster, as shown in member-status. You need to run the riak-admin command from the directory for the node that is joining; http://docs.basho.com/riak/latest/quickstart/#Create-the-Cluster On Thu, Jan 30,

Re: last_write_wins

2014-01-30 Thread Jason Campbell
I'm not sure Riak is the best fit for this. Riak is great for applications where it is the source of data, and has very strong consistency when used in this way. You are using it as a cache, where Riak will be significantly slower than other cache solutions. Especially since you say that each

Re: last_write_wins

2014-01-30 Thread Eric Redmond
Actually people use Riak as a distributed cache all the time. In fact, many customers use it exclusively as a cache system. Not all backends write to disk. Riak supports a main memory backend[1], complete with size limits and TTL. Eric [1]: http://docs.basho.com/riak/latest/ops/advanced/backend

Re: last_write_wins

2014-01-30 Thread Edgar Veiga
Hi! I think that you are making some kind of confusion here... I'm not using riak for cache purposes, thats exactly the opposite! Riak is my end persistence system, I need to store the documents in a strong, secure, available and consistent place. That's riak. It's like I've said before, just mak

Re: last_write_wins

2014-01-30 Thread Eric Redmond
For clarity, I was responding to Jason's assertion that Riak shouldn't be used as a cache, not to your specific issue, Edgar. Eric On Jan 30, 2014, at 2:54 PM, Edgar Veiga wrote: > Hi! > > I think that you are making some kind of confusion here... I'm not using riak > for cache purposes, tha

Re: last_write_wins

2014-01-30 Thread Edgar Veiga
Yes Eric, I understood :) On 30 January 2014 23:00, Eric Redmond wrote: > For clarity, I was responding to Jason's assertion that Riak shouldn't be > used as a cache, not to your specific issue, Edgar. > > Eric > > On Jan 30, 2014, at 2:54 PM, Edgar Veiga wrote: > > Hi! > > I think that you ar

Re: last_write_wins

2014-01-30 Thread Edgar Veiga
Here's a (bad) mockup of the solution: https://cloudup.com/cOMhcPry38U Hope that this time I've made myself a little more clear :) Regards On 30 January 2014 23:04, Edgar Veiga wrote: > Yes Eric, I understood :) > > > On 30 January 2014 23:00, Eric Redmond wrote: > >> For clarity, I was res

Re: last_write_wins

2014-01-30 Thread Jason Campbell
Oh, I completely misunderstood, I'm sorry for that. I was thinking of your application as a typical web application which could regenerate the data at any time (making that the authoritative source, not Riak). In that case, Riak does sound perfect, but I would definitely not use the memory bac

Re: last_write_wins

2014-01-30 Thread Edgar Veiga
No problem Jason, I'm glad you've tried to help :) I'm using leveldb backend, and the system is running in production for about 6 months. It's being quiet an interesting experience, but now that the load is getting bigger and the amount of data in riak too, we need to start tunning this little thi

Re: Custom hashing (partitioning) functions

2014-01-30 Thread Sargun Dhillon
Cool, I went ahead and created an issue a little while ago: https://github.com/basho/riak_kv/issues/811 It's not so much of a blocker for us, because the product team working with custom partitioners and Riak. It's just something that people might want to keep an eye out in the future when using M

Re: last_write_wins

2014-01-30 Thread John Daily
Replies inline. (Thanks to Russell for the link to my blog series, but honestly, as I now re-read the section on conflict resolution, I’m unhappy with it. It’s a very confusing topic and I regret not doing a better job of clarifying it. This answer will undoubtedly also be more confusing than I