Re: Riak - which O.S. to use?

t RHEL7/CentOS7 to be a reasonable choice in terms of the planned end-of-life date. -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: [ANN] Riak CS Is Now Open Source!

ring and pretty much anything else you'd expect from a cloud > store like S3. Does CS perform any chunk-level de-dup like Luwak? And if so, does it offer a sane way to delete items? -- Les Mikesell lesmikes...@gmail.com ___ riak-

Re: Atomicity of if_not_modified?

es failed. > > Can you post a link that confirms this when DW (on top of R) is set to 2 and > N=3? Do the initial reads to pick up the vector clock need to see a quorum before any writes happen here? I suppose you could still have a scenario where the partitioning happens between

Re: Atomicity of if_not_modified?

#x27;t contact each other? If it weren't for that possibility, it could just elect a master and do real atomic operations. -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: SSH Key?

or should I just trust it? > ssh/putty will remember host keys from previous connections and you only get the warning when they are new or different. If you just created a new VM, then you are the one who knows if it should be trusted or not... -- Les Mikesell lesmik

Re: Is Riak suitable for s small-record write-intensive billion-records application?

nces/appendices/comparisons/Riak-Compared-to-Couchbase/ > is the one for Riak v. Couchbase. Do you know how bigcouch fits into this picture? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http

Re: Is Riak suitable for s small-record write-intensive billion-records application?

locking mechanism if well designed will always take > care of that. If it is easy, why doesn't riak handle it? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Is Riak suitable for s small-record write-intensive billion-records application?

to be just as distributed and robust as riak? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Is Riak suitable for s small-record write-intensive billion-records application?

at you're > going to lose. And even that only works for a single writer. It won't prevent concurrent creation of the same key by different writers - there is no atomic operation for that. -- Les Mikesell lesmikes...@gmail.com ___ riak-u

Re: Read-Write-Read for enforcing read-repair

read-write-read sequence is acceptable or applied > pattern for such cases or are there any other solutions to this problem? Or > am I just expecting too much? I don't think riak has any transaction-like concepts or any way to give one writer precedence over another in the case of concur

Re: Solr Indexing and required fields.

x27;t be as simple as just using one small current index when storing data, but on the expire side you'd just drop the whole chunk. -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Solr Indexing and required fields.

r some timespan, and being able to expire by just dropping old indexes as they age without having to rewrite anything. -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/m

Re: Most efficient way to determine if 1000 specific keys exist?

how big a range would be more efficient to retrieve by asking for all possible keys vs. a map-reduce? Or is there a way to write a map-reduce so that it computes the possible keys in a range and returns any matching values instead of scanning the keyspace for them? -- Les Mikese

Re: Riak Adoption - What can we do better?

On Sat, Apr 21, 2012 at 12:55 PM, Gideon de Kok wrote: > Op zaterdag 21 april 2012, om 19:50 heeft Les Mikesell het volgende > geschreven: > > Is there 'something like redis' that doesn't introduce a single point > of failure? And a completely different set of ad

Re: Riak Adoption - What can we do better?

failure? And a completely different set of administrative concepts? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Riak Adoption - What can we do better?

t the risks; it's > something most people have no idea exists. But that's what we are talking about here. Riak handles the scenario where you continue in spite of risks nicely, but there are things your application may do where it is better to fail than be wrong. Do you maintain a

Re: Riak Adoption - What can we do better?

than NTP at fixing it, but why even continue to run in that state? If all it takes is a good clock for reliability, let's build good clocks. -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com htt

Re: Operations: Commodity hardware OK, or does Riak need ECC memory?

cause by definition RIAK is already redundant). This wasn't a riak server - just pointing out that bad RAM does happen, and it can cause strange things. (It was actually a machine holding backups which could have been even worse if we had happened to need them). -- Les Mikesell les

Re: Operations: Commodity hardware OK, or does Riak need ECC memory?

be the same. I've actually seen a scenario where intermittent RAM problems caused mostly hidden differences in the two disk instances of a software raid mirror. It wasn't fun to diagnose and fix since the disk reads would randomly have good and bad data even after the RAM was fixed. I

Re: Absolute consistency

ts and CP > requests. Perhaps there will be more to discuss on that point later on > this year. Yes, even understanding that you can't guarantee both at once, you could let the client decide which it wants. Some things can wait. -- Les Mikesell lesmikes...@gmail.com ___

Re: Absolute consistency

only node that doesn't store data on the same box with the application so you don't need to go through a separate load balancer to deal with failures of the node the app is configured to use. -- Les Mikesell lesmikes...@gmail.com ___ riak

Re: Absolute consistency

On Wed, Jan 11, 2012 at 10:39 AM, Ian Plosker wrote: > Les, > > In Riak, there is no single primary copy considered the canonical version. > For each key, there will be N (3 by default) partitions responsible for > storing the associated value. In effect, there are N primaries for any key. > This

Re: Absolute consistency

On Tue, Jan 10, 2012 at 8:52 PM, Justin Sheehy wrote: > > On Jan 10, 2012, at 9:42 PM, Les Mikesell wrote: > >> How do things like mongo and elasticsearch manage atomic operations >> while still being redundant? > > Most such systems use some variant of primary copy

Re: Absolute consistency

ns while still being redundant? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Absolute consistency

> double[1] the amount of hardware needed to achieve a single amount of > redundancy. Or perhaps that you want to use more nodes so having one down doesn't impact the others so much. -- Les Mikesell lesmikes...@gmail.com ___ ria

Re: atomically updating multiple keys

ery operation. I think riak has a concept of a partition 'owner' node, but it is used only in the data migration process for failover and node adds/removes, not to give ordinary writes an atomic property. -- Les Mikesell lesmikes...@gmail.com _

Re: Searching across multiple buckets

f buckets for you - with the reduce returning the values? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: diverting riak as a filesystem replacement

s/ I believe they only provide an http layer for access, not file system emulation though, and the software isn't open source. -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: What is the best way to model relationships in Riak from 1.0 forward?

ly (linkname,1) in one operation? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: diverting riak as a filesystem replacement

od place to > start for your use case. > There is something called 'moosefs' that is probably already close to what you are looking for, but I agree that it would be nice to have riak as the distributed db underneath. http://www.moosefs.org/ -- Les

Re: Achieving 100% consitency

node cluster? Or, for that matter on a 3-node cluster on the same box where partitioning isn't going to happen without some unusual intervention to emulate it? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: NoSQL combinations - what works best?

the same time as new items with no vector clock history. -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: NoSQL combinations - what works best?

ith persistent data on the server. I'm not sure how that works but I like the idea of clients that know how to load balance and fail over. -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http:

Re: NoSQL combinations - what works best?

lot of time making it work reasonably when some of the servers fail. You'd have to repeat that work for anything else and then it still probably wouldn't cache better than memcache. -- Les Mikesell lesmikes...@gmail.com ___ riak

Re: NoSQL combinations - what works best?

of memcache is that it is distributed and the clients automatically handle failover at any reasonably large scale. How do you arrange that with redis? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com

Re: High volume data series storage and queries

ter at handling small or naturally-ordered bits of data match riak's ability to scale up and down or handle schema changes without a lot of human intervention? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.

Re: In-Memory Performance

with storing and retrieving sometimes-consistent data. If atomic operations were an optional feature requiring a specified master/slave arrangement on certain nodes that you would have to keep mostly-working, you wouldn't lose any existing functionality and you could still tr

Re: Riak scenarios

s-heavy or requires a lot of adhoc queries. Will the upcoming index support make it suitable for time series data with range queries? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.c

Re: In-Memory Performance

erver nodes? Perhaps it is sending the request directly to the correct master node for each key where the riak client is likely to send to the wrong one which will then have to relay it and coordinate the status responses from the ones that own that key. -- Les Mikesell lesmikes...@gmai

Re: In-Memory Performance

s about multiple nodes for auto-failover, and the optional addition of some special master-slave nodes that could be used for atomic operations without needing to use a completely different client library for them. -- Les Mikesell lesmikes...@gmail.com

Re: In-Memory Performance

ke you need a cache, so why not use one? Are you confusing membase with memcache? The former is a persistent, replicated store, or at least that is the claim; the latter a cache. http://www.couchbase.org/wiki/display/membase/Membase+Architecture -- Les Mikesell lesmikes...@gmail.com

Re: scp data

. and riak-admin restore from that file. works like a charm. and you can selectively backup/restore a node, or a the whole cluster. Assuming the nodes are well-connected, does this work better than adding a new node, letting data migrate there, then removing the old one? -- Les Mikesell

Re: CentOS 5.6 and Riak

? Why not just use the .el5 RPMs? They include erlang. I'm running the riak-search version, but either should work on Centos5.6. -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com

Re: Riak Recap Blog Now Operational!

ibers. Thanks! I can confirm that the rss feed works nicely if you paste it into google reader where you can access it from either the web page or the phone app (and reading from either clears it from the unread messages). -- Les Mikesell lesmikes...@gmai

Re: Concurrency hazard when updating links

know that the link updates may have conflicted or does the server do some kind of resolution during the walk? Les Mikesell lesmikes...@gmail.com On 6/22/2011 10:23 AM, Mathias Meyer wrote: And here's the link I neatly forgot to include: http://wiki.basho.com/Vector-Clocks.html Ma

Re: Deleting Keys vs. Specifying a Null Value for a Key

en to make concurrent changes and revived old versions eventually consistent, you have to store something. -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/lis

Re: speeding up riaksearch precommit indexing

stamp and have a queue processor move writes to the "final" bucket once they're over a certain age? It can dedup/validate at that point too. On Tue, Jun 21, 2011 at 2:26 PM, Les Mikesell wrote: Where can I find the redis hacks that get close to clustering? Would membase

Re: speeding up riaksearch precommit indexing

cluster with a RAM backend and use that as a queue, probably with similar performance. The idea here is that you can scale these clusters (the "queue" and the indexed production data) independently in response to your load patterns, and have optimum hardware and I/O specs for the dif

Re: speeding up riaksearch precommit indexing

Is there a good way to handle something like this with redundancy all the way through? On simple key/value items you could have two readers write the same things to riak and let bitcask cleanup eventually discard one, but with indexing you probably need to use some sort of failover approach up

Re: Problem with deleting keys

replicated datastore. If you loose a node, you shrug, replace it with a new one and go about your business. Am 16.06.2011 19:21, schrieb Les Mikesell: But we expect something different in the case where a value was updated and the more current value is available on other nodes. Restoring an old value do

Re: Problem with deleting keys

Meyer mailto:nico.me...@adition.com>> wrote: Yes, but the same is true if you restore a relational DB from backup :-D Am 16.06.2011 18:49, schrieb Les Mikesell: On 6/16/2011 10:22 AM, Nico Meyer wrote: Btw, this whole issue is not really Riak spec

Re: Problem with deleting keys

fix - where for one reason or another you need to restore a backed up bitcask file that contains items deleted after the time the backup was done? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://

Re: Moving mapred* functions out of riak_client?

round-robin and retry on their own. -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Index support in Ripple

? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: [RELEASE] Riak and Riak Search 0.14.2

at it doesn't create and then fails to sudo to the riak user that it does add. # service riaksearch start Starting Riak Search: Attempting to restart script through sudo -u riak sudo: sorry, you must have a tty to run sudo [FAILED] -- Le

Re: Riak Recap as a Blog (?)

dividually for every interest you might have. But - if the web site provides an rss feed you can plug it into google reader or similar rss aggregator and still see everything new in one place either with a web browser or smart phone. -- Les Mikesell l

Re: Very, very slow data insert on two node cluster

ntrol the number of writes or just the number of acknowledgments it waits for (i.e. does the server side still attempt the writes configured for the bucket)? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.bash

Re: RiakSearch question

working? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: C++ Riak client?

r Advocate Basho Technologies, Inc. http://basho.com/ On Apr 9, 2011, at 12:10 PM, Les Mikesell wrote: On 4/9/11 10:47 AM, Sean Cribbs wrote: Because it's being confused in this conversation, I think it merits clarification -- the "protocol" that is used to talk to Riak and Goog

Re: C++ Riak client?

rest clients? Or does all access to a bucket have to use the same protocol? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Riak Development Environments

on. It's a makefile setting that makes 3 installations with the correct cinfig settings such that the 3 can be joined together. @siculars on twitter http://siculars.posterous.com Sent from my iPhone On Mar 29, 2011, at 15:52, Les Mikesell wrote: On 3/29/2011 5:33 PM, Mårten Gustafson wrote: O

Re: Riak Development Environments

add other nodes to migrate to production - and maybe eventually remove the originals? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Multiple disks

: Do the redundant writes still go to different physical nodes or just vnodes that might be on the same host and fail at the same time? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.

Re: Riak search timestamps (date/time)

]T[hh][mm][ss] This has the nice property of sorting in chronological order. Is there any hope for a more natural concept of time 'ranges' in riak? Maybe some kind of indexing that would avoid the full bucket scan that you need even with a key prefix match? -- Les Mikesell

Re: riak make fail

t;Thank you, Dan Do you know if appropriate rpm packages are available anywhere for Centos5.x? Or where to find fedora source versions that would work if rebuilt? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list

Re: tuning riak for 100s of concurrent connections

Those settings shouldn't make a big difference in how the number of connections scale up, though. There is a theoretical maximum rate limit for creating new connections as each socket is supposed to sit in TIME_WAIT for a packet round-trip time to ensure that nothing outstanding will collide w

Re: tuning riak for 100s of concurrent connections

sho.com/ On Feb 25, 2011, at 11:52 AM, Les Mikesell wrote: On 2/25/2011 10:37 AM, Sean Cribbs wrote: You can disable Nagle on the riak side (at least on 0.14 and later). Put this in the riak_core section of app.config: {disable_http_nagle, true} Shouldn't that be the default if clients

Re: tuning riak for 100s of concurrent connections

the delay if your protocol isn't a strict serial handshake and you need to send a small packet with data already outstanding (like at the end of a request where the socket isn't being closed). -- Les Mikesell lesmikes...@gmail.com __

Re: Number of replica for Luwak

sioning and periodically copy currently-referenced blocks forward, flip the bucket reference and drop everything in the old bucket? I guess you'd still have to deal with possible re-use during the copy. -- Les Mikesell lesmikes...@gmail.com _

Re: Number of replica for Luwak

On 2/23/2011 9:11 AM, Bryan Fink wrote: On Fri, Feb 18, 2011 at 8:54 PM, Les Mikesell wrote: What happens if there is a read of the object while it is in the process of being updated if the update is several different operations? Luwak streams work in an "all or nothing" fashion

Re: Number of replica for Luwak

is a read of the object while it is in the process of being updated if the update is several different operations? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: riak-search build assumes access to github using 'git' protocol

On 2/17/2011 11:03 AM, Jon Meredith wrote: I commented out the ./rebar get-deps line in the Makefile and ended up with something that seems to work. I'm not sure what I'm missing, though... Did you try downloading the tarball from riak_search-0.14.0-1.tar.gz

Re: Riak instead of memcached?

mbase uses a similar interface but does provide persistent storage. -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: redundant writers

-clocks-are-hard/ Thanks, Dan Daniel Reverri Developer Advocate Basho Technologies, Inc. d...@basho.com On Tue, Feb 15, 2011 at 10:11 AM, Les Mikesell wrote: Is riak suitable as a very reliable store where you have multiple feeds of streaming data that are at least theoretically identical? That is

redundant writers

this a common usage scenario? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

riak search client demo?

Does anyone have something simple to demonstrate what riak-search can do? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Getting all the Keys

-linking tree structure as you ga, but how do you maintain it so as you remove some end/intermediate items you also remove the references from the things linking there? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users

Re: Getting all the Keys

On 1/22/11 1:45 PM, Gary William Flake wrote: Riak is bad at enumerating keys. If the key isn't something that you can use to retrieve the items you want, what's the point of having it? -- Les Mikesell lesmikes...@gmail.com ___

Re: [ANN] Riak 0.14 Released

latest. -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Slow performance using linkwalk, help wanted

. -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Riak Search performance experiences ?

without slowing down because of the distributed nature (assuming the queries are also distributed over the nodes and refer to different data items)? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http

Re: large time series advice

mple rate for some length of time, then average to lower-resolution aggregates as the data ages so you can keep a long history on line. At least with OpenNMS, writing this data is usually what limits the number of devices it can monitor so distributing it would be a big win. -- Les

Re: riak performance

the latency. I've seen things that led me to believe that the guest doesn't get a timeslice until there are 2 cpus available simultaneously. -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.bash

Re: Is there difference between "MapReduce" and "MapReduce in RIAK"?

aho's project to do reporting on top of that? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: basic question: initial server connection failover?

It's not so much a matter of blocking as that it seems wrong to need to add the latency of a forwarding proxy with its own need for a failover mechanism in front of something inherently redundant. I sort of like the 'smart client', 'dumb server' approach of memcache, but that has the problem o

basic question: initial server connection failover?

ind a load balancer or is there some unique way of handling this? -- Les Mikesell lesmikes...@gmail.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com