Re: Data modeling a write-intensive comment storage cluster

2014-01-27 Thread Jeremiah Peschka
--- Jeremiah Peschka - Founder, Brent Ozar Unlimited MCITP: SQL Server 2008, MVP Cloudera Certified Developer for Apache Hadoop On Sun, Jan 26, 2014 at 10:27 PM, fxmy wang fxm...@gmail.com wrote: Thanks for the response, Jeremiah. Then here are my questions: 1) To get better writing

Rak 13.1 error on start

2014-01-27 Thread Daniel Iwan
I just got this right after installing Riak and restarting (Ubuntu 12.04.2) Node name should be riak@10.173.240.5 but is different in this error msg. Vm.args had a correct name ie. riak@10.173.240.5 Moving content /var/lib/riak, killing all riak processes and manual launch via riak start fixed

Riak transfer limit.

2014-01-27 Thread Guido Medina
Hi, What's a good value for transfer limit when re-arranging adding/removing nodes? Or if there is a generic rule of thumb like physical nodes, processors, etc. Once transfer is completed, is it a good practice to set it back to its default value or should the calculated (guessed?) transfer

Issue with 2i sorting on Linux

2014-01-27 Thread Wagner Camarao
I'm using 2i to model a document has many revisions so the index name is a lower case string and the indexed keys are formatted as timestamp_uuid. When I query 2i to grab last revisions on OSX they're always returned correctly, as per riak docs say 2i sorting happens first by index name and then

Re: Riak Search and Yokozuna Backup Strategy

2014-01-27 Thread Elias Levy
On Mon, Jan 27, 2014 at 11:57 AM, Matthew Von-Maszewski matth...@basho.comwrote: Google's designed leveldb to always assume it was not cleanly shutdown. If the startup can read the most recent MANIFEST file, leveldb cleans up the rest of the mess. However, using the backup strategy

Re: Riak Search and Yokozuna Backup Strategy

2014-01-27 Thread Matthew Von-Maszewski
On Jan 27, 2014, at 3:06 PM, Elias Levy fearsome.lucid...@gmail.com wrote: On Mon, Jan 27, 2014 at 11:57 AM, Matthew Von-Maszewski matth...@basho.com wrote: Google's designed leveldb to always assume it was not cleanly shutdown. If the startup can read the most recent MANIFEST file,

Re: Riak Search and Yokozuna Backup Strategy

2014-01-27 Thread Ryan Zezeski
Hi Elias, On Mon, Jan 27, 2014 at 2:40 PM, Elias Levy fearsome.lucid...@gmail.comwrote: Any comments on the backup strategy for Yokozuna? Will it make use of Solr's Replication Handler, or something more lower level? Will the node need to be offline to backup it up? There is no use of

Re: Riak Search and Yokozuna Backup Strategy

2014-01-27 Thread Elias Levy
On Mon, Jan 27, 2014 at 12:29 PM, Ryan Zezeski rzeze...@basho.com wrote: Any comments on the backup strategy for Yokozuna? Will it make use of Solr's Replication Handler, or something more lower level? Will the node need to be offline to backup it up? There is no use of any Solr

Re: Riak Search and Yokozuna Backup Strategy

2014-01-27 Thread Ryan Zezeski
On Mon, Jan 27, 2014 at 4:02 PM, Elias Levy fearsome.lucid...@gmail.comwrote: So it would appear to do it properly, we'd need some support from Yokozuna to take the snapshot, return a list of files to backup or back them up itself (hard links?), and then to allow an application to signal it

Re: Timeouts on Riak Search

2014-01-27 Thread Ryan Zezeski
On Sun, Jan 26, 2014 at 7:41 PM, ender extr...@gmail.com wrote: I am continuously getting the following types of errors in my riak logs: 2014-01-27 00:06:39.735 [error] 0.220.0 Supervisor riak_pipe_builder_sup had child undefined started with {riak_pipe_builder,start_link,undefined} at

Re: Timeouts on Riak Search

2014-01-27 Thread Ryan Zezeski
On Mon, Jan 27, 2014 at 5:20 PM, Ryan Zezeski rzeze...@basho.com wrote: I see you are doing a disjunction search across the type field `(type:image type:video type:FacebookPost)`. How many documents match that sub-query? If it is over 100k then legacy Riak Search will fail to return on the

rocksdb (fb leveldb fork) as riak backend?

2014-01-27 Thread Alexander Sicular
Hey Basho gang, Have you all taken any sort of look at FB's leveldb fork, rocksdb, http://rocksdb.org/? Just watching Dhruba's video it seems like it may be a useful upgrade,

last_write_wins

2014-01-27 Thread Edgar Veiga
Hi there everyone! I would like to know, if my current application is a good use case to set last_write_wins to true. Basically I have a cluster of node.js workers reading and writing to riak. Each node.js worker is responsible for a set of keys, so I can guarantee some kind of non distributed

Re: rocksdb (fb leveldb fork) as riak backend?

2014-01-27 Thread Matthew Von-Maszewski
Basho's leveldb requirements have lead to different optimizations. Facebook has a captive hardware environment and usage case that does not match ours. I am not saying their changes are better or worse, only different. Basho needs: - multiple databases running simultaneously: 6 to 64 -

Re: rocksdb (fb leveldb fork) as riak backend?

2014-01-27 Thread Matthew Von-Maszewski
P.S. I failed to include the link to the wiki page that discusses each of Basho's optimizations for the Riak environment: https://github.com/basho/leveldb/wiki On Jan 27, 2014, at 8:49 PM, Matthew Von-Maszewski matth...@basho.com wrote: Basho's leveldb requirements have lead to different

Re: rocksdb (fb leveldb fork) as riak backend?

2014-01-27 Thread Alexander Sicular
Awesome. I knew there were basho optimizations. Just wondering if there was parity. Cool! @siculars http://siculars.posthaven.com Sent from my iRotaryPhone On Jan 27, 2014, at 17:53, Matthew Von-Maszewski matth...@basho.com wrote: P.S. I failed to include the link to the wiki page that