Re: First stab at sizing a cluster

2013-10-21 Thread Mark Phillips
Hi Nathan, One alternative to the pure 2i-based solution for this would be time boxing. Sean referenced it a few months back on the list [1] and it's worth investigating. There are a few other resources I'm failing to remember at the moment but I'll send them along tomorrow if I do. That said, 2i

1.4.2: 'riak-admin reip' no longer works?

2013-10-21 Thread Dave Brady
Hi everyone, So, I went to copy /var/lib/riak/* from one five-node cluster to another, so that we could experiment on the data. I did this fairly frequently in the past ( 1.4.0), and always used riak-admin reip old new. Now, when I try that command on our 1.4.2 ring, 'riak-admin' dies with

Riak CS with a NFS storage backend

2013-10-21 Thread Adrian Nicolae
Hello, I want to try the following setup for a cloud-storage project : - a cluster of x86 servers with SAS drives running Riak CS - the replication for the metadata will be Nx3 on the servers running Riak - data for the objects will be stored on a NFS shared storage (SONAS probably)

Re: Riak CS with a NFS storage backend

2013-10-21 Thread John Daily
If you really want an S3 API layer around NFS, I suspect you'd be better off taking the code from Riak CS and creating your own solution than attempting this approach. One example of how this would run into trouble: if any server fails, nearly every large object would be unavailable because of

Re: 1.4.2: 'riak-admin reip' no longer works?

2013-10-21 Thread Dave Brady
Thanks to Joe Caswell at Basho: just have to comment out line 382 (node_up_check) in the riak-admin script. -- Dave Brady - Original Message - From: Dave Brady dbr...@weborama.com To: riak-users@lists.basho.com Sent: Lundi 21 Octobre 2013 13:59:37 Subject: 1.4.2: 'riak-admin reip' no

Re: 1.4.2: 'riak-admin reip' no longer works?

2013-10-21 Thread Jared Morrow
This was a mistake on my part, if you s/up/down/ (node_down_check) on that line it will correctly ensure the node is down before running reip. Sorry about that, clearly 'reip' is not heavily used with the new cluster commands and it slipped under the radar for all these months. -Jared On Mon,

Re: secondary indexes limit

2013-10-21 Thread Louis-Philippe Perron
I had heard from a possibly unfounded source that creating over 1000 different secondary indexes could place a burden on cluster performance. Can anyone confirm that? L-P On Fri, Oct 18, 2013 at 5:55 PM, Alexander Sicular sicul...@gmail.comwrote: I think that's just a memory limit. mo 2i

Re: 1.4.2: 'riak-admin reip' no longer works?

2013-10-21 Thread Dave Brady
...more to point: will riak_kv_console:reip still exist, and just not be surfaced in riak-admin, or will the function be removed? -- Dave Brady - Original Message - From: Dave Brady dbr...@weborama.com To: Jared Morrow ja...@basho.com Cc: Riak Users Mailing List

Re: secondary indexes limit

2013-10-21 Thread Russell Brown
Hi Louis-Philippe, It costs to create secondary indexes. Nothing is free. But I'm not sure what 1000 different secondary indexes means. When you add secondary indexes we store the name of the index and the value it indexes as part of the object metadata and on disk in an index. I'm sure our

Re: 1.4.2: 'riak-admin reip' no longer works?

2013-10-21 Thread Jared Morrow
We actually discussed this recently, my understanding of reip was clearly not complete, and Joe Caswell put me on the right track. 'reip' will continue to stick around. -Jared On Mon, Oct 21, 2013 at 8:23 AM, Dave Brady dbr...@weborama.com wrote: No problem, Jared! I'm happy it was a very

Re: 1.4.2: 'riak-admin reip' no longer works?

2013-10-21 Thread Dave Brady
Thanks for clarifying it! This functionality has been *great* to create quick-and-dirty test rings. -- Dave Brady - Original Message - From: Jared Morrow ja...@basho.com To: Dave Brady dbr...@weborama.com Cc: Riak Users Mailing List riak-users@lists.basho.com Sent: Lundi 21

Re: 1.4.2: 'riak-admin reip' no longer works?

2013-10-21 Thread Brady Wetherington
Huh. I thought we were supposed to use force-replace instead of reip? I remember having a discussion a few months back about the documentation and we cleared it up a little. Is reip the same as force-replace, or is it more...quick-and-dirty? Is it deprecated? -B. On Mon, Oct 21, 2013 at 11:33

Re: 1.4.2: 'riak-admin reip' no longer works?

2013-10-21 Thread Joe Caswell
Reip is the old, evil way to do it that is fraught with peril. When it works it works spectacularly, and when it doesn't, it fails spectacularly. The only use case left for reip is when you have simultaneously changed the node name for every node in the cluster, such as when loading an entire

Re: secondary indexes limit

2013-10-21 Thread Louis-Philippe Perron
Hi Russel, sorry for the confusion, when I talk about different indexes, I talk about different index names, each key only having around 10 indexes. The cluster is rather small, 2 nodes, with a dataset of about 25GB representing around 30 key entries with a possible total secondary index

Counting .SST tables in Level DB

2013-10-21 Thread Dave King
From the Riak LevelDB Page http://docs.basho.com/riak/latest/ops/advanced/backends/leveldb/ Where server resources allow, the value of max_open_files should exceed the count of .sst table files within the vnode's database directory. Is the vnode's database directory the numbered directory under

Re: Counting .SST tables in Level DB

2013-10-21 Thread Matthew Von-Maszewski
responses inline in '[ ]'On Oct 21, 2013, at 1:20 PM, Dave King djk...@gmail.com wrote:From the Riak LevelDB Pagehttp://docs.basho.com/riak/latest/ops/advanced/backends/leveldb/"Where server resources allow, the value of max_open_files should exceed the count of .sst table files within the vnode's

Date implementation in Riak's java vm

2013-10-21 Thread Toby Corkindale
Hi, I've been having some trouble getting the javascript vm in Riak to operate correctly on Date objects. According to this, I should be able to create dates using an ISO8601 date string, or a simplified -MM-DD format. http://www.ecma-international.org/ecma-262/5.1/#sec-15.9.1.15