Re: Proposal for chunked storage (related to Lowlevel Access to RiakCS objects)

2014-04-04 Thread Timo Gatsonides
Since this is related to my earlier question: sorry to have let you wait, Timo. Kelly, the reason I brought up my original question was because my use case involves delivering videos under load. Suppose there is a cluster of 50 nodes with a replication value of three. Now if a random

Re: Proposal for chunked storage (related to Lowlevel Access to RiakCS objects)

2014-04-04 Thread Brian Akins
I realize I am somewhat re-inventing the wheel. However I do not need an S3 interface Then you could just do what you are wanting in Riak. No need for low-level access to Riak-CS, etc. You could look to CS for inspiration, I suppose. Also, Stanchion is only needed when doing user related

LevelDB parameter planning - max_open_files

2014-04-04 Thread Oleksiy Krivoshey
Can someone please suggest how to understand the formula for open_file_memory on this page: http://docs.basho.com/riak/latest/ops/advanced/backends/leveldb/#Parameter-Planning 1. It definitely lacks some brackets, the correct formula is: OPEN_FILE_MEMORY = (max_open_files-10) * (184 +

Re: Instability due to HAProxy /ping health checks

2014-04-04 Thread Luke Bakken
Gabriel, We received information about this incident yesterday and have been discussing it internally. Thank you for providing such a detailed diagnosis. There must be something about the default httpchk headers that triggers a bug. I'll follow up if we need more information. In the meantime,

Re: LevelDB parameter planning - max_open_files

2014-04-04 Thread Matthew Von-Maszewski
Oleksiy, Go to step 6: Compare Step 2 and Step 5 …. There is a link to an Excel spreadsheet at the end of the sentence The above calculations are automated in this memory model spreadsheet.. Forget the text and use the spreadsheet (memory model spreadsheet). Much of that text is still

Re: LevelDB parameter planning - max_open_files

2014-04-04 Thread Matthew Von-Maszewski
Copying back to mailing list for others and archive. On Apr 4, 2014, at 11:37 AM, Oleksiy Krivoshey oleks...@gmail.com wrote: Great! I'm trying 2.0 right now and have found that 'total_leveldb_mem' and 'total_leveldb_mem_percent' are really much easier to use and understand. Thanks!

Delay between creating indexes and assigning search_index to bucket in pre20

2014-04-04 Thread Brendan Callahan
Hello all, We've just tried upgrading from 2.0.0pre11 - 2.0.0pre20 and have noticed some new behavior. In pre11, the following steps worked just fine: 1. create custom schema 2. create index with that schema 3. update bucket props: search_index to the new index name However, in pre20, step 3

Re: Change data directory

2014-04-04 Thread Matthew Von-Maszewski
Are you using leveldb or bitcask back end? What is your desired data directory? I will create an example. Sent from my iPhone On Apr 4, 2014, at 3:05 PM, Nabil Hassein na...@betterpath.com wrote: Hello all, I'm trying to change /etc/riak/app.config to store data in a directory of my

Re: Change data directory

2014-04-04 Thread Jordan West
https://gist.github.com/jrwest/a37e3fff5917f0bd44eb is a recent app.config I used on a 1.4.x cluster w/ CentOS. Look at the paths that start w/ /data/riak. If you're still having issues, or you have changed all the paths: are there any errors in the Riak logs? Cheers, Jordan On Fri, Apr 4, 2014

Re: Change data directory

2014-04-04 Thread Nabil Hassein
Thanks very much for your prompt replies. I am using the bitcask backend. For now I am just trying to use /home/nabil/riak as the directory as I test this out on my development machine, although naturally that is not the ultimate destination we have in mind for our production servers. I have

Re: Change data directory

2014-04-04 Thread Jordan West
Hey Nabil, Riak is having trouble finding or creating the ring directory. From your logs: 2014-04-04 15:44:41.655 [critical] 0.147.0@riak_core_app:start:54 Ring state directory /home/nabil/riak/ring does not exist, and could not be created: permission denied Jordan On Fri, Apr 4, 2014 at

Re: Change data directory

2014-04-04 Thread Nabil Hassein
Even after a manual `mkdir /home/nabil/riak/ring sudo chown riak:riak /home/nabil/riak/ring`, I still can't start the riak service. On Fri, Apr 4, 2014 at 3:58 PM, Jordan West jw...@basho.com wrote: Hey Nabil, Riak is having trouble finding or creating the ring directory. From your logs:

Re: Change data directory

2014-04-04 Thread Jordan West
how are you starting Riak? Did you install a package or are you building from source? Jordan On Fri, Apr 4, 2014 at 1:00 PM, Nabil Hassein na...@betterpath.com wrote: Even after a manual `mkdir /home/nabil/riak/ring sudo chown riak:riak /home/nabil/riak/ring`, I still can't start the riak

Re: Change data directory

2014-04-04 Thread Nabil Hassein
I installed the binary via yum. On Fri, Apr 4, 2014 at 4:02 PM, Jordan West jw...@basho.com wrote: how are you starting Riak? Did you install a package or are you building from source? Jordan On Fri, Apr 4, 2014 at 1:00 PM, Nabil Hassein na...@betterpath.comwrote: Even after a manual