Re: Caching in RIAK CS

2013-08-12 Thread Kota Uenishi
Hi, Putting varnish in front of Riak CS nodes seems a good idea, if the load concentrates on small number of videos whose total size fits in varnish's memory. Yet I'm not sure how varnish works in caching. Putting varnish between Riak CS and Riak is not a good idea because they communicates with p

Re: Caching in RIAK CS

2013-08-12 Thread Andre Lohmann
Hi Kota, one idea that came up was to work with varnish. You are right, Video Filesize can range from mega to gigybytes. So it would be usefull, if the cache is self organizing and deleting lesser used files, when space is needed. Varnish is a nice solution for that, but it lacks one problem. Th

Re: Caching in RIAK CS

2013-08-12 Thread Kota Uenishi
Currently Riak CS and Riak don't have caching system inside. Because in the context of Riak CS, file size might range so much, say, from kilobytes to terabytes and it's hard to build an efficient caching layer. Also, in the context of Riak, once you read a data from Riak, it is cached under the ker

Re: Practical Riak cluster choices in AWS (number of nodes? AZ's?)

2013-08-12 Thread Brady Wetherington
I will probably stick with EBS-store for now. I don't know how comfortable I can get with a replica that could disappear with simply an unintended reboot (one of my nodes just did that randomly today, for example). Sure, I would immediately start rebuilding it as soon as that were to happen, but we

RFC: Adding Bucket Types to Riak

2013-08-12 Thread Jordan West
riak-users, Adding to the existing list of RFCs for the next release of Riak, Andrew Thompson and I would like to get your feedback on a significant change to Riak's key structure: https://github.com/basho/riak/issues/362 This has an effect on third-party client developers, especially, since it

Re: Practical Riak cluster choices in AWS (number of nodes? AZ's?)

2013-08-12 Thread Hector Castro
On Mon, Aug 12, 2013 at 2:38 PM, Dave Martorana wrote: > Jared - thanks for the links. I'm in the same boat with Brady with weighing > deployment options in AWS. > > Jeremiah - isn't EBS the only option once your data starts reaching into the > hundreds-of-gigs? Several instances give you > 1TB o

Re: Practical Riak cluster choices in AWS (number of nodes? AZ's?)

2013-08-12 Thread Jeremiah Peschka
Nope, depending on how much you want to spend, you can cram up to 42TB into a single AWS instance. Reasonably priced instances can hold 1690GB of data on a single instance. You can see an easy to sort map over here: http://www.ec2instances.info/ I would take Amazon's own recommendations with a gra

Re: Practical Riak cluster choices in AWS (number of nodes? AZ's?)

2013-08-12 Thread Dave Martorana
Jared - thanks for the links. I'm in the same boat with Brady with weighing deployment options in AWS. Jeremiah - isn't EBS the only option once your data starts reaching into the hundreds-of-gigs? Dave On Sun, Aug 11, 2013 at 8:57 PM, Jared Morrow wrote: > +1 to what Jeremiah said, putting a

Specifying the filesystem

2013-08-12 Thread dilip kumar
Hi, How do I specify the filesystem where the RIAK CS buckets could run. Changing the data_root values in storage_backend is not working as it is specified in a FAQ (http://docs.basho.com/riakcs/latest/cookbooks/faqs/riak-cs/#is-it-possible-to-specify-a-file-system-where-my-r). Regards, Dilip

Dallas, SoftLayer, and Riak

2013-08-12 Thread John Daily
Earlier this year SoftLayer and Basho started collaborating to make Riak clusters easy to deploy, and later this month SoftLayer will be hosting and speaking at our first Dallas meetup. If you've ever been curious about just how blazing fast Riak can be on serious bare metal, please join us for

Re: riak core dumped, merge_index corruption?

2013-08-12 Thread Deyan Dyankov
Hi Ryan, sorry for the late reply. We are running 1.3.2 and after deleting the buffer.* files, riak started. However, running the riak_search_vnode:repair( P ) resulted in plenty of errors like: […] 2013-08-08 16:36:08.261 [error] <0.1938.0> Supervisor mi_buffer_converter_sup had child ignored