Re: Scaling Riak CS to hundreds or thousands of servers

2013-07-27 Thread Andre Lohmann
Hi Again and thanks for the answers. Now I have another questions. If chunk size is always 1mb and i have a file of 100mb within a cluster of 100 servers. Are the chunks then split over all 100 servers or am i able to manage the chunks of one file to be saved at one place, to prevent to much

Re: Scaling Riak CS to hundreds or thousands of servers

2013-07-27 Thread Andrew Stone
Hi Andre, The blocks are going to be spread across some subset of that 100 servers. Since Riak CS stores the chunks inside Riak they are hashed based on primary key. Currently there is no way to co-locate chunks in Riak CS. You can read more about How riak manages storage here:

Scaling Riak CS to hundreds or thousands of servers

2013-07-25 Thread Andre Lohmann
How is the Scaling of Raik CS when setting up a few hundred servers in a cluster? Does it make sense, to build a cluster of that size, or is it recommended to have smaller pools of clusters and shard the Files over more than one cluster? What about stanchion as the potetial single point of

Re: Scaling Riak CS to hundreds or thousands of servers

2013-07-25 Thread John Daily
Good questions, Andre, thanks for reaching out. How is the Scaling of Raik CS when setting up a few hundred servers in a cluster? The upper limit of a cluster size depends on traffic load, hardware, and network capacity, but anything approaching 100 servers is likely to run into trouble due