Re: Best insertion point for storage shim

2012-08-31 Thread Tommi Virtanen
On Fri, Aug 31, 2012 at 11:59 AM, Atchley, Scott wrote: > I think what he is looking for is not to bring data to a client to convert > from replication to/from erasure coding, but to have the servers do it based > on some metric _or_ have the client indicate which file needs to be converted > a

Re: Best insertion point for storage shim

2012-08-31 Thread Atchley, Scott
On Aug 31, 2012, at 11:15 AM, Tommi Virtanen wrote: > On Fri, Aug 31, 2012 at 10:37 AM, Stephen Perkins wrote: >> Would this require 2 clusters because of the need to have RADOS keep N >> copies on one and 1 copy on the other? > > That's doable with just multiple RADOS pools, no need for multipl

Re: Best insertion point for storage shim

2012-08-31 Thread Tommi Virtanen
On Fri, Aug 31, 2012 at 10:37 AM, Stephen Perkins wrote: > Would this require 2 clusters because of the need to have RADOS keep N > copies on one and 1 copy on the other? That's doable with just multiple RADOS pools, no need for multiple clusters. And CephFS is even able to pick what pool to put

RE: Best insertion point for storage shim

2012-08-31 Thread Stephen Perkins
e need to have RADOS keep N copies on one and 1 copy on the other? I appreciate the discussion... it is helping me fashion what I'm really interested in... - Steve -Original Message- From: Sage Weil [mailto:s...@inktank.com] Sent: Friday, August 24, 2012 11:43 AM To: Stephen Perkin

Re: Best insertion point for storage shim

2012-08-24 Thread Sage Weil
On Fri, 24 Aug 2012, Stephen Perkins wrote: > Hi all, > > I'd like to get feedback from folks as to where the best place would be to > insert a "shim" into the RADOS object storage. > > Currently, you can configure RADOS to use copy based storage to store > redundant copies of a file (I like 3 re

Re: Best insertion point for storage shim

2012-08-24 Thread Atchley, Scott
On Aug 24, 2012, at 11:49 AM, Stephen Perkins wrote: > Hi all, > > I'd like to get feedback from folks as to where the best place would be to > insert a "shim" into the RADOS object storage. > > Currently, you can configure RADOS to use copy based storage to store > redundant copies of a file (I

Re: Best insertion point for storage shim

2012-08-24 Thread Tommi Virtanen
On Fri, Aug 24, 2012 at 8:49 AM, Stephen Perkins wrote: > I'd like to get feedback from folks as to where the best place would be to > insert a "shim" into the RADOS object storage. ... > I would assume that it is "possible" to configure RADOS to store only 1 copy > of a file (bear with me here).