[ceph-users] Re: Metadata for LibRADOS

2021-03-02 Thread Cary FitzHugh
-would both be working with events > generated in RGW. > > Matt > > On Tue, Mar 2, 2021 at 3:55 PM Cary FitzHugh > wrote: > > > > Understood. > > > > With the RGW architecture comes more load balancing concerns, more > moving parts, more tedious (to me)

[ceph-users] Re: Metadata for LibRADOS

2021-03-02 Thread Cary FitzHugh
) On Tue, Mar 2, 2021 at 3:46 PM Matt Benjamin wrote: > Hi Cary, > > As you've said, these are well-developed features of RGW, I think that > would be the way to go, in the Ceph ecosystem. > > Matt > > On Tue, Mar 2, 2021 at 3:41 PM Cary FitzHugh > wrote: > &

[ceph-users] Metadata for LibRADOS

2021-03-02 Thread Cary FitzHugh
Hello - We're trying to use native libRADOS and the only challenge we're running into is searching metadata. Using the rgw metadata sync seems to require all data to be pushed through the rgw, which is not something we're interested in setting up at the moment. Are there hooks or features of lib

[ceph-users] Question on multi-site

2021-02-22 Thread Cary FitzHugh
Hello - We're using libRADOS directly for our communication between services. Some of the features are faster and more featured for our use cases than an S3 gateway. But we do want to leverage the ES Metadata search. It appears that the Metadata search is built on the object gateway. Question

[ceph-users] Re: libRADOS semantics

2021-01-26 Thread Cary FitzHugh
It seems I have erasure pools. https://docs.ceph.com/en/latest/rados/operations/erasure-code/#erasure-coding-with-overwrites On Tue, Jan 26, 2021 at 12:02 PM Cary FitzHugh wrote: > are there any good documents on the implicit requirements for librados > calls? > > I can write a

[ceph-users] libRADOS semantics

2021-01-26 Thread Cary FitzHugh
are there any good documents on the implicit requirements for librados calls? I can write a file, if it doesn't exist successfully. I can write_full a file, and it works (but many of my files will need to be chunked off disk, not enough RAM) I can append to a nonexistent file and it works. I *can

[ceph-users] Re: Auth Questions w/ librados

2021-01-26 Thread Cary FitzHugh
https://github.com/ceph/ceph/blob/master/src/pybind/rados/rados.pyx#L390 I have found that I need to pass in "name" to the Cluster create call, with the name of the user I want to connect with. On Tue, Jan 26, 2021 at 10:09 AM Cary FitzHugh wrote: > Hello! > > I've got

[ceph-users] Auth Questions w/ librados

2021-01-26 Thread Cary FitzHugh
Hello! I've got a new cluster set up. I created a new user and pool. Creating the user like so: ceph auth add client.myclient mon 'allow r' osd 'allow rw pool=testpool' I have set up librados and python bindings, with a ceph.conf and a keyring file. My trouble is that when I connect with clie