Right.  The elastic search integration--or something custom you could
base on s3 bucket notifications--would both be working with events
generated in RGW.

Matt

On Tue, Mar 2, 2021 at 3:55 PM Cary FitzHugh <cary.fitzh...@gmail.com> wrote:
>
> Understood.
>
> With the RGW architecture comes more load balancing concerns, more moving 
> parts, more tedious (to me) ACLs, less features (append and some other things 
> not supported in S3).  Was hoping for a solution which didn't require us to 
> be hamstrung and only read / write to a pool via the gateway.
>
> If the RGW Metadata search was able to "source" it's data from the OSDs and 
> sync that way, then I'd be up for setting up a skeleton implementation,  but 
> it sounds like RGW Metadata is only going to record things which are flowing 
> through the gateway.  (Is that correct?)
>
>
>
>
> On Tue, Mar 2, 2021 at 3:46 PM Matt Benjamin <mbenj...@redhat.com> wrote:
>>
>> Hi Cary,
>>
>> As you've said, these are well-developed features of RGW, I think that
>> would be the way to go, in the Ceph ecosystem.
>>
>> Matt
>>
>> On Tue, Mar 2, 2021 at 3:41 PM Cary FitzHugh <cary.fitzh...@gmail.com> wrote:
>> >
>> > Hello -
>> >
>> > We're trying to use native libRADOS and the only challenge we're running
>> > into is searching metadata.
>> >
>> > Using the rgw metadata sync seems to require all data to be pushed through
>> > the rgw, which is not something we're interested in setting up at the
>> > moment.
>> >
>> > Are there hooks or features of libRADOS which could be leveraged to enable
>> > syncing of metadata to an external system (elastic-search / postgres / 
>> > etc)?
>> >
>> > Is there a way to listen to a stream of updates to a pool in real-time,
>> > with some guarantees I wouldn't miss things?
>> >
>> > Are there any features like this in libRADOS?
>> >
>> > Thank you
>> > _______________________________________________
>> > ceph-users mailing list -- ceph-users@ceph.io
>> > To unsubscribe send an email to ceph-users-le...@ceph.io
>> >
>>
>>
>> --
>>
>> Matt Benjamin
>> Red Hat, Inc.
>> 315 West Huron Street, Suite 140A
>> Ann Arbor, Michigan 48103
>>
>> http://www.redhat.com/en/technologies/storage
>>
>> tel.  734-821-5101
>> fax.  734-769-8938
>> cel.  734-216-5309
>>


-- 

Matt Benjamin
Red Hat, Inc.
315 West Huron Street, Suite 140A
Ann Arbor, Michigan 48103

http://www.redhat.com/en/technologies/storage

tel.  734-821-5101
fax.  734-769-8938
cel.  734-216-5309
_______________________________________________
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io

Reply via email to