Hi, It relates to this sentence: "The median object size is ~4KB, written in RBD images using the default 4MB[0] object size. That will be ~100 millions RADOS objects instead of 100 billions."
Istvan Szabo Senior Infrastructure Engineer --------------------------------------------------- Agoda Services Co., Ltd. e: istvan.sz...@agoda.com --------------------------------------------------- -----Original Message----- From: Loïc Dachary <l...@dachary.org> Sent: Thursday, March 11, 2021 2:10 PM To: Szabo, Istvan (Agoda) <istvan.sz...@agoda.com> Cc: Ceph Users <ceph-users@ceph.io> Subject: [ceph-users] Re: A practical approach to efficiently store 100 billions small objects in Ceph Email received from outside the company. If in doubt don't click links nor open attachments! ________________________________ Hi, On 11/03/2021 04:38, Szabo, Istvan (Agoda) wrote: > Does this mean that even in an object store the files which is smaller than > 4MB will be packed in one 4 MB object? I'm not sure I understand the question. Would you be so kind as to rephrase it? Cheers > > -----Original Message----- > From: Loïc Dachary <l...@dachary.org> > Sent: Thursday, March 11, 2021 2:13 AM > To: Konstantin Shalygin <k0...@k0ste.ru> > Cc: Ceph Users <ceph-users@ceph.io>; swh-de...@inria.fr > Subject: [ceph-users] Re: A practical approach to efficiently store 100 > billions small objects in Ceph > > Email received from outside the company. If in doubt don't click links nor > open attachments! > ________________________________ > > Hi Konstantin, > > Thanks for the advice. Luckily objects are packed together and Ceph will only > see larger objects. The median object size is ~4KB, written in RBD images > using the default 4MB[0] object size. That will be ~100 millions RADOS > objects instead of 100 billions. > > Cheers > > [0] https://docs.ceph.com/en/latest/man/8/rbd/#cmdoption-rbd-object-size > > On 10/03/2021 17:44, Konstantin Shalygin wrote: >> Loic, please wait (or use shaman builds) for 14.2.17 cause for clusters with >> billions of injects code was not optimal [1] at objects delete step >> >> >> [1] https://tracker.ceph.com/issues/47044 >> <https://tracker.ceph.com/issues/47044> >> k >> >> Sent from my iPhone >> >>> On 10 Mar 2021, at 17:55, Loïc Dachary <l...@dachary.org> wrote: >>> >>> The next step will be to write and run benchmarks > -- > Loïc Dachary, Artisan Logiciel Libre > > > > ________________________________ > This message is confidential and is for the sole use of the intended > recipient(s). It may also be privileged or otherwise protected by copyright > or other legal rules. If you have received it by mistake please let us know > by reply email and delete it from your system. It is prohibited to copy this > message or disclose its content to anyone. Any confidentiality or privilege > is not waived or lost by any mistaken delivery or unauthorized disclosure of > the message. All messages sent to and from Agoda may be monitored to ensure > compliance with company policies, to protect the company's interests and to > remove potential malware. Electronic messages may be intercepted, amended, > lost or deleted, or contain viruses. -- Loïc Dachary, Artisan Logiciel Libre _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
