[ceph-users] Re: Inconsistency in rados ls

2023-02-06 Thread Ramin Najjarbashi
Thank you for your email and for providing the solution to check for shadow and multipart objects in CEPH. I have checked the objects in my CEPH cluster and found the following results: The command rados -p ls | grep --text -vE "shadow|multipart" | wc -l returns about 80 million objects. The

[ceph-users] Re: Inconsistency in rados ls

2023-02-06 Thread Robert Sander
On 04.02.23 20:54, Ramin Najjarbashi wrote: ceph df | grep mypoo --- POOLS --- POOL OBJECTS mypool 1.11G --- and from this, I got 8.8M objects : for item in `radosgw-admin user list | jq -r ".[]" | head`; do B_OBJ=$(radosgw-admin user stats --uid $item 2>/dev/null

[ceph-users] Re: Inconsistency in rados ls

2023-02-06 Thread Eugen Block
Hi, did you check if your cluster has many "shadow" or "multipart" objects in the pool? Those are taken into account when calculating the total number of objects in a pool but are not in the user stats of radosgw. Here's an example of a small rgw setup: rados -p ls | grep -vE

[ceph-users] Re: Inconsistency in rados ls

2023-02-04 Thread Ramin Najjarbashi
On Thu, Feb 2, 2023 at 7:56 PM Eugen Block wrote: > Hi, > > > I have a cluster with approximately one billion objects and when I run a > PG > > query, it shows that I have 27,000 objects per PG. > > which query is that, can you provide more details about that cluster and > pool? > Thanks for

[ceph-users] Re: Inconsistency in rados ls

2023-02-02 Thread Eugen Block
Hi, I have a cluster with approximately one billion objects and when I run a PG query, it shows that I have 27,000 objects per PG. which query is that, can you provide more details about that cluster and pool? However, when I run the same command per pg, the results are much less, with