Re: [ceph-users] CEPH Cluster Usage Discrepancy

2018-10-21 Thread Waterbly, Dan
Awesome! Thanks Serian! Do you know where the 64KB comes from? Can that be tuned down for a cluster holding smaller objects? Get Outlook for iOS On Sat, Oct 20, 2018 at 10:49 PM -0700, "Serkan Çoban" mailto:cobanser...@gmail.com>> wrote: you have 24M objects, not 2.4

Re: [ceph-users] Verifying the location of the wal

2018-10-21 Thread Robert Stanford
Thanks Serkan. I am using --path instead of --dev (dev won't work because I'm using VGs/LVs). The output shows block and block.db, but nothing about wal.db. How can I learn where my wal lives? On Sun, Oct 21, 2018 at 12:43 AM Serkan Çoban wrote: > ceph-bluestore-tool can show you the disk

Re: [ceph-users] CEPH Cluster Usage Discrepancy

2018-10-21 Thread Sergey Malinin
http://lists.ceph.com/pipermail/ceph-users-ceph.com/2018-February/024589.html > On 21.10.2018, at 16:12, Waterbly, Dan wrote: > > Awesome! Thanks Serian! > > Do you know where the 64KB comes from? Can that be tune

Re: [ceph-users] CEPH Cluster Usage Discrepancy

2018-10-21 Thread Waterbly, Dan
Thanks Sergey! Do you know where I can find details on the repercussions of adjusting this value? Performance (read/writes), for once, not critical for us, data durability and disaster recovery is our focus. -Dan Get Outlook for iOS On Sun, Oct 21, 2018 at 8:37 AM -07

Re: [ceph-users] Verifying the location of the wal

2018-10-21 Thread Serkan Çoban
wal and db device will be same if you use just db path during osd creation. i do not know how to verify this with ceph commands. On Sun, Oct 21, 2018 at 4:17 PM Robert Stanford wrote: > > > Thanks Serkan. I am using --path instead of --dev (dev won't work because > I'm using VGs/LVs). The outp

Re: [ceph-users] CEPH Cluster Usage Discrepancy

2018-10-21 Thread Sergey Malinin
It is just a block size and it has no impact on data safety except that OSDs need to be redeployed in order for them to create bluefs with given block size. > On 21.10.2018, at 19:04, Waterbly, Dan wrote: > > Thanks Sergey! > > Do you know where I can find details on the repercussions of adju

Re: [ceph-users] Verifying the location of the wal

2018-10-21 Thread Robert Stanford
I did exactly this when creating my osds, and found that my total utilization is about the same as the sum of the utilization of the pools, plus (wal size * number osds). So it looks like my wals are actually sharing OSDs. But I'd like to be 100% sure... so I am seeking a way to find out On Sun

Re: [ceph-users] cephfs kernel client blocks when removing large files

2018-10-21 Thread Dylan McCulloch
On Mon, Oct 8, 2018 at 2:57 PM Dylan McCulloch > wrote: >> >> Hi all, >> >> >> We have identified some unexpected blocking behaviour by the ceph-fs kernel >> client. >> >> >> When performing 'rm' on large files (100+GB), there appears to be a >> significant delay of 10 seconds or more, before a '

Re: [ceph-users] cephfs kernel client blocks when removing large files

2018-10-21 Thread Yan, Zheng
On Mon, Oct 22, 2018 at 9:46 AM Dylan McCulloch wrote: > > On Mon, Oct 8, 2018 at 2:57 PM Dylan McCulloch > wrote: > >> > >> Hi all, > >> > >> > >> We have identified some unexpected blocking behaviour by the ceph-fs > >> kernel client. > >> > >> > >> When performing 'rm' on large files (100+GB),

Re: [ceph-users] What is rgw.none

2018-10-21 Thread Tomasz Płaza
Hi, I have heard rumors it is a know bug an I should not bother (but I have not found bugtrack for it). Best regards Tomasz Płaza On 19.10.2018 at 08:47, Arvydas Opulskis wrote: Hi, we have same question when trying to understand output of bucket stats. Maybe you had found explanation somew

Re: [ceph-users] cephfs kernel client blocks when removing large files

2018-10-21 Thread Dylan McCulloch
> > On Mon, Oct 22, 2018 at 9:46 AM Dylan McCulloch wrote: > > > > On Mon, Oct 8, 2018 at 2:57 PM Dylan McCulloch > wrote: > > >> > > >> Hi all, > > >> > > >> > > >> We have identified some unexpected blocking behaviour by the ceph-fs > > >> kernel client. > > >> > > >> > > >> When performing 'rm

Re: [ceph-users] What is rgw.none

2018-10-21 Thread Janne Johansson
Den mån 6 aug. 2018 kl 12:58 skrev Tomasz Płaza : > Hi all, > > I have a bucket with a vary big num_objects in rgw.none: > > { > "bucket": "dyna", > > "usage": { > "rgw.none": { > > "num_objects": 18446744073709551615 > } > > What is rgw.none and is this big number OK?