[ceph-users] Re: Are there 'tuned profiles' for various ceph scenarios?
You can find things on the net. Here one starting point: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2019-May/034890.html Tuning depends heavily on way too many parameters, so generally applicable templates are probably non-existent. Every hardware has its own challenges. If you want to tune properly, I don't see a way around reading the entire kernel tuning parameter references. Best regards, = Frank Schilder AIT Risø Campus Bygning 109, rum S14 From: Harry G. Coin Sent: 01 July 2020 21:26:59 To: ceph-users@ceph.io Subject: [ceph-users] Are there 'tuned profiles' for various ceph scenarios? Hi Are there any 'official' or even 'works for us' pointers to 'tuned profiles' for such common uses as 'ceph baremetal osd host' 'ceph osd + libvirt host' 'ceph mon/mgr' 'guest vm based on a kernel-mounted rbd' 'guest vm based on a direct virtio->rados link' I suppose there are a few other common configurations, but you get the idea. If you haven't used or know of 'tuned'-- it's a nice way to collect a great whole lot of sysctl and other low level configuration options in one spot. https://tuned-project.org/ Thanks Harry Coin ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: Are there 'tuned profiles' for various ceph scenarios?
Here's an example for SCSI disks (the main benefit vs VirtIO is discard/unmap/TRIM support): discard='unmap'/> You also need a VirtIO-SCSI controller to use these, which will look something like: function='0x0'/> Cheers, Simon. On 01/07/2020 20:52, Harry G. Coin wrote: [Resent to correct title] Marc: Here's a template that works here. You'll need to do some steps to create the 'secret' and make the block devs and so on: Glad I could contribute something. Sure would appreciate leads for the suggested sysctls/etc either apart or as tuned profiles. Harry On 7/1/20 2:44 PM, Marc Roos wrote: Just curious, how does the libvirt xml part look like of a 'direct virtio->rados link' and 'kernel-mounted rbd' -Original Message- To: ceph-users@ceph.io Subject: *SPAM* [ceph-users] Are there 'tuned profiles' for various ceph scenarios? Hi Are there any 'official' or even 'works for us' pointers to 'tuned profiles' for such common uses as 'ceph baremetal osd host' 'ceph osd + libvirt host' 'ceph mon/mgr' 'guest vm based on a kernel-mounted rbd' 'guest vm based on a direct virtio->rados link' I suppose there are a few other common configurations, but you get the idea. If you haven't used or know of 'tuned'-- it's a nice way to collect a great whole lot of sysctl and other low level configuration options in one spot. https://tuned-project.org/ Thanks Harry Coin ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: Are there 'tuned profiles' for various ceph scenarios?
[Resent to correct title] Marc: Here's a template that works here. You'll need to do some steps to create the 'secret' and make the block devs and so on: Glad I could contribute something. Sure would appreciate leads for the suggested sysctls/etc either apart or as tuned profiles. Harry On 7/1/20 2:44 PM, Marc Roos wrote: > > Just curious, how does the libvirt xml part look like of a 'direct > virtio->rados link' and 'kernel-mounted rbd' > > > > > > -Original Message- > To: ceph-users@ceph.io > Subject: *SPAM* [ceph-users] Are there 'tuned profiles' for > various ceph scenarios? > > Hi > > Are there any 'official' or even 'works for us' pointers to 'tuned > profiles' for such common uses as > > 'ceph baremetal osd host' > > 'ceph osd + libvirt host' > > 'ceph mon/mgr' > > 'guest vm based on a kernel-mounted rbd' > > 'guest vm based on a direct virtio->rados link' > > I suppose there are a few other common configurations, but you get the > idea. > > If you haven't used or know of 'tuned'-- it's a nice way to collect a > great whole lot of sysctl and other low level configuration options in > one spot. https://tuned-project.org/ > > Thanks > > Harry Coin > > > > > ___ > ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an > email to ceph-users-le...@ceph.io > > ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io