[ceph-users] Re: Are there 'tuned profiles' for various ceph scenarios?

2020-07-02 Thread Frank Schilder
You can find things on the net. Here one starting point: 
http://lists.ceph.com/pipermail/ceph-users-ceph.com/2019-May/034890.html

Tuning depends heavily on way too many parameters, so generally applicable 
templates are probably non-existent. Every hardware has its own challenges. If 
you want to tune properly, I don't see a way around reading the entire kernel 
tuning parameter references.

Best regards,
=
Frank Schilder
AIT Risø Campus
Bygning 109, rum S14


From: Harry G. Coin 
Sent: 01 July 2020 21:26:59
To: ceph-users@ceph.io
Subject: [ceph-users] Are there 'tuned profiles' for various ceph scenarios?

Hi

Are there any 'official' or even 'works for us' pointers to 'tuned
profiles' for such common uses as

'ceph baremetal osd host'

'ceph osd + libvirt host'

'ceph mon/mgr'

'guest vm based on a kernel-mounted rbd'

'guest vm based on a direct virtio->rados link'

I suppose there are a few other common configurations, but you get the idea.

If you haven't used or know of 'tuned'-- it's a nice way to collect a
great whole lot of sysctl and other low level configuration options in
one spot. https://tuned-project.org/

Thanks

Harry Coin




___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io
___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io


[ceph-users] Re: Are there 'tuned profiles' for various ceph scenarios?

2020-07-01 Thread Simon Ironside
Here's an example for SCSI disks (the main benefit vs VirtIO is 
discard/unmap/TRIM support):



  discard='unmap'/>

  

  
  



  
  
  


You also need a VirtIO-SCSI controller to use these, which will look 
something like:



  function='0x0'/>



Cheers,
Simon.

On 01/07/2020 20:52, Harry G. Coin wrote:

[Resent to correct title]
Marc:

Here's a template that works here.  You'll need to do some steps to
create the 'secret' and make the block devs and so on:


   
   
     
   
   
     
     
     
     
   
   
   
   


Glad I could contribute something.   Sure would appreciate leads for the
suggested sysctls/etc either apart or as tuned profiles.

Harry

On 7/1/20 2:44 PM, Marc Roos wrote:
  
Just curious, how does the libvirt xml part look like of a 'direct

virtio->rados link' and 'kernel-mounted rbd'





-Original Message-
To: ceph-users@ceph.io
Subject: *SPAM* [ceph-users] Are there 'tuned profiles' for
various ceph scenarios?

Hi

Are there any 'official' or even 'works for us' pointers to 'tuned
profiles' for such common uses as

'ceph baremetal osd host'

'ceph osd + libvirt host'

'ceph mon/mgr'

'guest vm based on a kernel-mounted rbd'

'guest vm based on a direct virtio->rados link'

I suppose there are a few other common configurations, but you get the
idea.

If you haven't used or know of 'tuned'-- it's a nice way to collect a
great whole lot of sysctl and other low level configuration options in
one spot. https://tuned-project.org/

Thanks

Harry Coin




___
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an
email to ceph-users-le...@ceph.io



___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io


___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io


[ceph-users] Re: Are there 'tuned profiles' for various ceph scenarios?

2020-07-01 Thread Harry G. Coin
[Resent to correct title]
Marc:

Here's a template that works here.  You'll need to do some steps to
create the 'secret' and make the block devs and so on:


  
  
    
  
  
    
    
    
    
  
  
  
  


Glad I could contribute something.   Sure would appreciate leads for the
suggested sysctls/etc either apart or as tuned profiles.

Harry

On 7/1/20 2:44 PM, Marc Roos wrote:
>  
> Just curious, how does the libvirt xml part look like of a 'direct 
> virtio->rados link' and 'kernel-mounted rbd'
>
>
>
>
>
> -Original Message-
> To: ceph-users@ceph.io
> Subject: *SPAM* [ceph-users] Are there 'tuned profiles' for 
> various ceph scenarios?
>
> Hi
>
> Are there any 'official' or even 'works for us' pointers to 'tuned 
> profiles' for such common uses as
>
> 'ceph baremetal osd host'
>
> 'ceph osd + libvirt host'
>
> 'ceph mon/mgr'
>
> 'guest vm based on a kernel-mounted rbd'
>
> 'guest vm based on a direct virtio->rados link'
>
> I suppose there are a few other common configurations, but you get the 
> idea.
>
> If you haven't used or know of 'tuned'-- it's a nice way to collect a 
> great whole lot of sysctl and other low level configuration options in 
> one spot. https://tuned-project.org/
>
> Thanks
>
> Harry Coin
>
>
>
>
> ___
> ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an 
> email to ceph-users-le...@ceph.io
>
>
___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io