[ceph-users] Ceph in a shared environment
Hi All, So this may have been asked but I’ve googled the crap out of this so maybe my google-fu needs work. Does anyone have any experience running a Ceph cluster with the Ceph daemons (mons/osds/rgw) running on the same hosts as other services (so say Docker containers, or really anything generating load). What has been your experience? Used cgroups or seen any reason too? Any performance issues? Troubleshooting a pain? Any other general observations? Just curious if anyone out there has done it and to what scale and what issues they’ve encountered. Cheers everyone Kris Gillespie| System Engineer | bol.comhttp://bol.com De informatie verzonden met dit e-mailbericht is uitsluitend bestemd voor de geadresseerde. Gebruik van deze informatie door anderen dan de geadresseerde is uitdrukkelijk verboden. Indien u dit bericht per vergissing heeft ontvangen, verzoeken wij u ons onmiddelijk hiervan op de hoogte te stellen en het bericht te vernietigen. Openbaarmaking, vermenigvuldiging, verspreiding en/of verstrekking van deze informatie aan derden is niet toegestaan. Bol.com b.v. staat niet in voor de juiste en volledige overbrenging van de inhoud van een verzonden e-mail, noch voor tijdige ontvangst daarvan en aanvaardt geen aansprakelijkheid in dezen. The information contained in this communication is confidential and may be legally privileged. It is intended solely for the use of the individual or entity to whom it is addressed and others authorised to receive it. If you are not the intended recipient please notify the sender and destroy this message. Any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. Bol.com b.v. is neither liable for the proper and complete transmission of the information contained in this communication nor for delay in its receipt. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Ceph in a shared environment
We run CEPH OSDs on the same hosts as QEMU/KVM with OpenStack. You need to segregate the processes so the OSDs have their dedicated cores and memory, other than that it works fine. Our MONs also run on the same hosts as the OpenStack controller nodes (L3 agents and such) - no problem here, you just need dedicated drives for their data. Jan On 10 Jul 2015, at 12:28, Kris Gillespie kgilles...@bol.com wrote: Hi All, So this may have been asked but I’ve googled the crap out of this so maybe my google-fu needs work. Does anyone have any experience running a Ceph cluster with the Ceph daemons (mons/osds/rgw) running on the same hosts as other services (so say Docker containers, or really anything generating load). What has been your experience? Used cgroups or seen any reason too? Any performance issues? Troubleshooting a pain? Any other general observations? Just curious if anyone out there has done it and to what scale and what issues they’ve encountered. Cheers everyone Kris Gillespie| System Engineer | bol.com http://bol.com/ De informatie verzonden met dit e-mailbericht is uitsluitend bestemd voor de geadresseerde. Gebruik van deze informatie door anderen dan de geadresseerde is uitdrukkelijk verboden. Indien u dit bericht per vergissing heeft ontvangen, verzoeken wij u ons onmiddelijk hiervan op de hoogte te stellen en het bericht te vernietigen. Openbaarmaking, vermenigvuldiging, verspreiding en/of verstrekking van deze informatie aan derden is niet toegestaan. Bol.com b.v. staat niet in voor de juiste en volledige overbrenging van de inhoud van een verzonden e-mail, noch voor tijdige ontvangst daarvan en aanvaardt geen aansprakelijkheid in dezen. The information contained in this communication is confidential and may be legally privileged. It is intended solely for the use of the individual or entity to whom it is addressed and others authorised to receive it. If you are not the intended recipient please notify the sender and destroy this message. Any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. Bol.com b.v. is neither liable for the proper and complete transmission of the information contained in this communication nor for delay in its receipt. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Ceph in a shared environment
We do the same, so far no problems. nathan stratton | vp technology | broadsoft, inc | +1-240-404-6580 | www.broadsoft.com On Fri, Jul 10, 2015 at 6:51 AM, Jan Schermer j...@schermer.cz wrote: We run CEPH OSDs on the same hosts as QEMU/KVM with OpenStack. You need to segregate the processes so the OSDs have their dedicated cores and memory, other than that it works fine. Our MONs also run on the same hosts as the OpenStack controller nodes (L3 agents and such) - no problem here, you just need dedicated drives for their data. Jan On 10 Jul 2015, at 12:28, Kris Gillespie kgilles...@bol.com wrote: Hi All, So this may have been asked but I’ve googled the crap out of this so maybe my google-fu needs work. Does anyone have any experience running a Ceph cluster with the Ceph daemons (mons/osds/rgw) running on the same hosts as other services (so say Docker containers, or really anything generating load). What has been your experience? Used cgroups or seen any reason too? Any performance issues? Troubleshooting a pain? Any other general observations? Just curious if anyone out there has done it and to what scale and what issues they’ve encountered. Cheers everyone Kris Gillespie| System Engineer | bol.com De informatie verzonden met dit e-mailbericht is uitsluitend bestemd voor de geadresseerde. Gebruik van deze informatie door anderen dan de geadresseerde is uitdrukkelijk verboden. Indien u dit bericht per vergissing heeft ontvangen, verzoeken wij u ons onmiddelijk hiervan op de hoogte te stellen en het bericht te vernietigen. Openbaarmaking, vermenigvuldiging, verspreiding en/of verstrekking van deze informatie aan derden is niet toegestaan. Bol.com http://bol.com b.v. staat niet in voor de juiste en volledige overbrenging van de inhoud van een verzonden e-mail, noch voor tijdige ontvangst daarvan en aanvaardt geen aansprakelijkheid in dezen. The information contained in this communication is confidential and may be legally privileged. It is intended solely for the use of the individual or entity to whom it is addressed and others authorised to receive it. If you are not the intended recipient please notify the sender and destroy this message. Any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. Bol.com http://bol.com b.v. is neither liable for the proper and complete transmission of the information contained in this communication nor for delay in its receipt. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
