[ceph-users] [CEPH] OSD Memory Usage

2023-11-15 Thread Nguyễn Hữu Khôi
Hello, I am using a CEPH cluster. After monitoring it, I set: ceph config set osd osd_memory_target_autotune false ceph config set osd osd_memory_target 1G Then restart all OSD services then do test again, I just use fio commands from multi clients and I see that OSD memory consume is over 1GB.

[ceph-users] Re: [CEPH] OSD Memory Usage

2023-11-15 Thread Nguyễn Hữu Khôi
ph > operations as they're many times faster than the fastest storage devices. I > run my OSDs with osd_memory_target=17179869184 (16 GB) and it helps, > especially with slower HDD-backed OSDs. > > /Z > > On Thu, 16 Nov 2023 at 01:02, Nguyễn Hữu Khôi > wrote: >

[ceph-users] Re: [CEPH] OSD Memory Usage

2023-11-15 Thread Nguyễn Hữu Khôi
> ceph-osd > > Long story short, if you set reasonable targets, OSDs are unlikely to > exceed them during normal operations. If you set memory targets too low, it > is likely that they will be exceeded as OSDs need reasonable amounts of > memory to operate. > > /Z > >

[ceph-users] Re: [CEPH] OSD Memory Usage

2023-11-16 Thread Nguyễn Hữu Khôi
Hello. I will read more about it. Thank you :) Nguyen Huu Khoi On Thu, Nov 16, 2023 at 3:21 PM Zakhar Kirpichenko wrote: > Orch ps seems to show virtual size set instead of resident size set. > > /Z > > On Thu, 16 Nov 2023 at 09:43, Nguyễn Hữu Khôi > wrote: > >&

[ceph-users] Re: [CEPH] OSD Memory Usage

2023-11-16 Thread Nguyễn Hữu Khôi
Hello. Great Information, I will keep in mind. Thank you :) Nguyen Huu Khoi On Thu, Nov 16, 2023 at 5:51 PM Janne Johansson wrote: > Den tors 16 nov. 2023 kl 08:43 skrev Nguyễn Hữu Khôi > : > > > > Hello, > > Yes, I see it does not exceed RSS but I see in &quo

[ceph-users] [CEPH] Ceph multi nodes failed

2023-11-23 Thread Nguyễn Hữu Khôi
Hello guys. I see many docs and threads talking about osd failed. I have a question: how many nodes in a cluster can be failed. I am using ec 8 + 2(10 osd nodes) and when I shutdown 2 nodes then my cluster crashes, It cannot write anymore. Thank you. Regards Nguyen Huu Khoi

[ceph-users] Re: [CEPH] Ceph multi nodes failed

2023-11-23 Thread Nguyễn Hữu Khôi
ds, > Eugen > > [1] > > https://docs.ceph.com/en/quincy/rados/operations/erasure-code/?highlight=k%2B1#erasure-coded-pool-recovery > > Zitat von Nguyễn Hữu Khôi : > > > Hello guys. > > > > I see many docs and threads talking about osd failed. I have a questio

[ceph-users] Re: [CEPH] Ceph multi nodes failed

2023-11-23 Thread Nguyễn Hữu Khôi
Hello. I have 10 nodes. My goal is to ensure that I won't lose data if 2 nodes fail. Nguyen Huu Khoi On Fri, Nov 24, 2023 at 2:47 PM Etienne Menguy wrote: > Hello, > > How many nodes do you have? > > > -Original Message----- > > From: Nguyễn Hữu Khôi > >

[ceph-users] Re: [CEPH] Ceph multi nodes failed

2023-11-24 Thread Nguyễn Hữu Khôi
Hello. I get it. I will do a test and let you know. Thank you much. Nguyen Huu Khoi On Fri, Nov 24, 2023 at 5:01 PM Janne Johansson wrote: > Den fre 24 nov. 2023 kl 08:53 skrev Nguyễn Hữu Khôi < > nguyenhuukho...@gmail.com>: > > > > Hello. > > I have 10 node