[PVE-User] periodic Node Crash/freeze

Hello, i could need some hint/help since one cluster is letting me down since 29.07.2018 . Thats when one of my three nodes started to freeze and stop. In syslog the last entries are: Aug 21 02:33:00 node10 systemd[1]: Starting Proxmox VE replication runner... Aug 21 02:33:01 node10 systemd[1]:

Re: [PVE-User] Proxmox Ceph with differents HDD Size

Its really not a great idea because the larger drives will tend to get more writes so your performance won't be as good as all the same size where the writes will be distributed more evenly. On Wed, Aug 22, 2018 at 8:05 PM Gilberto Nunes wrote: > > Hi there > > > It's possible create a Ceph clus

Re: [PVE-User] Proxmox Ceph with differents HDD Size

Yes, you can mix and match drive sizes on ceph. Caution: heterogeneous environments do provide challenges. You will want to set your osd weight on the 8TB drives to 2x what the 4TB drives are. In doing so, however, realize the 8TB drives will be expected to "perform" 2x as much as the 4TB driv

[PVE-User] Proxmox Ceph with differents HDD Size

Hi there It's possible create a Ceph cluster with 4 servers, which has differents disk sizes: Server A - 2x 4TB Server B, C - 2x 8TB Server D - 2x 4TB This is ok? Thanks --- Gilberto Nunes Ferreira (47) 3025-5907 (47) 99676-7530 - Whatsapp / Telegram Skype: gilberto.nunes36

Re: [PVE-User] Mainline kernel

On 21. aug. 2018 21:01, Gilberto Nunes wrote: Hi there Can I download a kernel from here: http://kernel.ubuntu.com/~kernel-ppa/mainline/ And use it with proxmox? Thanks if you need a more recent kernel you could try the ones from pvetest repo. but i would not reccomend doing that in produ

[PVE-User] SSD and Proxmox CEPH

Hi there... I have 128GB SSD here, and wanna install Proxmox in it, and create a separated partition, lets say /dev/sda8, to make cache to CEPH? I mean, use the same SSD to install Proxmox AND a separated partition to make cache to CEPH! Thanks --- Gilberto Nunes Ferreira (47) 3025-5907 (47) 9

Re: [PVE-User] PVE kernel (sources, build process, etc.)

One thing speaks againts this being PTI is that both types of nodes have secondary OSDs causing slow requests. Though it still is an option to try before giving up completely. Am 22.08.18 um 11:45 schrieb Uwe Sauter: > Hi Marcus, > > no, I haven't disabled Spectre/Meltdown mitigations (yet).

Re: [PVE-User] PVE kernel (sources, build process, etc.)

Hi Marcus, no, I haven't disabled Spectre/Meltdown mitigations (yet). For 4 of my hosts I have the Intel microcode from 2018-05-08 running which is the most up-to-date version from Ubuntu. Using the spectre-meltdown-checker.sh script from https://github.com/speed47/spectre-meltdown-checker giv

Re: [PVE-User] PVE kernel (sources, build process, etc.)

Hi, did you try this: (taken from the ceph list) This is PTI, I think.  Try to add "noibrs noibpb nopti nospectre_v2" to kernel cmdline and reboot. Did this make a difference ? We are struggeling with proxmox/ceph too and we have the suspect that it is kernel related or network related, bu

Re: [PVE-User] PVE kernel (sources, build process, etc.)

>>> * pve-kernel 4.13 is based on http://kernel.ubuntu.com/git/ubuntu/ubuntu-artful.git/ ? >>> >>> Yes. (Note that this may not get much updates anymore) >>> * pve-kernel 4.15 is based on http://kernel.ubuntu.com/git/ubuntu/ubuntu-bionic.git/ ? >>> >>> Yes. We're no

Re: [PVE-User] PVE kernel (sources, build process, etc.)

On 8/22/18 9:58 AM, Uwe Sauter wrote: > Am 22.08.18 um 09:55 schrieb Thomas Lamprecht: >> On 8/22/18 9:48 AM, Uwe Sauter wrote: >>> Hi all, >>> >>> some quick questions: >>> >>> * As far as I can tell the PVE kernel is a modified version of Ubuntu >>> kernels, correct? >>> Modifications can be v

Re: [PVE-User] Mainline kernel

Hi, On 8/21/18 9:01 PM, Gilberto Nunes wrote: > Hi there > > Can I download a kernel from here: > > http://kernel.ubuntu.com/~kernel-ppa/mainline/ > > And use it with proxmox? > You can, just install the .deb with dpkg, but you won't have ZFS and a few other things included. It may work but

Re: [PVE-User] PVE kernel (sources, build process, etc.)

Marcus, thanks. Hopefully it won't come as far as compiling my own pve-kernel package. I'm currently hunting a networking issue and need to compare driver versions… Regards, Uwe Am 22.08.18 um 09:57 schrieb Marcus Haarmann: > Hi, > > yes we tried to work with a standard kernel (Debia

Re: [PVE-User] PVE kernel (sources, build process, etc.)

Hi Thomas, Am 22.08.18 um 09:55 schrieb Thomas Lamprecht: > Hi Uwe, > > On 8/22/18 9:48 AM, Uwe Sauter wrote: >> Hi all, >> >> some quick questions: >> >> * As far as I can tell the PVE kernel is a modified version of Ubuntu >> kernels, correct? >> Modifications can be viewed in the pve-kernel

Re: [PVE-User] PVE kernel (sources, build process, etc.)

Hi, yes we tried to work with a standard kernel (Debian) and this was a very wrong decision. All the CT did not work any more You need to apply the patches. The process of compiling a new one is documented, but you will need some time and lots of additional packages to do this. (and of

Re: [PVE-User] PVE kernel (sources, build process, etc.)

Hi Uwe, On 8/22/18 9:48 AM, Uwe Sauter wrote: > Hi all, > > some quick questions: > > * As far as I can tell the PVE kernel is a modified version of Ubuntu > kernels, correct? > Modifications can be viewed in the pve-kernel.git repository ( > https://git.proxmox.com/?p=pve-kernel.git;a=tree

[PVE-User] PVE kernel (sources, build process, etc.)

Hi all, some quick questions: * As far as I can tell the PVE kernel is a modified version of Ubuntu kernels, correct? Modifications can be viewed in the pve-kernel.git repository (https://git.proxmox.com/?p=pve-kernel.git;a=tree). * pve-kernel 4.13 is based on http://kernel.ubuntu.com/git/u