Re: [DRBD-user] [proxmox 5.4]Cannot create VM, cannot restore : timeout linstor sp l...

2020-02-05 Thread Christophe NOUVEL
We only have 2 nodes as of today. It is not easy to explain why vm creation fails, given that we cannot see any error from Linstor / DRBD logs... We removed 5 old error reports and linstor sp l, and linstor err l still needs 20seconds or so. May be it's time to rebuild from scratch now. Thank y

Re: [DRBD-user] [proxmox 5.4]Cannot create VM, cannot restore : timeout linstor sp l...

2020-02-05 Thread Gábor Hernádi
Hello, in the logs you can see that `lvs` needs ~150ms, `vgs` ~15-20ms, `lvcreate` ~200ms, `drbdadm ... --create-md` about 3 seconds (that is fine)... so no external command executed by linstor is exceptionally slow.. however, the reason that a `linstor err show` takes 20 seconds does not sound g

Re: [DRBD-user] [proxmox 5.4]Cannot create VM, cannot restore : timeout linstor sp l...

2020-02-04 Thread Christophe NOUVEL
Ok, tried to trace. No error so far, but long response time and no visible call to 'vgs', 'lvs' and so on : linstor sp l generates following trace : Feb 4 09:37:01 px1 Controller[6784]: 09:37:01.768 [grizzly-http-server-14] DEBUG LINSTOR/Controller - SYSTEM - REST access api 'LstStorPool' fro

Re: [DRBD-user] [proxmox 5.4]Cannot create VM, cannot restore : timeout linstor sp l...

2020-02-04 Thread Gábor Hernádi
You just showed the trace logs from the controller, not the satellite, whereas the satellite is the one executing all interesting external commands On Tue, Feb 4, 2020 at 9:48 AM Christophe NOUVEL < christophe.nou...@gmail.com> wrote: > Ok, tried to trace. > > No error so far, but long response t

Re: [DRBD-user] [proxmox 5.4]Cannot create VM, cannot restore : timeout linstor sp l...

2020-02-03 Thread Gábor Hernádi
In that case you might want to increase the log level on the satellite to TRACE by adding [logging] level="TRACE" to the linstor_satellite.toml file With trace logging you should see every external command (lvs, vgs, lvcreate, ...) linstor executes as well as the time linstor spent waiting fo

Re: [DRBD-user] [proxmox 5.4]Cannot create VM, cannot restore : timeout linstor sp l...

2020-02-03 Thread Christophe NOUVEL
Hi, LVM is not slow, see my previous message. The only filter in lvm.conf is : global_filter = [ "r|/dev/zd.*|", "r|/dev/mapper/pve-.*|", "r|/dev/drbd.*|" ] Then we updated to latest available versions : ii linstor-client1.0.11-1 all Linstor client command line too

Re: [DRBD-user] [proxmox 5.4]Cannot create VM, cannot restore : timeout linstor sp l...

2020-01-27 Thread Roland Kammerer
On Mon, Jan 27, 2020 at 10:19:31AM +0100, Christophe NOUVEL wrote: > We noticed long response time when : > linstor sp pl And that is the root cause for the plugin timeout. > An strace give a long wait (20s) to : > sendto(3, "GET /v1/view/storage-pools HTTP/"..., 153, 0, NULL, 0) = 153 > poll([{f

[DRBD-user] [proxmox 5.4]Cannot create VM, cannot restore : timeout linstor sp l...

2020-01-27 Thread Christophe NOUVEL
Hi all, Running a 2 node proxmox cluster : pveversion -v proxmox-ve: 5.4-2 (running kernel: 4.15.18-24-pve) pve-manager: 5.4-13 (running version: 5.4-13/aee6f0ec) pve-kernel-4.15: 5.4-12 linstor-client 1.0.10-1 linstor-common 1.4.1-1 linstor-controll