Re: [DRBD-user] linstor-proxmox broken after upgrading to PVE/libpve-storage-perl/stable 5.0-32
Hi, And the method for upgrading Proxmox is pveupgrade. Manual page for pveupgrade say : > pveupgrade(1) Proxmox Documentation pveupgrade(1) > > > NAME > > pveupgrade - wrapper arournd "apt-get dist-upgrade" > > > SYNOPSIS > > pveupgrade [--shell] > > > DESCRIPTION > > This is a small wrapper around "apt-get dist-upgrade". We use this to > print additional information (kernel restart > > required?), and optionally run an interactive shell after the update > (--shell) > > > 5.2 2018-11-19 pveupgrade(1) > Le 27/11/2018 à 17:08, Yannis Milios a écrit : > Ok, I used "dist-upgrade" because that's what Proxmox recommends to do > when upgrading their systems. > > On Tue, 27 Nov 2018 at 15:41, Roland Kammerer > mailto:roland.kamme...@linbit.com>> wrote: > > On Tue, Nov 27, 2018 at 03:22:07PM +, Yannis Milios wrote: > > Hi Roland, > > > > I just did a simple ‘apt dist-upgrade’ and the rest followed ... > > Ah yes, that is how "dist-upgrade" works. "upgrade" would not have > done > that. Anyways, there are "-3" versions of the plugins out now and one > should be save as long as "libpve-storage-perl" is not 5.0-31. '<' and > '>' are ok. > > Regards, rck > ___ > drbd-user mailing list > drbd-user@lists.linbit.com <mailto:drbd-user@lists.linbit.com> > http://lists.linbit.com/mailman/listinfo/drbd-user > > > ___ > drbd-user mailing list > drbd-user@lists.linbit.com > http://lists.linbit.com/mailman/listinfo/drbd-user -- Bien cordialement, Jean-Daniel TISSOT <https://chrono-environnement.univ-fcomte.fr/acteurs/annuaire/article/tissot-jean-daniel> Administrateur Systèmes et Réseaux Service Informatique UMR Chrono-environnement <https://chrono-ocs.univ-fcomte.fr/wiki_info/index.php/Accueil> Tel: +33 3 81 666 440 Fax: +33 3 81 666 568 Chrono-environnement <https://chrono-environnement.univ-fcomte.fr> CNRS <http://www.cnrs.fr>Université de Franche-Comté <http://www.univ-fcomte.fr> 10 ans de Chrono-envrironnement <https://chrono-environnement.univ-fcomte.fr/valorisation/conferences-et-soutenances/article/10-ans-de-chrono-environnement> Laboratoire Chrono-environnement <http://chrono-environnement.univ-fcomte.fr/> 16, Route de Gray 25 030 BESANÇON Cedex Plan et Accès <https://umap.openstreetmap.fr/fr/map/service-informatique-chrono-environnement_239834?scaleControl=true=true=false=true=false=true=false=false=false=true=undefined=true=611097=false=false=false#19/47.24516/5.98446> ___ drbd-user mailing list drbd-user@lists.linbit.com http://lists.linbit.com/mailman/listinfo/drbd-user
[DRBD-user] Strange drbdtop results
Hi, I have some strange results with drbdtop : On pve1: │ Name | Role | Disks | Peer Disks | Connections | Overall │ │ vm-102-disk-1 | Secondary | ✓ | ✓ | ✓ | ✓ │ │ .drbdctrl | Secondary | ✓ | ✗ (1) | ✓ | ✗ (1) │ │ vm-101-disk-1 | Secondary | ✓ | ✗ (3) | ✓ | ✗ (3) │ │ vm-100-disk-1 | Secondary | ✓ | ✗ (5) | ✓ | ✗ (5) │ On pve2: │ Name | Role | Disks | Peer Disks | Connections | Overall │ │ .drbdctrl | Primary | ✓ | ✓ | ✓ | ✓ │ │ vm-101-disk-1 | Secondary | ✓ | ✓ | ✓ | ✓ │ │ vm-102-disk-1 | Secondary | ✓ | ✓ | ✓ | ✓ │ │ vm-100-disk-1 | Secondary | ✓ | ✗ (3) | ✓ | ✗ (3) │ On pve3: │ Name | Role | Disks | Peer Disks | Connections | Overall │ │ .drbdctrl | Secondary | ✓ | ✓ | ✓ | ✓ │ │ vm-102-disk-1 | Primary | ✓ | ✓ | ✓ | ✓ │ │ vm-101-disk-1 | Primary | ✓ | ✗ (3) | ✓ | ✗ (3) │ │ vm-100-disk-1 | Primary | ✓ | ✗ (5) | ✓ | ✗ (5) │ drbdadm status and drbd-overview give me nice results. All my resources are UpToDate root@dmz-pve1:~ # drbdadm status .drbdctrl role:Secondary volume:0 disk:UpToDate volume:1 disk:UpToDate dmz-pve2 role:Primary volume:0 peer-disk:UpToDate volume:1 peer-disk:UpToDate dmz-pve3 role:Secondary volume:0 peer-disk:UpToDate volume:1 peer-disk:UpToDate vm-100-disk-1 role:Secondary disk:UpToDate dmz-pve2 role:Secondary peer-disk:UpToDate dmz-pve3 role:Primary peer-disk:UpToDate vm-101-disk-1 role:Secondary disk:UpToDate dmz-pve2 role:Secondary peer-disk:UpToDate dmz-pve3 role:Primary peer-disk:UpToDate vm-102-disk-1 role:Secondary disk:UpToDate dmz-pve2 role:Secondary peer-disk:UpToDate dmz-pve3 role:Primary peer-disk:UpToDate root@dmz-pve1:~ # drbd-overview NOTE: drbd-overview will be deprecated soon. Please consider using drbdtop. 0:.drbdctrl/0 Connected(3*) Seco(dmz-pve3,dmz-pve1)/Prim(dmz-pve2) UpTo(dmz-pve1)/UpTo(dmz-pve2,dmz-pve3) 1:.drbdctrl/1 Connected(3*) Seco(dmz-pve1,dmz-pve3)/Prim(dmz-pve2) UpTo(dmz-pve1)/UpTo(dmz-pve2,dmz-pve3) 100:vm-100-disk-1/0 Connected(3*) Seco(dmz-pve1,dmz-pve2)/Prim(dmz-pve3) UpTo(dmz-pve1)/UpTo(dmz-pve2,dmz-pve3) 101:vm-101-disk-1/0 Connected(3*) Seco(dmz-pve2,dmz-pve1)/Prim(dmz-pve3) UpTo(dmz-pve1)/UpTo(dmz-pve3,dmz-pve2) 102:vm-102-disk-1/0 Connected(3*) Seco(dmz-pve1,dmz-pve2)/Prim(dmz-pve3) UpTo(dmz-pve1)/UpTo(dmz-pve2,dmz-pve3) drbdtop on a resource with detailed status give me OutOfSync on some nodes. I try to adjust all resources without any success on solving this problem. Can I have some help for that. Thanks. -- Best regards, Jean-Daniel TISSOT <https://chrono-environnement.univ-fcomte.fr/acteurs/annuaire/article/tissot-jean-daniel> ___ drbd-user mailing list drbd-user@lists.linbit.com http://lists.linbit.com/mailman/listinfo/drbd-user
Re: [DRBD-user] Unable to init a node
And i forget, I get the same result Le 13/03/2018 à 16:57, Jdt a écrit : > > Le 13/03/2018 à 16:21, Roland Kammerer a écrit : > >> On Tue, Mar 13, 2018 at 04:07:17PM +0100, Jdt wrote: >>> Hi, >>> >>> We had a three nodes Proxmox cluster in V4 (jessie) with drbd from Proxmox. >>> I choose to reinitialize this cluster with Proxmox V5 (stretch) with >>> drbd from Linbit. >>> >>> I install Proxmox from the ISO image on the three nodes. Proxmox nodes >>> are not associated yet in a cluster. >>> I install drbdmanage-proxmox as indicated in >>> https://docs.linbit.com/docs/users-guide-9.0/#ch-proxmox >>> My network interfaces are well configured for drbd. >>> On the first node I create the drbdpool volume group as indicated in >>> https://docs.linbit.com/docs/users-guide-9.0/#s-dm-init-cluster >>> >>> But it's failed in initialization : >>> root@dmz-pve1:~ # drbdmanage init 192.168.2.10 >>> >>> You are going to initialize a new drbdmanage cluster. >>> CAUTION! Note that: >>> * Any previous drbdmanage cluster information may be removed >>> * Any remaining resources managed by a previous drbdmanage installation >>> that still exist on this system will no longer be managed by drbdmanage >>> >>> Confirm: >>> >>> yes/no: yes >>> Error: External command failed: >>> drbdsetup new-resource .drbdctrl 0 >>> Command output: >>> (stdout) >>> Command exited with exit_code 20 >>> >>> Initialization failed >> Failing at that early stage usually means that the wrong module is >> loaded. cat /proc/drbd > root@dmz-pve1:~ # cat /proc/drbd > version: 8.4.7 (api:1/proto:86-101) > srcversion: 2DCC561E7F1E3D63526E90D > >>> In /etc/drbdmanaged.cfg, I have >> You should not. > Ok, I reinstall > > root@dmz-pve1:~ # modinfo drbd > filename: > /lib/modules/4.13.13-6-pve/kernel/drivers/block/drbd/drbd.ko > alias: block-major-147-* > license: GPL > version: 8.4.7 > description: drbd - Distributed Replicated Block Device v8.4.7 > author: Philipp Reisner <p...@linbit.com>, Lars Ellenberg > <l...@linbit.com> > srcversion: 2DCC561E7F1E3D63526E90D > depends: lru_cache,libcrc32c > retpoline: Y > intree: Y > name: drbd > vermagic: 4.13.13-6-pve SMP mod_unload modversions > parm: minor_count:Approximate number of drbd devices (1-255) > (uint) > parm: disable_sendpage:bool > parm: allow_oos:DONT USE! (bool) > parm: proc_details:int > parm: usermode_helper:string > > root@dmz-pve1:~ # cat /etc/drbdmanaged.cfg > [LOCAL] > storage-plugin = drbdmanage.storage.lvm_thinlv.LvmThinLv > force=1 > root@dmz-pve1:~ # lsmod | grep drbd > drbd 360448 0 > lru_cache 16384 1 drbd > libcrc32c 16384 2 dm_persistent_data,drbd > > > >> >> If you don't have "force" set, most of them are ignored. Having options >> per node, per config files isn't possible for years. As I don't see >> "force", but your "custom options", that indicates to me that you did >> not use our version of drbdmanage for proxmox, which sets up >> drbdmanaged.cfg correctly, or you just overwrote what was in it with >> what you thought is a good idea. Unfortunately, it was not a good >> idea... >> Regards, rck >> ___ >> drbd-user mailing list >> drbd-user@lists.linbit.com >> http://lists.linbit.com/mailman/listinfo/drbd-user > Regards, JdT > > > ___ > drbd-user mailing list > drbd-user@lists.linbit.com > http://lists.linbit.com/mailman/listinfo/drbd-user -- Bien cordialement, Jean-Daniel TISSOT <https://chrono-environnement.univ-fcomte.fr/acteurs/annuaire/article/tissot-jean-daniel> Administrateur Systèmes et Réseaux Tel: +33 3 81 666 440 Fax: +33 3 81 666 568 Chrono-environnement Laboratoire Chrono-environnement <http://chrono-environnement.univ-fcomte.fr/> 16, Route de Gray 25 030 BESANÇON Cedex Plan et Accès <https://mapsengine.google.com/map/viewer?mid=zjsxW4ZzZPLY.kp2qPHUBD45c> ___ drbd-user mailing list drbd-user@lists.linbit.com http://lists.linbit.com/mailman/listinfo/drbd-user
[DRBD-user] Repositories
Hi, I will switching to three Proxmox V5.1 nodes for HA with DRBD. Since V5, drbdmanage and drbd-utils are no more available as debian packages on Proxmox repositories. Does Linbit provide repositories for Debian stretch for theses packages ? Thanks in advance. -- Best regards, Jean-Daniel TISSOT <https://chrono-environnement.univ-fcomte.fr/acteurs/annuaire/article/tissot-jean-daniel> ___ drbd-user mailing list drbd-user@lists.linbit.com http://lists.linbit.com/mailman/listinfo/drbd-user
Re: [DRBD-user] Testing new DRBD9 dedicated repo for PVE
On 27/12/2016 12:08, Roland Kammerer wrote : > On Tue, Dec 27, 2016 at 11:26:45AM +0100, Jean-Daniel Tissot wrote: >> >> >> > http-equiv="Content-Type"> >> >> >> On 27/12/2016 10:19, Roberto Resoli >> wrote : > Please stop sending html-only mail. Sorry for that, I do not see my mail was HTML-only. > >> I used DRBD 9 knowing it is not recommended for production. > Hm, there might be some over interpretation, right? IMO all that was > said is that if you don't need the additional features of DRBD9 (more > nodes, auto-promote, RDMA, resource management with drbdmanage), then > stay with drbd 8.4. IMO drbd9 improved a lot since .0, its simply your > decision. In https://pve.proxmox.com/wiki/DRBD9 they said "DRBD9 integration is introduced in Proxmox VE 4.x as technology preview". I don't know what they mean by preview. I don't have any commercial support for Proxmox or DRBD. Our financial resources are limited. >> Since we are on a production cluster, is it dangerous to switch to >> Linbit repository ? > Switching the repo isn't. Proxmox drbdmange had very minimal > modifications, basically using a different storage plugin as default. We > even ship that modification in our repo. The real thing is that the > drbdmanage *versions* shipped are very different. Get familiar with the > new one, especially the changed startup, try it in some VMs. Know what > the implications are if nodes are mission and you try to start the > cluster. There are many posts about that already, I don't repeat it here > again. > >> When DRBD 9 will be stable and really usable in production? > That's not a serious question, right? When will Linux be stable? For sure, a lot of my servers are on Debian / Jessie, they call it stable. That does not mean there is no bugs, but Jessie can be used in production. What I mean is "Is DRBD 9 in testing mode ? And can we use it in production ?" Sorry for my bad english. Regards, Jean-Daniel > > Regards, rck > ___ drbd-user mailing list drbd-user@lists.linbit.com http://lists.linbit.com/mailman/listinfo/drbd-user
Re: [DRBD-user] Testing new DRBD9 dedicated repo for PVE
On 27/12/2016 10:19, Roberto Resoli wrote : I have successfully done the transition to linbit repo drbdmanage. Hi, Well, I have done a three nodes PVE cluster. I can't use CEPH or others storage technologies. I used DRBD 9 knowing it is not recommended for production. I had some problems at the beginning, but now it's works well. HA is working. Live migration is working well. DRBD sync take quite a long time sometimes but if it's take too long, rebooting the node correct this problem. For now, I use Proxmox repository and I don't see DRBD Manage is no more present on it. Since we are on a production cluster, is it dangerous to switch to Linbit repository ? When DRBD 9 will be stable and really usable in production? Thanks in advance. Bests regards, Jean-Daniel -- Bien cordialement, Jean-Daniel TISSOT Administrateur Systèmes et Réseaux Tel: +33 3 81 666 440 Fax: +33 3 81 666 568 Laboratoire Chrono-environnement 16, Route de Gray 25030 BESANÇON Cédex Plan et Accès ___ drbd-user mailing list drbd-user@lists.linbit.com http://lists.linbit.com/mailman/listinfo/drbd-user
Re: [DRBD-user] DRBD9 Update not cleaning up depreciate commands
Sorry for missing context : Hi, I have not this file too. ii drbd-utils 8.9.8-1amd64 RAID 1 over TCP/IP for Linux (user utilities) un drbd8-utils (aucune description n'est disponible) ii drbdmanage 0.97.3-1 amd64 Distributed configuration management for DRBD Le 08/11/2016 à 14:26, Roland Kammerer a écrit : >> > Error 2: >> > This is the other error I am now seeing after upgrade. the >> > */etc/drbdmanaged.cfg* has not existed before this. How is it created? > There is one in the package. Basically since it got introduced many > months ago. -- Bien cordialement, Jean-Daniel TISSOT <http://chrono-environnement.univ-fcomte.fr/spip.php?article457> Administrateur Systèmes et Réseaux Tel: +33 3 81 666 440 Fax: +33 3 81 666 568 Laboratoire Chrono-environnement <http://chrono-environnement.univ-fcomte.fr/> 16, Route de Gray 25030 BESANÇON Cedex Plan et Accès <https://mapsengine.google.com/map/viewer?mid=zjsxW4ZzZPLY.kp2qPHUBD45c> ___ drbd-user mailing list drbd-user@lists.linbit.com http://lists.linbit.com/mailman/listinfo/drbd-user
Re: [DRBD-user] DRBD9 Update not cleaning up depreciate commands
Hi, I have not this file too. ii drbd-utils 8.9.8-1amd64 RAID 1 over TCP/IP for Linux (user utilities) un drbd8-utils (aucune description n'est disponible) ii drbdmanage 0.97.3-1 amd64 Distributed configuration management for DRBD Le 08/11/2016 à 14:26, Roland Kammerer a écrit : > There is one in the package. Basically since it got introduced many > months ago. -- Bien cordialement, Jean-Daniel TISSOT <http://chrono-environnement.univ-fcomte.fr/spip.php?article457> Administrateur Systèmes et Réseaux Tel: +33 3 81 666 440 Fax: +33 3 81 666 568 Laboratoire Chrono-environnement <http://chrono-environnement.univ-fcomte.fr/> 16, Route de Gray 25030 BESANÇON Cedex Plan et Accès <https://mapsengine.google.com/map/viewer?mid=zjsxW4ZzZPLY.kp2qPHUBD45c> ___ drbd-user mailing list drbd-user@lists.linbit.com http://lists.linbit.com/mailman/listinfo/drbd-user
Re: [DRBD-user] Proxmox VE 4.2 and DRBD 9 other problem
After another reboot, some links disappears from /dev/drbd/by-disk/drbdpool and /dev/drbd/by-res. For example i have 3 VM so /dev/drbd100, /dev/drbd101 and /dev/drbd102 correspond to theses VM raw disks. But in /dev/drbd/by-disk/drbdpool i have no more the link for vm-101-disk-1_00 to /dev/drbd100 and no directory /dev/drbd/by-res/vm-101-disk-1 with a link in it named 0 to /dev/drbd100 Could anybody explain this ? Le 16/09/2016 à 15:02, Jean-Daniel TISSOT a écrit : > > Hi, > > After testing a little bit more, I see that I must do drbdmanage export "*" > and drbd adjust all for retrieving my configuration and having my VM > resources updated. > > Why does it not done automatically ? > > Is there any way to do that automatically in the boot process and when ? > > Thanks. > > Regards. Jean-Daniel > > Le 05/09/2016 à 11:54, Robert Altnoeder a écrit : >> On 09/02/2016 06:05 PM, Jean-Daniel TISSOT wrote: >>> Hi list, >>> >>> I remark i have a file /var/lib/drbd.d/drbdmanage_vm-100-disk-2.res [...] >>> If i reboot a node, this file disappear on this node [...] >>> [...] if i do drbdadm connect vm-100-disk-2 i receive : >>> 'vm-100-disk-2' not defined in your config (for this host). >>> >> The DRBD resources on ProxMox with DRBD9 are managed by drbdmanage instead >> of just by drbdadm. >> You can run: >> drbdmanage export vm-100-disk-2 >> which will recreate the configuration file in /var/lib/drbd.d for use with >> drbdadm >> >> This command will also implicitly start the drbdmanage server if it is not >> yet started (otherwise, drbdmanage startup can be used to start the >> drbdmanage server, which also starts all resources managed by drbdmanage). >> >> Apart from that, since the resource appears to be running, but is marked as >> Outdated and StandAlone, there might also be something wrong with the >> resource itself. If the resource does not reconnect/resync after a 'drbdadm >> adjust' command, the system log should be checked for messages regarding the >> state of that resource (such as e.g. a split-brain alert) >> >> -- >> Robert Altnoeder >> DRBD - Corosync - Pacemaker >> +43 (1) 817 82 92 - 0 >> robert.altnoe...@linbit.com <mailto:robert.altnoe...@linbit.com> >> >> DRBD® and LINBIT® are registered trademarks of LINBIT, Austria. >> >> >> >> ___ >> drbd-user mailing list >> drbd-user@lists.linbit.com >> http://lists.linbit.com/mailman/listinfo/drbd-user > > -- > Bien cordialement, Jean-Daniel TISSOT > <http://chrono-environnement.univ-fcomte.fr/spip.php?article457> > Administrateur Systèmes et Réseaux > Tel: +33 3 81 666 440 Fax: +33 3 81 666 568 > > Laboratoire Chrono-environnement <http://chrono-environnement.univ-fcomte.fr/> > 16, Route de Gray > 25030 BESANÇON Cédex > > Plan et Accès > <https://mapsengine.google.com/map/viewer?mid=zjsxW4ZzZPLY.kp2qPHUBD45c> > > > ___ > drbd-user mailing list > drbd-user@lists.linbit.com > http://lists.linbit.com/mailman/listinfo/drbd-user -- Bien cordialement, Jean-Daniel TISSOT <http://chrono-environnement.univ-fcomte.fr/spip.php?article457> Administrateur Systèmes et Réseaux Tel: +33 3 81 666 440 Fax: +33 3 81 666 568 Laboratoire Chrono-environnement <http://chrono-environnement.univ-fcomte.fr/> 16, Route de Gray 25030 BESANÇON Cédex Plan et Accès <https://mapsengine.google.com/map/viewer?mid=zjsxW4ZzZPLY.kp2qPHUBD45c> ___ drbd-user mailing list drbd-user@lists.linbit.com http://lists.linbit.com/mailman/listinfo/drbd-user
Re: [DRBD-user] Proxmox VE 4.2 and DRBD 9
Hi, After testing a little bit more, I see that I must do drbdmanage export "*" and drbd adjust all for retrieving my configuration and having my VM resources updated. Why does it not done automatically ? Is there any way to do that automatically in the boot process and when ? Thanks. Regards. Jean-Daniel Le 05/09/2016 à 11:54, Robert Altnoeder a écrit : > On 09/02/2016 06:05 PM, Jean-Daniel TISSOT wrote: >> Hi list, >> >> I remark i have a file /var/lib/drbd.d/drbdmanage_vm-100-disk-2.res [...] >> If i reboot a node, this file disappear on this node [...] >> [...] if i do drbdadm connect vm-100-disk-2 i receive : >> 'vm-100-disk-2' not defined in your config (for this host). >> > The DRBD resources on ProxMox with DRBD9 are managed by drbdmanage instead of > just by drbdadm. > You can run: > drbdmanage export vm-100-disk-2 > which will recreate the configuration file in /var/lib/drbd.d for use with > drbdadm > > This command will also implicitly start the drbdmanage server if it is not > yet started (otherwise, drbdmanage startup can be used to start the > drbdmanage server, which also starts all resources managed by drbdmanage). > > Apart from that, since the resource appears to be running, but is marked as > Outdated and StandAlone, there might also be something wrong with the > resource itself. If the resource does not reconnect/resync after a 'drbdadm > adjust' command, the system log should be checked for messages regarding the > state of that resource (such as e.g. a split-brain alert) > > -- > Robert Altnoeder > DRBD - Corosync - Pacemaker > +43 (1) 817 82 92 - 0 > robert.altnoe...@linbit.com <mailto:robert.altnoe...@linbit.com> > > DRBD® and LINBIT® are registered trademarks of LINBIT, Austria. > > > > _______ > drbd-user mailing list > drbd-user@lists.linbit.com > http://lists.linbit.com/mailman/listinfo/drbd-user -- Bien cordialement, Jean-Daniel TISSOT <http://chrono-environnement.univ-fcomte.fr/spip.php?article457> Administrateur Systèmes et Réseaux Tel: +33 3 81 666 440 Fax: +33 3 81 666 568 Laboratoire Chrono-environnement <http://chrono-environnement.univ-fcomte.fr/> 16, Route de Gray 25030 BESANÇON Cédex Plan et Accès <https://mapsengine.google.com/map/viewer?mid=zjsxW4ZzZPLY.kp2qPHUBD45c> ___ drbd-user mailing list drbd-user@lists.linbit.com http://lists.linbit.com/mailman/listinfo/drbd-user
Re: [DRBD-user] Proxmox VE 4.2 and DRBD 9
Hi again, In fact there is other problems, when I migrate a VM on another node, it's fail with this error message : sept. 05 16:26:32 starting migration of VM 100 to node 'dmz-pve2' (192.168.0.20) sept. 05 16:26:32 copying disk images sept. 05 16:26:32 starting VM 100 on remote node 'dmz-pve2' sept. 05 16:26:34 start failed: command '/usr/bin/kvm -id 100 -chardev 'socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait' -mon 'chardev=qmp,mode=control' -pidfile /var/run/qemu-server/100.pid -daemonize -smbios 'type=1,uuid=644673aa-fb7e-4b11-9fa3-2f3ec9098235' -name vm100 -smp '4,sockets=2,cores=2,maxcpus=4' -nodefaults -boot 'menu=on,strict=on,reboot-timeout=1000' -vga cirrus -vnc unix:/var/run/qemu-server/100.vnc,x509,password -cpu kvm64,+lahf_lm,+sep,+kvm_pv_unhalt,+kvm_pv_eoi,enforce -m 4096 -k fr -device 'pci-bridge,id=pci.2,chassis_nr=2,bus=pci.0,addr=0x1f' -device 'pci-bridge,id=pci.1,chassis_nr=1,bus=pci.0,addr=0x1e' -device 'piix3-usb-uhci,id=uhci,bus=pci.0,addr=0x1.0x2' -device 'usb-tablet,id=tablet,bus=uhci.0,port=1' -device 'virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3' -iscsi 'initiator-name=iqn.1993-08.org.debian:01:96495c6512a9' -drive 'if=none,id=drive-ide2,media=cdrom,aio=threads' -device 'ide-cd,bus=ide.1,unit=0,drive=drive-ide2,id=ide2,bootindex=200' -drive 'file=/dev/drbd/by-res/vm-100-disk-2/0,if=none,id=drive-virtio0,cache=writethrough,format=raw,aio=threads,detect-zeroes=on' -device 'virtio-blk-pci,drive=drive-virtio0,id=virtio0,bus=pci.0,addr=0xa,bootindex=100' -netdev 'type=tap,id=net0,ifname=tap100i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on' -device 'virtio-net-pci,mac=B6:35:60:34:BD:DD,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300' -machine 'type=pc-i440fx-2.6' -incoming unix:/run/qemu-server/100.migrate -S' failed: exit code 1 sept. 05 16:26:34 ERROR: online migrate failure - command '/usr/bin/ssh -o 'BatchMode=yes' root@192.168.0.20 qm start 100 --skiplock --migratedfrom dmz-pve3 --stateuri unix --machine pc-i440fx-2.6' failed: exit code 255 sept. 05 16:26:34 aborting phase 2 - cleanup resources sept. 05 16:26:34 migrate_cancel sept. 05 16:26:34 ERROR: migration finished with problems (duration 00:00:02) TASK ERROR: migration problems Proxmox search for /dev/drbd/by-res/vm-100-disk-2/0 which is not present (/dev/drbdpool/vm-100-disk-2_00 exist). If I do: mkdir /dev/drbd/by-res/vm-100-disk-2 cd /dev/drbd/by-res/vm-100-disk-2 ln -s ../../../drbd101 0 My virtual machine can start. How to have /dev/drbd/by-res automatically filled by resources for all VMs ? PS : I do some apt-get purge ` deborphan --guess-all ` (until nothing need to be purged) on all Proxmox nodes as I do for all my Debian servers. Thanks in advance. Le 05/09/2016 à 12:53, Jean-Daniel TISSOT a écrit : > > Hi Robert, > > Thanks a lot. This export solve my problem. A drbdadm adjust all and after a > drbdadm status show me good results. > > > Le 05/09/2016 à 11:54, Robert Altnoeder a écrit : >> On 09/02/2016 06:05 PM, Jean-Daniel TISSOT wrote: >>> Hi list, >>> >>> I remark i have a file /var/lib/drbd.d/drbdmanage_vm-100-disk-2.res [...] >>> If i reboot a node, this file disappear on this node [...] >>> [...] if i do drbdadm connect vm-100-disk-2 i receive : >>> 'vm-100-disk-2' not defined in your config (for this host). >>> >> The DRBD resources on ProxMox with DRBD9 are managed by drbdmanage instead >> of just by drbdadm. >> You can run: >> drbdmanage export vm-100-disk-2 >> which will recreate the configuration file in /var/lib/drbd.d for use with >> drbdadm >> >> This command will also implicitly start the drbdmanage server if it is not >> yet started (otherwise, drbdmanage startup can be used to start the >> drbdmanage server, which also starts all resources managed by drbdmanage). >> >> Apart from that, since the resource appears to be running, but is marked as >> Outdated and StandAlone, there might also be something wrong with the >> resource itself. If the resource does not reconnect/resync after a 'drbdadm >> adjust' command, the system log should be checked for messages regarding the >> state of that resource (such as e.g. a split-brain alert) >> >> -- >> Robert Altnoeder >> DRBD - Corosync - Pacemaker >> +43 (1) 817 82 92 - 0 >> robert.altnoe...@linbit.com <mailto:robert.altnoe...@linbit.com> >> >> DRBD® and LINBIT® are registered trademarks of LINBIT, Austria. >> >> >> >> ___ >> drbd-user mailing list >> drbd-user@lists.linbit.com >> http://lists.linbit.com/mailman/listinfo/drbd-user > > -- > Bien cordialement, Jean-Daniel TISSOT > <
Re: [DRBD-user] Proxmox VE 4.2 and DRBD 9
Hi Robert, Thanks a lot. This export solve my problem. A drbdadm adjust all and after a drbdadm status show me good results. Le 05/09/2016 à 11:54, Robert Altnoeder a écrit : > On 09/02/2016 06:05 PM, Jean-Daniel TISSOT wrote: >> Hi list, >> >> I remark i have a file /var/lib/drbd.d/drbdmanage_vm-100-disk-2.res [...] >> If i reboot a node, this file disappear on this node [...] >> [...] if i do drbdadm connect vm-100-disk-2 i receive : >> 'vm-100-disk-2' not defined in your config (for this host). >> > The DRBD resources on ProxMox with DRBD9 are managed by drbdmanage instead of > just by drbdadm. > You can run: > drbdmanage export vm-100-disk-2 > which will recreate the configuration file in /var/lib/drbd.d for use with > drbdadm > > This command will also implicitly start the drbdmanage server if it is not > yet started (otherwise, drbdmanage startup can be used to start the > drbdmanage server, which also starts all resources managed by drbdmanage). > > Apart from that, since the resource appears to be running, but is marked as > Outdated and StandAlone, there might also be something wrong with the > resource itself. If the resource does not reconnect/resync after a 'drbdadm > adjust' command, the system log should be checked for messages regarding the > state of that resource (such as e.g. a split-brain alert) > > -- > Robert Altnoeder > DRBD - Corosync - Pacemaker > +43 (1) 817 82 92 - 0 > robert.altnoe...@linbit.com <mailto:robert.altnoe...@linbit.com> > > DRBD® and LINBIT® are registered trademarks of LINBIT, Austria. > > > > ___ > drbd-user mailing list > drbd-user@lists.linbit.com > http://lists.linbit.com/mailman/listinfo/drbd-user -- Bien cordialement, Jean-Daniel TISSOT <http://chrono-environnement.univ-fcomte.fr/spip.php?article457> Administrateur Systèmes et Réseaux Tel: +33 3 81 666 440 Fax: +33 3 81 666 568 Laboratoire Chrono-environnement <http://chrono-environnement.univ-fcomte.fr/> 16, Route de Gray 25030 BESANÇON Cédex Plan et Accès <https://mapsengine.google.com/map/viewer?mid=zjsxW4ZzZPLY.kp2qPHUBD45c> ___ drbd-user mailing list drbd-user@lists.linbit.com http://lists.linbit.com/mailman/listinfo/drbd-user
[DRBD-user] Proxmox VE 4.2 and DRBD 9
Hi list, I have a cluster with 3 nodes (for HA) and DRBD is used to replicate my VM on all three nodes. I remark i have a file /var/lib/drbd.d/drbdmanage_vm-100-disk-2.res created on the nodes but nothing about that VM in /etc/drbd.d. If i reboot a node, this file disappear on this node and when i run - drbdadm status on another node give : vm-100-disk-2 role:Primary disk:UpToDate dmz-pve1 role:Secondary peer-disk:UpToDate dmz-pve3 connection:Connecting - drbd-overview on an another node give : 0:.drbdctrl/0 Connected(3*) Secondary(3*) UpTo(dmz-pve2)/UpTo(dmz-pve3,dmz-pve1) 1:.drbdctrl/1 Connected(3*) Secondary(3*) UpTo(dmz-pve2)/UpTo(dmz-pve3,dmz-pve1) 101:vm-100-disk-2/0 Conn(dmz-pve2,dmz-pve1)/C'ng(dmz-pve3) Prim(dmz-pve2)/Seco(dmz-pve1)/Unkn(dmz-pve3) UpTo(dmz-pve2)/UpTo(dmz-pve1)/Inco(dmz-pve3) On the rebooted node : - drbdadm status : vm-100-disk-2 role:Secondary disk:Outdated dmz-pve1 connection:StandAlone dmz-pve2 connection:StandAlone - drbd-overview : 0:.drbdctrl/0 Connected(3*) Secondary(3*) UpTo(dmz-pve3)/UpTo(dmz-pve2,dmz-pve1) 1:.drbdctrl/1 Connected(3*) Secondary(3*) UpTo(dmz-pve3)/UpTo(dmz-pve1,dmz-pve2) 101:vm-100-disk-2/0 Conn(dmz-pve3)/StAl(dmz-pve2,dmz-pve1) Seco(dmz-pve3)/Unkn(dmz-pve1,dmz-pve2) Outd(dmz-pve3)/DUnk(dmz-pve1,dmz-pve2) How can i solve this problem ? If i do drbdadm disconnect all and drbdadm connect .drbdctrl all is OK but if i do drbdadm connect vm-100-disk-2 i receive : 'vm-100-disk-2' not defined in your config (for this host). Any help will be greatly appreciated. Sorry for my poor english. Best regards -- Bien cordialement, Jean-Daniel TISSOT <http://chrono-environnement.univ-fcomte.fr/spip.php?article457> Administrateur Systèmes et Réseaux Tel: +33 3 81 666 440 Fax: +33 3 81 666 568 Laboratoire Chrono-environnement <http://chrono-environnement.univ-fcomte.fr/> 16, Route de Gray 25030 BESANÇON Cédex Plan et Accès <https://mapsengine.google.com/map/viewer?mid=zjsxW4ZzZPLY.kp2qPHUBD45c> ___ drbd-user mailing list drbd-user@lists.linbit.com http://lists.linbit.com/mailman/listinfo/drbd-user
