[Bug 734777] Re: "cannot acquire state change lock" problems
Launchpad has imported 15 comments from the remote bug at https://bugzilla.redhat.com/show_bug.cgi?id=676205. If you reply to an imported comment from within Launchpad, your comment will be sent to the remote bug automatically. Read more about Launchpad's inter-bugtracker facilities at https://help.launchpad.net/InterBugTracking. On 2011-02-09T04:13:47+00:00 Douglas wrote: Description of problem: Customer cannot resume virtual machine, below the error: # virsh resume v_rhel5_prod error: Failed to resume domain v_rhel5_prod error: Timed out during operation: cannot acquire state change lock Version-Release number of selected component (if applicable): libvirt-0.8.2-15.el5_6.1.x86_64 libvirt-python-0.8.2-15.el5_6.1.x86_64 Also tried: # virsh destroy v_rhel5_prod error: Failed to destroy domain v_rhel5_prod error: Timed out during operation: cannot acquire state change lock # virsh start v_rhel5_prod error: Domain is already active Additional info: Even rebooting the host the VM keep locked. Similar issue: https://bugzilla.redhat.com/show_bug.cgi?id=668438 Attached the debug logs Reply at: https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/734777/comments/0 On 2011-02-09T04:18:50+00:00 Douglas wrote: Created attachment 477730 debug logs Reply at: https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/734777/comments/1 On 2011-02-09T17:18:24+00:00 Daniel wrote: Are there any files in /var/lib/libvirt/qemu/save or /var/lib/libvirt/qemu/snapshot ? And is the 'libvirt-guests' initscript enabled on boot ? Most likely guess would be that there was a saved guest that failed to restore properly on boot Reply at: https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/734777/comments/2 On 2011-02-15T21:34:53+00:00 Douglas wrote: Hello Daniel, Sorry the delay here, customer decided to moving to RHEL 6. They are uploading these files to further analyze. Would you like to make any suggestion? Thanks Douglas Reply at: https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/734777/comments/3 On 2011-02-21T14:54:19+00:00 John wrote: Hi, I am running libvirtd with kvm on a Debian Squeeze host and I am experiencing the same problem from time to time. I'm using virt-manager to control my virtual machines and sometimes libvirtd runs into problems controlling a kvm domain. I cannot exactly say, when the problem occurs but it usually happens when I start and stop several virtual machines one after another. I.e., I have several virtual machines with test installations for development and since some of them are running unstable versions (Debian for example), I start all the VMs once a week to update them, usually not more than two at the same time since my kvm host has only 4GB of RAM. It then usually happens that the state of the virtual machines is not updated in virt-manager and when trying to start a virtual machine which is powered off, I receive the aforementioned error message. The problem is always fixed by: killall -9 libvirtd rm /var/run/libvirtd.pid /etc/init.d/libvirt-bin restart The virtual machines are never affected by this problem, they still continue to run without any problems. It simply seems that libvirtd at some point cannot connect to the kvm host anymore due to a race condition. I'm attaching a screenshot of the error message in virt- manager the last time it happened. In this case, I logged into my Debian Squeeze kvm host over ssh and used X-forwarding to display virt-manager on the MacOS X host. virt-manager was not running on the Mac. Version numbers: dpkg -l libvirt\* |grep -e '^ii' ii libvirt-bin 0.8.3-5 the programs for the libvirt library ii libvirt0 dpkg -l virt\* |grep -e '^ii' ii virt-manager 0.8.4-8 desktop application for managing virtual machines ii virt-viewer 0.2.1-1 Displaying the graphical console of a virtual machine ii virtinst 0.500.3-2 Regards, Adrian Reply at: https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/734777/comments/4 On 2011-02-21T14:56:13+00:00 John wrote: Created attachment 479933 Screenshot of virt-manager running on Debian Squeeze (over X-forwarding on MacOSX) when the problem with libvirtd occured Reply at: https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/734777/comments/5 On 2011-
[Bug 734777] Re: "cannot acquire state change lock" problems
@Janne your issue is really a bug in Linux kernel KVM code being tracked in LP: #795717 https://bugs.launchpad.net/bugs/795717 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems To manage notifications about this bug go to: https://bugs.launchpad.net/libvirt/+bug/734777/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
@Serge Hallyn I used 'ubunut-bug libvirt-bin' to open LP: #882579 about this issue. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems To manage notifications about this bug go to: https://bugs.launchpad.net/libvirt/+bug/734777/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
@Janne, could you please file a new bug using 'ubuntu-bug libvirt', and list any information to help us reproduce it? That should give us more information about what has gone wrong in your particular case. If you can catch it while it is hanging, please also give us the output of for p in `pidof libvirtd`; do echo -n "$p: " cat /proc/$p/cmdline cat /proc/$p/cgroup cat /proc/$p/status done for p in `pidof kvm`; do echo -n "$p: " cat /proc/$p/cmdline cat /proc/$p/cgroup cat /proc/$p/status done -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems To manage notifications about this bug go to: https://bugs.launchpad.net/libvirt/+bug/734777/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
I got hit by this on natty. There seems to be a corresponding Red Hat bug at: https://bugzilla.redhat.com/show_bug.cgi?id=676205 ** Bug watch added: Red Hat Bugzilla #676205 https://bugzilla.redhat.com/show_bug.cgi?id=676205 ** Also affects: libvirt via https://bugzilla.redhat.com/show_bug.cgi?id=676205 Importance: Unknown Status: Unknown -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems To manage notifications about this bug go to: https://bugs.launchpad.net/libvirt/+bug/734777/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
** Changed in: libvirt (Debian) Status: Unknown => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/734777/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
@olx69 - I don't that is related. Please open a new bug for your issue. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
same here. I test at this time lxc. I've mounted cgroup to /cgroups by 'mount none -t cgroup /cgroup'. virt-manager/libvirt did work before mounting until this time -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
OK, went back to stock 10.10 kernel. All problems solved, it seemed. Sorry for the noise. Case closed. ** Changed in: libvirt (Ubuntu) Status: Incomplete => Invalid -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
Ubuntu 10.10 server 64bit: same story, xml attached ** Attachment added: "ubuntu 10.10 server xml" https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/734777/+attachment/1910219/+files/ubuntu1010server.xml -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
Just to be complete: uname -r 2.6.37-020637rc2-generic That's not stock 10.10 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
** Attachment added: "Windows XP xml" https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/734777/+attachment/1910199/+files/winxp.xml -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
Sure. Had to revert to 10.10 libvirt, because virsh from ppa libvirt didn't work. I have 2 guests: 1. Windows xp 2. RHEL6 (64) I am now deploying a 64bit ubuntu 10.10 server. Attached are the xml fiels for 1 and 2 ** Attachment added: "rhel6 xml" https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/734777/+attachment/1910198/+files/rhel6server.xml -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
Can you give the .xml file for one of the VMs which does not shut down? (virsh dumpxml VMNAME > uploadme.xml) ** Changed in: libvirt (Ubuntu) Status: New => Incomplete -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
I wasn't able to reproduce this with a ubuntu server guest started with libvirt in 10.10. I shut the guest down using 'sudo poweroff'. Is there any version of fedora (or some other freely downloadable OS) with which you've been able to reproduce this? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
OK, tried that, but now i cannot even start any guest:
Error starting domain: Unable to create cgroup for server1.lab.local: No
such file or directory
Traceback (most recent call last):
File "/usr/share/virt-manager/virtManager/engine.py", line 814, in run_domain
vm.startup()
File "/usr/share/virt-manager/virtManager/domain.py", line 1296, in startup
self._backend.create()
File "/usr/lib/python2.6/dist-packages/libvirt.py", line 330, in create
if ret == -1: raise libvirtError ('virDomainCreate() failed', dom=self)
libvirtError: Unable to create cgroup for server1.lab.local: No such file or
directory
cgroup-bin 0.36.20-3 is installed
--
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/734777
Title:
"cannot acquire state change lock" problems
--
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 734777] Re: "cannot acquire state change lock" problems
Quoting Fred van Zwieten (734...@bugs.launchpad.net): > No, it's also with a WindowsXP client. > > I do have some additional observations. When I do a force off when the > guest is running, it works (but is hardly diserable). Reboot works, Just > shutdown not. After shutdown, the guest is in a state that nothing > works, including forced off. > > Is it possible to have a testing ppa available with the version that has > a supposed fix in it (afaik 0.8.3-5). Since you are on 10.10, you could try the server edger's ppa version, which is close to the upstream version: https://launchpad.net/~ubuntu-server-edgers/+archive/server-edgers- libvirt?field.series_filter=maverick -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
No, it's also with a WindowsXP client. I do have some additional observations. When I do a force off when the guest is running, it works (but is hardly diserable). Reboot works, Just shutdown not. After shutdown, the guest is in a state that nothing works, including forced off. Is it possible to have a testing ppa available with the version that has a supposed fix in it (afaik 0.8.3-5). -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
Thanks for reporting this bug and helping to make Ubuntu better. I will try to reproduce this later today. Have you seen this on anything other than 10.10? Is the guest OS always Red Hat? ** Bug watch added: Debian Bug tracker #602715 http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=602715 ** Also affects: libvirt (Debian) via http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=602715 Importance: Unknown Status: Unknown -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
Thanks for reporting th -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 734777] Re: "cannot acquire state change lock" problems
-- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/734777 Title: "cannot acquire state change lock" problems -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
