Re: [Ganglia-general] Problem displaying Virtual Machine data with hsflowd and ganglia 3.2.0 in an Openstack Compute node.
Hi Neil, thanks for the suggestion. I tried to do it. After recompiling hsflowd i checked the files it had open and it showed: hsflowd 30019 nobody mem REG 251,3 84728 927248 /usr/lib/libxenctrl.so.3.2.0 hsflowd 30019 nobody mem REG 251,3 22928 927250 /usr/lib/libxenstore.so.3.0.0 but this solution didn't work. Virtual machines stopped showing up in ganglia and hsflowd gave this error: ERROR Internal error: Could not obtain handle on privileged command interface (2 = No such file or directory) xc_interface_open() failed : No such file or directory then it continued to work normally (hsflowd log file: http://uploading.com/files/get/a3876c8b/ ) but it didn't report anything to ganglia and the VMS were shown as down, the reporting for the physical host instead it's working perfectly, as before. If it can help you, the implementation of Openstack we have uses KVM to virtualize the hosts. Could it be related? Thanks again, Emanuele 2011/8/16 Neil Mckee neil.mckee...@gmail.com Hello, On an OpenStack node you may be able to use libxenstore instead of libvirt. You'll need to recompile hsflowd to try this. Looking at trunk/src/Linux/Makefile it appears to look for libvirt first, but you can override that by compiling hsflowd like this: make clean make LIBVIRT=no The Makefile will then test for libxenstore and libxenctrl. If it finds them it will compile with -DHSF_XEN (instead of -DHSF_VRT), and you may get better results. Please let me know what happens. Neil On Aug 16, 2011, at 2:14 AM, Emanuele Verga wrote: Hi, we have a problem with the following installation: we have a system that’s a compute node in an Openstack test installation. Now on this machine we decided to install Ganglia, to check it’s monitoring capabilities regarding virtual machines hosted on that node by Openstack. We then proceeded to add the repository for ganglia version 3.2 and install: Hsflowd 1.18 Ganglia Monitor Demon 3.2.0.0 Ganglia Meta demon 3.2.0.0 Ganglia Web FronEnd3.2.0.0 Dwoo1.1.1 all on the same machine and to configure ports accordingly. All said and done, the web frontend shown the physical host and all of the VM, but we were unable to: See the hypervisor section in the physical host statistics. It simply is not there. See the graphical preview for VM statistics ( http://imageshack.us/photo/my-images/585/screenshotgangliacomput.png/). The thumbnail are missing but the links do work, clicking on one of the missing thumbnails you are taken to the details page for that VM. See details regarding VM hard disk and I/O. ( http://imageshack.us/photo/my-images/694/screenshotgangliainstan.png/) Debugging hsflowd we found errors similar to the following: Aug 16 06:26:57 eta hsflowd: virStorageLookupByPath(/var/lib/nova/instances/instance-004d/disk.local) failed Aug 16 06:26:57 eta hsflowd: virStorageLookupByPath(/var/lib/nova/instances/instance-004d/disk) failed The strange thing is, the path is correct. We checked libvirt using virsh and found that the Storage Volumes are not reported by libvirt, it seems because libvirt by default search informations in path /var/lib/libvirt/images, instead nova places them inside /var/lib/nova/instances/INSTANCENAME/. Did you have the same problems when testing for Sflow/ Openstack ? How did you manage to resolve it? Any help is appreciated. Thanks in advance for your support! -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general
Re: [Ganglia-general] Problem displaying Virtual Machine data with hsflowd and ganglia 3.2.0 in an Openstack Compute node.
try having soft links using ln command, may or may not work though :) ln -s On Wed, Aug 17, 2011 at 4:17 PM, Emanuele Verga verga.emanu...@gmail.com wrote: Hi Neil, thanks for the suggestion. I tried to do it. After recompiling hsflowd i checked the files it had open and it showed: hsflowd 30019 nobody mem REG 251,3 84728 927248 /usr/lib/libxenctrl.so.3.2.0 hsflowd 30019 nobody mem REG 251,3 22928 927250 /usr/lib/libxenstore.so.3.0.0 but this solution didn't work. Virtual machines stopped showing up in ganglia and hsflowd gave this error: ERROR Internal error: Could not obtain handle on privileged command interface (2 = No such file or directory) xc_interface_open() failed : No such file or directory then it continued to work normally (hsflowd log file: http://uploading.com/files/get/a3876c8b/ ) but it didn't report anything to ganglia and the VMS were shown as down, the reporting for the physical host instead it's working perfectly, as before. If it can help you, the implementation of Openstack we have uses KVM to virtualize the hosts. Could it be related? Thanks again, Emanuele 2011/8/16 Neil Mckee neil.mckee...@gmail.com Hello, On an OpenStack node you may be able to use libxenstore instead of libvirt. You'll need to recompile hsflowd to try this. Looking at trunk/src/Linux/Makefile it appears to look for libvirt first, but you can override that by compiling hsflowd like this: make clean make LIBVIRT=no The Makefile will then test for libxenstore and libxenctrl. If it finds them it will compile with -DHSF_XEN (instead of -DHSF_VRT), and you may get better results. Please let me know what happens. Neil On Aug 16, 2011, at 2:14 AM, Emanuele Verga wrote: Hi, we have a problem with the following installation: we have a system that’s a compute node in an Openstack test installation. Now on this machine we decided to install Ganglia, to check it’s monitoring capabilities regarding virtual machines hosted on that node by Openstack. We then proceeded to add the repository for ganglia version 3.2 and install: Hsflowd 1.18 Ganglia Monitor Demon 3.2.0.0 Ganglia Meta demon 3.2.0.0 Ganglia Web FronEnd 3.2.0.0 Dwoo 1.1.1 all on the same machine and to configure ports accordingly. All said and done, the web frontend shown the physical host and all of the VM, but we were unable to: See the hypervisor section in the physical host statistics. It simply is not there. See the graphical preview for VM statistics (http://imageshack.us/photo/my-images/585/screenshotgangliacomput.png/). The thumbnail are missing but the links do work, clicking on one of the missing thumbnails you are taken to the details page for that VM. See details regarding VM hard disk and I/O. (http://imageshack.us/photo/my-images/694/screenshotgangliainstan.png/) Debugging hsflowd we found errors similar to the following: Aug 16 06:26:57 eta hsflowd: virStorageLookupByPath(/var/lib/nova/instances/instance-004d/disk.local) failed Aug 16 06:26:57 eta hsflowd: virStorageLookupByPath(/var/lib/nova/instances/instance-004d/disk) failed The strange thing is, the path is correct. We checked libvirt using virsh and found that the Storage Volumes are not reported by libvirt, it seems because libvirt by default search informations in path /var/lib/libvirt/images, instead nova places them inside /var/lib/nova/instances/INSTANCENAME/. Did you have the same problems when testing for Sflow/ Openstack ? How did you manage to resolve it? Any help is appreciated. Thanks in advance for your support! -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user
[Ganglia-general] unspecified Grid.
Good Morning! Wiki and archive searches aren't quite getting what I'm looking for. The gmetad.conf tells me the difference between cluster and grid, based on from what type of daemon I'm getting statistics. However, it doesn't say anything about naming the ~local~ grid. - I have 70 hosts in 6 irregularly sized clusters. The gmond on each host points to the lead gmond for its particular cluster. - A single infrastructure host runs gmetad to gather statistics. gmetad.conf has data_source entries for each cluster. Looking at the ganglia web PHP/RRD, I can see each cluster in the http://hostname/ganglia/ overall page. At the top of the page is the unspecified Grid that is the sum of the hosts and CPUs in those clusters. How do I change unspecified? Do I have to fake a data_source to localhost? Thanks! David -- David - Offbeat http://dafydd.livejournal.com dafydd - Online http://pgp.mit.edu/ Battalion 4 - Black Rock City Emergency Services Department Integrity*Commitment*Communication*Support 51525354555657-- It is the beginning of wisdom when you recognize that the best you can do is choose which rules you want to live by, and it's persistent and aggravated imbecility to pretend you can live without any. — Wallace Stegner -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general
Re: [Ganglia-general] Problem displaying Virtual Machine data with hsflowd and ganglia 3.2.0 in an Openstack Compute node.
I don't think the soft-links will work, but try this: 1) go back to compiling hsflowd for libvirt. 2) using virt-manager or equivalent, tell it about the storage pool of type filesystem directory at /var/lib/nova/instances. See details here: http://virt-manager.org/page/StorageManagement (To get to this virt-manager screen you need to select EditHost Details) Now you should see it with virsh pool-list. If you called it nova then virsh pool-info nova will show something like this: virsh # pool-info nova Name: noca UUID: 51341d87-d87e-f7ce-6cc0-81ac3967c182 State: running Capacity: 217.58 GB Allocation: 35.38 GB Available: 182.20 GB hsflowd should then be able to pull those Capacity, Allocation and Available values and send them to Ganglia. Neil P.S. It looks as though hsflowd is not filling in the disk reads/writes/errors counters for KVM VMs yet. If you know of an efficient way to do that, please suggest it on the hsflowd mailing list: https://lists.sourceforge.net/lists/listinfo/host-sflow-discuss On Aug 17, 2011, at 7:16 AM, santosh gangwani wrote: try having soft links using ln command, may or may not work though :) ln -s On Wed, Aug 17, 2011 at 4:17 PM, Emanuele Verga verga.emanu...@gmail.com wrote: Hi Neil, thanks for the suggestion. I tried to do it. After recompiling hsflowd i checked the files it had open and it showed: hsflowd 30019 nobody mem REG 251,3 84728 927248 /usr/lib/libxenctrl.so.3.2.0 hsflowd 30019 nobody mem REG 251,3 22928 927250 /usr/lib/libxenstore.so.3.0.0 but this solution didn't work. Virtual machines stopped showing up in ganglia and hsflowd gave this error: ERROR Internal error: Could not obtain handle on privileged command interface (2 = No such file or directory) xc_interface_open() failed : No such file or directory then it continued to work normally (hsflowd log file: http://uploading.com/files/get/a3876c8b/ ) but it didn't report anything to ganglia and the VMS were shown as down, the reporting for the physical host instead it's working perfectly, as before. If it can help you, the implementation of Openstack we have uses KVM to virtualize the hosts. Could it be related? Thanks again, Emanuele 2011/8/16 Neil Mckee neil.mckee...@gmail.com Hello, On an OpenStack node you may be able to use libxenstore instead of libvirt. You'll need to recompile hsflowd to try this. Looking at trunk/src/Linux/Makefile it appears to look for libvirt first, but you can override that by compiling hsflowd like this: make clean make LIBVIRT=no The Makefile will then test for libxenstore and libxenctrl. If it finds them it will compile with -DHSF_XEN (instead of -DHSF_VRT), and you may get better results. Please let me know what happens. Neil On Aug 16, 2011, at 2:14 AM, Emanuele Verga wrote: Hi, we have a problem with the following installation: we have a system that’s a compute node in an Openstack test installation. Now on this machine we decided to install Ganglia, to check it’s monitoring capabilities regarding virtual machines hosted on that node by Openstack. We then proceeded to add the repository for ganglia version 3.2 and install: Hsflowd 1.18 Ganglia Monitor Demon 3.2.0.0 Ganglia Meta demon 3.2.0.0 Ganglia Web FronEnd3.2.0.0 Dwoo1.1.1 all on the same machine and to configure ports accordingly. All said and done, the web frontend shown the physical host and all of the VM, but we were unable to: See the hypervisor section in the physical host statistics. It simply is not there. See the graphical preview for VM statistics (http://imageshack.us/photo/my-images/585/screenshotgangliacomput.png/). The thumbnail are missing but the links do work, clicking on one of the missing thumbnails you are taken to the details page for that VM. See details regarding VM hard disk and I/O. (http://imageshack.us/photo/my-images/694/screenshotgangliainstan.png/) Debugging hsflowd we found errors similar to the following: Aug 16 06:26:57 eta hsflowd: virStorageLookupByPath(/var/lib/nova/instances/instance-004d/disk.local) failed Aug 16 06:26:57 eta hsflowd: virStorageLookupByPath(/var/lib/nova/instances/instance-004d/disk) failed The strange thing is, the path is correct. We checked libvirt using virsh and found that the Storage Volumes are not reported by libvirt, it seems because libvirt by default search informations in path /var/lib/libvirt/images, instead nova places them inside /var/lib/nova/instances/INSTANCENAME/. Did you have the same problems when testing for Sflow/ Openstack ? How did you manage to resolve it? Any help is appreciated. Thanks in advance for your support!
