Re: [CentOS] Switch to measure traffic at IP level?
I think I have a solution: In the guests' XML files, I set a target device name so they will always use a known device (Instead of getting an aribtrary vnet* device). Next, using snmp on the host, I can get the interface stats for that device and use cacti to graph it. Thanks to everyone for the help, Neil -- Neil Aggarwal, (281)846-8957, www.JAMMConsulting.com Will your e-commerce site go offline if you have a DB server failure, fiber cut, flood, fire, or other disaster? If so, ask about our geographically redundant database system. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
Couple of diff ways to go about this. I use Cacti and monitor throughput via SNMP for the dom0. I also enable SNMP on my switch and monitor throughput of individual ports. However if you want granularity like monitoring at the network layer (IP or layer 3), then you can look at the netflow like plugin (flow- tools and flow-scan) for Cacti and monitor actual traffic patterns of individual hosts. Or get a netflow or sflow collector in general depending on what your switch supports and enable netflow/sflow just on those ports of interest, like the one your dom0 is on. On Oct 25, 2009, at 6:14 PM, Mathew S. McCarrell wrote: On Fri, Oct 23, 2009 at 12:07 PM, Neil Aggarwal > wrote: Matt: > depending on what your using for virtualization, you might be able to pull all > of those stats with snmp on the host. I am using KVM on CentOS 5.4 Let me know if you think it is possible to gather everything I need at the host without requirining anything from the guests. You might be able to use "virsh domifstat" or something similar. Matt -- Mathew S. McCarrell Clarkson University '10 mccar...@gmail.com mccar...@clarkson.edu 1-518-314-9214 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
On Fri, Oct 23, 2009 at 12:07 PM, Neil Aggarwal wrote: > Matt: > > > depending on what your using for virtualization, you might be able to > pull > all > > of those stats with snmp on the host. > > I am using KVM on CentOS 5.4 > > Let me know if you think it is possible to gather everything > I need at the host without requirining anything from the guests. > > You might be able to use "virsh domifstat" or something similar. Matt -- Mathew S. McCarrell Clarkson University '10 mccar...@gmail.com mccar...@clarkson.edu 1-518-314-9214 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
> I took a look and I think it requires software running on > each guest to report the data back to the centralized > system. Is that correct? Yes > If so, I am looking for a solution that does not require > any software on the guest machines. Oh well, it is not for you then. But it is a pretty sweet system for monitoring your boxes - easy to write your own plugins so the only limit is your imagination. -- “Don't eat anything you've ever seen advertised on TV” - Michael Pollan, author of "In Defense of Food" ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
- "Les Mikesell" escreveu: > Neil Aggarwal wrote: > > Matt: > > > >> why not just use your current cacti setup and > >> enable snmp on each of the hosts? That seems like > >> the simplest and cheapest approach. > > > > As I understand it, I would actually have to > > enable snmp on each of the guests, not the hosts. > > > > Am I wrong? > > > > Yes - the host would see the total traffic. The only other way to > separate it would be something upstream (switch/router, etc.) that knows how > to do > sflow plus a collector device. These are typically pretty expensive. For > some small number of guests it might be cheaper to add NICs to your hosts and > bridge the guests to individual NICs where you could monitor on either the > host > interface or the connected switch port. You might be able to simulate this > with > some clever use of vlans but I'm not sure how they interact with the > virtual nic bridges. Hum... I haven't tried it myself but maybe it is possible to try on the virtual NICs. The only drawback is that the need to create a way to link the data from the vifs to the corret guest :) Antonio. -- +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | Antonio S. Martins Jr. - Support Analist | "Only The Shadow Knows | | Universidade Estadual de Maringá - Brasil| what evil lurks in the | | NPD - Núcleo de Processamento de Dados | Heart of Men!" | | E-Mail: asmart...@uem.br / sha...@uem.br | !!! Linux User: 52392 !!! | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ "Real Programmers don’t need comments — the code is obvious." -- Esta mensagem foi verificada pelo sistema de antivírus e acredita-se estar livre de perigo. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
Neil Aggarwal wrote: > Matt: > >> why not just use your current cacti setup and >> enable snmp on each of the hosts? That seems like >> the simplest and cheapest approach. > > As I understand it, I would actually have to > enable snmp on each of the guests, not the hosts. > > Am I wrong? > Yes - the host would see the total traffic. The only other way to separate it would be something upstream (switch/router, etc.) that knows how to do sflow plus a collector device. These are typically pretty expensive. For some small number of guests it might be cheaper to add NICs to your hosts and bridge the guests to individual NICs where you could monitor on either the host interface or the connected switch port. You might be able to simulate this with some clever use of vlans but I'm not sure how they interact with the virtual nic bridges. -- Les Mikesell lesmikes...@gmail.com ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
Matt: > depending on what your using for virtualization, you might be able to pull all > of those stats with snmp on the host. I am using KVM on CentOS 5.4 Let me know if you think it is possible to gather everything I need at the host without requirining anything from the guests. Thanks, Neil -- Neil Aggarwal, (281)846-8957, www.JAMMConsulting.com Will your e-commerce site go offline if you have a DB server failure, fiber cut, flood, fire, or other disaster? If so, ask about our geographically redundant database system. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
On Fri, Oct 23, 2009 at 11:58 AM, Neil Aggarwal wrote: > Matt: > > > why not just use your current cacti setup and > > enable snmp on each of the hosts? That seems like > > the simplest and cheapest approach. > > As I understand it, I would actually have to > enable snmp on each of the guests, not the hosts. > > Am I wrong? > > Thanks, >Neil > > Yeah, I guess you probably would and I can see how you would want to avoid that. That is how I do it with Cacti right now but depending on what your using for virtualization, you might be able to pull all of those stats with snmp on the host. Matt ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
Matt: > why not just use your current cacti setup and > enable snmp on each of the hosts? That seems like > the simplest and cheapest approach. As I understand it, I would actually have to enable snmp on each of the guests, not the hosts. Am I wrong? Thanks, Neil -- Neil Aggarwal, (281)846-8957, www.JAMMConsulting.com Will your e-commerce site go offline if you have a DB server failure, fiber cut, flood, fire, or other disaster? If so, ask about our geographically redundant database system. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
On Fri, Oct 23, 2009 at 11:44 AM, Neil Aggarwal wrote: > > Alternately you could use something like Munin to monitor on > > the box itself. > > I took a look and I think it requires software running on > each guest to report the data back to the centralized > system. Is that correct? > > If so, I am looking for a solution that does not require > any software on the guest machines. > > Thanks, >Neil > > If your going to take this approach, why not just use your current cacti setup and enable snmp on each of the hosts? That seems like the simplest and cheapest approach. Just my thoughts. Matt -- Mathew S. McCarrell Clarkson University '10 mccar...@gmail.com mccar...@clarkson.edu 1-518-314-9214 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
> Alternately you could use something like Munin to monitor on > the box itself. I took a look and I think it requires software running on each guest to report the data back to the centralized system. Is that correct? If so, I am looking for a solution that does not require any software on the guest machines. Thanks, Neil -- Neil Aggarwal, (281)846-8957, www.JAMMConsulting.com Will your e-commerce site go offline if you have a DB server failure, fiber cut, flood, fire, or other disaster? If so, ask about our geographically redundant database system. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
> Can one setup a Linux server to offer sflow? If the Linux host can run > sflow, then it's easy to capture the bandwidth usage on the host? That is a good idea. Since we have to have the host OS running, it might be able to do the collection activities for us. If anyone has a soution for this, I am interested in more info. > I'm sitting with the same problem, and rely on snmpd on each VPS, but this > isn't ideal - especially if clients disable snmpd I agree. I do not want a solution that depends on software installed on the guest since the client has control of that. Neil -- Neil Aggarwal, (281)846-8957, www.JAMMConsulting.com Will your e-commerce site go offline if you have a DB server failure, fiber cut, flood, fire, or other disaster? If so, ask about our geographically redundant database system. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
nate wrote: > Neil Aggarwal wrote: > >> I just need something that gives me a usage graph >> at daily, weekly, and monthly intervals with a 95% >> line. > > Don't use RRD for billing 95% it will not be accurate > as RRD averages values over time. I use rtg (not mrtg, > but rtg) together with SNMP to get accurate 95% readings > at the interface/port level. > > sflow is also a sampling mechanism, but it is pretty > accurate depending on the interval, you can see this > site for accuracy on sflow: > > http://www.sflow.org/packetSamplingBasics/index.htm > > If your just using rrd for casual monitoring, no problem > but if your using it for billing at 95% then be > careful. RRD stores a certain number of samples at their collected values, then as they age, averages them into larger and larger time values per sample, with the numbers of each set being configurable. If you keep the raw samples for the time span of the calculation you should get accurate values. -- Les Mikesell lesmikes...@gmail.com ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
> Currently, I use Cacti to graph the data coming > from my switches. Do you know if that will that > work with any of these switches? Alternately you could use something like Munin to monitor on the box itself. -- “Don't eat anything you've ever seen advertised on TV” - Michael Pollan, author of "In Defense of Food" ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
Neil Aggarwal wrote: > I just need something that gives me a usage graph > at daily, weekly, and monthly intervals with a 95% > line. Don't use RRD for billing 95% it will not be accurate as RRD averages values over time. I use rtg (not mrtg, but rtg) together with SNMP to get accurate 95% readings at the interface/port level. sflow is also a sampling mechanism, but it is pretty accurate depending on the interval, you can see this site for accuracy on sflow: http://www.sflow.org/packetSamplingBasics/index.htm If your just using rrd for casual monitoring, no problem but if your using it for billing at 95% then be careful. nate ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
> http://www.sflow.org/products/collectors.php > > ntop would probably be the main "free" flow based monitor, > though there are some really really nice commercial > products. I just need something that gives me a usage graph at daily, weekly, and monthly intervals with a 95% line. It looks like ntop works with RRD so that seems like a good solution. Thanks for your help! Neil -- Neil Aggarwal, (281)846-8957, www.JAMMConsulting.com Will your e-commerce site go offline if you have a DB server failure, fiber cut, flood, fire, or other disaster? If so, ask about our geographically redundant database system. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
On Fri, Oct 23, 2009 at 4:04 PM, nate wrote: > Neil Aggarwal wrote: >> Nate: >> >> Thanks for the suggestion. I am looking into it >> now. >> >> Currently, I use Cacti to graph the data coming >> from my switches. Do you know if that will that >> work with any of these switches? > > Cacti will work for port based monitoring, it won't work > for flow-based monitoring though. > > http://www.sflow.org/products/collectors.php > > ntop would probably be the main "free" flow based monitor, > though there are some really really nice commercial > products. > > Inmon has a couple free tools as well sflowtrend, and another > command line tool which can dump the contents of sflow data > to STDOUT for parsing by a script. > > nate > > > ___ Can one setup a Linux server to offer sflow? If the Linux host can run sflow, then it's easy to capture the bandwidth usage on the host? I'm sitting with the same problem, and rely on snmpd on each VPS, but this isn't ideal - especially if clients disable snmpd -- Kind Regards Rudi Ahlers CEO, SoftDux Hosting Web: http://www.SoftDux.com Office: 087 805 9573 Cell: 082 554 7532 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
Neil Aggarwal wrote: > Nate: > > Thanks for the suggestion. I am looking into it > now. > > Currently, I use Cacti to graph the data coming > from my switches. Do you know if that will that > work with any of these switches? Cacti will work for port based monitoring, it won't work for flow-based monitoring though. http://www.sflow.org/products/collectors.php ntop would probably be the main "free" flow based monitor, though there are some really really nice commercial products. Inmon has a couple free tools as well sflowtrend, and another command line tool which can dump the contents of sflow data to STDOUT for parsing by a script. nate ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
Nate: Thanks for the suggestion. I am looking into it now. Currently, I use Cacti to graph the data coming from my switches. Do you know if that will that work with any of these switches? Thanks, Neil -- Neil Aggarwal, (281)846-8957, www.JAMMConsulting.com Will your e-commerce site go offline if you have a DB server failure, fiber cut, flood, fire, or other disaster? If so, ask about our geographically redundant database system. > -Original Message- > From: centos-boun...@centos.org > [mailto:centos-boun...@centos.org] On Behalf Of nate > Sent: Friday, October 23, 2009 8:50 AM > To: centos@centos.org > Subject: Re: [CentOS] Switch to measure traffic at IP level? > > Neil Aggarwal wrote: > > Hello all: > > > > Is there a network switch that will give me traffic > > stats at an IP address level? > > any of these can: > http://www.sflow.org/products/network.php > > Myself I'm biased towards Extreme networks having used them > for almost 10 years now, very easy to use. > > nate > > > ___ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Switch to measure traffic at IP level?
Neil Aggarwal wrote: > Hello all: > > Is there a network switch that will give me traffic > stats at an IP address level? any of these can: http://www.sflow.org/products/network.php Myself I'm biased towards Extreme networks having used them for almost 10 years now, very easy to use. nate ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] Switch to measure traffic at IP level?
Hello all: Is there a network switch that will give me traffic stats at an IP address level? Right now, I only get statstics at a port level, but that does not help since each of my servers run several virtual machines and I need to measure traffic per virtual machine. Thanks, Neil -- Neil Aggarwal, (281)846-8957, www.JAMMConsulting.com Will your e-commerce site go offline if you have a DB server failure, fiber cut, flood, fire, or other disaster? If so, ask about our geographically redundant database system. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
