Re: [SLUG] copying binaries from one Centos to another?
On Sun, September 19, 2010 11:32 am, Daniel Pittman wrote: Voytek Eymont li...@sbt.net.au writes: OK. So, just to check: can you reproduce this performance problem with a page that contains only one single graph? Daniel, I had a default '10 items per page' setup, anyhow, after a couple of dependency issues I've managed to rpm erase/install rrdtoll 1.4/1.2x, and, excluded rrdtool* and perl-rrdtool* from yum, (I'd have preferred to do like I managed on the other system, ver 1.2 on /usr/local/.., and, keep current version, but, well...) and, big performance uplift, web page generates/loads like in 5 seconds, if not less (versus almost 30 seconds) it's something to do with fonts caching that RRDTool does since 1.3 ? //from cacti ml: ... This indeed explains bad graphing times. RRDTool will (as I've deduced from a mailing to rrdtoll-users, so it's not my own knowledge) scan the font dir(s) on a first call. It will/shall cache the data and be faster on subsequent calls. But if there is no subsequent call as suggested by Larry, we will always face this time lag for rrdtool 1.3.x and up. ... // thanks again for all the suggestions -- Voytek -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] copying binaries from one Centos to another?
On Sat, September 18, 2010 3:37 pm, Daniel Pittman wrote: Voytek Eymont li...@sbt.net.au writes: That will not help unless you rebuild Cacti to use the older version of RRDTool. (Also, are you /sure/ it is RRDTool and not something else in the Cacti stack that causes the performance problems? RRDTool is crazy-efficient, so I wouldn't pick it as the first point to suspect. OTOH, if you measured it and found it was the cause then you measured it and all. :) Daniel, thanks Cacti has a setup screen where path to binaries like rddtool can be entered; when I first struck this problem, I retrofitted RRDT 1.2 to the Celeron system, and Celeron machine with RRDTool 1.2x outputs pages faster than with RRDT 1.4; in fact, Celeron with 1.2x outputs pages faster than P4 2.8 with RDDT 1.4 I thought the issue was again lack of math co-pro, and, will 'go way' on the P4, initially, Cacti was using RRDTool 1.2x, then after a yum update, it got 1.4, I 'fixed' the path in setup, but, a screen draw is painfully slow now, based on what I found on the Celeron system, it seems it's similar issue so I though I should install RRDT 1.2 to /usr/local/bin, and, specify that, and, let RRDT 1.4 stay as is, but, rather than copying the binaries, I'll try the configure/make path -- -- Voytek -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] copying binaries from one Centos to another?
Voytek Eymont li...@sbt.net.au writes: On Sat, September 18, 2010 3:37 pm, Daniel Pittman wrote: Voytek Eymont li...@sbt.net.au writes: That will not help unless you rebuild Cacti to use the older version of RRDTool. (Also, are you /sure/ it is RRDTool and not something else in the Cacti stack that causes the performance problems? RRDTool is crazy-efficient, so I wouldn't pick it as the first point to suspect. OTOH, if you measured it and found it was the cause then you measured it and all. :) Cacti has a setup screen where path to binaries like rddtool can be entered; That should be sufficient, then, to use your custom version. [...] I thought the issue was again lack of math co-pro, and, will 'go way' on the P4, initially Yeah, and naturally it didn't because there isn't anything Intel make that doesn't have a nicely fast math coprocessor these days (and, in fact, you have to go back to the days of the i486 to get something that didn't ship one on-die and all... :) Cacti was using RRDTool 1.2x, then after a yum update, it got 1.4, I 'fixed' the path in setup, but, a screen draw is painfully slow now, based on what I found on the Celeron system, it seems it's similar issue A screen draw? Are you running X locally on the system, or is this on your client? Neither one necessarily points to RRD 1.2 vs 1.4, although it could be involved in either. Daniel -- ✣ Daniel Pittman✉ dan...@rimspace.net☎ +61 401 155 707 ♽ made with 100 percent post-consumer electrons -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] copying binaries from one Centos to another?
On 18 September 2010 15:51, Voytek Eymont li...@sbt.net.au wrote: On Sat, September 18, 2010 1:55 pm, Dean Hamstead wrote: you can just force the older rpm to install Dean, thanks how do I prevent a future yum update from upgrading and 'overwriting' it again ? Add an exclude clause on all versions above the current version for that package to the yum configuration. You'll have to look around the manuals for the specific syntax as I can't give it for sure off the top of my head. Cheers, --Amos -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] copying binaries from one Centos to another?
On Sat, September 18, 2010 9:24 pm, Amos Shapira wrote: On 18 September 2010 15:51, Voytek Eymont li...@sbt.net.au wrote: Add an exclude clause on all versions above the current version for that package to the yum configuration. You'll have to look around the manuals for the specific syntax as I can't give it for sure off the top of my head. Amos, thanks this seems to be what I need to try: yum.conf -- [main] options exclude list of packages to exclude from updates or installs. This should be a space separated list. Filename globs *,?,., etc are allowed according to yum log, this is what I had/now have installed: # grep rrd yum.log Sep 16 22:30:37 Installed: rrdtool-1.2.27-3.el5.i386 Sep 16 12:21:39 Installed: perl-rrdtool-1.4.4-1.el5.rf.i386 Sep 16 12:21:41 Updated: rrdtool-1.4.4-1.el5.rf.i386 I've now found rrdtool-1.2.29-1.el5.rf.i386.rpm so, I should 'rpm -e' rrdtool* and perl-rrd* followed by 'rpm -i' of the rrdtool-1.2.29-1.el5.rf.i386.rpm, yes ? (I tried copying the binaries, and, installing from source, neither gave desired results: attempting to compile source complained about somestuff missing, when I attempted to install the complained-about-item, it complained about something else; it was at that point that I've decide that 30 seconds to generate a web page isn't really such a big deal) copying binaries was a little more successful: no errors. but, no graphs generated, either. -- Voytek -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] copying binaries from one Centos to another?
On Sat, September 18, 2010 3:37 pm, Daniel Pittman wrote: Voytek Eymont li...@sbt.net.au writes: I want to use this on another Centos 5x, do I need to copy anything else beside recursive /usr/local/rrdtool-1.2.27? Maybe. That setup /looks/ like a complete install of rrdtool under that path, but unless you actually know that there is no assurance it is true. or is it a 'bad idea' to copy from one system? Generally, maybe. Technically, no, it should work fine by and large. You might run into issues having to get older versions of libraries that the binary depends on, and if the glibc versions are far enough apart their could be trouble, but it *should* work. However, outside the strictly technical you are probably inviting even *more* effort and suffering later using a hand-managed version of that package. yes, it wasn't the best idea, just as you've hinted: even though both system are 'same' Centos, they obviously differ somewhat, source install that worked on the old box didn't on the new one, when I attempted to install the missing dependency, it complained about another, at that point I decide that 30 seconds to wait for web page too load might be a better option at this point. -- Voytek -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] copying binaries from one Centos to another?
On Sat, September 18, 2010 7:17 pm, Daniel Pittman wrote: Voytek Eymont li...@sbt.net.au writes: A screen draw? Are you running X locally on the system, or is this on your client? Neither one necessarily points to RRD 1.2 vs 1.4, although it could be involved in either. sorry, I meant lag to generate /populate graph images in the browser, to load the cacti graph page in a browser on a client over ethernet -- Voytek -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] copying binaries from one Centos to another?
Voytek Eymont li...@sbt.net.au writes: On Sat, September 18, 2010 7:17 pm, Daniel Pittman wrote: Voytek Eymont li...@sbt.net.au writes: A screen draw? Are you running X locally on the system, or is this on your client? Neither one necessarily points to RRD 1.2 vs 1.4, although it could be involved in either. sorry, I meant lag to generate /populate graph images in the browser, to load the cacti graph page in a browser on a client over ethernet OK. So, just to check: can you reproduce this performance problem with a page that contains only one single graph? One of the big performance ... well, not problems any longer, but issues with our use of munin in-house is that the default view for a host contains something like 60 or 80 graphs[1]. Using the CGI or FastCGI drawing model this, by default, means that we fired off something like 120 processes on the machine when we visit that page. That caused some performance delay in getting results, because they all took about the same length of time to draw, and were all CPU hogs... So, it might be worth checking if your problem isn't RRD, but rather the fact that you have lots of instances running concurrently on an old and slow machine[2] that just take ages to start delivering results. Daniel We fixed it my limiting concurrency, so you get less overall delay, and faster initial results, out of the system. Footnotes: [1] We love us some metrics, and how! [2] Heck, with a P4 or Celeron it wasn't a fast machine even back in the day, thanks to Intel's foolish micro-architecture decisions and all. -- ✣ Daniel Pittman✉ dan...@rimspace.net☎ +61 401 155 707 ♽ made with 100 percent post-consumer electrons -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] copying binaries from one Centos to another?
you can just force the older rpm to install On 18/09/10 13:01, Voytek Eymont wrote: I have a Centos 5x system with RRDTool 1.2x as in # ls bin include lib share # pwd /usr/local/rrdtool-1.2.27 I want to use this on another Centos 5x, do I need to copy anything else beside recursive /usr/local/rrdtool-1.2.27 ? or is it a 'bad idea' to copy from one system ? (I've setup a Centos 5 to run Cacti on Celeron 1.7GHz, but, it seems to really struggle, maxing to 100% (guess it wants arithemetic processor that Celeron doesn't have ?); so, I found a P4, and, setup Cacti, that was better, till yum update updated RRDTool from 1.2 to 1.4, now, cacti web page load really lags, hence I thought I'll backgrade to RRDTool 1.2) -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] copying binaries from one Centos to another?
Voytek Eymont li...@sbt.net.au writes: I have a Centos 5x system with RRDTool 1.2x as in # ls bin include lib share # pwd /usr/local/rrdtool-1.2.27 I want to use this on another Centos 5x, do I need to copy anything else beside recursive /usr/local/rrdtool-1.2.27? Maybe. That setup /looks/ like a complete install of rrdtool under that path, but unless you actually know that there is no assurance it is true. or is it a 'bad idea' to copy from one system? Generally, maybe. Technically, no, it should work fine by and large. You might run into issues having to get older versions of libraries that the binary depends on, and if the glibc versions are far enough apart their could be trouble, but it *should* work. However, outside the strictly technical you are probably inviting even *more* effort and suffering later using a hand-managed version of that package. (I've setup a Centos 5 to run Cacti on Celeron 1.7GHz, but, it seems to really struggle, maxing to 100% (guess it wants arithemetic processor that Celeron doesn't have ?); It sure does. Whatever the problem was, it wasn't that. (Probably just that Cacti needs more CPU than it could get, possibly just in sudden bursts. :) so, I found a P4, and, setup Cacti, that was better, till yum update updated RRDTool from 1.2 to 1.4, now, cacti web page load really lags, hence I thought I'll backgrade to RRDTool 1.2) That will not help unless you rebuild Cacti to use the older version of RRDTool. (Also, are you /sure/ it is RRDTool and not something else in the Cacti stack that causes the performance problems? RRDTool is crazy-efficient, so I wouldn't pick it as the first point to suspect. OTOH, if you measured it and found it was the cause then you measured it and all. :) Regards, Daniel -- ✣ Daniel Pittman✉ dan...@rimspace.net☎ +61 401 155 707 ♽ made with 100 percent post-consumer electrons -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] copying binaries from one Centos to another?
On Sat, September 18, 2010 1:55 pm, Dean Hamstead wrote: you can just force the older rpm to install Dean, thanks how do I prevent a future yum update from upgrading and 'overwriting' it again ? On 18/09/10 13:01, Voytek Eymont wrote: I have a Centos 5x system with RRDTool 1.2x as in # ls bin include lib share # pwd /usr/local/rrdtool-1.2.27 I want to use this on another Centos 5x, do I need to copy anything else beside recursive /usr/local/rrdtool-1.2.27 ? or is it a 'bad idea' to copy from one system ? (I've setup a Centos 5 to run Cacti on Celeron 1.7GHz, but, it seems to really struggle, maxing to 100% (guess it wants arithemetic processor that Celeron doesn't have ?); so, I found a P4, and, setup Cacti, that was better, till yum update updated RRDTool from 1.2 to 1.4, now, cacti web page load really lags, hence I thought I'll backgrade to RRDTool 1.2) -- Voytek -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
