Re: [CentOS] centos6 not using /etc/gdm/custom.conf
- Original Message - | In CentOS5 you were able to create a server section in | /etc/gdm/custom.conf such as | | [server-Standard] | name=Standard server | command=/usr/bin/Xorg -br -audit 4 -s 15 | chooser=false | handled=true | flexible=true | priority=0 | | After this change, Xorg would run with the -br -audit 4 -s 15 options. | | Unfortunately in CentOS6 this is not the case. It completely ignores | anything put into custom.conf as far as I can tell. It appears to run | with -nr -verbose -auth -nolisten tcp by default. Is there any way to | modify this? | | Regards, | | Stephen Jamieson much of this functionality has moved into the gconf2 stuff so you use gconf2 to disable things like user visibility and such things -- James A. Peltier IT Services - Research Computing Group Simon Fraser University - Burnaby Campus Phone : 778-782-6573 Fax : 778-782-3045 E-Mail : jpelt...@sfu.ca Website : http://www.sfu.ca/itservices http://blogs.sfu.ca/people/jpeltier ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] SOLVED: CentOS 6 PXE boot:Unable to download the kickstart file
- Original Message - | Ole Holm Nielsen wrote: | > We have CentOS 6 manual installation working by PXE booting from a | > RHEL5.6 | > PXE/TFTP server. However, when we add a Kickstart file in the PXE | > configuration: | > | > kernel CentOS-6-i386/vmlinuz | > append load_ramdisk=1 initrd=CentOS-6-i386/initrd.img network | > ks=nfs:130.226.86.4:/u/rpm/kickstart/ks-centos-6-clean-i386.cfg | > | > then the CentOS 6 client install reports "Unable to download the | > kickstart file". | > The console 3 reports "failed to mount nfs source". | | This problem has been resolved. A silly editing error replacing 5->6 | also | changed the IP-address :-( With the correct IP-address Kickstart works | correctly with an NFSv3 server as shown above. No need to upgrade to | NFSv4 | and Kerberos :-) | | For the record, it is in fact possible to add NFS mount options to the | PXE | APPEND line, as documented in | http://fedoraproject.org/wiki/Anaconda_Boot_Options. | To explicitly force an NFSv3 mount you may add the following NFS mount | option: | ks=nfs:nfsvers=3:servername:filename | | Thanks again for everybody's help. | /Ole | ___ | CentOS mailing list | CentOS@centos.org | http://lists.centos.org/mailman/listinfo/centos I would still push for a move to HTTP. I manage about 1500 GNU/Linux, CentOS 5 workstations and about 3 months ago moved away from NFS and to HTTP. This was for additional security, NFSv3 being less secure than NFSv4, as well as for scalability reasons. After making the move from NFS to HTTP I found that my installations went from 20 minutes for a @core installation to ~5 minutes for the same install. I am also now able to do more 'interesting' things like heavy HTTP caching, load balancing as well as other things to "tune" my installation path. You really should consider it if you've got the resources. ;) -- James A. Peltier IT Services - Research Computing Group Simon Fraser University - Burnaby Campus Phone : 778-782-6573 Fax : 778-782-3045 E-Mail : jpelt...@sfu.ca Website : http://www.sfu.ca/itservices http://blogs.sfu.ca/people/jpeltier ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
> I'll be moving to Ubunto. They have a 3 year window for support on a > distribution unlike CentOS/RHEL. They seem to be more user friendly for a > home networking environment. RHEL is supported for 10 years on each major release. -- Eero ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On 7/24/11 4:08 PM, Keith Roberts wrote: > On Sun, 24 Jul 2011, R P Herrold wrote: > >> By using a hash, we remove those constraints, and also gain >> the virtuous effect for free of self-organizing a relatively >> level dispersion of files to the destination directories > > Not followed the whole thread, but a SQL database index of > the actual picture files, giving the path into the directory > structure. Would that work? You introduce new issues where the name in the database can't be managed atomically with the name in the directory that way. Consider what might happen with concurrent operations trying to add different files with the same name - or perhaps an add and delete at the same times. And it still doesn't help with the real problem unless you do something to break up the large directory. Unix-like filesystems guarantee atomic operations in filename manipulation, so every time you try to create a file, the system must check that the name does not already exist, find an empty slot for the name and insert it with the directory locked against other changes until that is complete. Filesystems that index directories can help with the lookup, with the tradeoff that additions require an index update. -- Les Mikesell lesmikes...@gmail.com ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sun, 2011-07-24 at 19:51 -0500, Lanny Marcus wrote: > Installing non RPM software on an RPM Distro like CentOS is frowned > upon. That is the worst way to do it. why? you made a vacuous argument. Craig -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sun, 2011-07-24 at 22:20 -0400, Thomas Dukes wrote: > > > -Original Message- > > From: centos-boun...@centos.org > > [mailto:centos-boun...@centos.org] On Behalf Of Lanny Marcus > > Sent: Sunday, July 24, 2011 8:51 PM > > To: CentOS mailing list > > Subject: Re: [CentOS] Upgrading from CentOS 5.6 to 6.0 > > > > On Sat, Jul 23, 2011 at 5:41 PM, Thomas Dukes > > wrote: > > > Just ran the installation DVD but there is no option to 'upgrade'. > > > Looked at the RHEL docs, > > > > > http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Inst > > > allati > > > on_Guide/ch-guimode-x86.html#id4594292 referenced off the CentOS > > > Release notes but the CentOS installation doesn't offer the > > 'upgrade'. > > > > > > I use to be able to upgrade by doing a 'yum update'. That > > doesn't work > > > either. > > > > > > Guess I'm stuck with 5.6 as I an not about to install a new version > > > and have to rebuild all non-rpm packages from scratch. This > > is worse than Microsoft!! > > > > @Thomas: I'm a "newbie" home user, with CentOS on our > > Desktops, and Red Hat Linux, before that. > > > > I do not believe you understand the philosophy behind CentOS > > (an Enterprise OS) or RHEL (the upstream distro). This is a > > distro with a > > *LONG* life, and without the "latest and greatest", for > > security and stability reasons. > > > > It has always been recommended to do a "Clean Install" when > > moving from one major version (ie: 5.x) to a newer version > > (ie: 6.x) and then to Restore your data, from your backup. > > > > If you do it in some other fashion, there are apt to be > > problems, which will probably not be supported on this list. > > If you break it, you will fix it. > > > > There is a lot of information available, on CentOS.org in the Wiki. > > HowTos, FAQs, etc. If you look there, you will find many > > things explained clearly. > > > > Also, if you search the archives of the mailing list, you > > will find a ton of information, from a large group of highly > > knowledgeable users. > > People who work with CentOS in the Enterprise, all day, every day. > > > > Installing non RPM software on an RPM Distro like CentOS is > > frowned upon. That is the worst way to do it. There are 3rd > > party Yum repositories, with lots of things that have been > > packaged for CentOS and you can install them with Yum, once > > you have the Repository data ready for yum. You probably > > won't need to rebuild many packages, if any, if you use the > > 3rd party repositories. GL > > I have never had a problem upgrading a CentOS release since I started with > 3.x. Seems now, I can't even upgrade from 5.6 to 5.7. I have never had to do > a complete re-install since moving from Slackware 1.x to Redhat 2.x except > once when I had a hard drive failure. > > I'll be moving to Ubunto. They have a 3 year window for support on a > distribution unlike CentOS/RHEL. They seem to be more user friendly for a > home networking environment. > > The software package I use which takes hours of trial and error to compile > and install is as simple apt-get install under Ubunto. There are no rpms for > zoneminder 1.24.x. The compliation of ffmpeg/zoneminder seems to be an issue > with CentOS with the outdated php/mysql and other various libs. > > I can see the direction RHEL is taking and its more and more like Microsoft. > The enduser is having to be more and more dependent on the provider. CentOS > has its hands tied. > > I thank all for the help I have recievied over the years, its just not > beneficial to stay this current direction. update from CentOS 5.6 to 5.7 (when 5.7 becomes available) is automatic... just run 'yum update' - no extra efforts or thought need to be given. update from CentOS 5.x to CentOS 6.x is at best a crapshoot. Skilled admins should be able to fix whatever needs fixing. Less than skilled admins will find it takes less time to backup and re-install. As for switching to Ubuntu... I have switched my latest installs from RHEL/CentOS to Ubuntu. Primarily because I felt I couldn't rely upon timely releases/updates. Let me assure you though that nothing is perfect with any distribution and while some packages might be newer/more readily available on one distribution than the other, there are certainly other packages that are newer/better vice versa. ffmpeg on CentOS/RHEL 5.x is a bit behind (CentOS/RHEL 5 is way behind). zoneminder is just perl scripts so it doesn't make that much of a difference if it is RPM packaged or just tarball install CentOS/RHEL has a much larger window of support for a specific version than Ubuntu so claiming that Ubuntu has a 3 year window as an advantage suggests that you don't understand the RHEL/CentOS support windows at all. Craig -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. ___ CentOS mailing li
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sun, 2011-07-24 at 22:20 -0400, Thomas Dukes wrote: > The compliation of ffmpeg/zoneminder seems to be an issue > with CentOS with the outdated php/mysql and other various libs. PHP and MySQL work fine for me. My systems depend on both these being reliable, efficient, dependable and robust - they are on Centos 5.6. > I can see the direction RHEL is taking and its more and more like > Microsoft. While Centos (and SL) exist, we are never going to be like M$. RH needs, commercially, to prevent/reduce business losses to copy-cat companies like Oracle etc. > The enduser is having to be more and more dependent on the provider. > CentOS has its hands tied. Yes all Centos users are dependent on RH if they want to run a 100% binary compatible system. However there is flexibility to add non-standard software and, as you have proved, one's own non-standard applications successfully. Good Luck. We will be here if you pop back sometime in the future. -- With best regards, Paul. England, EU. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sun, Jul 24, 2011 at 10:20:07PM -0400, Thomas Dukes wrote: > > I have never had a problem upgrading a CentOS release since I started with > 3.x. Seems now, I can't even upgrade from 5.6 to 5.7. I have never had to do > a complete re-install since moving from Slackware 1.x to Redhat 2.x except > once when I had a hard drive failure. There is no 5.7 yet. > The software package I use which takes hours of trial and error to compile > and install is as simple apt-get install under Ubunto. There are no rpms for > zoneminder 1.24.x. The compliation of ffmpeg/zoneminder seems to be an issue > with CentOS with the outdated php/mysql and other various libs. I know of at least one packaged zoneminder and its required deps; I'm not sure if it's public but if it is the person that did the packaging will likely speak up as he is on this list. So it's indeed possible. > I can see the direction RHEL is taking and its more and more like Microsoft. > The enduser is having to be more and more dependent on the provider. CentOS > has its hands tied. This is purely FUD. > I thank all for the help I have recievied over the years, its just not > beneficial to stay this current direction. Good luck with future endeavors. John -- What lies behind us and what lies before us are tiny matters compared to what lies within us. -- Ralph Waldo Emerson pgpVcUQu5j67h.pgp Description: PGP signature ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
> -Original Message- > From: centos-boun...@centos.org > [mailto:centos-boun...@centos.org] On Behalf Of Lanny Marcus > Sent: Sunday, July 24, 2011 8:51 PM > To: CentOS mailing list > Subject: Re: [CentOS] Upgrading from CentOS 5.6 to 6.0 > > On Sat, Jul 23, 2011 at 5:41 PM, Thomas Dukes > wrote: > > Just ran the installation DVD but there is no option to 'upgrade'. > > Looked at the RHEL docs, > > > http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Inst > > allati > > on_Guide/ch-guimode-x86.html#id4594292 referenced off the CentOS > > Release notes but the CentOS installation doesn't offer the > 'upgrade'. > > > > I use to be able to upgrade by doing a 'yum update'. That > doesn't work > > either. > > > > Guess I'm stuck with 5.6 as I an not about to install a new version > > and have to rebuild all non-rpm packages from scratch. This > is worse than Microsoft!! > > @Thomas: I'm a "newbie" home user, with CentOS on our > Desktops, and Red Hat Linux, before that. > > I do not believe you understand the philosophy behind CentOS > (an Enterprise OS) or RHEL (the upstream distro). This is a > distro with a > *LONG* life, and without the "latest and greatest", for > security and stability reasons. > > It has always been recommended to do a "Clean Install" when > moving from one major version (ie: 5.x) to a newer version > (ie: 6.x) and then to Restore your data, from your backup. > > If you do it in some other fashion, there are apt to be > problems, which will probably not be supported on this list. > If you break it, you will fix it. > > There is a lot of information available, on CentOS.org in the Wiki. > HowTos, FAQs, etc. If you look there, you will find many > things explained clearly. > > Also, if you search the archives of the mailing list, you > will find a ton of information, from a large group of highly > knowledgeable users. > People who work with CentOS in the Enterprise, all day, every day. > > Installing non RPM software on an RPM Distro like CentOS is > frowned upon. That is the worst way to do it. There are 3rd > party Yum repositories, with lots of things that have been > packaged for CentOS and you can install them with Yum, once > you have the Repository data ready for yum. You probably > won't need to rebuild many packages, if any, if you use the > 3rd party repositories. GL I have never had a problem upgrading a CentOS release since I started with 3.x. Seems now, I can't even upgrade from 5.6 to 5.7. I have never had to do a complete re-install since moving from Slackware 1.x to Redhat 2.x except once when I had a hard drive failure. I'll be moving to Ubunto. They have a 3 year window for support on a distribution unlike CentOS/RHEL. They seem to be more user friendly for a home networking environment. The software package I use which takes hours of trial and error to compile and install is as simple apt-get install under Ubunto. There are no rpms for zoneminder 1.24.x. The compliation of ffmpeg/zoneminder seems to be an issue with CentOS with the outdated php/mysql and other various libs. I can see the direction RHEL is taking and its more and more like Microsoft. The enduser is having to be more and more dependent on the provider. CentOS has its hands tied. I thank all for the help I have recievied over the years, its just not beneficial to stay this current direction. TE Dukes ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Mon, Jul 25, 2011 at 06:38:33AM +0530, Rajagopal Swaminathan wrote: > > hmm... does mount -noatime -noadirtime help speed it up? Just an FYI: noatime is a superset that includes noadirtime. John -- You can safely assume you've created God in your own image when it turns out that God hates all the same people you do. -- Anne Lamott (10 April 1954-), American author, Bird by Bird pgp0qSMUHthUt.pgp Description: PGP signature ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
Greetings, On Sun, Jul 24, 2011 at 2:59 PM, yonatan pingle wrote: > Hello, > after looking into the website folders, i have found one folder which > from my point of view is one of the causes for the server loads. > hmm... does mount -noatime -noadirtime help speed it up? -- Regards, Rajagopal ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sat, Jul 23, 2011 at 5:41 PM, Thomas Dukes wrote: > Just ran the installation DVD but there is no option to 'upgrade'. Looked at > the RHEL docs, > http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Installati > on_Guide/ch-guimode-x86.html#id4594292 referenced off the CentOS Release > notes but the CentOS installation doesn't offer the 'upgrade'. > > I use to be able to upgrade by doing a 'yum update'. That doesn't work > either. > > Guess I'm stuck with 5.6 as I an not about to install a new version and have > to rebuild all non-rpm packages from scratch. This is worse than Microsoft!! @Thomas: I'm a "newbie" home user, with CentOS on our Desktops, and Red Hat Linux, before that. I do not believe you understand the philosophy behind CentOS (an Enterprise OS) or RHEL (the upstream distro). This is a distro with a *LONG* life, and without the "latest and greatest", for security and stability reasons. It has always been recommended to do a "Clean Install" when moving from one major version (ie: 5.x) to a newer version (ie: 6.x) and then to Restore your data, from your backup. If you do it in some other fashion, there are apt to be problems, which will probably not be supported on this list. If you break it, you will fix it. There is a lot of information available, on CentOS.org in the Wiki. HowTos, FAQs, etc. If you look there, you will find many things explained clearly. Also, if you search the archives of the mailing list, you will find a ton of information, from a large group of highly knowledgeable users. People who work with CentOS in the Enterprise, all day, every day. Installing non RPM software on an RPM Distro like CentOS is frowned upon. That is the worst way to do it. There are 3rd party Yum repositories, with lots of things that have been packaged for CentOS and you can install them with Yum, once you have the Repository data ready for yum. You probably won't need to rebuild many packages, if any, if you use the 3rd party repositories. GL ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, 2011-07-24 at 17:50 -0400, R P Herrold wrote: > On Sun, 24 Jul 2011, Keith Roberts wrote: > > >> By using a hash, we remove those constraints, and also gain > >> the virtuous effect for free of self-organizing a relatively > >> level dispersion of files to the destination directories > > > > Not followed the whole thread, but a SQL database index of > > the actual picture files, giving the path into the directory > > structure. Would that work? The answer must be 'yes' to a normal problem of identifying (searching for) then retrieving data. MySQL would be a good choice. Russ' adoration(?) of Donald KNUTH made me read the first page of [1] http://pplab.snu.ac.kr/courses/adv_pl05/papers/p261-knuth.pdf which includes this "This study focuses largely on two issues: (a) improved syntax for iterations and error exits, making it possible to write a larger class of programs clearly and efficiently without go to statements; (b) a methodology of program design, beginning with readable and correct, but possibly inefficient programs that are systematically transformed if necessary into efficient and correct, but possibly less readable code." A computer programmer can not change the syntax of the language he or her is writing-in. The syntax of any programming language is determined by the creator of that programming language. Spaghetti-code is a trade-mark of confused programmers, usually of little ability and certainly have never spend days trying to debug someone else's programme. Spaghetti-code can always be avoided by a clear understanding of what the user wants coupled with the programmer's in depth understanding of how to implement the user's requirements in the chosen programming language whilst remembering someone else may have to maintain the programme. Hashing file names is an interesting concept but a simple, and they are very simple to write, MySQL db application running as HTML pages, with a dash of PHP, makes the application universally accessible and easy to use. Oh, and on Centos, amazingly quick to run :-) -- With best regards, Paul. England, EU. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] lots of small files in a folder on Linux centos
On Sun, 24 Jul 2011, Keith Roberts wrote: >> By using a hash, we remove those constraints, and also gain >> the virtuous effect for free of self-organizing a relatively >> level dispersion of files to the destination directories > > Not followed the whole thread, but a SQL database index of > the actual picture files, giving the path into the directory > structure. Would that work? Fortunately there is a full, and freely accessible of all posts to this mailing list. The link to that archive is in the header of every message through this list. As such you need not speculate As I read the post initially, the problem was as stated in the subject line, and the database issue was not in the forefront Per the initial problem description, the files were all splatted into a single directory. The fastest database I know of is using the filesystem as a database; The addition of the hashing is just a pointer, and so also O(1) Adding a database engine, with the overhead that it brings, and as the thread has already pointed out, in a domU as well (not usually the best place to add the overhead of a database), simply are additonal points of mis-design “We should forget about small efficiencies, say about 97% of the time: premature optimization is the root of all evil. Yet we should not pass up our opportunities in that critical 3%. A good programmer will not be lulled into complacency by such reasoning, he will be wise to look carefully at the critical code; but only after that code has been identified” - Donald Knuth [1] Once the implementation is 'correct', then it is time to do A:B testing to see where the really problem lies ... which testing was at the head of my initial post on this topic -- Russ herrold [1] http://pplab.snu.ac.kr/courses/adv_pl05/papers/p261-knuth.pdf A person not willing to pony up $2.73 for a used copy of 'The Art of Computer Programming: Sorting and Searching. Volume 3', which discusses the specific problem space here, may wish to read and consider his rather nice lecture published by the ACM ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, 2011-07-24 at 16:33 -0400, R P Herrold wrote: > On Sun, 24 Jul 2011, Always Learning wrote: > > > If the pictures are named sequentially, why not store then at a 100 per > > directory structure something like this > > > > /pix/0/00/pix1.jpg > > > > /pix/0/26/pix02614.jpg > > > > /pix/6/72/pix67255.jpg > > Go read Knuth > > One does not do that because then one is counting on the end > user's data to conform to, and to continue to conform to your > expectations [here you have added an invisible constraint of > 'pix' as the first part of the file name which you are > hoping remains constant -- it will not, as survey of naming > schemes used by digital camera makers will reveal]. Your > explicit constraint of a monotonicly increasing image number > is also not likely to be realized in a world where people will > erase or for other reasons not submit all of a given photo > shoot I did begin with 'IF' :-) Photo-shoot or whatever, using the 'rename' command means pictures can adopt a uniform numbering system. There is no logical or genuine practical reason to accept a disorganised mess. I have about 21,000+ pictures - all my own work. I can find and display any of them within about 17 seconds (just timed myself) using basic operating system commands. (My database application is unfinished). -- With best regards, Paul. England, EU. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, 24 Jul 2011, R P Herrold wrote: > By using a hash, we remove those constraints, and also gain > the virtuous effect for free of self-organizing a relatively > level dispersion of files to the destination directories Not followed the whole thread, but a SQL database index of the actual picture files, giving the path into the directory structure. Would that work? Kind Regards, Keith Roberts - Websites: http://www.karsites.net http://www.php-debuggers.net http://www.raised-from-the-dead.org.uk All email addresses are challenge-response protected with TMDA [http://tmda.net] - ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] lots of small files in a folder on Linux centos
On Sun, 24 Jul 2011, Always Learning wrote: > If the pictures are named sequentially, why not store then at a 100 per > directory structure something like this > > /pix/0/00/pix1.jpg > > /pix/0/26/pix02614.jpg > > /pix/6/72/pix67255.jpg Go read Knuth One does not do that because then one is counting on the end user's data to conform to, and to continue to conform to your expectations [here you have added an invisible constraint of 'pix' as the first part of the file name which you are hoping remains constant -- it will not, as survey of naming schemes used by digital camera makers will reveal]. Your explicit constraint of a monotonicly increasing image number is also not likely to be realized in a world where people will erase or for other reasons not submit all of a given photo shoot By using a hash, we remove those constraints, and also gain the virtuous effect for free of self-organizing a relatively level dispersion of files to the destination directories -- Russ herrold ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sunday 24 July 2011 22:48:23 Always Learning wrote: > > On Sun, Jul 24, 2011 at 5:13 PM, R P Herrold wrote: > > > then, we look to the leading letter of the hask, to design our > > > egg carton bins. We place pix1.jpg in directory: ./f/ and > > > pix2.jpg in directory ./1/ and pix3.jpg in directory > > > ./b/ and so forth -- if the directories get too full again, > > > you might go to using the first two letters of the hash to > > > perform the 'binning' process > > If the pictures are named sequentially, why not store then at a 100 per > directory structure something like this > > /pix/0/00/pix1.jpg > > /pix/0/26/pix02614.jpg > > /pix/6/72/pix67255.jpg As I have worked on projects where the 'coder' is not willing to do any changes, I offer you another temporary solution: If the pictures are in /home/site/public_html/images, you simply need to create a tmpfs, copy the pictures there and then bind mount the tmpfs in that directory: # mkdir /home/site/ram # mount -t tmpfs -o size=200M none /home/site/ram # cp -a /home/site/public_html/images/* /home/site/ram # mount --bind /home/site/ram /home/site/public_html/images Instant performance gain, while you wait for the coder to actually fix the problem. However you should make sure that you copy the new images from the ram to disk. Maybe with inotifywatch. Keep in mind that this is only a temporary solution that should serve only as a proof that this is the problem and it needs to be fixed. Try to explain that this hack is not an actual solution. -- Best regards, Marian Marinov signature.asc Description: This is a digitally signed message part. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
> On Sun, Jul 24, 2011 at 5:13 PM, R P Herrold wrote: > > then, we look to the leading letter of the hask, to design our > > egg carton bins. We place pix1.jpg in directory: ./f/ and > > pix2.jpg in directory ./1/ and pix3.jpg in directory > > ./b/ and so forth -- if the directories get too full again, > > you might go to using the first two letters of the hash to > > perform the 'binning' process If the pictures are named sequentially, why not store then at a 100 per directory structure something like this /pix/0/00/pix1.jpg /pix/0/26/pix02614.jpg /pix/6/72/pix67255.jpg -- With best regards, Paul. England, EU. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sun, 2011-07-24 at 15:59 +0200, Alexander Dalloz wrote: > Paul, > > as much as I understand your point of view, I must disagree taking > upstream's and CentOS's position. Your description reflects a home user > or an administrator with just less than a handful of systems. Alexander, I have 11 servers all running C 5.6 and will stay on 5.x while everything works satisfactorily. For development and experimentation I use 2 desktops, laptop and notebook running C 5.6 as a server/client (server/normal user). The 6.x kernel offers me new development possibilities. > CentOS and RHEL aims for the enterprise use. Of course that does not > imply people can not rely on this stable platform in very small > environments, but that's not the focus of the OS design. The operating system comprises several parts. The kernel, Red Hat's versions of various semi-system/application software, the extras like clustering and kvm. The focus of the design is to provide a very stable base upon which many different additions will successfully operate and co-exist. Red Hat provide one basic version of their RHEL which can be used both as a server and as a client (meaning 'normal user' environment). You may have noticed RH's endorsement of Gnome. RHEL is an enterprise operating system but enterprise, in the commercial understanding of the word, means more than a server farm or racks in a data centre. It means the entire corporation - servers and end-users. From the payroll system to the chief executive officer's desk. RHEL does all these different tasks admirably well. > And speaking > about the enterprise scenario, no serious administrator will risk the > proper function of his install base by going risky paths. Is 'risky path' someone wanting to easily upgrade/convert from 5.x to 6.x ? > Typically the > OS is just the base for the middleware and application level. Switching > to a new major level of OS with lots of important changes means, the > administrator will have to test and adjust his setup of OS and > application use in multiple aspects. This even applies to applications > the base OS ships with. The large? jump from 5.x to 6.x and the resulting pressure on people to find the problems and solve them is, obviously, time consuming and for some demanding. If some (certainly not 'all') of the 'new' 6.x systems/changes/improvements were available in 5.x, people could gradually learn about them including any changes. This pre-knowledge spread over a year, would make major version transitions easier and quicker. I acknowledge this is not a Centos issue but a Red Hat policy. A solution is to experiment with the relevant Fedora versions. > In enterprise environments, where the CentOS systems are more than a > simple shell box or a trivial webserver, it is more time consuming to > find all the possible places to adjust the obsolete configurations being > transferred by an upgrade and to find the tripping points Hopefully each application has just one configuration file in one known location. Keeping a set-up simple and ensuring up-to-date documentation should avoid 'obsolete configurations' existing and 'tripping points' occurring. -- With best regards, Paul. England, EU. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] high performance open source DHCP solution?
On Tue, Jul 19, 2011 at 7:54 PM, Rogelio wrote: > The free DHCP solution, ISC, seems to be having scaling issues (i.e. > handling only about 200 DHCPDISCOVER and 20 DHCPRENEW requests), and I > was wondering if anyone had any open source suggestions of solutions > that could scale much better? > > (Ideally, I could find a free version of a solution like Nominum, but > I know that's asking for much.) > > Anyone have any suggestions? > Not really, but it might be a good idea to restrict this posting to the list for the OS you're using - is it CentOS or Debian or what? ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, Jul 24, 2011 at 5:13 PM, R P Herrold wrote: > On Sun, 24 Jul 2011, yonatan pingle wrote: > >> the coder is not tech savvy as one might expect, so it's >> really hard for me to explain the issue of having lots of >> files in one folder to the site owner or to the coder. > > I do not expect coders to remain 'not tech savvy' > > If the coder is not willing to learn and to test, you are > already doomed, and should walk away from the project > > To show the problem, take a pile of pennies, and ask the coder > to find one with a given year. The coder will have to do a > linear search, to even know if the target exists. Then show a > egg carton with another pile of pennies sorted and labelled by > year in each section, and aask them to repeat the task -- in > the latter case, it is a 'single seek' to solve the problem > > Obviously, the target year may not even be present. With a > single pile (directory) the linear search is still required, > but with 'binning' by years, that is obvious by inspection as > well > > > One approach to lots of files in a single directory (which can > cause problems in getting timely access to a specific file) is > to build a permuted directory tree from the file names to > spread the load around. If the files are of a form where they > have 'closely identical' names [pix1.jpg, pix2.jpg, > etc], first build a 'hashed' version of the file name with > md5sum, or such, to level the hash leading characters > > [herrold@localhost ~]$ ./hashdemo.sh > pix1.jpg fd8f49c6487588989cd764eb493251ec > pix2.jpg 12955d9587d99becf3b2ede46305624c > pix3.jpg bfdc8f593676e4f1e878bb6959f14ce2 > [herrold@localhost ~]$ cat hashdemo.sh > #!/bin/sh > # > CANDIDATES="pix1.jpg pix2.jpg pix3.jpg" > for i in `echo "${CANDIDATES}"`; do > HASH=`echo "$i" | md5sum - | awk {'print $1'}` > echo "$i ${HASH}" > done > [herrold@localhost ~]$ > > then, we look to the leading letter of the hask, to design our > egg carton bins. We place pix1.jpg in directory: ./f/ and > pix2.jpg in directory ./1/ and pix3.jpg in directory > ./b/ and so forth -- if the directories get too full again, > you might go to using the first two letters of the hash to > perform the 'binning' process > > The md5sum function is readily available in php, as are > directory creation and so forth, so positioning the files, and > computing the indexes are straightforward there > > This is all pretty basic stuff, covered in Knuth in TAOCP long > ago > > -- Russ herrold > ___ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos > Thank you for the excellent analogy , i will actually use it to explain the matter. I do hope he understands the simple logic behind a proper directory tree, it's clearly a design flaw, bad planning or laziness which lead him to this state. unfortunately, as bash is easier to read then English for you and me, ill spare the demohash.sh code from him , and simply put it out in words , and hope he figures out the proper way to create a tree. I am strongly tempted to walk away on this one, normally when there no co-operation and statements like "it's a problem with the server " when clearly it's a code issue , it's just nerve wrecking to try and help these guys. as i said earlier , he was hosted directly on a virtual server with the largest isp in my country , and they have failed to help him ( just selling him more ram and cpu, until it got to a breaking point ). I have actually co-locate at the very same ISP and i know for a fact they are awesome when it comes to support... -- Best Regards, Yonatan Pingle RHCT | RHCSA | CCNA1 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, Jul 24, 2011 at 4:02 PM, John R. Dennison wrote: > On Sun, Jul 24, 2011 at 03:53:46PM +0300, yonatan pingle wrote: >> >> Yes Ryan, that exactly what i have done. >> he will get the log shortly and i will get some not free beer. > > While I'm all for mysql optimization it's clearly evident from an > earlier posting that your disks are thrashing with insanely high iowait > figures; and while it's _possible_ for this to be caused by mysql you > really have to go out of your way to achieve that type of behavior. > > > > > > John > -- > The best argument against democracy is a five minute conversation > with the average voter. > > -- Winston Churchill > > ___ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos > > this is exactly what i was thinking, that's an insane iowait value, taking into consideration its a VM , not the hardware machine , and the fact the he fills up all his ram along with slow queries showing in the log, it's simply bad code and wrong handling of files. -- Best Regards, Yonatan Pingle RHCT | RHCSA | CCNA1 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] lots of small files in a folder on Linux centos
On Sun, 24 Jul 2011, yonatan pingle wrote: > the coder is not tech savvy as one might expect, so it's > really hard for me to explain the issue of having lots of > files in one folder to the site owner or to the coder. I do not expect coders to remain 'not tech savvy' If the coder is not willing to learn and to test, you are already doomed, and should walk away from the project To show the problem, take a pile of pennies, and ask the coder to find one with a given year. The coder will have to do a linear search, to even know if the target exists. Then show a egg carton with another pile of pennies sorted and labelled by year in each section, and aask them to repeat the task -- in the latter case, it is a 'single seek' to solve the problem Obviously, the target year may not even be present. With a single pile (directory) the linear search is still required, but with 'binning' by years, that is obvious by inspection as well One approach to lots of files in a single directory (which can cause problems in getting timely access to a specific file) is to build a permuted directory tree from the file names to spread the load around. If the files are of a form where they have 'closely identical' names [pix1.jpg, pix2.jpg, etc], first build a 'hashed' version of the file name with md5sum, or such, to level the hash leading characters [herrold@localhost ~]$ ./hashdemo.sh pix1.jpgfd8f49c6487588989cd764eb493251ec pix2.jpg12955d9587d99becf3b2ede46305624c pix3.jpgbfdc8f593676e4f1e878bb6959f14ce2 [herrold@localhost ~]$ cat hashdemo.sh #!/bin/sh # CANDIDATES="pix1.jpg pix2.jpg pix3.jpg" for i in `echo "${CANDIDATES}"`; do HASH=`echo "$i" | md5sum - | awk {'print $1'}` echo "$i${HASH}" done [herrold@localhost ~]$ then, we look to the leading letter of the hask, to design our egg carton bins. We place pix1.jpg in directory: ./f/ and pix2.jpg in directory ./1/ and pix3.jpg in directory ./b/ and so forth -- if the directories get too full again, you might go to using the first two letters of the hash to perform the 'binning' process The md5sum function is readily available in php, as are directory creation and so forth, so positioning the files, and computing the indexes are straightforward there This is all pretty basic stuff, covered in Knuth in TAOCP long ago -- Russ herrold ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
Am 24.07.2011 14:04, schrieb Always Learning: > > On Sun, 2011-07-24 at 08:30 -0300, Giovanni Tirloni wrote: > >> My point is that big changes happen in Linux much frequently than in >> Solaris and even Solaris sometimes doesn't support these kinds of >> upgrades. > > It is the inevitable and time-consuming upheaval which many will > probably find daunting. Installing Centos then configuring it for a > specific manner of operation can take several hours. > > When I recently re-installed C 5.6 as a server/desktop, the > configuration took 4 to 5 hours to complete. I didn't use kickstart. > > People love and appreciate Centos. They sometimes shudder at the > implication of effectively a re-installation, re-configuration and a > translation of perfectly good reliable working applications into > unfamiliar compulsory alternatives. Get something wrong and the time and > effort increases and competes with the daily priorities of running a > smooth computer operation and responding to all the things that do > occur. > > The challenge is how to do an easily transition from one major version > to its successor version with the least physical, emotional, > intellectual and time-consuming effort. Paul, as much as I understand your point of view, I must disagree taking upstream's and CentOS's position. Your description reflects a home user or an administrator with just less than a handful of systems. CentOS and RHEL aims for the enterprise use. Of course that does not imply people can not rely on this stable platform in very small environments, but that's not the focus of the OS design. And speaking about the enterprise scenario, no serious administrator will risk the proper function of his install base by going risky paths. Typically the OS is just the base for the middleware and application level. Switching to a new major level of OS with lots of important changes means, the administrator will have to test and adjust his setup of OS and application use in multiple aspects. This even applies to applications the base OS ships with. In enterprise environments, where the CentOS systems are more than a simple shell box or a trivial webserver, it is more time consuming to find all the possible places to adjust the obsolete configurations being transferred by an upgrade and to find the tripping points than to run a clean and fresh installation with a defined state. In less trivial setups the applications even get wrecked because of library changes and such. Regards Alexander ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
2011/7/24 yonatan pingle : > > there is no caching system, its a " home made" CMS. > > You can use an accelerator too. http://en.wikipedia.org/wiki/PHP_accelerator http://en.wikipedia.org/wiki/List_of_PHP_accelerators Please, make a big backup before this! (I nevever had a problem, but... why tempt the devil?) -- Diego - Yo no soy paranoico! (pero que me siguen, me siguen) http://about.me/diegors/bio ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, Jul 24, 2011 at 03:53:46PM +0300, yonatan pingle wrote: > > Yes Ryan, that exactly what i have done. > he will get the log shortly and i will get some not free beer. While I'm all for mysql optimization it's clearly evident from an earlier posting that your disks are thrashing with insanely high iowait figures; and while it's _possible_ for this to be caused by mysql you really have to go out of your way to achieve that type of behavior. John -- The best argument against democracy is a five minute conversation with the average voter. -- Winston Churchill pgpQQWMH9fKHI.pgp Description: PGP signature ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] VLAN's
On Sat, Jul 23, 2011 at 3:26 PM, John R Pierce wrote: > On 07/23/11 12:09 PM, Tom H wrote: >> >> Even after this explanation I don't understand your objection to >> helping someone with a firewall and routing issue on a CentOS box. You >> might have a point if the executables didn't come from packages in the >> canonical CentOS repo. > > "I'm writing my doctoral thesis on pygmy rhino genetic marker traits, I > am using LibreOffice on CentOS. Should I put the 1 or 2 pages of > abstract before or after my table of contents". :) I was of course assuming that the query was about system administration and not anything remotely similar to what you're suggesting! I get your point that there has to be a limit but I still think that the limit that you're proposing's too restrictive. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, Jul 24, 2011 at 3:43 PM, Ryan Wagoner wrote: > On Sun, Jul 24, 2011 at 8:40 AM, yonatan pingle > wrote: >> im good with mysqltuner.pl, >> as it seems there are slow queries on mysql and i have adjusted all >> values in my.cnf according to the application needs. >> >> looks like it's all in the code and the way the CMS handles the files >> from that upload directory , so there is nothing wrong with the centos >> machine after all, it's doing it's job >> >> ill point the coder to the status page and hope he gets a clue. >> >> thank you everybody for the good advices, i am now sure it's not "my fault" >> :-) >> >> /thread >> >> -- >> Best Regards, >> Yonatan Pingle >> RHCT | RHCSA | CCNA1 > > Sounds like you need to enable logging in mySQL for slow queries. Give > your developer the log and let him know to either optimize the queries > or create indexes appropriately to improve the performance. > > Ryan > ___ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos > Yes Ryan, that exactly what i have done. he will get the log shortly and i will get some not free beer. :-) -- Best Regards, Yonatan Pingle RHCT | RHCSA | CCNA1 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, Jul 24, 2011 at 8:40 AM, yonatan pingle wrote: > im good with mysqltuner.pl, > as it seems there are slow queries on mysql and i have adjusted all > values in my.cnf according to the application needs. > > looks like it's all in the code and the way the CMS handles the files > from that upload directory , so there is nothing wrong with the centos > machine after all, it's doing it's job > > ill point the coder to the status page and hope he gets a clue. > > thank you everybody for the good advices, i am now sure it's not "my fault" > :-) > > /thread > > -- > Best Regards, > Yonatan Pingle > RHCT | RHCSA | CCNA1 Sounds like you need to enable logging in mySQL for slow queries. Give your developer the log and let him know to either optimize the queries or create indexes appropriately to improve the performance. Ryan ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
>> RHCT | RHCSA | CCNA1 > > If you are using phpMyAdmin the status page will aid you in tuning > mySQL. Look for values in red. The description will usually tell you > what to adjust to improve performance. > > Ryan > ___ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos > im good with mysqltuner.pl, as it seems there are slow queries on mysql and i have adjusted all values in my.cnf according to the application needs. looks like it's all in the code and the way the CMS handles the files from that upload directory , so there is nothing wrong with the centos machine after all, it's doing it's job ill point the coder to the status page and hope he gets a clue. thank you everybody for the good advices, i am now sure it's not "my fault" :-) /thread -- Best Regards, Yonatan Pingle RHCT | RHCSA | CCNA1 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
>> >> > > Do you have cahcing turned on in CMS? That could help. > > -- > > Ljubomir Ljubojevic > (Love is in the Air) > PL Computers > Serbia, Europe > > Google is the Mother, Google is the Father, and traceroute is your > trusty Spiderman... > StarOS, Mikrotik and CentOS/RHEL/Linux consultant > ___ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos > there is no caching system, its a " home made" CMS. -- Best Regards, Yonatan Pingle RHCT | RHCSA | CCNA1 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, Jul 24, 2011 at 7:52 AM, yonatan pingle wrote: > Hi, Alexander > good suggestions, ill monitor I/O and mysql code, sounds like a code > related issue and not a centos issue after all. > > it runs on ext3 ,i could only guess how to code deals with the dir, > as it seems to be the site builds the pages using php+mysql for each > visitor, with about 40K unique visitors a day, that is a lot of I/O. > > This looks like an issue with MySQL after all. > Queries: 48.0M qps: 66 Slow: 65.0 > > avg-cpu: %user %nice %system %iowait %steal %idle > 0.97 0.00 0.28 97.91 0.00 0.84 > > runq-sz plist-sz ldavg-1 ldavg-5 ldavg-15 > > 0 102 5.30 3.13 2.06 > 2 120 3.14 2.77 2.22 > > we wait and see, > tail -f log-slow-queries.log > /usr/sbin/mysqld, Version: 5.0.67-community-log (MySQL Community > Edition (GPL)). started with: > Tcp port: 3306 Unix socket: /var/lib/mysql/mysql.sock > Time Id Command Argument > > > > thank you > > > > -- > Best Regards, > Yonatan Pingle > RHCT | RHCSA | CCNA1 If you are using phpMyAdmin the status page will aid you in tuning mySQL. Look for values in red. The description will usually tell you what to adjust to improve performance. Ryan ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
yonatan pingle wrote: > On Sun, Jul 24, 2011 at 2:19 PM, Alexander Dalloz wrote: >> Am 24.07.2011 13:03, schrieb Eero Volotinen: >>> 2011/7/24 yonatan pingle : uploads]# ls | wc -l 3123 >>> I assume that you are using ext3 or ext4 filesystems? Both ext3 and >>> ext4 slows down, if there is too much files in same directory. >>> XFS-fs is solution to fix this problem. >>> Eero >> Seriously, 3123 files in a single directory is not an issue for any of >> the extX filesystems. Though ext2 probably performs the worst, ext3 and >> particular ext4 should not have any problem with that small amount of >> file objects. Given that the filesystem is not already filled nearby 100%. >> >> An issue may be, how the code deals with the directory content. Horrible >> code for sure can impact the speed of the website, but should not affect >> the system globally. >> >> Yonatan, if you really are concerned about the uploads directory, then >> use vmstat, iostat or sar to check system parameters while the directory >> is accessed. >> >> Your problem is something else, I am pretty sure. >> >> Alexander >> >> ___ >> CentOS mailing list >> CentOS@centos.org >> http://lists.centos.org/mailman/listinfo/centos >> > > > Hi, Alexander > good suggestions, ill monitor I/O and mysql code, sounds like a code > related issue and not a centos issue after all. > > it runs on ext3 ,i could only guess how to code deals with the dir, > as it seems to be the site builds the pages using php+mysql for each > visitor, with about 40K unique visitors a day, that is a lot of I/O. > > This looks like an issue with MySQL after all. > Queries: 48.0M qps: 66 Slow:65.0 > > avg-cpu: %user %nice %system %iowait %steal %idle > 0.970.000.28 97.910.000.84 > >runq-sz plist-sz ldavg-1 ldavg-5 ldavg-15 > > 0 102 5.30 3.13 2.06 > 2 120 3.14 2.77 2.22 > > we wait and see, > tail -f log-slow-queries.log > /usr/sbin/mysqld, Version: 5.0.67-community-log (MySQL Community > Edition (GPL)). started with: > Tcp port: 3306 Unix socket: /var/lib/mysql/mysql.sock > Time Id CommandArgument > > > > thank you > > > Do you have cahcing turned on in CMS? That could help. -- Ljubomir Ljubojevic (Love is in the Air) PL Computers Serbia, Europe Google is the Mother, Google is the Father, and traceroute is your trusty Spiderman... StarOS, Mikrotik and CentOS/RHEL/Linux consultant ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sun, 2011-07-24 at 08:30 -0300, Giovanni Tirloni wrote: > My point is that big changes happen in Linux much frequently than in > Solaris and even Solaris sometimes doesn't support these kinds of > upgrades. It is the inevitable and time-consuming upheaval which many will probably find daunting. Installing Centos then configuring it for a specific manner of operation can take several hours. When I recently re-installed C 5.6 as a server/desktop, the configuration took 4 to 5 hours to complete. I didn't use kickstart. People love and appreciate Centos. They sometimes shudder at the implication of effectively a re-installation, re-configuration and a translation of perfectly good reliable working applications into unfamiliar compulsory alternatives. Get something wrong and the time and effort increases and competes with the daily priorities of running a smooth computer operation and responding to all the things that do occur. The challenge is how to do an easily transition from one major version to its successor version with the least physical, emotional, intellectual and time-consuming effort. -- With best regards, Paul. England, EU. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
On Sun, Jul 24, 2011 at 2:19 PM, Alexander Dalloz wrote: > Am 24.07.2011 13:03, schrieb Eero Volotinen: >> 2011/7/24 yonatan pingle : > >>> uploads]# ls | wc -l >>> 3123 > >> I assume that you are using ext3 or ext4 filesystems? Both ext3 and >> ext4 slows down, if there is too much files in same directory. >> XFS-fs is solution to fix this problem. > >> Eero > > Seriously, 3123 files in a single directory is not an issue for any of > the extX filesystems. Though ext2 probably performs the worst, ext3 and > particular ext4 should not have any problem with that small amount of > file objects. Given that the filesystem is not already filled nearby 100%. > > An issue may be, how the code deals with the directory content. Horrible > code for sure can impact the speed of the website, but should not affect > the system globally. > > Yonatan, if you really are concerned about the uploads directory, then > use vmstat, iostat or sar to check system parameters while the directory > is accessed. > > Your problem is something else, I am pretty sure. > > Alexander > > ___ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos > Hi, Alexander good suggestions, ill monitor I/O and mysql code, sounds like a code related issue and not a centos issue after all. it runs on ext3 ,i could only guess how to code deals with the dir, as it seems to be the site builds the pages using php+mysql for each visitor, with about 40K unique visitors a day, that is a lot of I/O. This looks like an issue with MySQL after all. Queries: 48.0M qps: 66 Slow:65.0 avg-cpu: %user %nice %system %iowait %steal %idle 0.970.000.28 97.910.000.84 runq-sz plist-sz ldavg-1 ldavg-5 ldavg-15 0 102 5.30 3.13 2.06 2 120 3.14 2.77 2.22 we wait and see, tail -f log-slow-queries.log /usr/sbin/mysqld, Version: 5.0.67-community-log (MySQL Community Edition (GPL)). started with: Tcp port: 3306 Unix socket: /var/lib/mysql/mysql.sock Time Id CommandArgument thank you -- Best Regards, Yonatan Pingle RHCT | RHCSA | CCNA1 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Upgrading from CentOS 5.6 to 6.0
On Sat, Jul 23, 2011 at 8:58 PM, Thomas Dukes wrote: > Red Hat does not support upgrades between major versions (doesn't necessarily > mean it's not possible) > http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Installation_Guide/ch-upgrade-x86.html > http://linsec.ca/blog/2011/02/23/my-adventure-upgrading-rhel5-to-rhel6/ > > Since when?? I started with slackware 1.0 on a pentinum 1 system from > VaResearch back in the mid 90's, change to Redat 2.0, then Fedora, then to > Whitebox, then CentOS.. Never had a problem upgrading on an rpm based system. That's a good question. It seems that since RHEL 4 (2005), Red Hat has been telling us that upgrading from earlier major versions is not a good idea. - RHEL 3 docs say it's possible to upgrade from 2.1 to 3.x (http://goo.gl/8Gwrs) - RHEL 4 docs don't bother showing the steps and provide a lot of warnings for 2.x/3.x to 4.x (http://goo.gl/yiRGK) - RHEL 5 docs explicitly say Red Hat does not support upgrading from earlier major versions (http://goo.gl/RQABB) - RHEL 6 docs explicitly say Red Hat does not support upgrading from earlier major versions (http://goo.gl/H9zBU) I don't think RPM is the one allowing/disallowing the upgrade between major versions. The kernel architecture and other major components changes are more likely to be the culprit. I'd be surprised how you moved from Slackware 1.0 all the way to CentOS without a reinstall (because that's what is being discussed here). Just as reference, starting with Solaris 11, it'll not be possible to upgrade from earlier major versions either (although binary compatibility will still be there). Oracle is asking customers to treat earlier versions as legacy and put them in containers and/or virtual machines. Solaris 11 will change so much how things work that Oracle says it's better not to bother upgrading path from Solaris 10. My point is that big changes happen in Linux much frequently than in Solaris and even Solaris sometimes doesn't support these kinds of upgrades. -- Giovanni Tirloni ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
Am 24.07.2011 13:03, schrieb Eero Volotinen: > 2011/7/24 yonatan pingle : >> uploads]# ls | wc -l >> 3123 > I assume that you are using ext3 or ext4 filesystems? Both ext3 and > ext4 slows down, if there is too much files in same directory. > XFS-fs is solution to fix this problem. > Eero Seriously, 3123 files in a single directory is not an issue for any of the extX filesystems. Though ext2 probably performs the worst, ext3 and particular ext4 should not have any problem with that small amount of file objects. Given that the filesystem is not already filled nearby 100%. An issue may be, how the code deals with the directory content. Horrible code for sure can impact the speed of the website, but should not affect the system globally. Yonatan, if you really are concerned about the uploads directory, then use vmstat, iostat or sar to check system parameters while the directory is accessed. Your problem is something else, I am pretty sure. Alexander ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] lots of small files in a folder on Linux centos
2011/7/24 yonatan pingle : > Hello, > I have a rather annoying issue on going with one of my centos virtual servers. > the server hosts a website using apache and mysql ,there are three > persons involved with keeping the site up and running. > and i am his root due to the fact he does not know anything with about Linux. > there is an php/sql coder , and the site owner which only knows to use > the CMS and upload new articles to the website. > > the coder and the site owner work together for a long time already , i > am their new admin ( as the last one was a major ISP which failed to > host the site properly ). > > lately the server is under-preforming and load averages are high, > mysql service keeps crashing and the server is hitting max memory > usage ( so i added ram .. ) , > after looking into the website folders, i have found one folder which > from my point of view is one of the causes for the server loads. > > (sorry for piping ls ). > > uploads]# ls | wc -l > 3123 > > I have talked with the site owner, which in turn showed this to the > coder ,now he throws the ball back claiming: it has nothing to do with > server performance. > the folder is full of images, about 40K each, and i have good reason > to believe this is the problem, as this is not the first time i see > that a folder which includes a large amount of files causes a server > to under-perform. > > the coder is not tech savvy as one might expect, so it's really hard > for me to explain the issue of having lots of files in one folder to > the site owner or to the coder. > > the hardware is a decent machine dual E5530 24RAM with six hard drives in > raid. > the virtual server has 2GB of ram and it's own CPU share ( 4 cores 8 threads > ). > the coder is arguing with facts sadly to say he has the site owner on > "his side". > > long story short, how should i explain in the most simple way in plain > english that having that much files in a folder will cause a server to > work slower? > > pros vs cons of having a large amount of small files in the same > folder on Linux Centos? I assume that you are using ext3 or ext4 filesystems? Both ext3 and ext4 slows down, if there is too much files in same directory. XFS-fs is solution to fix this problem. -- Eero ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] lots of small files in a folder on Linux centos
Hello, I have a rather annoying issue on going with one of my centos virtual servers. the server hosts a website using apache and mysql ,there are three persons involved with keeping the site up and running. and i am his root due to the fact he does not know anything with about Linux. there is an php/sql coder , and the site owner which only knows to use the CMS and upload new articles to the website. the coder and the site owner work together for a long time already , i am their new admin ( as the last one was a major ISP which failed to host the site properly ). lately the server is under-preforming and load averages are high, mysql service keeps crashing and the server is hitting max memory usage ( so i added ram .. ) , after looking into the website folders, i have found one folder which from my point of view is one of the causes for the server loads. (sorry for piping ls ). uploads]# ls | wc -l 3123 I have talked with the site owner, which in turn showed this to the coder ,now he throws the ball back claiming: it has nothing to do with server performance. the folder is full of images, about 40K each, and i have good reason to believe this is the problem, as this is not the first time i see that a folder which includes a large amount of files causes a server to under-perform. the coder is not tech savvy as one might expect, so it's really hard for me to explain the issue of having lots of files in one folder to the site owner or to the coder. the hardware is a decent machine dual E5530 24RAM with six hard drives in raid. the virtual server has 2GB of ram and it's own CPU share ( 4 cores 8 threads ). the coder is arguing with facts sadly to say he has the site owner on "his side". long story short, how should i explain in the most simple way in plain english that having that much files in a folder will cause a server to work slower? pros vs cons of having a large amount of small files in the same folder on Linux Centos? -- Best Regards, Yonatan Pingle RHCT | RHCSA | CCNA1 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] missing run-parts in /etc/crontab
2011/7/22 thomas veymont : >> hello, >> >> after a Centos 6 fresh install, I don't see any run-parts scripts in >> /etc/contab >> like in the 5.x releases : >> >> # run-parts >> 01 * * * * root run-parts /etc/cron.hourly >> 02 4 * * * root run-parts /etc/cron.daily >> 22 4 * * 0 root run-parts /etc/cron.weekly >> 42 4 1 * * root run-parts /etc/cron.monthly >> >> was it moved somewhere else ? am I missing any package ? >> >> thanks, >> Tom >> > >Just consult the docs please. > >http://www.linuxtopia.org/online_books/rhel6/rhel_6_migration_guide/rhel_6_migration_ch04s13.html > >Alexander > > >Horse's mouth better? The EL 6.1 version is at > >http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Migration_Planning_Guide/ch04s14.html > uh-oh, I missed that. thanks for your answers Tom ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos