Re: [Bug 229745] Re: after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd)
Hi, I've just done that, reinstalled my machine by putting ext4 on / (and /home) and keeping my data on a separate ext3 partition. I can only say one word: WOW! Jaunty coupled with ext4 is super fast. Previoulsy my disk was pretty busy, especially during startup, with a lot of IO activity. I watch IO activity all the time, since it is actually my bottleneck. After the upgrade, I almost _NEVER_ see any IO activity!!! I suspect ext4 delayed allocation is the key here, along with the fact that I reinstalled, my previous filesystem had certainly some fragmentation (upgraded since Gutsy). So I would suggest anybody to deploy a similar approach: ext4 on / and data in a separate ext3 partition. Furthermore with Jaunty I noticed that preload is not necessary anymore, it seems that the filesystem cache is already primed. Many application start up much faster! I have a 8-years old PC with 512MB of RAM that now feels like a new machine. My best congratulations to all the devs :) 2009/4/11 Alexander Sack a...@jwsdot.com On Mon, Mar 23, 2009 at 02:15:00AM -, R (Chandra) Chandrasekhar wrote: Alexander Sack wrote: in anycase, if you still have an issue in jaunty you could also test ext4 filesystem which should help to make the filesystem access done by firefox less IO hungry. Thanks for that hint. I need clarification on the ext4 filesystem: 1. Will it be an option in jaunty? Yes, from what i can recall its available as an option in the jaunty installer. However, its still not 100% finished (which is reflected by the fact that its still not the default for us). 2. Is it enough for the root partition / to be ext4 or should the /home partition also be ext4? The write operation happens on your /home partition, so migrating that to ext4 should help. However, remember that with ext4 keeping regular backups is even more important. - Alexander -- after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) https://bugs.launchpad.net/bugs/229745 You received this bug notification because you are a direct subscriber of the bug. Status in The Mozilla Firefox Browser: Invalid Status in “firefox-3.0” source package in Ubuntu: Invalid Status in “xulrunner-1.9” source package in Ubuntu: Won't Fix Status in firefox-3.0 in Ubuntu Hardy: Invalid Status in xulrunner-1.9 in Ubuntu Hardy: Won't Fix Status in firefox-3.0 in Ubuntu Intrepid: Invalid Status in xulrunner-1.9 in Ubuntu Intrepid: Won't Fix Bug description: Binary package hint: firefox some follow up comments from bug #215728 [ https://bugs.edge.launchpad.net/ubuntu/+bug/215728/comments/118 ]: Yes, there is still some heavy disk I/O going on. It's no where near as bad as it was before the update. This patch is a HUGE improvement, but it still happens from time to time causing Firefox to become unresponsive for a few seconds. [ https://bugs.edge.launchpad.net/ubuntu/+bug/215728/comments/120 ] actually I've just measured some firefox heavy IO activity, but as Nick reported, it is a matter of seconds and in my case it doesn't make the whole system irresponsive as it was before the patch. Luckily I had disktop running, so here is the output. I can say that the the slowdown that I felt was probably due to the large write of 5.5MB in 5 seconds you can see at 18:28:31 - some random IO activity I guess. -- after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) https://bugs.launchpad.net/bugs/229745 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 229745] Re: after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd)
On Mon, Mar 23, 2009 at 02:15:00AM -, R (Chandra) Chandrasekhar wrote: Alexander Sack wrote: in anycase, if you still have an issue in jaunty you could also test ext4 filesystem which should help to make the filesystem access done by firefox less IO hungry. Thanks for that hint. I need clarification on the ext4 filesystem: 1. Will it be an option in jaunty? Yes, from what i can recall its available as an option in the jaunty installer. However, its still not 100% finished (which is reflected by the fact that its still not the default for us). 2. Is it enough for the root partition / to be ext4 or should the /home partition also be ext4? The write operation happens on your /home partition, so migrating that to ext4 should help. However, remember that with ext4 keeping regular backups is even more important. - Alexander -- after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) https://bugs.launchpad.net/bugs/229745 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 229745] Re: after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd)
Arthur wrote: This was Firefox idle? Without flash movies, Ajax applications etc.? Mine only shows low one digit kb/s values when using it actively. Nothing when not using it. Nothing more than a few open tabs and normal browsing. No flash, Googlemap, etc. Ever since FF 3.0.5 beta, I have had this type of problem. It then decreased and receded into the background when an interim fox with xulrunner was issued. Now it has suddenly re-emerged into the foreground as a distraction after the latest security fix in 3.0.8. -- after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) https://bugs.launchpad.net/bugs/229745 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 229745] Re: after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd)
Alexander Sack wrote: in anycase, if you still have an issue in jaunty you could also test ext4 filesystem which should help to make the filesystem access done by firefox less IO hungry. Thanks for that hint. I need clarification on the ext4 filesystem: 1. Will it be an option in jaunty? 2. Is it enough for the root partition / to be ext4 or should the /home partition also be ext4? Thank you. -- after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) https://bugs.launchpad.net/bugs/229745 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 229745] Re: after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd)
-- after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) https://bugs.launchpad.net/bugs/229745 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 229745] Re: after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd)
Guys, I was having this problem early in the Hardy release cycle, but after months of usage on multiple machines I can say that now is almost disappeared. To me, it would be more correct to say that the bug is resolved, than not. As usual, great work guys. 2008/9/12 Son [EMAIL PROTECTED] -- after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) https://bugs.launchpad.net/bugs/229745 You received this bug notification because you are a direct subscriber of the bug. Status in The Mozilla Firefox Browser: Incomplete Status in firefox-3.0 source package in Ubuntu: Invalid Status in xulrunner-1.9 source package in Ubuntu: Triaged Status in firefox-3.0 in Ubuntu Hardy: Invalid Status in xulrunner-1.9 in Ubuntu Hardy: Won't Fix Status in firefox-3.0 in Ubuntu Intrepid: Invalid Status in xulrunner-1.9 in Ubuntu Intrepid: Won't Fix Bug description: Binary package hint: firefox some follow up comments from bug #215728 [ https://bugs.edge.launchpad.net/ubuntu/+bug/215728/comments/118 ]: Yes, there is still some heavy disk I/O going on. It's no where near as bad as it was before the update. This patch is a HUGE improvement, but it still happens from time to time causing Firefox to become unresponsive for a few seconds. [ https://bugs.edge.launchpad.net/ubuntu/+bug/215728/comments/120 ] actually I've just measured some firefox heavy IO activity, but as Nick reported, it is a matter of seconds and in my case it doesn't make the whole system irresponsive as it was before the patch. Luckily I had disktop running, so here is the output. I can say that the the slowdown that I felt was probably due to the large write of 5.5MB in 5 seconds you can see at 18:28:31 - some random IO activity I guess. -- after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) https://bugs.launchpad.net/bugs/229745 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 229745] Re: after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd)
Alexander Sack wrote: R (Chandra) Chandrasekhar, how long does this oscillating happen? one minute? one hour? all the time? I did not pay attention to the frequency, but from memory, I would say it happens from once every half hour to once every hour. -- after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) https://bugs.launchpad.net/bugs/229745 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 229745] Re: after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd)
Interesting. Alexander, do you know if the mozilla developers are working on this? Thanks 2008/7/1 R (Chandra) Chandrasekhar [EMAIL PROTECTED]: At least one other person seems to have encountered a similar problem on Windows Vista. See post of June 24th, 2008 at: http://forums.mozillazine.org/viewtopic.php?f=7p=3612185 entitled Reducing disk I/O used by Firefox 3.0 • mozillaZine Forums where the poster writes: -Quote Looking at the Windows resource monitor, it seemed that places.sqlite and places.sqlite-journal were the main culprits of all the disk I/O. -Unquote -- after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) https://bugs.launchpad.net/bugs/229745 You received this bug notification because you are a direct subscriber of the bug. Status in The Mozilla Firefox Browser: Incomplete Status in firefox-3.0 source package in Ubuntu: Invalid Status in xulrunner-1.9 source package in Ubuntu: In Progress Status in firefox-3.0 in Ubuntu Hardy: Invalid Status in xulrunner-1.9 in Ubuntu Hardy: In Progress Status in firefox-3.0 in Ubuntu Intrepid: Invalid Status in xulrunner-1.9 in Ubuntu Intrepid: In Progress Bug description: Binary package hint: firefox some follow up comments from bug #215728 [ https://bugs.edge.launchpad.net/ubuntu/+bug/215728/comments/118 ]: Yes, there is still some heavy disk I/O going on. It's no where near as bad as it was before the update. This patch is a HUGE improvement, but it still happens from time to time causing Firefox to become unresponsive for a few seconds. [ https://bugs.edge.launchpad.net/ubuntu/+bug/215728/comments/120 ] actually I've just measured some firefox heavy IO activity, but as Nick reported, it is a matter of seconds and in my case it doesn't make the whole system irresponsive as it was before the patch. Luckily I had disktop running, so here is the output. I can say that the the slowdown that I felt was probably due to the large write of 5.5MB in 5 seconds you can see at 18:28:31 - some random IO activity I guess. -- after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) https://bugs.launchpad.net/bugs/229745 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 229745] Re: after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd)
stek79 wrote: I never experienced any grey issue since the first post, now the IO activity is not so overwhelming like it was before. Perhaps we can close this bug? I am hesitant to say the problem has been resolved. I still experience periods where the program does not respond while I/O activity is intense. There might be two possible causes, specific to my installation: 1. Something in my user profile from earlier versions of FF which has been carried over. I know that a mailto fix in user.js for previous versions of FF caused me some trouble until I got rid of that file in FF-3.0. 2. Some FF addon is causing loss of response. If I were to switch to a new profile to see if the problem goes away, what files can I safely import from my existing profile? More specifically, is there a web link to change profile cleanly but without too much hardship, so that existing bookmarks etc. are preserved? Thanks. Chandra -- after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) https://bugs.launchpad.net/bugs/229745 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 229745] Re: after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd)
On Sat, Jun 14, 2008 at 12:43:49PM -, R (Chandra) Chandrasekhar wrote: My places.sqlite file has grown to 12107776 bytes and there is still periodic loss of responsiveness with high CPU usage and concentrated I/O. My urlclassifier3.sqlite file is growing only slowly at is 54878208 bytes and does not seem to be the problem. Perhaps this blog explains what I am experiencing: Christopher Blizzard » Blog Archive » system components, fsync and distribution-specific changes: a cautionary tale http://www.0xdeadbeef.com/weblog/?p=368 I checked my libsqlite3-0 and found it was version was 3.4.2-2. This isn't an issue in our builds. we have all the patches in rc1 that were about those fsync issues and we dont use system-sqlite, so we are not affected by a version mismatch causing performance. I have now used prevu to compile version3.5.9-2~8.04prevu1. I do not know if it will help because the firefox I am using is already compiled and version 3.0~rc1+nobinonly-0ubuntu0.8.04.1. But I am sure that it is places.sqlite that is causing loss of responsiveness. Why are you sure about this? - Alexander -- after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) https://bugs.launchpad.net/bugs/229745 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 229745] Re: after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd)
Alexander Sack wrote: On Sat, Jun 14, 2008 at 12:43:49PM -, R (Chandra) Chandrasekhar wrote: But I am sure that it is places.sqlite that is causing loss of responsiveness. Why are you sure about this? - Alexander Because when the computer is unresponsive and I run top the first listed process is firefox. If I then go to ~/.mozilla/firefox/something and do ls -altr I see the file places.sqlite as the last listed and it changes in size as I view it progressively by repeating the command. If there is a more sophisticated and foolproof way to confirm this, perhaps by running some other commands, do let me know and I will try it and post results. Thanks. Chandra -- after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) https://bugs.launchpad.net/bugs/229745 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 229745] Re: after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd)
On Mon, May 12, 2008 at 10:07:21PM -, Tormod Volden wrote: My urlclassifier3.sqlite has now grown to 20MB and I haven't used Firefox that much - it definitely grows out of all proportions. 20MB is still in the bounds of expected. it will grow even further, but at some point it shouldn't increase its size in that dimensions anymore ... - Alexander -- after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) https://bugs.launchpad.net/bugs/229745 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
