Re: [squid-users] Squid3 just Died
Wilson Hernandez - MSD, S. A. wrote: Pieter, I had to delete my cache. I didn't get any answers from the list and I had a lot of people calling. I did: rm -r /squid/cache/* it took over 30 minutes. Then, restarted squid (/etc/init.d/squid3 start) and it was doing the same: It started and it just died without giving any errors. I then decided to also delete, actually rename, access.log and store.log files. This time when I restarted, it worked. I had to do it that way because that was the only solution I found. I there is another way to restore all the previous objects please let me know. One more thing, What could have caused that problem? Will this happen again in a couple of months? Hmm, if it was the logging drive running out of space yes it might happen again. Check for core.* files in the squid home directory. Amos Thanks Pieter De Wit wrote: Well - something is killing it. It got a lot future than before, it stopped at 0.6% iirc last time ? On Tue, 09 Dec 2008 22:42:52 -0400, Wilson Hernandez - MSD, S. A. [EMAIL PROTECTED] wrote: That i486 thing just might have been the original kernel. I don't know why it says i486. I ran tail -f /var/log/squid/cache.log and noticed that squid tries to rebuild the cache, it stops and restarts again: Store rebuilding is 10.1% complete I don't want to delete my cache. That's the only solutions I've found on the internet: 1) Shutdown your squid server squid -k shutdown 2) Remove the cache directory rm -r /squid/cache/* 3) Re-Create the squid cache directory squid -z 4) Start the squid My cache is pretty big and it would take a while to delete all the stuff in there. Also, I will loose all that data from months of objects... Pieter De Wit wrote: Hi, Might be totally off here, but I noted your swap size is large. Could it be that the cache has more objects (in count and in byte count ?) than can fit into a 32-bit counter ? I got to this by seeing that it crashes at the cache rebuild section as well as the fact the the build is i486. Like I said, might be *way* off but hey :) Cheers, Pieter On Tue, 09 Dec 2008 19:04:54 -0700, [EMAIL PROTECTED] wrote: Hello. I came across something weird. Squid3 just stopped working, just dies without any error message. My server was running as usual and all over a sudden users weren't getting internet. I checked if all the normal processes were running and noticed squid wasn't. Now, I try to start the server and it starts and dies after a few seconds. Heres part of the cache.log file: 2008/12/09 22:03:07| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:07| Process ID 4063 2008/12/09 22:03:07| With 1024 file descriptors available 2008/12/09 22:03:07| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:07| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:07| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:07| Unlinkd pipe opened on FD 13 2008/12/09 22:03:07| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:07| Target number of buckets: 393846 2008/12/09 22:03:07| Using 524288 Store buckets 2008/12/09 22:03:07| Max Mem size: 102400 KB 2008/12/09 22:03:07| Max Swap size: 10240 KB 2008/12/09 22:03:07| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:07| Using Least Load store dir selection 2008/12/09 22:03:07| Current Directory is / 2008/12/09 22:03:07| Loaded Icons. 2008/12/09 22:03:07| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:07| HTCP Disabled. 2008/12/09 22:03:07| WCCP Disabled. 2008/12/09 22:03:07| Ready to serve requests. 2008/12/09 22:03:11| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:11| Process ID 4066 2008/12/09 22:03:11| With 1024 file descriptors available 2008/12/09 22:03:11| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:11| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:11| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:11| Unlinkd pipe opened on FD 13 2008/12/09 22:03:11| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:11| Target number of buckets: 393846 2008/12/09 22:03:11| Using 524288 Store buckets 2008/12/09 22:03:11| Max Mem size: 102400 KB 2008/12/09 22:03:11| Max Swap size: 10240 KB 2008/12/09 22:03:11| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:11| Using Least Load store dir selection 2008/12/09 22:03:11| Current Directory is / 2008/12/09 22:03:11| Loaded Icons. 2008/12/09 22:03:11| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:11| HTCP Disabled. 2008/12/09 22:03:11| WCCP Disabled. 2008/12/09 22:03:11| Ready to serve requests. 2008/12/09 22:03:12| Store rebuilding is 0.6% complete 2008/12/09 22:03:17| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09
Re: [squid-users] Squid3 just Died
Amos, I checked all the squid3 directories: squid3: /usr/sbin/squid3 /etc/squid3 /usr/lib/squid3 /usr/share/squid3 and didn't find any core.* files. I even did a /etc/squid3# whereis core core: /usr/share/man/man5/core.5.gz and it didn't find anything significant. I installed squid3 on debian with apt-get install squid3. Looks like debian doesn't have a current version of squid3 other than PRE5. I will download it from the website and install it from source. I don't think the logging drive was running out of space because Is a pretty big drive and partition. What can other thing make squid act like this? Amos Jeffries wrote: Wilson Hernandez - MSD, S. A. wrote: Pieter, I had to delete my cache. I didn't get any answers from the list and I had a lot of people calling. I did: rm -r /squid/cache/* it took over 30 minutes. Then, restarted squid (/etc/init.d/squid3 start) and it was doing the same: It started and it just died without giving any errors. I then decided to also delete, actually rename, access.log and store.log files. This time when I restarted, it worked. I had to do it that way because that was the only solution I found. I there is another way to restore all the previous objects please let me know. One more thing, What could have caused that problem? Will this happen again in a couple of months? Hmm, if it was the logging drive running out of space yes it might happen again. Check for core.* files in the squid home directory. Amos Thanks Pieter De Wit wrote: Well - something is killing it. It got a lot future than before, it stopped at 0.6% iirc last time ? On Tue, 09 Dec 2008 22:42:52 -0400, Wilson Hernandez - MSD, S. A. [EMAIL PROTECTED] wrote: That i486 thing just might have been the original kernel. I don't know why it says i486. I ran tail -f /var/log/squid/cache.log and noticed that squid tries to rebuild the cache, it stops and restarts again: Store rebuilding is 10.1% complete I don't want to delete my cache. That's the only solutions I've found on the internet: 1) Shutdown your squid server squid -k shutdown 2) Remove the cache directory rm -r /squid/cache/* 3) Re-Create the squid cache directory squid -z 4) Start the squid My cache is pretty big and it would take a while to delete all the stuff in there. Also, I will loose all that data from months of objects... Pieter De Wit wrote: Hi, Might be totally off here, but I noted your swap size is large. Could it be that the cache has more objects (in count and in byte count ?) than can fit into a 32-bit counter ? I got to this by seeing that it crashes at the cache rebuild section as well as the fact the the build is i486. Like I said, might be *way* off but hey :) Cheers, Pieter On Tue, 09 Dec 2008 19:04:54 -0700, [EMAIL PROTECTED] wrote: Hello. I came across something weird. Squid3 just stopped working, just dies without any error message. My server was running as usual and all over a sudden users weren't getting internet. I checked if all the normal processes were running and noticed squid wasn't. Now, I try to start the server and it starts and dies after a few seconds. Heres part of the cache.log file: 2008/12/09 22:03:07| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:07| Process ID 4063 2008/12/09 22:03:07| With 1024 file descriptors available 2008/12/09 22:03:07| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:07| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:07| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:07| Unlinkd pipe opened on FD 13 2008/12/09 22:03:07| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:07| Target number of buckets: 393846 2008/12/09 22:03:07| Using 524288 Store buckets 2008/12/09 22:03:07| Max Mem size: 102400 KB 2008/12/09 22:03:07| Max Swap size: 10240 KB 2008/12/09 22:03:07| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:07| Using Least Load store dir selection 2008/12/09 22:03:07| Current Directory is / 2008/12/09 22:03:07| Loaded Icons. 2008/12/09 22:03:07| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:07| HTCP Disabled. 2008/12/09 22:03:07| WCCP Disabled. 2008/12/09 22:03:07| Ready to serve requests. 2008/12/09 22:03:11| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:11| Process ID 4066 2008/12/09 22:03:11| With 1024 file descriptors available 2008/12/09 22:03:11| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:11| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:11| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:11| Unlinkd pipe opened on FD 13 2008/12/09 22:03:11| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:11| Target number of buckets: 393846 2008/12/09 22:03:11| Using 524288 Store buckets 2008/12/09 22:03:11| Max Mem
Re: [squid-users] Squid3 just Died
... My cache is pretty big ... ... I will lose all that data from months of objects... Dumb question: is all that stuff really of much value? Does performance really continue to improve significantly with increasing cache size even when the cache is already very very large? Isn't the cache hit rate for stuff that old awfully low? (Or to say it another way, doesn't if-modified-since almost always cause the item to be re-fetched from the website anyway?) thanks! -Chuck Kollars
Re: [squid-users] Squid3 just Died
ons 2008-12-10 klockan 00:00 -0400 skrev Wilson Hernandez - MSD, S. A.: I then decided to also delete, actually rename, access.log and store.log files. This time when I restarted, it worked. I had to do it that way because that was the only solution I found. I there is another way to restore all the previous objects please let me know. Most likely you hit the magic 2GB barrier on access.log or store.log.. 32-bit applications by default are limited to 2GB file sizes, and the OS will abruptly kill any application trying to write to a file making it larger than 2GB.. Squid can be built with support for large files (a configure flag). Or run a 64-bit OS (if you hardware is 64-bit capable. Most are today) where this is a non-issue for 64-bit applications. Regards Henrik
Re: [squid-users] Squid3 just Died
ons 2008-12-10 klockan 06:25 -0800 skrev Chuck Kollars: Does performance really continue to improve significantly with increasing cache size even when the cache is already very very large? At least up to a month worth of cache growth shows noticeable increases in hit ratio, both bytes and requests. But it's no where near the increase seen in the first week. Isn't the cache hit rate for stuff that old awfully low? (Or to say it another way, doesn't if-modified-since almost always cause the item to be re-fetched from the website anyway?) If-Modified-Since is a quite lightweight query. And nearly all images etc has not changed in a month. Regards Henrik
Re: [squid-users] Squid3 just Died
On Wednesday 10 December 2008 04:00:36 Wilson Hernandez - MSD, S. A. wrote: Pieter, I had to delete my cache. I didn't get any answers from the list and I had a lot of people calling. I did: rm -r /squid/cache/* it took over 30 minutes. Next time, rename /squid/cache and delete the old cache later. I realise it's easier to think of stuff like this when the phone's not ringing off the hook. Then, restarted squid (/etc/init.d/squid3 start) and it was doing the same: It started and it just died without giving any errors. I then decided to also delete, actually rename, access.log and store.log files. This time when I restarted, it worked. I had to do it that way because that was the only solution I found. I there is another way to restore all the previous objects please let me know. One more thing, What could have caused that problem? Will this happen again in a couple of months? Thanks [snip, tangent] -- ian j hart
Re: [squid-users] Squid3 just Died
Amos, I checked all the squid3 directories: squid3: /usr/sbin/squid3 /etc/squid3 /usr/lib/squid3 /usr/share/squid3 and didn't find any core.* files. I even did a /etc/squid3# whereis core core: /usr/share/man/man5/core.5.gz and it didn't find anything significant. I installed squid3 on debian with apt-get install squid3. Looks like debian doesn't have a current version of squid3 other than PRE5. I will download it from the website and install it from source. 3.0.STABLE* release package is available from the lenny repositories. I don't think the logging drive was running out of space because Is a pretty big drive and partition. What can other thing make squid act like this? A random segfault is the probable cause. They are most commonly seen when running out of disk space. But can occur elsewhere. Amos Amos Jeffries wrote: Wilson Hernandez - MSD, S. A. wrote: Pieter, I had to delete my cache. I didn't get any answers from the list and I had a lot of people calling. I did: rm -r /squid/cache/* it took over 30 minutes. Then, restarted squid (/etc/init.d/squid3 start) and it was doing the same: It started and it just died without giving any errors. I then decided to also delete, actually rename, access.log and store.log files. This time when I restarted, it worked. I had to do it that way because that was the only solution I found. I there is another way to restore all the previous objects please let me know. One more thing, What could have caused that problem? Will this happen again in a couple of months? Hmm, if it was the logging drive running out of space yes it might happen again. Check for core.* files in the squid home directory. Amos Thanks Pieter De Wit wrote: Well - something is killing it. It got a lot future than before, it stopped at 0.6% iirc last time ? On Tue, 09 Dec 2008 22:42:52 -0400, Wilson Hernandez - MSD, S. A. [EMAIL PROTECTED] wrote: That i486 thing just might have been the original kernel. I don't know why it says i486. I ran tail -f /var/log/squid/cache.log and noticed that squid tries to rebuild the cache, it stops and restarts again: Store rebuilding is 10.1% complete I don't want to delete my cache. That's the only solutions I've found on the internet: 1) Shutdown your squid server squid -k shutdown 2) Remove the cache directory rm -r /squid/cache/* 3) Re-Create the squid cache directory squid -z 4) Start the squid My cache is pretty big and it would take a while to delete all the stuff in there. Also, I will loose all that data from months of objects... Pieter De Wit wrote: Hi, Might be totally off here, but I noted your swap size is large. Could it be that the cache has more objects (in count and in byte count ?) than can fit into a 32-bit counter ? I got to this by seeing that it crashes at the cache rebuild section as well as the fact the the build is i486. Like I said, might be *way* off but hey :) Cheers, Pieter On Tue, 09 Dec 2008 19:04:54 -0700, [EMAIL PROTECTED] wrote: Hello. I came across something weird. Squid3 just stopped working, just dies without any error message. My server was running as usual and all over a sudden users weren't getting internet. I checked if all the normal processes were running and noticed squid wasn't. Now, I try to start the server and it starts and dies after a few seconds. Heres part of the cache.log file: 2008/12/09 22:03:07| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:07| Process ID 4063 2008/12/09 22:03:07| With 1024 file descriptors available 2008/12/09 22:03:07| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:07| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:07| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:07| Unlinkd pipe opened on FD 13 2008/12/09 22:03:07| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:07| Target number of buckets: 393846 2008/12/09 22:03:07| Using 524288 Store buckets 2008/12/09 22:03:07| Max Mem size: 102400 KB 2008/12/09 22:03:07| Max Swap size: 10240 KB 2008/12/09 22:03:07| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:07| Using Least Load store dir selection 2008/12/09 22:03:07| Current Directory is / 2008/12/09 22:03:07| Loaded Icons. 2008/12/09 22:03:07| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:07| HTCP Disabled. 2008/12/09 22:03:07| WCCP Disabled. 2008/12/09 22:03:07| Ready to serve requests. 2008/12/09 22:03:11| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:11| Process ID 4066 2008/12/09 22:03:11| With 1024 file descriptors available 2008/12/09 22:03:11| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:11| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:11| Adding nameserver
Re: [squid-users] Squid3 just Died
On Wed, Dec 10, 2008 at 06:25:41AM -0800, Chuck Kollars wrote: ... My cache is pretty big ... ... I will lose all that data from months of objects... Dumb question: is all that stuff really of much value? In some countries where volume charging is applied to data then, yes, dumping the cache can represent a real dollar (or equivalent local currency term) amount. For what it is worth, if the cache is on a separate file system it is sometimes simpler and faster just to unmount the file system and newfs it than trying to remove the files. -- Brett Lymn Warning: The information contained in this email and any attached files is confidential to BAE Systems Australia. If you are not the intended recipient, any use, disclosure or copying of this email or any attachments is expressly prohibited. If you have received this email in error, please notify us immediately. VIRUS: Every care has been taken to ensure this email and its attachments are virus free, however, any loss or damage incurred in using this email is not the sender's responsibility. It is your responsibility to ensure virus checks are completed before installing any data sent in this email to your computer.
[squid-users] Squid3 just Died
Hello. I came across something weird. Squid3 just stopped working, just dies without any error message. My server was running as usual and all over a sudden users weren't getting internet. I checked if all the normal processes were running and noticed squid wasn't. Now, I try to start the server and it starts and dies after a few seconds. Heres part of the cache.log file: 2008/12/09 22:03:07| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:07| Process ID 4063 2008/12/09 22:03:07| With 1024 file descriptors available 2008/12/09 22:03:07| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:07| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:07| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:07| Unlinkd pipe opened on FD 13 2008/12/09 22:03:07| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:07| Target number of buckets: 393846 2008/12/09 22:03:07| Using 524288 Store buckets 2008/12/09 22:03:07| Max Mem size: 102400 KB 2008/12/09 22:03:07| Max Swap size: 10240 KB 2008/12/09 22:03:07| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:07| Using Least Load store dir selection 2008/12/09 22:03:07| Current Directory is / 2008/12/09 22:03:07| Loaded Icons. 2008/12/09 22:03:07| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:07| HTCP Disabled. 2008/12/09 22:03:07| WCCP Disabled. 2008/12/09 22:03:07| Ready to serve requests. 2008/12/09 22:03:11| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:11| Process ID 4066 2008/12/09 22:03:11| With 1024 file descriptors available 2008/12/09 22:03:11| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:11| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:11| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:11| Unlinkd pipe opened on FD 13 2008/12/09 22:03:11| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:11| Target number of buckets: 393846 2008/12/09 22:03:11| Using 524288 Store buckets 2008/12/09 22:03:11| Max Mem size: 102400 KB 2008/12/09 22:03:11| Max Swap size: 10240 KB 2008/12/09 22:03:11| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:11| Using Least Load store dir selection 2008/12/09 22:03:11| Current Directory is / 2008/12/09 22:03:11| Loaded Icons. 2008/12/09 22:03:11| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:11| HTCP Disabled. 2008/12/09 22:03:11| WCCP Disabled. 2008/12/09 22:03:11| Ready to serve requests. 2008/12/09 22:03:12| Store rebuilding is 0.6% complete 2008/12/09 22:03:17| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:17| Process ID 4069 2008/12/09 22:03:17| With 1024 file descriptors available 2008/12/09 22:03:17| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:17| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:17| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:17| Unlinkd pipe opened on FD 13 2008/12/09 22:03:17| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:17| Target number of buckets: 393846 2008/12/09 22:03:17| Using 524288 Store buckets 2008/12/09 22:03:17| Max Mem size: 102400 KB 2008/12/09 22:03:17| Max Swap size: 10240 KB 2008/12/09 22:03:17| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:17| Using Least Load store dir selection 2008/12/09 22:03:17| Current Directory is / 2008/12/09 22:03:17| Loaded Icons. 2008/12/09 22:03:17| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:17| HTCP Disabled. 2008/12/09 22:03:17| WCCP Disabled. 2008/12/09 22:03:17| Ready to serve requests. 2008/12/09 22:03:18| Store rebuilding is 0.6% complete Please help. Your help will be appreciated. Thank you in advanced.
Re: [squid-users] Squid3 just Died
Hi, Might be totally off here, but I noted your swap size is large. Could it be that the cache has more objects (in count and in byte count ?) than can fit into a 32-bit counter ? I got to this by seeing that it crashes at the cache rebuild section as well as the fact the the build is i486. Like I said, might be *way* off but hey :) Cheers, Pieter On Tue, 09 Dec 2008 19:04:54 -0700, [EMAIL PROTECTED] wrote: Hello. I came across something weird. Squid3 just stopped working, just dies without any error message. My server was running as usual and all over a sudden users weren't getting internet. I checked if all the normal processes were running and noticed squid wasn't. Now, I try to start the server and it starts and dies after a few seconds. Heres part of the cache.log file: 2008/12/09 22:03:07| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:07| Process ID 4063 2008/12/09 22:03:07| With 1024 file descriptors available 2008/12/09 22:03:07| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:07| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:07| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:07| Unlinkd pipe opened on FD 13 2008/12/09 22:03:07| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:07| Target number of buckets: 393846 2008/12/09 22:03:07| Using 524288 Store buckets 2008/12/09 22:03:07| Max Mem size: 102400 KB 2008/12/09 22:03:07| Max Swap size: 10240 KB 2008/12/09 22:03:07| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:07| Using Least Load store dir selection 2008/12/09 22:03:07| Current Directory is / 2008/12/09 22:03:07| Loaded Icons. 2008/12/09 22:03:07| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:07| HTCP Disabled. 2008/12/09 22:03:07| WCCP Disabled. 2008/12/09 22:03:07| Ready to serve requests. 2008/12/09 22:03:11| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:11| Process ID 4066 2008/12/09 22:03:11| With 1024 file descriptors available 2008/12/09 22:03:11| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:11| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:11| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:11| Unlinkd pipe opened on FD 13 2008/12/09 22:03:11| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:11| Target number of buckets: 393846 2008/12/09 22:03:11| Using 524288 Store buckets 2008/12/09 22:03:11| Max Mem size: 102400 KB 2008/12/09 22:03:11| Max Swap size: 10240 KB 2008/12/09 22:03:11| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:11| Using Least Load store dir selection 2008/12/09 22:03:11| Current Directory is / 2008/12/09 22:03:11| Loaded Icons. 2008/12/09 22:03:11| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:11| HTCP Disabled. 2008/12/09 22:03:11| WCCP Disabled. 2008/12/09 22:03:11| Ready to serve requests. 2008/12/09 22:03:12| Store rebuilding is 0.6% complete 2008/12/09 22:03:17| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:17| Process ID 4069 2008/12/09 22:03:17| With 1024 file descriptors available 2008/12/09 22:03:17| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:17| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:17| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:17| Unlinkd pipe opened on FD 13 2008/12/09 22:03:17| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:17| Target number of buckets: 393846 2008/12/09 22:03:17| Using 524288 Store buckets 2008/12/09 22:03:17| Max Mem size: 102400 KB 2008/12/09 22:03:17| Max Swap size: 10240 KB 2008/12/09 22:03:17| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:17| Using Least Load store dir selection 2008/12/09 22:03:17| Current Directory is / 2008/12/09 22:03:17| Loaded Icons. 2008/12/09 22:03:17| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:17| HTCP Disabled. 2008/12/09 22:03:17| WCCP Disabled. 2008/12/09 22:03:17| Ready to serve requests. 2008/12/09 22:03:18| Store rebuilding is 0.6% complete Please help. Your help will be appreciated. Thank you in advanced.
Re: [squid-users] Squid3 just Died
That i486 thing just might have been the original kernel. I don't know why it says i486. I ran tail -f /var/log/squid/cache.log and noticed that squid tries to rebuild the cache, it stops and restarts again: Store rebuilding is 10.1% complete I don't want to delete my cache. That's the only solutions I've found on the internet: 1) Shutdown your squid server squid -k shutdown 2) Remove the cache directory rm -r /squid/cache/* 3) Re-Create the squid cache directory squid -z 4) Start the squid My cache is pretty big and it would take a while to delete all the stuff in there. Also, I will loose all that data from months of objects... Pieter De Wit wrote: Hi, Might be totally off here, but I noted your swap size is large. Could it be that the cache has more objects (in count and in byte count ?) than can fit into a 32-bit counter ? I got to this by seeing that it crashes at the cache rebuild section as well as the fact the the build is i486. Like I said, might be *way* off but hey :) Cheers, Pieter On Tue, 09 Dec 2008 19:04:54 -0700, [EMAIL PROTECTED] wrote: Hello. I came across something weird. Squid3 just stopped working, just dies without any error message. My server was running as usual and all over a sudden users weren't getting internet. I checked if all the normal processes were running and noticed squid wasn't. Now, I try to start the server and it starts and dies after a few seconds. Heres part of the cache.log file: 2008/12/09 22:03:07| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:07| Process ID 4063 2008/12/09 22:03:07| With 1024 file descriptors available 2008/12/09 22:03:07| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:07| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:07| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:07| Unlinkd pipe opened on FD 13 2008/12/09 22:03:07| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:07| Target number of buckets: 393846 2008/12/09 22:03:07| Using 524288 Store buckets 2008/12/09 22:03:07| Max Mem size: 102400 KB 2008/12/09 22:03:07| Max Swap size: 10240 KB 2008/12/09 22:03:07| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:07| Using Least Load store dir selection 2008/12/09 22:03:07| Current Directory is / 2008/12/09 22:03:07| Loaded Icons. 2008/12/09 22:03:07| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:07| HTCP Disabled. 2008/12/09 22:03:07| WCCP Disabled. 2008/12/09 22:03:07| Ready to serve requests. 2008/12/09 22:03:11| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:11| Process ID 4066 2008/12/09 22:03:11| With 1024 file descriptors available 2008/12/09 22:03:11| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:11| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:11| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:11| Unlinkd pipe opened on FD 13 2008/12/09 22:03:11| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:11| Target number of buckets: 393846 2008/12/09 22:03:11| Using 524288 Store buckets 2008/12/09 22:03:11| Max Mem size: 102400 KB 2008/12/09 22:03:11| Max Swap size: 10240 KB 2008/12/09 22:03:11| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:11| Using Least Load store dir selection 2008/12/09 22:03:11| Current Directory is / 2008/12/09 22:03:11| Loaded Icons. 2008/12/09 22:03:11| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:11| HTCP Disabled. 2008/12/09 22:03:11| WCCP Disabled. 2008/12/09 22:03:11| Ready to serve requests. 2008/12/09 22:03:12| Store rebuilding is 0.6% complete 2008/12/09 22:03:17| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:17| Process ID 4069 2008/12/09 22:03:17| With 1024 file descriptors available 2008/12/09 22:03:17| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:17| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:17| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:17| Unlinkd pipe opened on FD 13 2008/12/09 22:03:17| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:17| Target number of buckets: 393846 2008/12/09 22:03:17| Using 524288 Store buckets 2008/12/09 22:03:17| Max Mem size: 102400 KB 2008/12/09 22:03:17| Max Swap size: 10240 KB 2008/12/09 22:03:17| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:17| Using Least Load store dir selection 2008/12/09 22:03:17| Current Directory is / 2008/12/09 22:03:17| Loaded Icons. 2008/12/09 22:03:17| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:17| HTCP Disabled. 2008/12/09 22:03:17| WCCP Disabled. 2008/12/09 22:03:17| Ready to serve requests. 2008/12/09 22:03:18| Store rebuilding is 0.6% complete
Re: [squid-users] Squid3 just Died
Well - something is killing it. It got a lot future than before, it stopped at 0.6% iirc last time ? On Tue, 09 Dec 2008 22:42:52 -0400, Wilson Hernandez - MSD, S. A. [EMAIL PROTECTED] wrote: That i486 thing just might have been the original kernel. I don't know why it says i486. I ran tail -f /var/log/squid/cache.log and noticed that squid tries to rebuild the cache, it stops and restarts again: Store rebuilding is 10.1% complete I don't want to delete my cache. That's the only solutions I've found on the internet: 1) Shutdown your squid server squid -k shutdown 2) Remove the cache directory rm -r /squid/cache/* 3) Re-Create the squid cache directory squid -z 4) Start the squid My cache is pretty big and it would take a while to delete all the stuff in there. Also, I will loose all that data from months of objects... Pieter De Wit wrote: Hi, Might be totally off here, but I noted your swap size is large. Could it be that the cache has more objects (in count and in byte count ?) than can fit into a 32-bit counter ? I got to this by seeing that it crashes at the cache rebuild section as well as the fact the the build is i486. Like I said, might be *way* off but hey :) Cheers, Pieter On Tue, 09 Dec 2008 19:04:54 -0700, [EMAIL PROTECTED] wrote: Hello. I came across something weird. Squid3 just stopped working, just dies without any error message. My server was running as usual and all over a sudden users weren't getting internet. I checked if all the normal processes were running and noticed squid wasn't. Now, I try to start the server and it starts and dies after a few seconds. Heres part of the cache.log file: 2008/12/09 22:03:07| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:07| Process ID 4063 2008/12/09 22:03:07| With 1024 file descriptors available 2008/12/09 22:03:07| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:07| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:07| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:07| Unlinkd pipe opened on FD 13 2008/12/09 22:03:07| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:07| Target number of buckets: 393846 2008/12/09 22:03:07| Using 524288 Store buckets 2008/12/09 22:03:07| Max Mem size: 102400 KB 2008/12/09 22:03:07| Max Swap size: 10240 KB 2008/12/09 22:03:07| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:07| Using Least Load store dir selection 2008/12/09 22:03:07| Current Directory is / 2008/12/09 22:03:07| Loaded Icons. 2008/12/09 22:03:07| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:07| HTCP Disabled. 2008/12/09 22:03:07| WCCP Disabled. 2008/12/09 22:03:07| Ready to serve requests. 2008/12/09 22:03:11| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:11| Process ID 4066 2008/12/09 22:03:11| With 1024 file descriptors available 2008/12/09 22:03:11| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:11| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:11| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:11| Unlinkd pipe opened on FD 13 2008/12/09 22:03:11| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:11| Target number of buckets: 393846 2008/12/09 22:03:11| Using 524288 Store buckets 2008/12/09 22:03:11| Max Mem size: 102400 KB 2008/12/09 22:03:11| Max Swap size: 10240 KB 2008/12/09 22:03:11| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:11| Using Least Load store dir selection 2008/12/09 22:03:11| Current Directory is / 2008/12/09 22:03:11| Loaded Icons. 2008/12/09 22:03:11| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:11| HTCP Disabled. 2008/12/09 22:03:11| WCCP Disabled. 2008/12/09 22:03:11| Ready to serve requests. 2008/12/09 22:03:12| Store rebuilding is 0.6% complete 2008/12/09 22:03:17| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:17| Process ID 4069 2008/12/09 22:03:17| With 1024 file descriptors available 2008/12/09 22:03:17| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:17| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:17| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:17| Unlinkd pipe opened on FD 13 2008/12/09 22:03:17| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:17| Target number of buckets: 393846 2008/12/09 22:03:17| Using 524288 Store buckets 2008/12/09 22:03:17| Max Mem size: 102400 KB 2008/12/09 22:03:17| Max Swap size: 10240 KB 2008/12/09 22:03:17| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:17| Using Least Load store dir selection 2008/12/09 22:03:17| Current Directory is /
Re: [squid-users] Squid3 just Died
Pieter, I had to delete my cache. I didn't get any answers from the list and I had a lot of people calling. I did: rm -r /squid/cache/* it took over 30 minutes. Then, restarted squid (/etc/init.d/squid3 start) and it was doing the same: It started and it just died without giving any errors. I then decided to also delete, actually rename, access.log and store.log files. This time when I restarted, it worked. I had to do it that way because that was the only solution I found. I there is another way to restore all the previous objects please let me know. One more thing, What could have caused that problem? Will this happen again in a couple of months? Thanks Pieter De Wit wrote: Well - something is killing it. It got a lot future than before, it stopped at 0.6% iirc last time ? On Tue, 09 Dec 2008 22:42:52 -0400, Wilson Hernandez - MSD, S. A. [EMAIL PROTECTED] wrote: That i486 thing just might have been the original kernel. I don't know why it says i486. I ran tail -f /var/log/squid/cache.log and noticed that squid tries to rebuild the cache, it stops and restarts again: Store rebuilding is 10.1% complete I don't want to delete my cache. That's the only solutions I've found on the internet: 1) Shutdown your squid server squid -k shutdown 2) Remove the cache directory rm -r /squid/cache/* 3) Re-Create the squid cache directory squid -z 4) Start the squid My cache is pretty big and it would take a while to delete all the stuff in there. Also, I will loose all that data from months of objects... Pieter De Wit wrote: Hi, Might be totally off here, but I noted your swap size is large. Could it be that the cache has more objects (in count and in byte count ?) than can fit into a 32-bit counter ? I got to this by seeing that it crashes at the cache rebuild section as well as the fact the the build is i486. Like I said, might be *way* off but hey :) Cheers, Pieter On Tue, 09 Dec 2008 19:04:54 -0700, [EMAIL PROTECTED] wrote: Hello. I came across something weird. Squid3 just stopped working, just dies without any error message. My server was running as usual and all over a sudden users weren't getting internet. I checked if all the normal processes were running and noticed squid wasn't. Now, I try to start the server and it starts and dies after a few seconds. Heres part of the cache.log file: 2008/12/09 22:03:07| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:07| Process ID 4063 2008/12/09 22:03:07| With 1024 file descriptors available 2008/12/09 22:03:07| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:07| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:07| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:07| Unlinkd pipe opened on FD 13 2008/12/09 22:03:07| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:07| Target number of buckets: 393846 2008/12/09 22:03:07| Using 524288 Store buckets 2008/12/09 22:03:07| Max Mem size: 102400 KB 2008/12/09 22:03:07| Max Swap size: 10240 KB 2008/12/09 22:03:07| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:07| Using Least Load store dir selection 2008/12/09 22:03:07| Current Directory is / 2008/12/09 22:03:07| Loaded Icons. 2008/12/09 22:03:07| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:07| HTCP Disabled. 2008/12/09 22:03:07| WCCP Disabled. 2008/12/09 22:03:07| Ready to serve requests. 2008/12/09 22:03:11| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:11| Process ID 4066 2008/12/09 22:03:11| With 1024 file descriptors available 2008/12/09 22:03:11| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:11| Adding nameserver 200.42.213.11 from squid.conf 2008/12/09 22:03:11| Adding nameserver 200.42.213.21 from squid.conf 2008/12/09 22:03:11| Unlinkd pipe opened on FD 13 2008/12/09 22:03:11| Swap maxSize 10240 KB, estimated 7876923 objects 2008/12/09 22:03:11| Target number of buckets: 393846 2008/12/09 22:03:11| Using 524288 Store buckets 2008/12/09 22:03:11| Max Mem size: 102400 KB 2008/12/09 22:03:11| Max Swap size: 10240 KB 2008/12/09 22:03:11| Rebuilding storage in /var/log/squid/cache (DIRTY) 2008/12/09 22:03:11| Using Least Load store dir selection 2008/12/09 22:03:11| Current Directory is / 2008/12/09 22:03:11| Loaded Icons. 2008/12/09 22:03:11| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 15. 2008/12/09 22:03:11| HTCP Disabled. 2008/12/09 22:03:11| WCCP Disabled. 2008/12/09 22:03:11| Ready to serve requests. 2008/12/09 22:03:12| Store rebuilding is 0.6% complete 2008/12/09 22:03:17| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/12/09 22:03:17| Process ID 4069 2008/12/09 22:03:17| With 1024 file descriptors available 2008/12/09 22:03:17| DNS Socket created at 0.0.0.0, port 33054, FD 8 2008/12/09 22:03:17| Adding
Re: [squid-users] Squid3 just Died
Please try the latest squid. There are many hundreds of bug fixes to 3.0 since PRE5. Amos -- Please be using Current Stable Squid 2.7.STABLE5 or 3.0.STABLE10 Current Beta Squid 3.1.0.3 or 3.0.STABLE11-RC1
