[squid-users] Where are the objects?
I have a question regarding the storage of objects: Where is really saved to on disk? Is it in /var/log/squid3/access.log or in: /var/log/squid3/store.log? I've noticed that in the /var/log/squid3/cache swaplog there isn't any entries as stated below. How exactly are objects saved? 2008/11/20 08:49:53| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/11/20 08:49:53| Process ID 2789 2008/11/20 08:49:53| With 1024 file descriptors available 2008/11/20 08:49:53| DNS Socket created at 0.0.0.0, port 32794, FD 8 2008/11/20 08:49:53| Adding nameserver 200.88.127.22 from squid.conf 2008/11/20 08:49:53| Adding nameserver 196.3.81.5 from squid.conf 2008/11/20 08:49:53| Adding nameserver 200.88.127.23 from squid.conf 2008/11/20 08:49:53| Adding nameserver 196.3.81.182 from squid.conf 2008/11/20 08:49:53| Unlinkd pipe opened on FD 13 2008/11/20 08:49:53| Swap maxSize 1024 KB, estimated 787692 objects 2008/11/20 08:49:53| Target number of buckets: 39384 2008/11/20 08:49:53| Using 65536 Store buckets 2008/11/20 08:49:53| Max Mem size: 102400 KB 2008/11/20 08:49:53| Max Swap size: 1024 KB 2008/11/20 08:49:53| Rebuilding storage in /var/log/squid3/cache (CLEAN) 2008/11/20 08:49:53| Using Least Load store dir selection 2008/11/20 08:49:53| Current Directory is / 2008/11/20 08:49:53| Loaded Icons. 2008/11/20 08:49:53| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 14. 2008/11/20 08:49:53| HTCP Disabled. 2008/11/20 08:49:53| WCCP Disabled. 2008/11/20 08:49:53| Ready to serve requests. 2008/11/20 08:50:13| Done scanning /var/log/squid3/cache swaplog (0 entries) 2008/11/20 08:50:13| Finished rebuilding storage from disk. 2008/11/20 08:50:13| 0 Entries scanned 2008/11/20 08:50:13| 0 Invalid entries. 2008/11/20 08:50:13| 0 With invalid flags. 2008/11/20 08:50:13| 0 Objects loaded. 2008/11/20 08:50:13| 0 Objects expired. 2008/11/20 08:50:13| 0 Objects cancelled. 2008/11/20 08:50:13| 0 Duplicate URLs purged. 2008/11/20 08:50:13| 0 Swapfile clashes avoided. 2008/11/20 08:50:13| Took 19.7 seconds ( 0.0 objects/sec). 2008/11/20 08:50:13| Beginning Validation Procedure 2008/11/20 08:50:13| Completed Validation Procedure 2008/11/20 08:50:13| Validated 25 Entries 2008/11/20 08:50:13| store_swap_size = 0 2008/11/20 08:50:13| storeLateRelease: released 0 objects 2008/11/20 08:50:41| Preparing for shutdown after 0 requests 2008/11/20 08:50:41| Waiting 30 seconds for active connections to finish 2008/11/20 08:50:41| FD 14 Closing HTTP connection 2008/11/20 08:51:12| Shutting down... 2008/11/20 08:51:12| Closing unlinkd pipe on FD 13 2008/11/20 08:51:12| storeDirWriteCleanLogs: Starting... 2008/11/20 08:51:12| Finished. Wrote 0 entries. 2008/11/20 08:51:12| Took 0.0 seconds ( 0.0 entries/sec). CPU Usage: 0.036 seconds = 0.024 user + 0.012 sys Maximum Resident Size: 0 KB Page faults with physical i/o: 0 Memory usage for squid via mallinfo(): total space in arena:2736 KB Ordinary blocks: 2715 KB 9 blks Small blocks: 0 KB 0 blks Holding blocks: 1500 KB 7 blks Free Small blocks: 0 KB Free Ordinary blocks: 20 KB Total in use:4215 KB 154% Total free:20 KB 1% 2008/11/20 08:51:12| Squid Cache (Version 3.0.PRE5): Exiting normally. 2008/11/20 08:51:18| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/11/20 08:51:18| Process ID 2824 2008/11/20 08:51:18| With 1024 file descriptors available 2008/11/20 08:51:18| DNS Socket created at 0.0.0.0, port 32794, FD 8 2008/11/20 08:51:18| Adding nameserver 200.88.127.22 from squid.conf 2008/11/20 08:51:18| Adding nameserver 196.3.81.5 from squid.conf 2008/11/20 08:51:18| Adding nameserver 200.88.127.23 from squid.conf 2008/11/20 08:51:18| Adding nameserver 196.3.81.182 from squid.conf 2008/11/20 08:51:18| Unlinkd pipe opened on FD 13 2008/11/20 08:51:18| Swap maxSize 1024 KB, estimated 787692 objects 2008/11/20 08:51:18| Target number of buckets: 39384 2008/11/20 08:51:18| Using 65536 Store buckets 2008/11/20 08:51:18| Max Mem size: 102400 KB 2008/11/20 08:51:18| Max Swap size: 1024 KB 2008/11/20 08:51:18| Rebuilding storage in /var/log/squid3/cache (CLEAN) 2008/11/20 08:51:18| Using Least Load store dir selection 2008/11/20 08:51:18| Current Directory is / 2008/11/20 08:51:18| Loaded Icons. 2008/11/20 08:51:18| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 14. 2008/11/20 08:51:18| HTCP Disabled. 2008/11/20 08:51:18| WCCP Disabled. 2008/11/20 08:51:18| Ready to serve requests.
Re: [squid-users] Where are the objects?
Wilson Hernandez - MSD, S. A. wrote: I have a question regarding the storage of objects: Where is really saved to on disk? Is it in /var/log/squid3/access.log or in: /var/log/squid3/store.log? Objects are stored in the cache. This has several forms. Most use a directory structure. The swap.state is a journal of the currently stored objects. The *.log files are logs of things that have changed. store.log shows what has been added/removed from the cache, and when. access.log shows details about who is using the cache and for what. cache.log show administrative information about problems, and if set debugging information for tracking down problems. 2008/11/20 08:49:53| Ready to serve requests. 2008/11/20 08:50:13| Done scanning /var/log/squid3/cache swaplog (0 entries) 2008/11/20 08:50:13| Finished rebuilding storage from disk. 2008/11/20 08:50:13| 0 Entries scanned 2008/11/20 08:50:13| 0 Invalid entries. 2008/11/20 08:50:13| 0 With invalid flags. 2008/11/20 08:50:13| 0 Objects loaded. 2008/11/20 08:50:13| 0 Objects expired. 2008/11/20 08:50:13| 0 Objects cancelled. 2008/11/20 08:50:13| 0 Duplicate URLs purged. 2008/11/20 08:50:13| 0 Swapfile clashes avoided. 2008/11/20 08:50:13| Took 19.7 seconds ( 0.0 objects/sec). I take it you mean all the zeros there. They mean one of a few things. 1) no traffic is going through your Squid. nothing to be cached. 2) you are using memory-only cache. nothing gets stored on disk. 3) you have configured cache deny all. nothing allowed to store Amos -- Please be using Current Stable Squid 2.7.STABLE5 or 3.0.STABLE10 Current Beta Squid 3.1.0.2
RE: [squid-users] Where are the objects?
Hi, Squid saves the files to var/cache in subfolders, or any other folder you configure using cache_dir. If you shut down squid, delete the FILES in this folder and its subfolder (do not delete folders, just files), restart squid and access a cacheable file, you should see a new file added in a sub folder (as well as a swap file). The new file in one of the sub directories is the cached version of the resource. You can open it in a text editor. If the original resource was text (html, css, etc) it will be pretty easy to understand this file. If you do not see a file on disk, it is possible that the resource is not cacheable, or the configuration of your squid does not allow disk caching. Hope this helps, E -Original Message- From: Wilson Hernandez - MSD, S. A. [mailto:[EMAIL PROTECTED] Sent: Saturday, November 22, 2008 12:16 AM To: squid-users@squid-cache.org Subject: [squid-users] Where are the objects? I have a question regarding the storage of objects: Where is really saved to on disk? Is it in /var/log/squid3/access.log or in: /var/log/squid3/store.log? I've noticed that in the /var/log/squid3/cache swaplog there isn't any entries as stated below. How exactly are objects saved? 2008/11/20 08:49:53| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/11/20 08:49:53| Process ID 2789 2008/11/20 08:49:53| With 1024 file descriptors available 2008/11/20 08:49:53| DNS Socket created at 0.0.0.0, port 32794, FD 8 2008/11/20 08:49:53| Adding nameserver 200.88.127.22 from squid.conf 2008/11/20 08:49:53| Adding nameserver 196.3.81.5 from squid.conf 2008/11/20 08:49:53| Adding nameserver 200.88.127.23 from squid.conf 2008/11/20 08:49:53| Adding nameserver 196.3.81.182 from squid.conf 2008/11/20 08:49:53| Unlinkd pipe opened on FD 13 2008/11/20 08:49:53| Swap maxSize 1024 KB, estimated 787692 objects 2008/11/20 08:49:53| Target number of buckets: 39384 2008/11/20 08:49:53| Using 65536 Store buckets 2008/11/20 08:49:53| Max Mem size: 102400 KB 2008/11/20 08:49:53| Max Swap size: 1024 KB 2008/11/20 08:49:53| Rebuilding storage in /var/log/squid3/cache (CLEAN) 2008/11/20 08:49:53| Using Least Load store dir selection 2008/11/20 08:49:53| Current Directory is / 2008/11/20 08:49:53| Loaded Icons. 2008/11/20 08:49:53| Accepting transparently proxied HTTP connections at 192.168.2.1, port 3128, FD 14. 2008/11/20 08:49:53| HTCP Disabled. 2008/11/20 08:49:53| WCCP Disabled. 2008/11/20 08:49:53| Ready to serve requests. 2008/11/20 08:50:13| Done scanning /var/log/squid3/cache swaplog (0 entries) 2008/11/20 08:50:13| Finished rebuilding storage from disk. 2008/11/20 08:50:13| 0 Entries scanned 2008/11/20 08:50:13| 0 Invalid entries. 2008/11/20 08:50:13| 0 With invalid flags. 2008/11/20 08:50:13| 0 Objects loaded. 2008/11/20 08:50:13| 0 Objects expired. 2008/11/20 08:50:13| 0 Objects cancelled. 2008/11/20 08:50:13| 0 Duplicate URLs purged. 2008/11/20 08:50:13| 0 Swapfile clashes avoided. 2008/11/20 08:50:13| Took 19.7 seconds ( 0.0 objects/sec). 2008/11/20 08:50:13| Beginning Validation Procedure 2008/11/20 08:50:13| Completed Validation Procedure 2008/11/20 08:50:13| Validated 25 Entries 2008/11/20 08:50:13| store_swap_size = 0 2008/11/20 08:50:13| storeLateRelease: released 0 objects 2008/11/20 08:50:41| Preparing for shutdown after 0 requests 2008/11/20 08:50:41| Waiting 30 seconds for active connections to finish 2008/11/20 08:50:41| FD 14 Closing HTTP connection 2008/11/20 08:51:12| Shutting down... 2008/11/20 08:51:12| Closing unlinkd pipe on FD 13 2008/11/20 08:51:12| storeDirWriteCleanLogs: Starting... 2008/11/20 08:51:12| Finished. Wrote 0 entries. 2008/11/20 08:51:12| Took 0.0 seconds ( 0.0 entries/sec). CPU Usage: 0.036 seconds = 0.024 user + 0.012 sys Maximum Resident Size: 0 KB Page faults with physical i/o: 0 Memory usage for squid via mallinfo(): total space in arena:2736 KB Ordinary blocks: 2715 KB 9 blks Small blocks: 0 KB 0 blks Holding blocks: 1500 KB 7 blks Free Small blocks: 0 KB Free Ordinary blocks: 20 KB Total in use:4215 KB 154% Total free:20 KB 1% 2008/11/20 08:51:12| Squid Cache (Version 3.0.PRE5): Exiting normally. 2008/11/20 08:51:18| Starting Squid Cache version 3.0.PRE5 for i486-pc-linux-gnu... 2008/11/20 08:51:18| Process ID 2824 2008/11/20 08:51:18| With 1024 file descriptors available 2008/11/20 08:51:18| DNS Socket created at 0.0.0.0, port 32794, FD 8 2008/11/20 08:51:18| Adding nameserver 200.88.127.22 from squid.conf 2008/11/20 08:51:18| Adding nameserver 196.3.81.5 from squid.conf 2008/11/20 08:51:18| Adding nameserver 200.88.127.23 from squid.conf 2008/11/20 08:51:18| Adding nameserver 196.3.81.182 from squid.conf 2008/11/20 08:51:18| Unlinkd pipe opened on FD 13 2008/11/20 08:51:18| Swap maxSize
