[squid-users] Fw: new message
Hey! New message, please read <http://americantrailermart.com/lady.php?v> Alexandre Chappaz ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
[squid-users] Fw: new message
Hey! New message, please read <http://addictionsubstanceabuse.org/speaking.php?3u> Alexandre Chappaz ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
[squid-users] Fw: new message
Hey! New message, please read <http://americantrailermart.com/sea.php?ha> Alexandre Chappaz ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
[squid-users] Fw: new message
Hey! New message, please read <http://sw1ng.com/silence.php?8cdp> Alexandre Chappaz ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
[squid-users] la belle affaire......
Hello, ca y est je vends ma voiture, voilà l'annonce : http://www.leboncoin.fr/voitures/603661288.htm beaucoup de monde me répond pour envoyer la bête en Afrique, mais si je peux faire un(e) heureux(se) en France et conclure l'affaire sans emmerdement ça m'arrange ! faites donc circuler. Cdlt
Re: [squid-users] squid 3.4.0.2 + smp + rock storage error
Hi, I added a loop waiting for the end of all squid processes ( with 30 seconds limit, I don't want to loop forever ..) and it did the trick : for i in {1..30} do sleep 1 pidof 'squid' /dev/null pssquid=$? if [ $pssquid -eq 0 ];then echo Attente fin de process squid-z /var/tmp/demarrage-squid.txt else echo tous les process sont terminés /var/tmp/demarrage-squid.txt break fi done Thanks for your input. Maybe this info has it's place here : http://wiki.squid-cache.org/Features/SmpScale#Troubleshooting Regards Alex 2013/11/21 Alexandre Chappaz alexandrechap...@gmail.com: Thanks and yes this is exactly what we are doing. I will modify the init script so that it waits for the effective end of the squid-z before starting the daemon. Le 20 nov. 2013 18:16, Alex Rousskov rouss...@measurement-factory.com a écrit : On 11/20/2013 02:19 AM, Alexandre Chappaz wrote: I have the same kind of error but what bugs me is that I cannot reproduce this systematically. I am really wondering if this is a permission PB on shm mount point and / or /var/run/squid permissions : some times the service starts normally ( worker kids stay up ) and some times some or all of the the worker kids die with this error : FATAL: Ipc::Mem::Segment::open failed to shm_open(/squid-cache_mem.shm): (2) No such file or directory. This is usually caused by two SMP Squid instances running, which is usually caused by incorrect squid -z application in the system startup/service scripts. YMMV, but the logs you posted later seem to suggest that it is exactly what is happening in your case. Do you run squid-z from the system startup/service script? If yes, does the script assume that squid -z ends when the squid -z command returns? If yes, the script should be modified to avoid that assumption because, in recent Squid releases, the squid-z instance continues to run (in the background) and clash with the regular squid instance started by the same script a moment later. There was a recent squid-dev discussion about fixing squid-z. I am not sure there was a strong consensus regarding the best solution, but I hope that squid-z will start doing nothing (Squid will just exit with a warning message about the deprecated option) in the foreseeable future while Squid instances will be capable of creating missing directories runtime, when needed (and allowed) to do so. More details and a call for volunteers at http://www.squid-cache.org/mail-archive/squid-dev/201311/0017.html HTH, Alex.
Re: [squid-users] squid 3.4.0.2 + smp + rock storage error
Hi, I have the same kind of error but what bugs me is that I cannot reproduce this systematically. I am really wondering if this is a permission PB on shm mount point and / or /var/run/squid permissions : some times the service starts normally ( worker kids stay up ) and some times some or all of the the worker kids die with this error : FATAL: Ipc::Mem::Segment::open failed to shm_open(/squid-cache_mem.shm): (2) No such file or directory. attached is the cache.log, and here below the squid.conf. Best regards # pour le debogage (ne pas mettre plus de 2) #debug_options ALL,2 # Utilisateurs cache_effective_user nobody cache_effective_group nobody # Format access.log strip_query_terms off #logformat Squid %ts.%03tu %6tr %a %Ss/%Hs %st %rm %ru %un %Sh/%A %mt logformat PAS-Bdx %ts.%03tu %6tr %a %Ss/%Hs %st %rm %ru %un %Sh/%A %mt %rv %tl %{Referer}h %{User-Agent}h # chemins coredump_dir /var/cache/squid pid_filename /var/run/squid/squid.pid access_log stdio:/var/log/squid/access.log PAS-Bdx cache_log /var/log/squid/cache.log cache_store_log none mime_table /etc/squid/mime.conf error_directory /etc/squid/errors error_default_language fr err_page_stylesheet /etc/squid/errorpage.css # Fichier hosts hosts_file /etc/hosts # SNMP acl snmpcommunity snmp_community read_only_user snmp_access allow snmpcommunity snmp_port 3401 ### # FONCTIONNEMENT DU PROXY # ### #SMP workers 4 #Ports d'ecoute http_port 3128 #localhost a droit au cachemanager http_access allow localhost manager http_access deny manager #localhost a droit a purger le cache acl PURGE method PURGE http_access allow PURGE localhost http_access deny PURGE # Les requetes intranet sont retournees en erreur acl ip_intranet dst 10.0.0.0/8 http_access deny ip_intranet acl PLSU_SIE_USERAGENT browser PLSU_SIE acl PLSU_SIE_DEST dstdomain /etc/squid/acl/dest/PLSU_SIE.dst http_access allow PLSU_SIE_USERAGENT PLSU_SIE_DEST http_access deny PLSU_SIE_USERAGENT #définition de la VIP des squid Père #cache_peer 192.168.1.129 parent 3128 0 default no-query no-digest cache_peer 192.168.1.201 parent 3128 0 sourcehash no-query no-digest cache_peer 192.168.1.202 parent 3128 0 sourcehash no-query no-digest cache_peer 192.168.1.203 parent 3128 0 sourcehash no-query no-digest cache_peer 192.168.1.204 parent 3128 0 sourcehash no-query no-digest # Time Out / Time To Live negative_ttl 1 seconds read_timeout 15 minutes request_timeout 5 minutes client_lifetime 4 hours positive_dns_ttl 2 hours negative_dns_ttl 5 minutes shutdown_lifetime 5 seconds dns_nameservers 127.0.0.1 # Divers ftp_passive on ftp_epsv off logfile_rotate 2 request_header_access Via deny all request_header_access X-Forwarded-For allow all refresh_all_ims on ### # FONCTIONNEMENT DU CACHE # ### #Rafraichissement du cache memory_cache_shared on cache_mem 2 GB max_filedesc 65535 maximum_object_size 512 MB maximum_object_size_in_memory 2048 KB ipcache_size 8192 fqdncache_size 8192 #definition du cache #8Gb of shared rock cache, for 32Ko objects max cache_dir rock /var/cache/squid/mem/ 8192 max-size=32768 if ${process_number} =1 # Filtrage avec squidGuard url_rewrite_program /usr/local/squidGuard/bin/squidGuard url_rewrite_children 1000 startup=15 idle=15 concurrency=0 cache_dir aufs /var/cache/squid/mem/W${process_number} 2048 16 256 min-size=32768 max-size=131072 cache_dir aufs /var/cache/squid/W${process_number} 12000 16 256 min-size=131072 endif if ${process_number} =2 # Filtrage avec squidGuard url_rewrite_program /usr/local/squidGuard/bin/squidGuard url_rewrite_children 1000 startup=15 idle=15 concurrency=0 cache_dir aufs /var/cache/squid/mem/W${process_number} 2048 16 256 min-size=32768 max-size=131072 cache_dir aufs /var/cache/squid/W${process_number} 12000 16 256 min-size=131072 endif if ${process_number} =3 # Filtrage avec squidGuard url_rewrite_program /usr/local/squidGuard/bin/squidGuard url_rewrite_children 1000 startup=15 idle=15 concurrency=0 cache_dir aufs /var/cache/squid/mem/W${process_number} 2048 16 256 min-size=32768 max-size=131072 cache_dir aufs /var/cache/squid/W${process_number} 12000 16 256 min-size=131072 endif if ${process_number} =4 # Filtrage avec squidGuard url_rewrite_program /usr/local/squidGuard/bin/squidGuard url_rewrite_children 1000 startup=15 idle=15 concurrency=0 cache_dir aufs /var/cache/squid/mem/W${process_number} 2048 16 256 min-size=32768 max-size=131072 cache_dir aufs /var/cache/squid/W${process_number} 12000 16 256 min-size=131072 endif # pages dynamiques non mises en cache acl QUERY urlpath_regex cgi-bin \? \.fcgi \.cgi \.pl \.php3 \.asp \.php \.do no_cache deny QUERY # Reecriture des regles de gestion du cache pour certains domaines gros consommateurs acl forcedcache urlpath_regex .lefigaro\.fr .leparisien\.fr .20minutes\.fr .lemde\.fr .lemonde\.fr .lepoint\.fr .lexpress\.fr .meteofrance\.com .ouest-france\.fr .nouvelobs\.com .wikimedia\.org
Re: [squid-users] squid 3.4.0.2 + smp + rock storage error
here it is 2013/11/20 Eliezer Croitoru elie...@ngtech.co.il: Hey Alexandre, I do not see any cache.log attachment here. Please resend it. Thanks, Eliezer On 20/11/13 11:19, Alexandre Chappaz wrote: Hi, I have the same kind of error but what bugs me is that I cannot reproduce this systematically. I am really wondering if this is a permission PB on shm mount point and / or /var/run/squid permissions : some times the service starts normally ( worker kids stay up ) and some times some or all of the the worker kids die with this error : FATAL: Ipc::Mem::Segment::open failed to shm_open(/squid-cache_mem.shm): (2) No such file or directory. attached is the cache.log, and here below the squid.conf. Best regards cache.log.bz2 Description: BZip2 compressed data
[squid-users] PURGE not purging with memory_cache_shared on
Hi, from what I have seen, with v3.3.8, PURGE method is not purging if memory_cache_shared is on. posting in pastebin 2 logs with the same requests debug log with 1 worker / memory_cache_shared on : cache.log is here : http://pastebin.archlinux.fr/467269 corresponding to these requests : 1375190125.156 12 ::1 TCP_MISS/200 1295 GET http://bofip.impots.gouv.fr/bofip/1-PGP.html - FIRSTUP_PARENT/10.154.61.1 text/html 1.1 30/Jul/2013:15:15:25 +0200 - Wget/1.14 (linux-gnu) 1375190127.367 2 ::1 TCP_MISS/200 255 PURGE http://bofip.impots.gouv.fr/bofip/1-PGP.html - HIER_NONE/- - 1.0 30/Jul/2013:15:15:27 +0200 - squidclient/3.3.8 1375190130.735 2 ::1 TCP_MEM_HIT/200 1390 GET http://bofip.impots.gouv.fr/bofip/1-PGP.html - HIER_NONE/- text/html 1.1 30/Jul/2013:15:15:30 +0200 - Wget/1.14 (linux-gnu) this is wrong, because the purge request should have cleared the object from the cache, so the last GET should be a MISS, but it is a HIT Now the same with memory_cache_shared off : cache.log http://pastebin.archlinux.fr/467270 corresponding to these requests : 1375190414.749 14 ::1 TCP_MISS/200 1295 GET http://bofip.impots.gouv.fr/bofip/1-PGP.html - FIRSTUP_PARENT/10.154.61.1 text/html 1.1 30/Jul/2013:15:20:14 +0200 - Wget/1.14 (linux-gnu) 1375190417.550 3 ::1 TCP_MISS/200 255 PURGE http://bofip.impots.gouv.fr/bofip/1-PGP.html - HIER_NONE/- - 1.0 30/Jul/2013:15:20:17 +0200 - squidclient/3.3.8 1375190420.694 15 ::1 TCP_MISS/200 1295 GET http://bofip.impots.gouv.fr/bofip/1-PGP.html - FIRSTUP_PARENT/10.154.61.1 text/html 1.1 30/Jul/2013:15:20:20 +0200 - Wget/1.14 (linux-gnu) this is right, because the purge request have cleared the object from the cache, so the last GET is a MISS. Guess I should file a bug on this. Regards Alex
Re: [squid-users] object not being cached
thanks, it's working now. Regards Alex 2013/7/8 Amos Jeffries squ...@treenet.co.nz: On 9/07/2013 12:57 a.m., Alexandre Chappaz wrote: ### # FONCTIONNEMENT DU CACHE # ### #definition du cache #8Gb of shared rock cache, for 32Ko objects max cache_dir rock /var/cache/squid/mem/ 8192 max-size=32768 if ${process_number} =1 cache_dir aufs /var/cache/squid/mem/W${process_number} 3000 16 256 min-size=32768 max-size=131072 cache_dir aufs /var/cache/squid/W${process_number} 9000 16 256 min-size=131072 endif if ${process_number} =2 cache_dir aufs /var/cache/squid/mem/W${process_number} 3000 16 256 min-size=32768 max-size=131072 cache_dir aufs /var/cache/squid/W${process_number} 9000 16 256 min-size=131072 endif if ${process_number} =3 cache_dir aufs /var/cache/squid/mem/W${process_number} 3000 16 256 min-size=32768 max-size=131072 cache_dir aufs /var/cache/squid/W${process_number} 9000 16 256 min-size=131072 endif if ${process_number} =4 cache_dir aufs /var/cache/squid/mem/W${process_number} 3000 16 256 min-size=32768 max-size=131072 cache_dir aufs /var/cache/squid/W${process_number} 9000 16 256 min-size=131072 endif # pages dynamiques non mises en cache acl QUERY urlpath_regex cgi-bin \? \.fcgi \.cgi \.pl \.php3 \.asp \.php \.do no_cache deny QUERY #Rafraichissement du cache memory_cache_shared on cache_mem 4 GB max_filedesc 65535 maximum_object_size 512 MB maximum_object_size_in_memory 2048 KB You may be hitting a strange issue we have not yet figured out properly. In the recent Squid these limits need to be placed *above* the cache_dir lines or the default maximum objects the cache_dir will store is 4MB. Amos
Re: [squid-users] object not being cached
Maximum Size: 9216000 KB Current Size: 8294132.00 KB Percent Used: 90.00% Filemap bits in use: 24771 of 32768 (76%) Filesystem Space in use: 39747760/59850496 KB (66%) Filesystem Inodes in use: 117081/15451392 (1%) Flags: Removal policy: lru LRU reference age: 10.99 days } by kid4 by kid5 { Store Directory Statistics: Store Entries : 52 Maximum Swap Size : 8388608 KB Current Store Swap Size: 8387184.00 KB Current Capacity : 99.98% used, 0.02% free Store Directory #0 (rock): /var/cache/squid/mem/ FS Block Size 1024 Bytes Maximum Size: 8388608 KB Current Size: 8387184.00 KB 99.98% Maximum entries:262143 Current entries:262099 99.98% Pending operations: 1 out of 0 Flags: } by kid5 Thanks! Alex 2013/7/5 Amos Jeffries squ...@treenet.co.nz: On 5/07/2013 3:33 a.m., Alexandre Chappaz wrote: Hi, I have this object not being cached, and I can't understand why. Lets start with... how are you identifying that it is not being cached? http://download.cdn.mozilla.net/pub/mozilla.org/firefox/releases/22.0/update/win32/fr/firefox-22.0.complete.mar redbot.org confirms this is a cacheable resource with no protocol problems visible. I have this cachedir set for objects of size 128Ko : cache_dir aufs /var/cache/squid/W${process_number} 9000 16 256 min-size=131072 SMP macros in use I see. How many workers do you have? Also, what *other* size limits on object sizes are in your configuration file? please list those *and* all cache_dir lines in your configuration file in exactly the order they appear in the config. the headers of the object : HTTP/1.1 200 OK Last-Modified: Tue, 18 Jun 2013 15:38:37 GMT ETag: dcfc8c-19e4648-4df6f81aff940 Server: Apache X-Backend-Server: ftp3.dmz.scl3.mozilla.com Content-Type: application/octet-stream Accept-Ranges: bytes Access-Control-Allow-Origin: * X-Cache-Info: caching Content-Length: 27149896 Cache-Control: max-age=266561 Expires: Sat, 06 Jul 2013 18:26:03 GMT Date: Wed, 03 Jul 2013 16:23:22 GMT the storedir is full, but I understand that since the object is requested very often, it should replace anotherone in the cachedir. (cache_replacement_policy heap LFUDA ) You say *the storedir* ... but there are multiple store directories yes? one for each Squid worker process. Do you have any hint on how to make sure th object gets cached? Thanks More info needed. Please also list your refresh_pattern rules. Amos
[squid-users] object not being cached
Hi, I have this object not being cached, and I can't understand why. http://download.cdn.mozilla.net/pub/mozilla.org/firefox/releases/22.0/update/win32/fr/firefox-22.0.complete.mar I have this cachedir set for objects of size 128Ko : cache_dir aufs /var/cache/squid/W${process_number} 9000 16 256 min-size=131072 the headers of the object : HTTP/1.1 200 OK Last-Modified: Tue, 18 Jun 2013 15:38:37 GMT ETag: dcfc8c-19e4648-4df6f81aff940 Server: Apache X-Backend-Server: ftp3.dmz.scl3.mozilla.com Content-Type: application/octet-stream Accept-Ranges: bytes Access-Control-Allow-Origin: * X-Cache-Info: caching Content-Length: 27149896 Cache-Control: max-age=266561 Expires: Sat, 06 Jul 2013 18:26:03 GMT Date: Wed, 03 Jul 2013 16:23:22 GMT the storedir is full, but I understand that since the object is requested very often, it should replace anotherone in the cachedir. (cache_replacement_policy heap LFUDA ) Do you have any hint on how to make sure th object gets cached? Thanks
[squid-users] désolé de vous avoir spammé
sorry for spamming you... desolé de vous avoir spammé here is the video that should explains the origin of the word SPAM Pour vous consoler : l'origine du mot spam viendrait d'ici ( merci Luc) http://www.youtube.com/watch?v=anwy2MPT5REfeature=youtube_gdata_player Alex
Re: [squid-users] Denied pages for HTTPS requests
Hi, browsers are not reacting as you expect with a redirection after a https ( request with method CONNECT ). They do not follow the redirection. 2013/5/14 FredB fredbm...@free.fr: It depends... are these reverse-proxy https_port requests? intercepted https_port requests? intercepted and ssl-bumped https_port requests? ssl-bumped CONNECT requests? or just regular CONNECT requests? Amos Just regular CONNECT requests, and basic acl, nothing more Thanks
[squid-users] Re: assertion failed
Hi, can anyone explain to me the meaning/reason of this assertion : src/fs/ufs/ufscommon.cc l 706 : .. assert(sde); .. got the backtrace out : (gdb) bt #0 0x2ba9da45d265 in raise () from /lib64/libc.so.6 #1 0x2ba9da45ed10 in abort () from /lib64/libc.so.6 #2 0x0050ae66 in xassert (msg=0x72992f sde, file=0x729918 ufs/ufscommon.cc, line=706) at debug.cc:567 #3 0x00669c18 in RebuildState::undoAdd (this=value optimized out) at ufs/ufscommon.cc:706 #4 0x0066b7f4 in RebuildState::rebuildFromSwapLog (this=0x16090668) at ufs/ufscommon.cc:570 #5 0x0066bed7 in RebuildState::rebuildStep (this=0x16090668) at ufs/ufscommon.cc:411 #6 0x0066c099 in RebuildState::RebuildStep (data=0x366c) at ufs/ufscommon.cc:384 #7 0x0064ac68 in AsyncCallQueue::fireNext (this=value optimized out) at AsyncCallQueue.cc:54 #8 0x0064adc9 in AsyncCallQueue::fire (this=0x366c) at AsyncCallQueue.cc:40 #9 0x00526fa1 in EventLoop::dispatchCalls (this=value optimized out) at EventLoop.cc:154 #10 0x005271a1 in EventLoop::runOnce (this=0x74ac93f0) at EventLoop.cc:119 #11 0x00527338 in EventLoop::run (this=0x74ac93f0) at EventLoop.cc:95 #12 0x005911b3 in SquidMain (argc=value optimized out, argv=value optimized out) at main.cc:1501 #13 0x00591443 in SquidMainSafe (argc=13932, argv=0x366c) at main.cc:1216 #14 0x2ba9da44a994 in __libc_start_main () from /lib64/libc.so.6 Thank you Alex 2013/4/18 Alexandre Chappaz alexandrechap...@gmail.com: sorry, I meant One kid fails to start giving the following assertion 2013/4/18 Alexandre Chappaz alexandrechap...@gmail.com: Hi, In our SMP enabled environnement, I have one kid to start giving the fooloowing assertion : 2013/04/18 04:03:43 kid1| assertion failed: ufs/ufscommon.cc:706: sde I guess it is something related with the store / store rebuiding. Maybe a malformed object in the cache store? here the part of the log : 2013/04/18 04:03:42 kid1| Store rebuilding is 5.57% complete 2013/04/18 04:03:42 kid1| Done reading /var/cache/squid/W1 swaplog (18735 entries) 2013/04/18 04:03:43 kid1| Accepting SNMP messages on 0.0.0.0:3401 2013/04/18 04:03:43 kid1| Accepting HTTP Socket connections at local=0.0.0.0:3128 remote=[::] FD 12 flags=1 2013/04/18 04:03:43 kid1| assertion failed: ufs/ufscommon.cc:706: sde core file is generated, but it seems to be not valid : gdb says : gdb /usr/local/squid/sbin/squid 004/core.758 GNU gdb (GDB) Red Hat Enterprise Linux (7.0.1-32.el5_6.2) Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type show copying and show warranty for details. This GDB was configured as x86_64-redhat-linux-gnu. For bug reporting instructions, please see: http://www.gnu.org/software/gdb/bugs/... Reading symbols from /usr/local/squid/sbin/squid...done. Attaching to program: /usr/local/squid/sbin/squid, process 4 ptrace: Opération non permise. BFD: Warning: /root/004/core.758 is truncated: expected core file size = 58822656, found: 20480. Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Failed to read a valid object file image from memory. Core was generated by `(squid-1) -S -f /etc/squid/squid.conf'. Program terminated with signal 6, Aborted. #0 0x2b6babe7a265 in ?? () (gdb) bt Cannot access memory at address 0x7fff38b1cf98 (gdb) quit Any clue on how to get a usable core file and/or on the meaning of the assertion ? Thanks Alex
[squid-users] assertion failed
Hi, In our SMP enabled environnement, I have one kid to start giving the fooloowing assertion : 2013/04/18 04:03:43 kid1| assertion failed: ufs/ufscommon.cc:706: sde I guess it is something related with the store / store rebuiding. Maybe a malformed object in the cache store? here the part of the log : 2013/04/18 04:03:42 kid1| Store rebuilding is 5.57% complete 2013/04/18 04:03:42 kid1| Done reading /var/cache/squid/W1 swaplog (18735 entries) 2013/04/18 04:03:43 kid1| Accepting SNMP messages on 0.0.0.0:3401 2013/04/18 04:03:43 kid1| Accepting HTTP Socket connections at local=0.0.0.0:3128 remote=[::] FD 12 flags=1 2013/04/18 04:03:43 kid1| assertion failed: ufs/ufscommon.cc:706: sde core file is generated, but it seems to be not valid : gdb says : gdb /usr/local/squid/sbin/squid 004/core.758 GNU gdb (GDB) Red Hat Enterprise Linux (7.0.1-32.el5_6.2) Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type show copying and show warranty for details. This GDB was configured as x86_64-redhat-linux-gnu. For bug reporting instructions, please see: http://www.gnu.org/software/gdb/bugs/... Reading symbols from /usr/local/squid/sbin/squid...done. Attaching to program: /usr/local/squid/sbin/squid, process 4 ptrace: Opération non permise. BFD: Warning: /root/004/core.758 is truncated: expected core file size = 58822656, found: 20480. Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Failed to read a valid object file image from memory. Core was generated by `(squid-1) -S -f /etc/squid/squid.conf'. Program terminated with signal 6, Aborted. #0 0x2b6babe7a265 in ?? () (gdb) bt Cannot access memory at address 0x7fff38b1cf98 (gdb) quit Any clue on how to get a usable core file and/or on the meaning of the assertion ? Thanks Alex
[squid-users] Re: assertion failed
sorry, I meant One kid fails to start giving the following assertion 2013/4/18 Alexandre Chappaz alexandrechap...@gmail.com: Hi, In our SMP enabled environnement, I have one kid to start giving the fooloowing assertion : 2013/04/18 04:03:43 kid1| assertion failed: ufs/ufscommon.cc:706: sde I guess it is something related with the store / store rebuiding. Maybe a malformed object in the cache store? here the part of the log : 2013/04/18 04:03:42 kid1| Store rebuilding is 5.57% complete 2013/04/18 04:03:42 kid1| Done reading /var/cache/squid/W1 swaplog (18735 entries) 2013/04/18 04:03:43 kid1| Accepting SNMP messages on 0.0.0.0:3401 2013/04/18 04:03:43 kid1| Accepting HTTP Socket connections at local=0.0.0.0:3128 remote=[::] FD 12 flags=1 2013/04/18 04:03:43 kid1| assertion failed: ufs/ufscommon.cc:706: sde core file is generated, but it seems to be not valid : gdb says : gdb /usr/local/squid/sbin/squid 004/core.758 GNU gdb (GDB) Red Hat Enterprise Linux (7.0.1-32.el5_6.2) Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type show copying and show warranty for details. This GDB was configured as x86_64-redhat-linux-gnu. For bug reporting instructions, please see: http://www.gnu.org/software/gdb/bugs/... Reading symbols from /usr/local/squid/sbin/squid...done. Attaching to program: /usr/local/squid/sbin/squid, process 4 ptrace: Opération non permise. BFD: Warning: /root/004/core.758 is truncated: expected core file size = 58822656, found: 20480. Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Failed to read a valid object file image from memory. Core was generated by `(squid-1) -S -f /etc/squid/squid.conf'. Program terminated with signal 6, Aborted. #0 0x2b6babe7a265 in ?? () (gdb) bt Cannot access memory at address 0x7fff38b1cf98 (gdb) quit Any clue on how to get a usable core file and/or on the meaning of the assertion ? Thanks Alex
Re: [squid-users] high traffic with google
Thanks, what do you mean by adding some headers? Regards Alex 2013/4/12 Eliezer Croitoru elie...@ngtech.co.il: I suggest you to contact squid and adding some headers will might help in this case. Regards, Eliezer - Original Message - From: Alexandre Chappaz alexandrechap...@gmail.com To: squid-users@squid-cache.org Sent: Thursday, April 11, 2013 6:38:04 PM Subject: [squid-users] high traffic with google Hi, we are handling a rather large network ( ~140Kusers ) and we use one unique public IP address for internet traffic. This lead google to get suspicious with us ( captcha with each search ) Do you know if google can whitelist us in some way? where to contact them? any way to smartly bypass this behavior? Thanks Alex
[squid-users] high traffic with google
Hi, we are handling a rather large network ( ~140Kusers ) and we use one unique public IP address for internet traffic. This lead google to get suspicious with us ( captcha with each search ) Do you know if google can whitelist us in some way? where to contact them? any way to smartly bypass this behavior? Thanks Alex
Re: [squid-users] investigate squid eating 100% CPU
Hi, you can activate the full debug launch squid -k debug with the service running, and check what comes in the cache.log. squid -k parse will audit your config file. Look for WARNING in the output of this command. the cachemanager can be usefull to see the actual activity of your squid : squidclient localhost mgr:5min gives you the last 5 min stats. (see if the n° of req/s is coherent with what you expect ) Bonne chance Alex 2013/3/26 Youssef Ghorbal d...@pasteur.fr: Hello, We have a Squid 3.1.23 running on a FreeBSD 8.3 (amd64) The proxy is used to handle web access for ~2500 workstations and in pure proxy/filter (squidGaurd) mode with no cache (all disk caching is disabled) It's not a tranparent/intercepting proxy, just a plain explicit proxy mode. What we see, is that the squid process is using 100% of CPU (userland CPU usage, not kernel) all the time. Even in late night when the whole traffic is very minimalistic. What I'm looking for is some advice on how to track down what is causing this CPU misbehaviour. Maybe it's some stupid config option not suitable for this kind of setup, maybe a bug etc. What would be the tools/methodology that I can use to profile the running process. Any help/suggestion would be really appreciated. Youssef Ghorbal squid -v Squid Cache: Version 3.1.23 configure options: '--with-default-user=squid' '--bindir=/usr/local/sbin' '--sbindir=/usr/local/sbin' '--datadir=/usr/local/etc/squid' '--libexecdir=/usr/local/libexec/squid' '--localstatedir=/var/squid' '--sysconfdir=/usr/local/etc/squid' '--with-logdir=/var/log/squid' '--with-pidfile=/var/run/squid/squid.pid' '--enable-removal-policies=lru heap' '--disable-linux-netfilter' '--disable-linux-tproxy' '--disable-epoll' '--disable-translation' '--disable-ecap' '--disable-loadable-modules' '--enable-auth=basic digest negotiate ntlm' '--enable-basic-auth-helpers=DB NCSA PAM MSNT SMB squid_radius_auth LDAP YP' '--enable-digest-auth-helpers=password ldap' '--enable-external-acl-helpers=ip_user session unix_group wbinfo_group ldap_group' '--enable-ntlm-auth-helpers=smb_lm' '--enable-storeio=ufs diskd aufs' '--enable-disk-io=AIO Blocking DiskDaemon DiskThreads' '--enable-delay-pools' '--enable-icap-client' '--enable-kqueue' '--with-large-files' '--enable-stacktraces' '--disable-optimizations' '--prefix=/usr/local' '--mandir=/usr/local/man' '--infodir=/usr/local/info/' '--build=amd64-portbld-freebsd8.3' 'build_alias=amd64-portbld-freebsd8.3' 'CC=cc' 'CFLAGS=-pipe -I/usr/local/include -g -g -DLDAP_DEPRECATED' 'LDFLAGS= -L/usr/local/lib' 'CPPFLAGS=' 'CXX=c++' 'CXXFLAGS=-pipe -I/usr/local/include -g -g -DLDAP_DEPRECATED' 'CPP=cpp' --with-squid=/wrkdirs/usr/ports/www/squid31/work/squid-3.1.23 --enable-ltdl-convenience
Re: [squid-users] rock squid -k reconfigure
Hi, investigating on this issue, it appears that the problem comes from the disker ID in the SwapDir object. Added these debug lines in SwapDir::active() ... // we are inside a disker dedicated to this disk debugs(3,1,SwapDir::active :: KidIdentifier = KidIdentifier disker =disker . ); if (KidIdentifier == disker) return true; it appears that the disker is wrong after running a squid -k reconfigure, and hence the active() function returns false. with a fresh start : 2013/03/22 11:30:29 kid3| SwapDir::active :: KidIdentifier = 3disker = 2. 2013/03/22 11:30:29 kid3| SwapDir::active :: KidIdentifier = 3disker = 2. 2013/03/22 11:30:29 kid2| SwapDir::active :: KidIdentifier = 2disker = 2. 2013/03/22 11:30:29 kid2| SwapDir::active :: KidIdentifier = 2disker = 2. 2013/03/22 11:30:30 kid3| SwapDir::active :: KidIdentifier = 3disker = 2. 2013/03/22 11:30:30 kid3| SwapDir::active :: KidIdentifier = 3disker = 2. 2013/03/22 11:30:30 kid2| SwapDir::active :: KidIdentifier = 2disker = 2. 2013/03/22 11:30:30 kid2| SwapDir::active :: KidIdentifier = 2disker = 2. with [root@tv alex]# ps aux|grep squid root 20320 0.0 0.0 1182724 2096 ?Ss 11:30 0:00 squid -f /etc/squid/squid.conf proxy20322 0.1 0.2 1183196 11220 ? S11:30 0:00 (squid-coord-3) -f /etc/squid/squid.conf proxy20323 0.0 0.2 1184180 11640 ? S11:30 0:00 (squid-disk-2) -f /etc/squid/squid.conf proxy20324 0.0 0.2 1188276 11484 ? S11:30 0:00 (squid-1) -f /etc/squid/squid.conf after issuing the squid -k reconfigure, the output of the ps is identical, but the diskerID is set to 3. 2013/03/22 11:31:46 kid3| SwapDir::active :: KidIdentifier = 3disker = 3. 2013/03/22 11:31:46 kid2| SwapDir::active :: KidIdentifier = 2disker = 3. 2013/03/22 11:31:46 kid2| SwapDir::active :: KidIdentifier = 2disker = 3. 2013/03/22 11:31:47 kid3| SwapDir::active :: KidIdentifier = 3disker = 3. 2013/03/22 11:31:47 kid3| SwapDir::active :: KidIdentifier = 3disker = 3. 2013/03/22 11:31:47 kid2| SwapDir::active :: KidIdentifier = 2disker = 3. 2013/03/22 11:31:47 kid2| SwapDir::active :: KidIdentifier = 2disker = 3. Trying to trace the problem futher, the disker ID seems to be given in the contructor of the SwapDir, SwapDir::SwapDir(char const *aType): theType(aType), max_size(0), min_objsize(0), max_objsize (-1), path(NULL), index(-1), disker(-1), repl(NULL), removals(0), scanned(0), cleanLog(NULL) { fs.blksize = 1024; } Any hints on where is the right call for creation ( or re-creation ) of this object after a reconfigure? Thanks Alex 2013/3/18 Alex Rousskov rouss...@measurement-factory.com: On 03/18/2013 09:18 AM, Alexandre Chappaz wrote: Hi, Im am using squid 3.2.8-20130304-r11795 with SMP a rock dir configured. After a fresh start, cachemanager:storedir reports : by kid5 { Store Directory Statistics: Store Entries : 52 Maximum Swap Size : 8388608 KB Current Store Swap Size: 28176.00 KB Current Capacity : 0.34% used, 99.66% free Store Directory #0 (rock): /var/cache/squid/mem/ FS Block Size 1024 Bytes Maximum Size: 8388608 KB Current Size: 28176.00 KB 0.34% Maximum entries:262143 Current entries: 880 0.34% Pending operations: 1 out of 0 Flags: } by kid5 for the rock cache_dir. After a squid -k reconfigure, without any change in the squid.conf, the cachemanager is reporting this : by kid5 { Store Directory Statistics: Store Entries : 52 Maximum Swap Size : 0 KB Current Store Swap Size: 0.00 KB Current Capacity : 0.00% used, 0.00% free } by kid5 Is this only a problem with the reporting? Is the rock cachedir still in use after the reconfigure / is there a way to check if it is still in use? Please see Bug 3774. It may be related to your problem. http://bugs.squid-cache.org/show_bug.cgi?id=3774 Alex.
Re: [squid-users] squid/SMP
Hi, there is also one important directory where squid stores the .pid file and one .ipc file for each process, typically /var/run/squid/. make sure this directory is writable by the user set for squid. Regards Alex 2013/3/21 Adam W. Dace colonelforbi...@gmail.com: I had this exact problem on a different platform, Mac OS X. You probably want to use sysctl to increase the OS-default limits on Unix Domain Sockets. They're mentioned at the bottom of the squid Wiki page here: http://wiki.squid-cache.org/Features/SmpScale Please mail the list if you don't mind once you try that, I then ran into a different problem but most likely FreeBSD isn't affected. Regards, On Thu, Mar 21, 2013 at 5:52 AM, Eugene M. Zheganin e...@norma.perm.ru wrote: Hi. I'm using squid 3.2.6 on a FreeBSD and today I tried to use it's SMP feature. I've added 'workers 2' in it's configuration file, checked the permission on localstatedir and ran it. I got on start FATAL: kid2 registration timed out and then looks like coordinator started to try to restart kids, but unsuccessfully. Obviously, no client requests were served at that time. I checked the localstatedir and saw 3 sockets, one from coordinator and two from kids - so I'm sure permissions are ok. What can I do to debug this feature ? I understand 3.2.x is no longer supported and I need to use 3.3.x, but right now I'm stuck to FreeBSD ports on my production, and there's no 3.3.[ in it yet; will try to build 3.3.[ realease on a test machine. Thanks. Eugene. -- Adam W. Dace colonelforbi...@gmail.com Phone: (815) 355-5848 Instant Messenger: AIM Yahoo! IM - colonelforbin74 | ICQ - #39374451 Microsoft Messenger - colonelforbi...@live.com Google Profile: http://www.google.com/profiles/ColonelForbin74
[squid-users] rock squid -k reconfigure
Hi, Im am using squid 3.2.8-20130304-r11795 with SMP a rock dir configured. After a fresh start, cachemanager:storedir reports : by kid5 { Store Directory Statistics: Store Entries : 52 Maximum Swap Size : 8388608 KB Current Store Swap Size: 28176.00 KB Current Capacity : 0.34% used, 99.66% free Store Directory #0 (rock): /var/cache/squid/mem/ FS Block Size 1024 Bytes Maximum Size: 8388608 KB Current Size: 28176.00 KB 0.34% Maximum entries:262143 Current entries: 880 0.34% Pending operations: 1 out of 0 Flags: } by kid5 for the rock cache_dir. After a squid -k reconfigure, without any change in the squid.conf, the cachemanager is reporting this : by kid5 { Store Directory Statistics: Store Entries : 52 Maximum Swap Size : 0 KB Current Store Swap Size: 0.00 KB Current Capacity : 0.00% used, 0.00% free } by kid5 Is this only a problem with the reporting? Is the rock cachedir still in use after the reconfigure / is there a way to check if it is still in use? Thank you Alex
Re: [squid-users] Re: Squid 3.3.2 SMP Problem
Hi, which OS do you recommend for running SMP enabled version of squid? Is there a particular kernel version to use or not use? Do you have more specific tuning settings for shm, IPC and UDS sockets, other than the hints from http://wiki.squid-cache.org/Features/SmpScale#Troubleshooting Regards Alex 2013/3/15 Ahmad ahmed.za...@netstream.ps: hi all , ive added in my squid.conf the config of smp , im using squid 3.3.3 , but my question is , how to monitoe the performace and make sure if my other idle cores are being used ?? here is what i modified : smp options### # Custom options memory_cache_shared off #workers 2 # workers 4 cache_dir rock /squid-cache/rock-1 3000 max-size=31000 max-swap-rate=250 swap-timeout=350 cache_dir rock /squid-cache/rock-2 3000 max-size=31000 max-swap-rate=250 swap-timeout=350 = also i want to ask about another issue , does using smp can make delay when starting squid ? i mean that rebuildig process take more time when using smp ??!! wish to help regards -- View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/Squid-3-3-2-SMP-Problem-tp4658906p4659000.html Sent from the Squid - Users mailing list archive at Nabble.com.
Re: [squid-users] sharepoint pinning issue?
Hi, I have found some time to go further in the investigation. And here is status right now. the behavior is the some with only 1 squid ( no upstream server ), and is also the same if I use squid as a reverse proxy for the Sharepoint server. As read is some threads about this subject, depending ont the browser / OS, behaviour differes. IE in XP works perfectly, whereas FF in XP or linux asks for authentification in a loop whenever trying to upload a relatively big file to the server. Activating the debug level and trying to analyse the headers of the packets gave me quite some headache! What we can see is that the HTTP headers and techniques for POSTing files used are totally differents between browser. I would love some help on analysing these logs. Joined are 2 files : capture_IE_XP : upload of a file works capture_FF_XP : upload of a file does not I can provide access to the sharepoint server reverse proxy if someone has time to jump in. Best regards Alex 2013/2/13 Amos Jeffries squ...@treenet.co.nz: On 13/02/2013 3:49 a.m., Alexandre Chappaz wrote: Hi, I know this is a subject that has been put on the table many times, but I wanted to share with you my experience with squid + sharepoint. Squid Cache: Version 3.2.7-20130211-r11781 I am having an issue with autehtication : when accessing the sharepoint server, I do get a login/pw popup, I can login and see some of the pages behind, but when doing some operation, even though I am supposed to be logged in, the autentcation popup comes back. Here is what I find the the access log : 1360679927.561 43 X.X.X.X TCP_MISS/200 652 GET http://saralex.hd.free.fr/_layouts/images/selbg.png - FIRSTUP_PARENT/192.168.100.XX image/png URL #1. No authentication required. non-pinned connection used. 1360679928.543 37 X.X.X.X TCP_MISS/401 542 GET http://saralex.hd.free.fr/_layouts/listform.aspx? - PINNED/192.168.100.XX - URL #2. Sent to upstream on already authenticated+PINNED connection. Upstream server requires further authentication details. -- authentication challenge? 1360679928.665 58 X.X.X.X TCP_MISS/401 795 GET http://saralex.hd.free.fr/_layouts/listform.aspx? - PINNED/192.168.100.XX - URL #2 repeated. Sent to upstream on already authenticated+PINNED connection. Upstream server requires further authentication details. -- possibly authentication handshake request? 1360679928.753229 X.X.X.X TCP_MISS/200 20625 GET http://saralex.hd.free.fr/_layouts/images/fgimg.png - FIRSTUP_PARENT/192.168.100.XX image/png URL #3. No authentication required. non-pinned connection used. 1360679928.788 68 X.X.X.X TCP_MISS/302 891 GET http://saralex.hd.free.fr/_layouts/listform.aspx? - PINNED/192.168.100.XX text/html URL #2 repeated. Sent to upstream on already authenticated+PINNED connection. Upstream server redirectes the client to another URL. -- authentication credentials accepted. 1360679928.921 45 X.X.X.X TCP_MISS/401 542 GET http://saralex.hd.free.fr/Lists/Tasks/NewForm.aspx? - PINNED/192.168.100.XX - URL #4. Sent to upstream on already authenticated+PINNED connection. Upstream server requires further authentication details. -- authentication challenge? 1360679929.019 47 X.X.X.X TCP_MISS/401 795 GET http://saralex.hd.free.fr/Lists/Tasks/NewForm.aspx? - PINNED/192.168.100.XX - URL #4 repeated. Sent to upstream on already authenticated+PINNED connection. Upstream server requires further authentication details. -- possibly authentication handshake request? 1360679929.656 81 X.X.X.X TCP_MISS/200 1986 GET http://saralex.hd.free.fr/_layouts/images/loadingcirclests16.gif - FIRSTUP_PARENT/192.168.100.XX image/gif URL #5. no authentication required. non-pinned connection used. 1360679930.417 1322 X.X.X.X TCP_MISS/200 130496 GET http://saralex.hd.free.fr/Lists/Tasks/NewForm.aspx? - PINNED/192.168.100.XX text/html URL #4 repeated. Sent to upstream on already authenticated+PINNED connection. Upstream server provides the display response. -- authentication credentials accepted. 1360679934.618 53 X.X.X.X TCP_MISS/401 542 GET http://saralex.hd.free.fr/_layouts/iframe.aspx? - PINNED/192.168.100.XX - 1360679934.729 51 X.X.X.X TCP_MISS/401 795 GET http://saralex.hd.free.fr/_layouts/iframe.aspx? - PINNED/192.168.100.XX - could this be a pinning issue? Is V2.7 STABLE managing these things in a nicer way? Unknown. But I doubt it. This is Squid using a PINNED connection to relay traffic to an upstream server. That upstream server is rejecting the clients delivered credentials after each object. There is no sign of proxy authentication taking place, this re-challenge business is all between client and upstream server. You need to look at whether these connections are being pinned then closed, and why that is happening. Squid-3.2 offers debug level 11,2 which will give you a trace of the HTTP headers to see if the close is a normal
[squid-users] logformat emulate_httpd_log
Hi, I am looking for some precision on the %st in the log format directive. with squid 2.6, I used to set emulate_httpd_log on In order to have the useragent and referer I commented this line out and used instead the combined format as defined here : logformat combined %a %[ui %[un [%tl] %rm %ru HTTP/%rv %Hs %st %{Referer}h %{User-Agent}h %Ss:%Sh This is messing up with the scripts I have for parsing the logfiles in the sense that %Hs and %st now report '-' character when I was expecting a '0' with the emulate_httpd_log on. Is there a way to turn these 2 fields back to the emulate_httpd_log behavior? Regards Alex
[squid-users] assertion failed
Hi, My squid 3.2.2 - R is failing after a reconfigure. Not using SMP. here is what I find in the logs : 2012/10/24 14:54:42 kid1| assertion failed: comm.cc:163: !fd_table[conn-fd].closing() 2012/10/24 14:58:29 kid1| StoreEntry-ping_status: 2 2012/10/24 14:58:29 kid1| StoreEntry-store_status: 1 2012/10/24 14:58:29 kid1| StoreEntry-swap_status: 0 2012/10/24 14:58:29 kid1| assertion failed: store.cc:1854: isEmpty() 2012/10/24 14:58:33 kid1| Starting Squid Cache version 3.2.2-20121011-r11676 for x86_64-unknown-linux-gnu... 2012/10/24 14:58:33 kid1| Process ID 569 2012/10/24 14:58:33 kid1| Process Roles: worker 2012/10/24 14:58:33 kid1| With 65535 file descriptors available 2012/10/24 14:58:33 kid1| Initializing IP Cache... 2012/10/24 14:58:33 kid1| DNS Socket created at 0.0.0.0, FD 11 2012/10/24 14:58:33 kid1| Adding nameserver 194.2.0.20 from /etc/resolv.conf 2012/10/24 14:58:33 kid1| Adding nameserver 194.2.0.50 from /etc/resolv.conf 2012/10/24 14:58:33 kid1| Adding domain d097.cp from /etc/resolv.conf 2012/10/24 14:58:33 kid1| helperOpenServers: Starting 10/1000 'squidGuard' processes 2012/10/24 14:58:33 kid1| Logfile: opening log stdio:/var/log/squid/access.log 2012/10/24 14:58:33 kid1| Logfile: opening log stdio:/var/log/squid/pirates_XFF.log 2012/10/24 14:58:33 kid1| Logfile: opening log stdio:/var/log/squid/pirates_VIA.log 2012/10/24 14:58:33 kid1| Store logging disabled 2012/10/24 14:58:33 kid1| Swap maxSize 23019520 + 2097152 KB, estimated 1932051 objects 2012/10/24 14:58:33 kid1| Target number of buckets: 96602 2012/10/24 14:58:33 kid1| Using 131072 Store buckets 2012/10/24 14:58:33 kid1| Max Mem size: 2097152 KB 2012/10/24 14:58:33 kid1| Max Swap size: 23019520 KB 2012/10/24 14:58:33 kid1| Rebuilding storage in /var/cache/squid-mem (dirty log) 2012/10/24 14:58:33 kid1| Rebuilding storage in /var/cache/squid (dirty log) 2012/10/24 14:58:33 kid1| Using Least Load store dir selection 2012/10/24 14:58:33 kid1| Set Current Directory to /var/cache/squid 2012/10/24 14:58:33 kid1| Loaded Icons. 2012/10/24 14:58:33 kid1| HTCP Disabled. 2012/10/24 14:58:33 kid1| Sending SNMP messages from 0.0.0.0:3401 2012/10/24 14:58:33 kid1| Configuring Parent proxyav.bercy.cp/3128/0 2012/10/24 14:58:33 kid1| Squid plugin modules loaded: 0 2012/10/24 14:58:33 kid1| Accepting HTTP Socket connections at local=0.0.0.0:3128 remote=[::] FD 39 flags=9 2012/10/24 14:58:33 kid1| Accepting ICP messages on 0.0.0.0:3130 2012/10/24 14:58:33 kid1| Sending ICP messages from 0.0.0.0:3130 2012/10/24 14:58:33 kid1| Accepting SNMP messages on 0.0.0.0:3401 2012/10/24 14:58:33 kid1| Store rebuilding is 0.62% complete 2012/10/24 14:58:33 kid1| Done reading /var/cache/squid swaplog (57155 entries) 2012/10/24 14:58:34 kid1| WARNING: HTTP header contains NULL characters {Accept: */*^M Content-Type: application/x-www-form-urlencoded} NULL {Accept: */*^M Content-Type: application/x-www-form-urlencoded 2012/10/24 14:58:34 kid1| Starting new redirector helpers... 2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000 'squidGuard' processes 2012/10/24 14:58:34 kid1| Starting new redirector helpers... 2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000 'squidGuard' processes 2012/10/24 14:58:34 kid1| Starting new redirector helpers... 2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000 'squidGuard' processes 2012/10/24 14:58:34 kid1| Starting new redirector helpers... 2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000 'squidGuard' processes 2012/10/24 14:58:34 kid1| Starting new redirector helpers... 2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000 'squidGuard' processes 2012/10/24 14:58:34 kid1| Starting new redirector helpers... 2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000 'squidGuard' processes 2012/10/24 14:58:34 kid1| Starting new redirector helpers... 2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000 'squidGuard' processes 2012/10/24 14:58:34 kid1| Starting new redirector helpers... 2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000 'squidGuard' processes 2012/10/24 14:58:34 kid1| Starting new redirector helpers... 2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000 'squidGuard' processes 2012/10/24 14:58:37 kid1| Done reading /var/cache/squid-mem swaplog (648235 entries) 2012/10/24 14:58:37 kid1| Finished rebuilding storage from disk. 2012/10/24 14:58:37 kid1|435593 Entries scanned 2012/10/24 14:58:37 kid1| 1 Invalid entries. 2012/10/24 14:58:37 kid1| 0 With invalid flags. 2012/10/24 14:58:37 kid1|165731 Objects loaded. 2012/10/24 14:58:37 kid1| 0 Objects expired. 2012/10/24 14:58:37 kid1|268805 Objects cancelled. 2012/10/24 14:58:37 kid1| 912 Duplicate URLs purged. 2012/10/24 14:58:37 kid1| 145 Swapfile clashes avoided. 2012/10/24 14:58:37 kid1| Took 4.08 seconds (40609.22 objects/sec). 2012/10/24 14:58:37 kid1| Beginning Validation Procedure 2012/10/24 14:58:37 kid1|
[squid-users] NTLM passthu
Hi, since upgrade from 3.1.20 to 3.2.1, we are facing a problem regarding access to a IIS server with authentication : the popup asking for credentials keeps poping out and make the browsing impossibe. I observed the same behavior with latest 3.2.2 version (r11676 ). On the contrary, using 3.1.20 and same config, everything is fine. Is this a regression? Shoudl I file a bug? Thanks Alex
Re: [squid-users] NTLM passthu
Yes I have seen this bug and applied the patch right now. with patch applied, behavior is a bit different : after asking for credentials, I get a connexion reset. and from access log : 1349962782.169 9 10.XXX.XXX.XXX TCP_MISS/401 436 GET http://www.si-diamant.fr/ - HIER_DIRECT/94.124.232.64 - 2012/10/11 Wolfgang Breyha wbre...@gmx.net: Alexandre Chappaz wrote, on 11.10.2012 14:45: Is this a regression? Shoudl I file a bug? There already is a bug and a proposed fix http://bugs.squid-cache.org/show_bug.cgi?id=3655 Greetings, Wolfgang -- Wolfgang Breyha wbre...@gmx.net | http://www.blafasel.at/ Vienna University Computer Center | Austria
Re: [squid-users] NTLM passthu
Applied the patch on both 3.2.1 and 3.2.2 . Same result. I'll post on your bug report. In the meantime, is there some additional info that could help to debug? 2012/10/11 Wolfgang Breyha wbre...@gmx.net: Alexandre Chappaz wrote, on 11.10.2012 15:42: Yes I have seen this bug and applied the patch right now. with patch applied, behavior is a bit different : after asking for credentials, I get a connexion reset. Did you use 3.2.2 or 3.2.1? My patch is for 3.2.1. Don't know if it still works on 3.2.2. If it doesn't work on 3.2.1 either it's bad because this is not trivial to debug. Maybe you want to comment on my bugreport that my patch doesn't fix it for you. Greetings, Wolfgang -- Wolfgang Breyha wbre...@gmx.net | http://www.blafasel.at/ Vienna University Computer Center | Austria
Re: [squid-users] NTLM passthu
Hi, In fact I made a wrong manipulation while appling the patch. When applied correctly, the provided patch does fix the pinning problem and the authentaction to IIS works. thanks Alex 2012/10/11 Wolfgang Breyha wbre...@gmx.net: Alexandre Chappaz wrote, on 11.10.2012 15:57: Applied the patch on both 3.2.1 and 3.2.2 . Same result. I'll post on your bug report. In the meantime, is there some additional info that could help to debug? At least I can't help in this matter because my knowledge about squid source code is still very limited. I thought I understood all the stuff about pinning and ntlm/negotiate passthrough. It was enough to fix our troubles, but obviously not to fix yours;-) I currently do not have the spare time to debug any further. Sorry. Greetings, Wolfgang -- Wolfgang Breyha wbre...@gmx.net | http://www.blafasel.at/ Vienna University Computer Center | Austria
[squid-users] squid 3.2.1 : assertion failed on reconfigure
Hi, I am having a frequent issue since upgrade to squid 3.2.1-20120817-r11648 only one worker configured. frequently dies with the following message in cache.log Says report this, so reporting I am! 2012/10/08 14:02:01 kid1| Could not parse headers from on disk object 2012/10/08 14:02:01 kid1| WARNING: An error inside Squid has caused an HTTP reply without Date:. Please report this: 2012/10/08 14:02:01 kid1| StoreEntry-key: DAAE3F7903C505691D3DBAF0C7764E53 2012/10/08 14:02:01 kid1| StoreEntry-next: 0x1d74118 2012/10/08 14:02:01 kid1| StoreEntry-mem_obj: 0x4c9eba0 2012/10/08 14:02:01 kid1| StoreEntry-timestamp: -1 2012/10/08 14:02:01 kid1| StoreEntry-lastref: 1349697721 2012/10/08 14:02:01 kid1| StoreEntry-expires: -1 2012/10/08 14:02:01 kid1| StoreEntry-lastmod: -1 2012/10/08 14:02:01 kid1| StoreEntry-swap_file_sz: 0 2012/10/08 14:02:01 kid1| StoreEntry-refcount: 1 2012/10/08 14:02:01 kid1| StoreEntry-flags: CACHABLE,DISPATCHED,PRIVATE,FWD_HDR_WAIT,VALIDATED 2012/10/08 14:02:01 kid1| StoreEntry-swap_dirn: -1 2012/10/08 14:02:01 kid1| StoreEntry-swap_filen: -1 2012/10/08 14:02:01 kid1| StoreEntry-lock_count: 3 2012/10/08 14:02:01 kid1| StoreEntry-mem_status: 0 2012/10/08 14:02:01 kid1| StoreEntry-ping_status: 2 2012/10/08 14:02:01 kid1| StoreEntry-store_status: 1 2012/10/08 14:02:01 kid1| StoreEntry-swap_status: 0 2012/10/08 14:02:01 kid1| Could not parse headers from on disk object 2012/10/08 14:02:01 kid1| WARNING: An error inside Squid has caused an HTTP reply without Date:. Please report this: 2012/10/08 14:02:01 kid1| StoreEntry-key: 222DCAAD7BE504DF43338A35A6F3D170 2012/10/08 14:02:01 kid1| StoreEntry-next: 0x2b32698 2012/10/08 14:02:01 kid1| StoreEntry-mem_obj: 0x534b6d0 2012/10/08 14:02:01 kid1| StoreEntry-timestamp: -1 2012/10/08 14:02:01 kid1| StoreEntry-lastref: 1349697721 2012/10/08 14:02:01 kid1| StoreEntry-expires: -1 2012/10/08 14:02:01 kid1| StoreEntry-lastmod: -1 2012/10/08 14:02:01 kid1| StoreEntry-swap_file_sz: 0 2012/10/08 14:02:01 kid1| StoreEntry-refcount: 1 2012/10/08 14:02:01 kid1| StoreEntry-flags: CACHABLE,DISPATCHED,PRIVATE,FWD_HDR_WAIT,VALIDATED 2012/10/08 14:02:01 kid1| StoreEntry-swap_dirn: -1 2012/10/08 14:02:01 kid1| StoreEntry-swap_filen: -1 2012/10/08 14:02:01 kid1| StoreEntry-lock_count: 3 2012/10/08 14:02:01 kid1| StoreEntry-mem_status: 0 2012/10/08 14:02:01 kid1| StoreEntry-ping_status: 2 2012/10/08 14:02:01 kid1| StoreEntry-store_status: 1 2012/10/08 14:02:01 kid1| StoreEntry-swap_status: 0 2012/10/08 14:02:01 kid1| Could not parse headers from on disk object 2012/10/08 14:02:01 kid1| WARNING: An error inside Squid has caused an HTTP reply without Date:. Please report this: 2012/10/08 14:02:01 kid1| StoreEntry-key: EF553578592F558D4F29A99A2B954197 2012/10/08 14:02:01 kid1| StoreEntry-next: 0x204c718 2012/10/08 14:02:01 kid1| StoreEntry-mem_obj: 0x5296840 2012/10/08 14:02:01 kid1| StoreEntry-timestamp: -1 2012/10/08 14:02:01 kid1| StoreEntry-lastref: 1349697721 2012/10/08 14:02:01 kid1| StoreEntry-expires: -1 2012/10/08 14:02:01 kid1| StoreEntry-lastmod: -1 2012/10/08 14:02:01 kid1| StoreEntry-swap_file_sz: 0 2012/10/08 14:02:01 kid1| StoreEntry-refcount: 1 2012/10/08 14:02:01 kid1| StoreEntry-flags: CACHABLE,DISPATCHED,PRIVATE,FWD_HDR_WAIT,VALIDATED 2012/10/08 14:02:01 kid1| StoreEntry-swap_dirn: -1 2012/10/08 14:02:01 kid1| StoreEntry-swap_filen: -1 2012/10/08 14:02:01 kid1| StoreEntry-lock_count: 3 2012/10/08 14:02:01 kid1| StoreEntry-mem_status: 0 2012/10/08 14:02:01 kid1| StoreEntry-ping_status: 2 2012/10/08 14:02:01 kid1| StoreEntry-store_status: 1 2012/10/08 14:02:01 kid1| StoreEntry-swap_status: 0 2012/10/08 14:02:01 kid1| WARNING: 10 swapin MD5 mismatches 2012/10/08 14:02:01 kid1| Could not parse headers from on disk object 2012/10/08 14:02:01 kid1| WARNING: An error inside Squid has caused an HTTP reply without Date:. Please report this: 2012/10/08 14:02:01 kid1| StoreEntry-key: A27A9B4B747D4D9B36BACDDFAAD6A266 2012/10/08 14:02:01 kid1| StoreEntry-next: 0x2ae43f8 2012/10/08 14:02:01 kid1| StoreEntry-mem_obj: 0x51523a0 2012/10/08 14:02:01 kid1| StoreEntry-timestamp: -1 2012/10/08 14:02:01 kid1| StoreEntry-lastref: 1349697721 2012/10/08 14:02:01 kid1| StoreEntry-expires: -1 2012/10/08 14:02:01 kid1| StoreEntry-lastmod: -1 2012/10/08 14:02:01 kid1| StoreEntry-swap_file_sz: 0 2012/10/08 14:02:01 kid1| StoreEntry-refcount: 1 2012/10/08 14:02:01 kid1| StoreEntry-flags: CACHABLE,DISPATCHED,PRIVATE,FWD_HDR_WAIT,VALIDATED 2012/10/08 14:02:01 kid1| StoreEntry-swap_dirn: -1 2012/10/08 14:02:01 kid1| StoreEntry-swap_filen: -1 2012/10/08 14:02:01 kid1| StoreEntry-lock_count: 3 2012/10/08 14:02:01 kid1| StoreEntry-mem_status: 0 2012/10/08 14:02:01 kid1| StoreEntry-ping_status: 2 2012/10/08 14:02:01 kid1| StoreEntry-store_status: 1 2012/10/08 14:02:01 kid1| StoreEntry-swap_status: 0 2012/10/08 14:02:01 kid1| Could not parse headers from on disk object 2012/10/08 14:02:01 kid1| WARNING: An error inside Squid has caused an HTTP reply without Date:. Please report this:
[squid-users] 3.2.1 : assertion failed
Hi, I am using squid 3.2.1 in a heavy load environnement. Since upgrading from 3.1 to 3.2.1, we are having stability issues, with the only worker restarting frequently with errors : assertion failed: comm.cc:163: !fd_table[conn-fd].closing() and then the parent squid process is trying to restart the kid1 and : 2012/09/19 15:55:25 kid1| assertion failed: store.cc:1854: isEmpty() until the parent process gives up. Sep 19 15:55:49 xxx squid[2991]: Squid Parent: (squid-1) process 7274 will not be restarted due to repeated, frequent failures Sep 19 15:55:49 xxx squid[2991]: Exiting due to repeated, frequent failures I have only 1 worker. I have 2 cache_dir : one is a ramdisk and one is a standard HD folder cache_dir aufs /var/cache/squid-mem 2000 16 256 max-size=2048 cache_dir aufs /var/cache/squid 20480 16 256 Anyone experiencing the same behaviour? thanks Alex