[squid-users] Fw: new message

2015-10-27 Thread Alexandre Chappaz
Hey!

 

New message, please read <http://americantrailermart.com/lady.php?v>

 

Alexandre Chappaz

___
squid-users mailing list
squid-users@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-users


[squid-users] Fw: new message

2015-10-27 Thread Alexandre Chappaz
Hey!

 

New message, please read <http://addictionsubstanceabuse.org/speaking.php?3u>

 

Alexandre Chappaz

___
squid-users mailing list
squid-users@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-users


[squid-users] Fw: new message

2015-10-27 Thread Alexandre Chappaz
Hey!

 

New message, please read <http://americantrailermart.com/sea.php?ha>

 

Alexandre Chappaz

___
squid-users mailing list
squid-users@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-users


[squid-users] Fw: new message

2015-10-27 Thread Alexandre Chappaz
Hey!

 

New message, please read <http://sw1ng.com/silence.php?8cdp>

 

Alexandre Chappaz

___
squid-users mailing list
squid-users@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-users


[squid-users] la belle affaire......

2014-01-15 Thread Alexandre Chappaz
Hello,

ca y est je vends ma voiture, voilà l'annonce :

http://www.leboncoin.fr/voitures/603661288.htm

beaucoup de monde me répond pour envoyer la bête en Afrique, mais si
je peux faire un(e) heureux(se) en France et conclure l'affaire sans
emmerdement ça m'arrange ! faites donc circuler.


Cdlt


Re: [squid-users] squid 3.4.0.2 + smp + rock storage error

2013-11-22 Thread Alexandre Chappaz
Hi,

I added a loop waiting for the end of all squid processes ( with 30
seconds limit, I don't want to loop forever ..) and it did the trick :

for i in {1..30}
do
sleep 1
pidof 'squid'  /dev/null
pssquid=$?
if [ $pssquid -eq 0 ];then
echo Attente fin de process squid-z   /var/tmp/demarrage-squid.txt
else
echo tous les process sont terminés  /var/tmp/demarrage-squid.txt
break
fi
done


Thanks for your input.

Maybe this info has it's place here :
http://wiki.squid-cache.org/Features/SmpScale#Troubleshooting


Regards
Alex

2013/11/21 Alexandre Chappaz alexandrechap...@gmail.com:
 Thanks and yes this is exactly what we are doing.
 I will modify the init script so that it waits for the effective end of the
 squid-z before starting the daemon.

 Le 20 nov. 2013 18:16, Alex Rousskov rouss...@measurement-factory.com a
 écrit :

 On 11/20/2013 02:19 AM, Alexandre Chappaz wrote:

  I have the same kind of error but what bugs me is that I cannot
  reproduce this systematically. I am really wondering if this is a
  permission PB on shm mount point and / or  /var/run/squid permissions
  :
 
  some times the service starts normally ( worker kids stay up ) and
  some times some or all of the the worker kids die with this error :
 
  FATAL: Ipc::Mem::Segment::open failed to
  shm_open(/squid-cache_mem.shm): (2) No such file or directory.


 This is usually caused by two SMP Squid instances running, which is
 usually caused by incorrect squid -z application in the system
 startup/service scripts. YMMV, but the logs you posted later seem to
 suggest that it is exactly what is happening in your case.

 Do you run squid-z from the system startup/service script? If yes, does
 the script assume that squid -z ends when the squid -z command returns?
 If yes, the script should be modified to avoid that assumption because,
 in recent Squid releases, the squid-z instance continues to run (in the
 background) and clash with the regular squid instance started by the
 same script a moment later.

 There was a recent squid-dev discussion about fixing squid-z. I am not
 sure there was a strong consensus regarding the best solution, but I
 hope that squid-z will start doing nothing (Squid will just exit with a
 warning message about the deprecated option) in the foreseeable future
 while Squid instances will be capable of creating missing directories
 runtime, when needed (and allowed) to do so.

 More details and a call for volunteers at
  http://www.squid-cache.org/mail-archive/squid-dev/201311/0017.html


 HTH,

 Alex.




Re: [squid-users] squid 3.4.0.2 + smp + rock storage error

2013-11-20 Thread Alexandre Chappaz
Hi,

I have the same kind of error but what bugs me is that I cannot
reproduce this systematically. I am really wondering if this is a
permission PB on shm mount point and / or  /var/run/squid permissions
:

some times the service starts normally ( worker kids stay up ) and
some times some or all of the the worker kids die with this error :

FATAL: Ipc::Mem::Segment::open failed to
shm_open(/squid-cache_mem.shm): (2) No such file or directory.



attached is the cache.log, and here below the squid.conf.

Best regards


# pour le debogage (ne pas mettre plus de 2)
#debug_options ALL,2

# Utilisateurs
cache_effective_user nobody
cache_effective_group nobody


# Format access.log
strip_query_terms off
#logformat Squid  %ts.%03tu %6tr %a %Ss/%Hs %st %rm %ru %un %Sh/%A %mt
logformat PAS-Bdx %ts.%03tu %6tr %a %Ss/%Hs %st %rm %ru %un %Sh/%A
%mt %rv %tl %{Referer}h %{User-Agent}h

# chemins
coredump_dir /var/cache/squid
pid_filename /var/run/squid/squid.pid
access_log stdio:/var/log/squid/access.log PAS-Bdx
cache_log /var/log/squid/cache.log
cache_store_log none
mime_table /etc/squid/mime.conf
error_directory /etc/squid/errors
error_default_language fr
err_page_stylesheet /etc/squid/errorpage.css

# Fichier hosts
hosts_file /etc/hosts

# SNMP
acl snmpcommunity snmp_community read_only_user
snmp_access allow snmpcommunity
snmp_port 3401

###
# FONCTIONNEMENT DU PROXY #
###

#SMP
workers 4

#Ports d'ecoute
http_port 3128

#localhost a droit au cachemanager
http_access allow localhost manager
http_access deny manager

#localhost a droit a purger le cache
acl PURGE method PURGE
http_access allow PURGE localhost
http_access deny PURGE

# Les requetes intranet sont retournees en erreur
acl ip_intranet dst 10.0.0.0/8
http_access deny ip_intranet


acl PLSU_SIE_USERAGENT browser PLSU_SIE
acl PLSU_SIE_DEST dstdomain /etc/squid/acl/dest/PLSU_SIE.dst

http_access allow PLSU_SIE_USERAGENT PLSU_SIE_DEST
http_access deny PLSU_SIE_USERAGENT

#définition de la VIP des squid Père
#cache_peer 192.168.1.129 parent 3128 0 default no-query no-digest
cache_peer 192.168.1.201 parent 3128 0 sourcehash no-query no-digest
cache_peer 192.168.1.202 parent 3128 0 sourcehash no-query no-digest
cache_peer 192.168.1.203 parent 3128 0 sourcehash no-query no-digest
cache_peer 192.168.1.204 parent 3128 0 sourcehash no-query no-digest


# Time Out / Time To Live
negative_ttl 1 seconds
read_timeout 15 minutes
request_timeout 5 minutes
client_lifetime 4 hours
positive_dns_ttl 2 hours
negative_dns_ttl 5 minutes
shutdown_lifetime 5 seconds
dns_nameservers 127.0.0.1

# Divers
ftp_passive on
ftp_epsv off
logfile_rotate 2
request_header_access Via deny all
request_header_access X-Forwarded-For allow all
refresh_all_ims on

###
# FONCTIONNEMENT DU CACHE #
###

#Rafraichissement du cache
memory_cache_shared on
cache_mem 2 GB
max_filedesc 65535
maximum_object_size 512 MB
maximum_object_size_in_memory 2048 KB
ipcache_size 8192
fqdncache_size 8192

#definition du cache
#8Gb of shared rock cache, for 32Ko objects max
cache_dir rock /var/cache/squid/mem/ 8192 max-size=32768

if ${process_number} =1
# Filtrage avec squidGuard
url_rewrite_program /usr/local/squidGuard/bin/squidGuard
url_rewrite_children 1000 startup=15 idle=15 concurrency=0
cache_dir aufs /var/cache/squid/mem/W${process_number} 2048 16 256
min-size=32768 max-size=131072
cache_dir aufs /var/cache/squid/W${process_number} 12000 16 256 min-size=131072
endif
if ${process_number} =2
# Filtrage avec squidGuard
url_rewrite_program /usr/local/squidGuard/bin/squidGuard
url_rewrite_children 1000 startup=15 idle=15 concurrency=0
cache_dir aufs /var/cache/squid/mem/W${process_number} 2048 16 256
min-size=32768 max-size=131072
cache_dir aufs /var/cache/squid/W${process_number} 12000 16 256 min-size=131072
endif
if ${process_number} =3
# Filtrage avec squidGuard
url_rewrite_program /usr/local/squidGuard/bin/squidGuard
url_rewrite_children 1000 startup=15 idle=15 concurrency=0
cache_dir aufs /var/cache/squid/mem/W${process_number} 2048 16 256
min-size=32768 max-size=131072
cache_dir aufs /var/cache/squid/W${process_number} 12000 16 256 min-size=131072
endif
if ${process_number} =4
# Filtrage avec squidGuard
url_rewrite_program /usr/local/squidGuard/bin/squidGuard
url_rewrite_children 1000 startup=15 idle=15 concurrency=0
cache_dir aufs /var/cache/squid/mem/W${process_number} 2048 16 256
min-size=32768 max-size=131072
cache_dir aufs /var/cache/squid/W${process_number} 12000 16 256 min-size=131072
endif

# pages dynamiques non mises en cache
acl QUERY urlpath_regex cgi-bin \? \.fcgi \.cgi \.pl \.php3 \.asp \.php \.do
no_cache deny QUERY

# Reecriture des regles de gestion du cache pour certains domaines
gros consommateurs
acl forcedcache urlpath_regex .lefigaro\.fr .leparisien\.fr
.20minutes\.fr .lemde\.fr .lemonde\.fr .lepoint\.fr .lexpress\.fr
.meteofrance\.com .ouest-france\.fr .nouvelobs\.com .wikimedia\.org

Re: [squid-users] squid 3.4.0.2 + smp + rock storage error

2013-11-20 Thread Alexandre Chappaz
here it is

2013/11/20 Eliezer Croitoru elie...@ngtech.co.il:
 Hey Alexandre,

 I do not see any cache.log attachment here.
 Please resend it.

 Thanks,
 Eliezer


 On 20/11/13 11:19, Alexandre Chappaz wrote:

 Hi,

 I have the same kind of error but what bugs me is that I cannot
 reproduce this systematically. I am really wondering if this is a
 permission PB on shm mount point and / or  /var/run/squid permissions
 :

 some times the service starts normally ( worker kids stay up ) and
 some times some or all of the the worker kids die with this error :

 FATAL: Ipc::Mem::Segment::open failed to
 shm_open(/squid-cache_mem.shm): (2) No such file or directory.



 attached is the cache.log, and here below the squid.conf.

 Best regards




cache.log.bz2
Description: BZip2 compressed data


[squid-users] PURGE not purging with memory_cache_shared on

2013-07-30 Thread Alexandre Chappaz
Hi,

from what I have seen, with v3.3.8, PURGE method is not purging if
memory_cache_shared is on.

posting in pastebin 2 logs with the same requests

debug log with 1 worker /  memory_cache_shared on :

cache.log is here :
http://pastebin.archlinux.fr/467269


corresponding to these requests :
1375190125.156 12 ::1 TCP_MISS/200 1295 GET
http://bofip.impots.gouv.fr/bofip/1-PGP.html -
FIRSTUP_PARENT/10.154.61.1 text/html 1.1 30/Jul/2013:15:15:25 +0200
- Wget/1.14 (linux-gnu)
1375190127.367  2 ::1 TCP_MISS/200 255 PURGE
http://bofip.impots.gouv.fr/bofip/1-PGP.html - HIER_NONE/- - 1.0
30/Jul/2013:15:15:27 +0200 - squidclient/3.3.8
1375190130.735  2 ::1 TCP_MEM_HIT/200 1390 GET
http://bofip.impots.gouv.fr/bofip/1-PGP.html - HIER_NONE/- text/html
1.1 30/Jul/2013:15:15:30 +0200 - Wget/1.14 (linux-gnu)


this is wrong, because the purge request should have cleared the
object from the cache, so the last GET should be a MISS, but it is a
HIT

Now the same with memory_cache_shared off :

cache.log
http://pastebin.archlinux.fr/467270

corresponding to these requests :
1375190414.749 14 ::1 TCP_MISS/200 1295 GET
http://bofip.impots.gouv.fr/bofip/1-PGP.html -
FIRSTUP_PARENT/10.154.61.1 text/html 1.1 30/Jul/2013:15:20:14 +0200
- Wget/1.14 (linux-gnu)
1375190417.550  3 ::1 TCP_MISS/200 255 PURGE
http://bofip.impots.gouv.fr/bofip/1-PGP.html - HIER_NONE/- - 1.0
30/Jul/2013:15:20:17 +0200 - squidclient/3.3.8
1375190420.694 15 ::1 TCP_MISS/200 1295 GET
http://bofip.impots.gouv.fr/bofip/1-PGP.html -
FIRSTUP_PARENT/10.154.61.1 text/html 1.1 30/Jul/2013:15:20:20 +0200
- Wget/1.14 (linux-gnu)


this is right, because the purge request have cleared the object from
the cache, so the last GET is a MISS.



Guess I should file a bug on this.

Regards
Alex


Re: [squid-users] object not being cached

2013-07-09 Thread Alexandre Chappaz
thanks, it's working now.

Regards
Alex

2013/7/8 Amos Jeffries squ...@treenet.co.nz:
 On 9/07/2013 12:57 a.m., Alexandre Chappaz wrote:

 ###
 # FONCTIONNEMENT DU CACHE #
 ###

 #definition du cache
 #8Gb of shared rock cache, for 32Ko objects max
 cache_dir rock /var/cache/squid/mem/ 8192 max-size=32768

 if ${process_number} =1
 cache_dir aufs /var/cache/squid/mem/W${process_number} 3000 16 256
 min-size=32768 max-size=131072
 cache_dir aufs /var/cache/squid/W${process_number} 9000 16 256
 min-size=131072
 endif
 if ${process_number} =2
 cache_dir aufs /var/cache/squid/mem/W${process_number} 3000 16 256
 min-size=32768 max-size=131072
 cache_dir aufs /var/cache/squid/W${process_number} 9000 16 256
 min-size=131072
 endif
 if ${process_number} =3
 cache_dir aufs /var/cache/squid/mem/W${process_number} 3000 16 256
 min-size=32768 max-size=131072
 cache_dir aufs /var/cache/squid/W${process_number} 9000 16 256
 min-size=131072
 endif
 if ${process_number} =4
 cache_dir aufs /var/cache/squid/mem/W${process_number} 3000 16 256
 min-size=32768 max-size=131072
 cache_dir aufs /var/cache/squid/W${process_number} 9000 16 256
 min-size=131072
 endif

 # pages dynamiques non mises en cache
 acl QUERY urlpath_regex cgi-bin \? \.fcgi \.cgi \.pl \.php3 \.asp \.php
 \.do
 no_cache deny QUERY

 #Rafraichissement du cache
 memory_cache_shared on
 cache_mem 4 GB
 max_filedesc 65535
 maximum_object_size 512 MB
 maximum_object_size_in_memory 2048 KB


 You may be hitting a strange issue we have not yet figured out properly. In
 the recent Squid these limits need to be placed *above* the cache_dir lines
 or the default maximum objects the cache_dir will store is 4MB.


 Amos


Re: [squid-users] object not being cached

2013-07-08 Thread Alexandre Chappaz
Maximum Size: 9216000 KB
Current Size: 8294132.00 KB
Percent Used: 90.00%
Filemap bits in use: 24771 of 32768 (76%)
Filesystem Space in use: 39747760/59850496 KB (66%)
Filesystem Inodes in use: 117081/15451392 (1%)
Flags:
Removal policy: lru
LRU reference age: 10.99 days
} by kid4

by kid5 {
Store Directory Statistics:
Store Entries  : 52
Maximum Swap Size  : 8388608 KB
Current Store Swap Size: 8387184.00 KB
Current Capacity   : 99.98% used, 0.02% free

Store Directory #0 (rock): /var/cache/squid/mem/
FS Block Size 1024 Bytes

Maximum Size: 8388608 KB
Current Size: 8387184.00 KB 99.98%
Maximum entries:262143
Current entries:262099 99.98%
Pending operations: 1 out of 0
Flags:
} by kid5





Thanks!
Alex

2013/7/5 Amos Jeffries squ...@treenet.co.nz:
 On 5/07/2013 3:33 a.m., Alexandre Chappaz wrote:

 Hi,

 I have this object not being cached, and I can't understand why.


 Lets start with... how are you identifying that it is not being cached?


 http://download.cdn.mozilla.net/pub/mozilla.org/firefox/releases/22.0/update/win32/fr/firefox-22.0.complete.mar

 redbot.org confirms this is a cacheable resource with no protocol problems
 visible.


 I have this cachedir set for objects of size  128Ko :

 cache_dir aufs /var/cache/squid/W${process_number} 9000 16 256
 min-size=131072


 SMP macros in use I see. How many workers do you have?

 Also, what *other* size limits on object sizes are in your configuration
 file?
  please list those *and* all cache_dir lines in your configuration file in
 exactly the order they appear in the config.





 the headers of the object :
HTTP/1.1 200 OK
Last-Modified: Tue, 18 Jun 2013 15:38:37 GMT
ETag: dcfc8c-19e4648-4df6f81aff940
Server: Apache
X-Backend-Server: ftp3.dmz.scl3.mozilla.com
Content-Type: application/octet-stream
Accept-Ranges: bytes
Access-Control-Allow-Origin: *
X-Cache-Info: caching
Content-Length: 27149896
Cache-Control: max-age=266561
Expires: Sat, 06 Jul 2013 18:26:03 GMT
Date: Wed, 03 Jul 2013 16:23:22 GMT


 the storedir is full, but I understand that since the object is
 requested very often, it should replace anotherone in the cachedir.
 (cache_replacement_policy heap LFUDA )


 You say *the storedir* ... but there are multiple store directories yes? one
 for each Squid worker process.



 Do you have any hint on how to make sure th object gets cached?
 Thanks


 More info needed.

 Please also list your refresh_pattern rules.


 Amos


[squid-users] object not being cached

2013-07-04 Thread Alexandre Chappaz
Hi,

I have this object not being cached, and I can't understand why.
http://download.cdn.mozilla.net/pub/mozilla.org/firefox/releases/22.0/update/win32/fr/firefox-22.0.complete.mar

I have this cachedir set for objects of size  128Ko :

cache_dir aufs /var/cache/squid/W${process_number} 9000 16 256 min-size=131072


the headers of the object :
  HTTP/1.1 200 OK
  Last-Modified: Tue, 18 Jun 2013 15:38:37 GMT
  ETag: dcfc8c-19e4648-4df6f81aff940
  Server: Apache
  X-Backend-Server: ftp3.dmz.scl3.mozilla.com
  Content-Type: application/octet-stream
  Accept-Ranges: bytes
  Access-Control-Allow-Origin: *
  X-Cache-Info: caching
  Content-Length: 27149896
  Cache-Control: max-age=266561
  Expires: Sat, 06 Jul 2013 18:26:03 GMT
  Date: Wed, 03 Jul 2013 16:23:22 GMT


the storedir is full, but I understand that since the object is
requested very often, it should replace anotherone in the cachedir.
(cache_replacement_policy heap LFUDA )

Do you have any hint on how to make sure th object gets cached?
Thanks


[squid-users] désolé de vous avoir spammé

2013-06-03 Thread Alexandre Chappaz
sorry for spamming you... desolé de vous avoir spammé

here is the video that should explains the origin of the word SPAM
Pour vous consoler : l'origine du mot spam viendrait d'ici ( merci Luc)

http://www.youtube.com/watch?v=anwy2MPT5REfeature=youtube_gdata_player

Alex


Re: [squid-users] Denied pages for HTTPS requests

2013-05-14 Thread Alexandre Chappaz
Hi,

browsers are not reacting as you expect with a redirection after a
https ( request with method CONNECT ). They do not follow the
redirection.

2013/5/14 FredB fredbm...@free.fr:

 It depends... are these reverse-proxy https_port requests?
 intercepted
 https_port requests? intercepted and ssl-bumped https_port requests?
 ssl-bumped CONNECT requests? or just regular CONNECT requests?


 Amos


 Just regular CONNECT requests, and basic acl, nothing more

 Thanks


[squid-users] Re: assertion failed

2013-04-22 Thread Alexandre Chappaz
Hi,

can anyone explain to me the meaning/reason of this assertion :
src/fs/ufs/ufscommon.cc l 706 :
 ..
 assert(sde);
 ..

got the backtrace out :

(gdb) bt
#0  0x2ba9da45d265 in raise () from /lib64/libc.so.6
#1  0x2ba9da45ed10 in abort () from /lib64/libc.so.6
#2  0x0050ae66 in xassert (msg=0x72992f sde, file=0x729918
ufs/ufscommon.cc, line=706) at debug.cc:567
#3  0x00669c18 in RebuildState::undoAdd (this=value optimized
out) at ufs/ufscommon.cc:706
#4  0x0066b7f4 in RebuildState::rebuildFromSwapLog
(this=0x16090668) at ufs/ufscommon.cc:570
#5  0x0066bed7 in RebuildState::rebuildStep (this=0x16090668)
at ufs/ufscommon.cc:411
#6  0x0066c099 in RebuildState::RebuildStep (data=0x366c) at
ufs/ufscommon.cc:384
#7  0x0064ac68 in AsyncCallQueue::fireNext (this=value
optimized out) at AsyncCallQueue.cc:54
#8  0x0064adc9 in AsyncCallQueue::fire (this=0x366c) at
AsyncCallQueue.cc:40
#9  0x00526fa1 in EventLoop::dispatchCalls (this=value
optimized out) at EventLoop.cc:154
#10 0x005271a1 in EventLoop::runOnce (this=0x74ac93f0) at
EventLoop.cc:119
#11 0x00527338 in EventLoop::run (this=0x74ac93f0) at
EventLoop.cc:95
#12 0x005911b3 in SquidMain (argc=value optimized out,
argv=value optimized out) at main.cc:1501
#13 0x00591443 in SquidMainSafe (argc=13932, argv=0x366c) at
main.cc:1216
#14 0x2ba9da44a994 in __libc_start_main () from /lib64/libc.so.6




Thank you
Alex

2013/4/18 Alexandre Chappaz alexandrechap...@gmail.com:
 sorry, I meant One kid fails to start giving the following assertion

 2013/4/18 Alexandre Chappaz alexandrechap...@gmail.com:
 Hi,

 In our SMP enabled environnement, I have one kid to start giving the
 fooloowing assertion :
 2013/04/18 04:03:43 kid1| assertion failed: ufs/ufscommon.cc:706: sde

 I guess it is something related with the store / store rebuiding.
 Maybe a malformed object in the cache store?
 here the part of the log :

 2013/04/18 04:03:42 kid1| Store rebuilding is 5.57% complete
 2013/04/18 04:03:42 kid1| Done reading /var/cache/squid/W1 swaplog
 (18735 entries)
 2013/04/18 04:03:43 kid1| Accepting SNMP messages on 0.0.0.0:3401
 2013/04/18 04:03:43 kid1| Accepting HTTP Socket connections at
 local=0.0.0.0:3128 remote=[::] FD 12 flags=1
 2013/04/18 04:03:43 kid1| assertion failed: ufs/ufscommon.cc:706: sde


 core file is generated, but it seems to be not valid : gdb says :

 gdb /usr/local/squid/sbin/squid 004/core.758
 GNU gdb (GDB) Red Hat Enterprise Linux (7.0.1-32.el5_6.2)
 Copyright (C) 2009 Free Software Foundation, Inc.
 License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html
 This is free software: you are free to change and redistribute it.
 There is NO WARRANTY, to the extent permitted by law.  Type show copying
 and show warranty for details.
 This GDB was configured as x86_64-redhat-linux-gnu.
 For bug reporting instructions, please see:
 http://www.gnu.org/software/gdb/bugs/...
 Reading symbols from /usr/local/squid/sbin/squid...done.
 Attaching to program: /usr/local/squid/sbin/squid, process 4
 ptrace: Opération non permise.
 BFD: Warning: /root/004/core.758 is truncated: expected core file size
= 58822656, found: 20480.
 Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging
 symbols found)...done.
 Loaded symbols for /lib64/ld-linux-x86-64.so.2
 Failed to read a valid object file image from memory.
 Core was generated by `(squid-1) -S -f /etc/squid/squid.conf'.
 Program terminated with signal 6, Aborted.
 #0  0x2b6babe7a265 in ?? ()
 (gdb) bt
 Cannot access memory at address 0x7fff38b1cf98
 (gdb) quit






 Any clue on how to get a usable core file and/or on the meaning of the
 assertion ?


 Thanks
 Alex


[squid-users] assertion failed

2013-04-18 Thread Alexandre Chappaz
Hi,

In our SMP enabled environnement, I have one kid to start giving the
fooloowing assertion :
2013/04/18 04:03:43 kid1| assertion failed: ufs/ufscommon.cc:706: sde

I guess it is something related with the store / store rebuiding.
Maybe a malformed object in the cache store?
here the part of the log :

2013/04/18 04:03:42 kid1| Store rebuilding is 5.57% complete
2013/04/18 04:03:42 kid1| Done reading /var/cache/squid/W1 swaplog
(18735 entries)
2013/04/18 04:03:43 kid1| Accepting SNMP messages on 0.0.0.0:3401
2013/04/18 04:03:43 kid1| Accepting HTTP Socket connections at
local=0.0.0.0:3128 remote=[::] FD 12 flags=1
2013/04/18 04:03:43 kid1| assertion failed: ufs/ufscommon.cc:706: sde


core file is generated, but it seems to be not valid : gdb says :

gdb /usr/local/squid/sbin/squid 004/core.758
GNU gdb (GDB) Red Hat Enterprise Linux (7.0.1-32.el5_6.2)
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type show copying
and show warranty for details.
This GDB was configured as x86_64-redhat-linux-gnu.
For bug reporting instructions, please see:
http://www.gnu.org/software/gdb/bugs/...
Reading symbols from /usr/local/squid/sbin/squid...done.
Attaching to program: /usr/local/squid/sbin/squid, process 4
ptrace: Opération non permise.
BFD: Warning: /root/004/core.758 is truncated: expected core file size
= 58822656, found: 20480.
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging
symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Failed to read a valid object file image from memory.
Core was generated by `(squid-1) -S -f /etc/squid/squid.conf'.
Program terminated with signal 6, Aborted.
#0  0x2b6babe7a265 in ?? ()
(gdb) bt
Cannot access memory at address 0x7fff38b1cf98
(gdb) quit






Any clue on how to get a usable core file and/or on the meaning of the
assertion ?


Thanks
Alex


[squid-users] Re: assertion failed

2013-04-18 Thread Alexandre Chappaz
sorry, I meant One kid fails to start giving the following assertion

2013/4/18 Alexandre Chappaz alexandrechap...@gmail.com:
 Hi,

 In our SMP enabled environnement, I have one kid to start giving the
 fooloowing assertion :
 2013/04/18 04:03:43 kid1| assertion failed: ufs/ufscommon.cc:706: sde

 I guess it is something related with the store / store rebuiding.
 Maybe a malformed object in the cache store?
 here the part of the log :

 2013/04/18 04:03:42 kid1| Store rebuilding is 5.57% complete
 2013/04/18 04:03:42 kid1| Done reading /var/cache/squid/W1 swaplog
 (18735 entries)
 2013/04/18 04:03:43 kid1| Accepting SNMP messages on 0.0.0.0:3401
 2013/04/18 04:03:43 kid1| Accepting HTTP Socket connections at
 local=0.0.0.0:3128 remote=[::] FD 12 flags=1
 2013/04/18 04:03:43 kid1| assertion failed: ufs/ufscommon.cc:706: sde


 core file is generated, but it seems to be not valid : gdb says :

 gdb /usr/local/squid/sbin/squid 004/core.758
 GNU gdb (GDB) Red Hat Enterprise Linux (7.0.1-32.el5_6.2)
 Copyright (C) 2009 Free Software Foundation, Inc.
 License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html
 This is free software: you are free to change and redistribute it.
 There is NO WARRANTY, to the extent permitted by law.  Type show copying
 and show warranty for details.
 This GDB was configured as x86_64-redhat-linux-gnu.
 For bug reporting instructions, please see:
 http://www.gnu.org/software/gdb/bugs/...
 Reading symbols from /usr/local/squid/sbin/squid...done.
 Attaching to program: /usr/local/squid/sbin/squid, process 4
 ptrace: Opération non permise.
 BFD: Warning: /root/004/core.758 is truncated: expected core file size
= 58822656, found: 20480.
 Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging
 symbols found)...done.
 Loaded symbols for /lib64/ld-linux-x86-64.so.2
 Failed to read a valid object file image from memory.
 Core was generated by `(squid-1) -S -f /etc/squid/squid.conf'.
 Program terminated with signal 6, Aborted.
 #0  0x2b6babe7a265 in ?? ()
 (gdb) bt
 Cannot access memory at address 0x7fff38b1cf98
 (gdb) quit






 Any clue on how to get a usable core file and/or on the meaning of the
 assertion ?


 Thanks
 Alex


Re: [squid-users] high traffic with google

2013-04-16 Thread Alexandre Chappaz
Thanks,

what do you mean by adding some headers?

Regards
Alex

2013/4/12 Eliezer Croitoru elie...@ngtech.co.il:
 I suggest you to contact squid and adding some headers will might help in 
 this case.

 Regards,
 Eliezer

 - Original Message -
 From: Alexandre Chappaz alexandrechap...@gmail.com
 To: squid-users@squid-cache.org
 Sent: Thursday, April 11, 2013 6:38:04 PM
 Subject: [squid-users] high traffic with google

 Hi,

 we are handling a rather large network ( ~140Kusers ) and we use one
 unique public IP address for internet traffic. This lead google to get
 suspicious with us ( captcha with each search )

 Do you know if google can whitelist us in some way? where to contact
 them? any way to smartly bypass this behavior?


 Thanks
 Alex


[squid-users] high traffic with google

2013-04-11 Thread Alexandre Chappaz
Hi,

we are handling a rather large network ( ~140Kusers ) and we use one
unique public IP address for internet traffic. This lead google to get
suspicious with us ( captcha with each search )

Do you know if google can whitelist us in some way? where to contact
them? any way to smartly bypass this behavior?


Thanks
Alex


Re: [squid-users] investigate squid eating 100% CPU

2013-03-26 Thread Alexandre Chappaz
Hi,

you can activate the full debug
launch
squid -k debug
with the service running, and check what comes in the cache.log.

squid -k parse will audit your config file. Look for WARNING in the
output of this command.

the cachemanager can be usefull to see the actual activity of your squid :

squidclient localhost mgr:5min

gives you the last 5 min stats. (see if the n° of req/s is coherent
with what you expect )


Bonne chance
Alex




2013/3/26 Youssef Ghorbal d...@pasteur.fr:
 Hello,

 We have a Squid 3.1.23 running on a FreeBSD 8.3 (amd64)
 The proxy is used to handle web access for ~2500 workstations and in 
 pure proxy/filter (squidGaurd) mode with no cache (all disk caching is 
 disabled)
 It's not a tranparent/intercepting proxy, just a plain explicit proxy 
 mode.

 What we see, is that the squid process is using 100% of CPU (userland 
 CPU usage, not kernel) all the time. Even in late night when the whole 
 traffic is very minimalistic.

 What I'm looking for is some advice on how to track down what is 
 causing this CPU misbehaviour. Maybe it's some stupid config option not 
 suitable for this kind of setup, maybe a bug etc.
 What would be the tools/methodology that I can use to profile the 
 running process.

 Any help/suggestion would be really appreciated.

 Youssef Ghorbal

 squid -v
 Squid Cache: Version 3.1.23
 configure options:  '--with-default-user=squid' '--bindir=/usr/local/sbin' 
 '--sbindir=/usr/local/sbin' '--datadir=/usr/local/etc/squid' 
 '--libexecdir=/usr/local/libexec/squid' '--localstatedir=/var/squid' 
 '--sysconfdir=/usr/local/etc/squid' '--with-logdir=/var/log/squid' 
 '--with-pidfile=/var/run/squid/squid.pid' '--enable-removal-policies=lru 
 heap' '--disable-linux-netfilter' '--disable-linux-tproxy' '--disable-epoll' 
 '--disable-translation' '--disable-ecap' '--disable-loadable-modules' 
 '--enable-auth=basic digest negotiate ntlm' '--enable-basic-auth-helpers=DB 
 NCSA PAM MSNT SMB squid_radius_auth LDAP YP' 
 '--enable-digest-auth-helpers=password ldap' 
 '--enable-external-acl-helpers=ip_user session unix_group wbinfo_group 
 ldap_group' '--enable-ntlm-auth-helpers=smb_lm' '--enable-storeio=ufs diskd 
 aufs' '--enable-disk-io=AIO Blocking DiskDaemon DiskThreads' 
 '--enable-delay-pools' '--enable-icap-client' '--enable-kqueue' 
 '--with-large-files' '--enable-stacktraces' '--disable-optimizations' 
 '--prefix=/usr/local' '--mandir=/usr/local/man' '--infodir=/usr/local/info/' 
 '--build=amd64-portbld-freebsd8.3' 'build_alias=amd64-portbld-freebsd8.3' 
 'CC=cc' 'CFLAGS=-pipe -I/usr/local/include -g -g -DLDAP_DEPRECATED' 'LDFLAGS= 
 -L/usr/local/lib' 'CPPFLAGS=' 'CXX=c++' 'CXXFLAGS=-pipe -I/usr/local/include 
 -g -g -DLDAP_DEPRECATED' 'CPP=cpp' 
 --with-squid=/wrkdirs/usr/ports/www/squid31/work/squid-3.1.23 
 --enable-ltdl-convenience



Re: [squid-users] rock squid -k reconfigure

2013-03-22 Thread Alexandre Chappaz
Hi,

investigating on this issue, it appears that the problem comes from
the disker ID in the SwapDir object.
Added these debug lines in SwapDir::active()

...
// we are inside a disker dedicated to this disk
debugs(3,1,SwapDir::active :: KidIdentifier =   KidIdentifier 
disker =disker  . );
if (KidIdentifier == disker)
return true;



it appears that the disker is wrong after running a squid -k
reconfigure, and hence the active() function returns false.


with a fresh start :

2013/03/22 11:30:29 kid3| SwapDir::active :: KidIdentifier = 3disker =  2.
2013/03/22 11:30:29 kid3| SwapDir::active :: KidIdentifier = 3disker =  2.
2013/03/22 11:30:29 kid2| SwapDir::active :: KidIdentifier = 2disker =  2.
2013/03/22 11:30:29 kid2| SwapDir::active :: KidIdentifier = 2disker =  2.
2013/03/22 11:30:30 kid3| SwapDir::active :: KidIdentifier = 3disker =  2.
2013/03/22 11:30:30 kid3| SwapDir::active :: KidIdentifier = 3disker =  2.
2013/03/22 11:30:30 kid2| SwapDir::active :: KidIdentifier = 2disker =  2.
2013/03/22 11:30:30 kid2| SwapDir::active :: KidIdentifier = 2disker =  2.

with

[root@tv alex]# ps aux|grep squid

root 20320  0.0  0.0 1182724 2096 ?Ss   11:30   0:00 squid
-f /etc/squid/squid.conf
proxy20322  0.1  0.2 1183196 11220 ?   S11:30   0:00
(squid-coord-3) -f /etc/squid/squid.conf
proxy20323  0.0  0.2 1184180 11640 ?   S11:30   0:00
(squid-disk-2) -f /etc/squid/squid.conf
proxy20324  0.0  0.2 1188276 11484 ?   S11:30   0:00
(squid-1) -f /etc/squid/squid.conf




after issuing the squid -k reconfigure, the output of the ps is
identical, but the diskerID is set to 3.

2013/03/22 11:31:46 kid3| SwapDir::active :: KidIdentifier = 3disker =  3.
2013/03/22 11:31:46 kid2| SwapDir::active :: KidIdentifier = 2disker =  3.
2013/03/22 11:31:46 kid2| SwapDir::active :: KidIdentifier = 2disker =  3.
2013/03/22 11:31:47 kid3| SwapDir::active :: KidIdentifier = 3disker =  3.
2013/03/22 11:31:47 kid3| SwapDir::active :: KidIdentifier = 3disker =  3.
2013/03/22 11:31:47 kid2| SwapDir::active :: KidIdentifier = 2disker =  3.
2013/03/22 11:31:47 kid2| SwapDir::active :: KidIdentifier = 2disker =  3.


Trying to trace the problem futher, the disker ID seems to be given
in the contructor of the SwapDir,

SwapDir::SwapDir(char const *aType): theType(aType),
max_size(0), min_objsize(0), max_objsize (-1),
path(NULL), index(-1), disker(-1),
repl(NULL), removals(0), scanned(0),
cleanLog(NULL)
{
fs.blksize = 1024;
}



Any hints on where is the right call for creation ( or re-creation )
of this object after a reconfigure?


Thanks
Alex

2013/3/18 Alex Rousskov rouss...@measurement-factory.com:
 On 03/18/2013 09:18 AM, Alexandre Chappaz wrote:
 Hi,

 Im am using squid 3.2.8-20130304-r11795 with SMP  a rock dir configured.
 After a fresh start, cachemanager:storedir reports :

 by kid5 {
 Store Directory Statistics:
 Store Entries  : 52
 Maximum Swap Size  : 8388608 KB
 Current Store Swap Size: 28176.00 KB
 Current Capacity   : 0.34% used, 99.66% free

 Store Directory #0 (rock): /var/cache/squid/mem/
 FS Block Size 1024 Bytes

 Maximum Size: 8388608 KB
 Current Size: 28176.00 KB 0.34%
 Maximum entries:262143
 Current entries:   880 0.34%
 Pending operations: 1 out of 0
 Flags:
 } by kid5



 for the rock cache_dir.


 After a squid -k reconfigure, without any change in the squid.conf,
 the cachemanager is reporting this :

 by kid5 {
 Store Directory Statistics:
 Store Entries  : 52
 Maximum Swap Size  : 0 KB
 Current Store Swap Size: 0.00 KB
 Current Capacity   : 0.00% used, 0.00% free

 } by kid5



 Is this only a problem with the reporting? Is the rock cachedir still
 in use after the reconfigure / is there a way to check if it is still
 in use?


 Please see Bug 3774. It may be related to your problem.

http://bugs.squid-cache.org/show_bug.cgi?id=3774

 Alex.



Re: [squid-users] squid/SMP

2013-03-21 Thread Alexandre Chappaz
Hi,

there is also one important directory where squid stores the .pid file
and one .ipc file for each process, typically /var/run/squid/.
make sure this directory is writable by the user set for squid.

Regards
Alex



2013/3/21 Adam W. Dace colonelforbi...@gmail.com:
 I had this exact problem on a different platform, Mac OS X.

 You probably want to use sysctl to increase the OS-default limits on
 Unix Domain Sockets.
 They're mentioned at the bottom of the squid Wiki page here:
 http://wiki.squid-cache.org/Features/SmpScale

 Please mail the list if you don't mind once you try that, I then ran
 into a different problem but most likely FreeBSD isn't affected.

 Regards,

 On Thu, Mar 21, 2013 at 5:52 AM, Eugene M. Zheganin e...@norma.perm.ru 
 wrote:
 Hi.

 I'm using squid 3.2.6 on a FreeBSD and today I tried to use it's SMP
 feature. I've added 'workers 2' in it's configuration file, checked the
 permission on localstatedir and ran it.
 I got on start

 FATAL: kid2 registration timed out

 and then looks like coordinator started to try to restart kids, but
 unsuccessfully. Obviously, no client requests were served at that time.
 I checked the localstatedir and saw 3 sockets, one from coordinator and two
 from kids - so I'm sure permissions are ok.

 What can I do to debug this feature ?
 I understand 3.2.x is no longer supported and I need to use 3.3.x, but right
 now I'm stuck to FreeBSD ports on my production, and there's no 3.3.[ in it
 yet; will try to build 3.3.[ realease on a test machine.

 Thanks.
 Eugene.



 --
 
 Adam W. Dace colonelforbi...@gmail.com

 Phone: (815) 355-5848
 Instant Messenger: AIM  Yahoo! IM - colonelforbin74 | ICQ - #39374451
 Microsoft Messenger - colonelforbi...@live.com

 Google Profile: http://www.google.com/profiles/ColonelForbin74


[squid-users] rock squid -k reconfigure

2013-03-18 Thread Alexandre Chappaz
Hi,

Im am using squid 3.2.8-20130304-r11795 with SMP  a rock dir configured.
After a fresh start, cachemanager:storedir reports :

by kid5 {
Store Directory Statistics:
Store Entries  : 52
Maximum Swap Size  : 8388608 KB
Current Store Swap Size: 28176.00 KB
Current Capacity   : 0.34% used, 99.66% free

Store Directory #0 (rock): /var/cache/squid/mem/
FS Block Size 1024 Bytes

Maximum Size: 8388608 KB
Current Size: 28176.00 KB 0.34%
Maximum entries:262143
Current entries:   880 0.34%
Pending operations: 1 out of 0
Flags:
} by kid5



for the rock cache_dir.


After a squid -k reconfigure, without any change in the squid.conf,
the cachemanager is reporting this :

by kid5 {
Store Directory Statistics:
Store Entries  : 52
Maximum Swap Size  : 0 KB
Current Store Swap Size: 0.00 KB
Current Capacity   : 0.00% used, 0.00% free

} by kid5



Is this only a problem with the reporting? Is the rock cachedir still
in use after the reconfigure / is there a way to check if it is still
in use?

Thank you
Alex


Re: [squid-users] Re: Squid 3.3.2 SMP Problem

2013-03-15 Thread Alexandre Chappaz
Hi,

which OS do you recommend for running SMP enabled version of squid?
Is there a particular kernel version to use or not use?
Do you have more specific tuning settings for shm, IPC and UDS
sockets, other than the hints from
http://wiki.squid-cache.org/Features/SmpScale#Troubleshooting

Regards
Alex

2013/3/15 Ahmad ahmed.za...@netstream.ps:
 hi all ,
 ive added in my squid.conf the config of smp ,
 im using squid 3.3.3  ,

 but my question is , how to monitoe the performace and make sure if my other
 idle cores are being used ??

 here is what i modified :
 smp options###
 # Custom options
 memory_cache_shared off
 #workers 2
 #
 workers 4
 cache_dir rock /squid-cache/rock-1 3000 max-size=31000 max-swap-rate=250
 swap-timeout=350
 cache_dir rock /squid-cache/rock-2 3000 max-size=31000 max-swap-rate=250
 swap-timeout=350
 =
 also i want to ask about another issue ,
 does using smp can make delay when starting squid ? i mean that rebuildig
 process take more time when using smp ??!!
 wish to help

 regards



 --
 View this message in context: 
 http://squid-web-proxy-cache.1019090.n4.nabble.com/Squid-3-3-2-SMP-Problem-tp4658906p4659000.html
 Sent from the Squid - Users mailing list archive at Nabble.com.


Re: [squid-users] sharepoint pinning issue?

2013-02-26 Thread Alexandre Chappaz
Hi,

I have found some time to go further in the investigation. And here is
status right now.
the behavior is the some with only 1 squid ( no upstream server ), and
is also the same if I use squid as a reverse proxy for the Sharepoint
server.

As read is some threads about this subject, depending ont the browser
/ OS, behaviour differes.
IE in XP works perfectly, whereas FF in XP or linux asks for
authentification in a loop whenever trying to upload a relatively big
file to the server.
Activating the debug level and trying to analyse the headers of the
packets gave me quite some headache! What we can see is that the HTTP
headers and techniques for POSTing files used are totally differents
between browser.
I would love some help on analysing these logs.
Joined are 2 files :
capture_IE_XP : upload of a file works
capture_FF_XP : upload of a file does not

I can provide access to the sharepoint server  reverse proxy if
someone has time to jump in.

Best regards
Alex

2013/2/13 Amos Jeffries squ...@treenet.co.nz:
 On 13/02/2013 3:49 a.m., Alexandre Chappaz wrote:

 Hi,

 I know this is a subject that has been put on the table many times,
 but I wanted to share with you my experience with squid + sharepoint.

 Squid Cache: Version 3.2.7-20130211-r11781

 I am having an issue with autehtication :
 when accessing the sharepoint server, I do get a login/pw popup, I can
 login and see some of the pages behind, but when doing some operation,
 even though I am supposed to be logged in, the autentcation popup
 comes back.
 Here is what I find the the access log :
 1360679927.561 43 X.X.X.X TCP_MISS/200 652 GET
 http://saralex.hd.free.fr/_layouts/images/selbg.png -
 FIRSTUP_PARENT/192.168.100.XX image/png


 URL #1. No authentication required. non-pinned connection used.


 1360679928.543 37 X.X.X.X TCP_MISS/401 542 GET
 http://saralex.hd.free.fr/_layouts/listform.aspx? -
 PINNED/192.168.100.XX -


 URL #2. Sent to upstream on already authenticated+PINNED connection.
 Upstream server requires further authentication details.
  -- authentication challenge?


 1360679928.665 58 X.X.X.X TCP_MISS/401 795 GET
 http://saralex.hd.free.fr/_layouts/listform.aspx? -
 PINNED/192.168.100.XX -


 URL #2 repeated. Sent to upstream on already authenticated+PINNED
 connection. Upstream server requires further authentication details.
  -- possibly authentication handshake request?


 1360679928.753229 X.X.X.X TCP_MISS/200 20625 GET
 http://saralex.hd.free.fr/_layouts/images/fgimg.png -
 FIRSTUP_PARENT/192.168.100.XX image/png


 URL #3. No authentication required. non-pinned connection used.


 1360679928.788 68 X.X.X.X TCP_MISS/302 891 GET
 http://saralex.hd.free.fr/_layouts/listform.aspx? -
 PINNED/192.168.100.XX text/html


 URL #2 repeated. Sent to upstream on already authenticated+PINNED
 connection. Upstream server redirectes the client to another URL.
  -- authentication credentials accepted.


 1360679928.921 45 X.X.X.X TCP_MISS/401 542 GET
 http://saralex.hd.free.fr/Lists/Tasks/NewForm.aspx? -
 PINNED/192.168.100.XX -


 URL #4. Sent to upstream on already authenticated+PINNED connection.
 Upstream server requires further authentication details.
  -- authentication challenge?


 1360679929.019 47 X.X.X.X TCP_MISS/401 795 GET
 http://saralex.hd.free.fr/Lists/Tasks/NewForm.aspx? -
 PINNED/192.168.100.XX -


 URL #4 repeated. Sent to upstream on already authenticated+PINNED
 connection. Upstream server requires further authentication details.
  -- possibly authentication handshake request?


 1360679929.656 81 X.X.X.X TCP_MISS/200 1986 GET
 http://saralex.hd.free.fr/_layouts/images/loadingcirclests16.gif -
 FIRSTUP_PARENT/192.168.100.XX image/gif


 URL #5. no authentication required. non-pinned connection used.


 1360679930.417   1322 X.X.X.X TCP_MISS/200 130496 GET
 http://saralex.hd.free.fr/Lists/Tasks/NewForm.aspx? -
 PINNED/192.168.100.XX text/html


 URL #4 repeated. Sent to upstream on already authenticated+PINNED
 connection. Upstream server provides the display response.
  -- authentication credentials accepted.


 1360679934.618 53 X.X.X.X TCP_MISS/401 542 GET
 http://saralex.hd.free.fr/_layouts/iframe.aspx? -
 PINNED/192.168.100.XX -
 1360679934.729 51 X.X.X.X TCP_MISS/401 795 GET
 http://saralex.hd.free.fr/_layouts/iframe.aspx? -
 PINNED/192.168.100.XX -

 could this be a pinning issue?

 Is V2.7 STABLE managing these things in a nicer way?


 Unknown. But I doubt it. This is Squid using a PINNED connection to relay
 traffic to an upstream server. That upstream server is rejecting the clients
 delivered credentials after each object. There is no sign of proxy
 authentication taking place, this re-challenge business is all between
 client and upstream server.

 You need to look at whether these connections are being pinned then closed,
 and why that is happening. Squid-3.2 offers debug level 11,2 which will give
 you a trace of the HTTP headers to see if the close is a normal

[squid-users] logformat emulate_httpd_log

2012-11-14 Thread Alexandre Chappaz
Hi,

I am looking for some precision on the %st  in the log format directive.
with squid 2.6, I used to set

emulate_httpd_log on

In order to have the useragent and referer I commented this line out
and used instead the combined format as defined here :

logformat combined %a %[ui %[un [%tl] %rm %ru HTTP/%rv %Hs %st
%{Referer}h %{User-Agent}h %Ss:%Sh


This is messing up with the scripts I have for parsing the logfiles in
the sense that %Hs and %st now report '-' character when I was
expecting a '0' with the emulate_httpd_log on.

Is there a way to turn these 2 fields back to the emulate_httpd_log behavior?


Regards
Alex


[squid-users] assertion failed

2012-10-24 Thread Alexandre Chappaz
Hi,

My squid 3.2.2 - R is failing after a reconfigure.
Not using SMP.

here is what I find in the logs :


2012/10/24 14:54:42 kid1| assertion failed: comm.cc:163:
!fd_table[conn-fd].closing()


2012/10/24 14:58:29 kid1| StoreEntry-ping_status: 2
2012/10/24 14:58:29 kid1| StoreEntry-store_status: 1
2012/10/24 14:58:29 kid1| StoreEntry-swap_status: 0
2012/10/24 14:58:29 kid1| assertion failed: store.cc:1854: isEmpty()
2012/10/24 14:58:33 kid1| Starting Squid Cache version
3.2.2-20121011-r11676 for x86_64-unknown-linux-gnu...
2012/10/24 14:58:33 kid1| Process ID 569
2012/10/24 14:58:33 kid1| Process Roles: worker
2012/10/24 14:58:33 kid1| With 65535 file descriptors available
2012/10/24 14:58:33 kid1| Initializing IP Cache...
2012/10/24 14:58:33 kid1| DNS Socket created at 0.0.0.0, FD 11
2012/10/24 14:58:33 kid1| Adding nameserver 194.2.0.20 from /etc/resolv.conf
2012/10/24 14:58:33 kid1| Adding nameserver 194.2.0.50 from /etc/resolv.conf
2012/10/24 14:58:33 kid1| Adding domain d097.cp from /etc/resolv.conf
2012/10/24 14:58:33 kid1| helperOpenServers: Starting 10/1000
'squidGuard' processes
2012/10/24 14:58:33 kid1| Logfile: opening log stdio:/var/log/squid/access.log
2012/10/24 14:58:33 kid1| Logfile: opening log
stdio:/var/log/squid/pirates_XFF.log
2012/10/24 14:58:33 kid1| Logfile: opening log
stdio:/var/log/squid/pirates_VIA.log
2012/10/24 14:58:33 kid1| Store logging disabled
2012/10/24 14:58:33 kid1| Swap maxSize 23019520 + 2097152 KB,
estimated 1932051 objects
2012/10/24 14:58:33 kid1| Target number of buckets: 96602
2012/10/24 14:58:33 kid1| Using 131072 Store buckets
2012/10/24 14:58:33 kid1| Max Mem  size: 2097152 KB
2012/10/24 14:58:33 kid1| Max Swap size: 23019520 KB
2012/10/24 14:58:33 kid1| Rebuilding storage in /var/cache/squid-mem (dirty log)
2012/10/24 14:58:33 kid1| Rebuilding storage in /var/cache/squid (dirty log)
2012/10/24 14:58:33 kid1| Using Least Load store dir selection
2012/10/24 14:58:33 kid1| Set Current Directory to /var/cache/squid
2012/10/24 14:58:33 kid1| Loaded Icons.
2012/10/24 14:58:33 kid1| HTCP Disabled.
2012/10/24 14:58:33 kid1| Sending SNMP messages from 0.0.0.0:3401
2012/10/24 14:58:33 kid1| Configuring Parent proxyav.bercy.cp/3128/0
2012/10/24 14:58:33 kid1| Squid plugin modules loaded: 0
2012/10/24 14:58:33 kid1| Accepting HTTP Socket connections at
local=0.0.0.0:3128 remote=[::] FD 39 flags=9
2012/10/24 14:58:33 kid1| Accepting ICP messages on 0.0.0.0:3130
2012/10/24 14:58:33 kid1| Sending ICP messages from 0.0.0.0:3130
2012/10/24 14:58:33 kid1| Accepting SNMP messages on 0.0.0.0:3401
2012/10/24 14:58:33 kid1| Store rebuilding is 0.62% complete
2012/10/24 14:58:33 kid1| Done reading /var/cache/squid swaplog (57155 entries)
2012/10/24 14:58:34 kid1| WARNING: HTTP header contains NULL
characters {Accept: */*^M
Content-Type: application/x-www-form-urlencoded}
NULL
{Accept: */*^M
Content-Type: application/x-www-form-urlencoded
2012/10/24 14:58:34 kid1| Starting new redirector helpers...
2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000
'squidGuard' processes
2012/10/24 14:58:34 kid1| Starting new redirector helpers...
2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000
'squidGuard' processes
2012/10/24 14:58:34 kid1| Starting new redirector helpers...
2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000
'squidGuard' processes
2012/10/24 14:58:34 kid1| Starting new redirector helpers...
2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000
'squidGuard' processes
2012/10/24 14:58:34 kid1| Starting new redirector helpers...
2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000
'squidGuard' processes
2012/10/24 14:58:34 kid1| Starting new redirector helpers...
2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000
'squidGuard' processes
2012/10/24 14:58:34 kid1| Starting new redirector helpers...
2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000
'squidGuard' processes
2012/10/24 14:58:34 kid1| Starting new redirector helpers...
2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000
'squidGuard' processes
2012/10/24 14:58:34 kid1| Starting new redirector helpers...
2012/10/24 14:58:34 kid1| helperOpenServers: Starting 5/1000
'squidGuard' processes
2012/10/24 14:58:37 kid1| Done reading /var/cache/squid-mem swaplog
(648235 entries)
2012/10/24 14:58:37 kid1| Finished rebuilding storage from disk.
2012/10/24 14:58:37 kid1|435593 Entries scanned
2012/10/24 14:58:37 kid1| 1 Invalid entries.
2012/10/24 14:58:37 kid1| 0 With invalid flags.
2012/10/24 14:58:37 kid1|165731 Objects loaded.
2012/10/24 14:58:37 kid1| 0 Objects expired.
2012/10/24 14:58:37 kid1|268805 Objects cancelled.
2012/10/24 14:58:37 kid1|   912 Duplicate URLs purged.
2012/10/24 14:58:37 kid1|   145 Swapfile clashes avoided.
2012/10/24 14:58:37 kid1|   Took 4.08 seconds (40609.22 objects/sec).
2012/10/24 14:58:37 kid1| Beginning Validation Procedure
2012/10/24 14:58:37 kid1|   

[squid-users] NTLM passthu

2012-10-11 Thread Alexandre Chappaz
Hi,

since upgrade from 3.1.20 to 3.2.1, we are facing a problem regarding
access to a IIS server with authentication :

the popup asking for credentials keeps poping out and make the
browsing impossibe.
I observed the same behavior with latest 3.2.2 version (r11676 ).

On the contrary, using 3.1.20 and same config, everything is fine.


Is this a regression? Shoudl I file a bug?

Thanks
Alex


Re: [squid-users] NTLM passthu

2012-10-11 Thread Alexandre Chappaz
Yes I have seen this bug and applied the patch right now.

with patch applied, behavior is a bit different :

after asking for credentials, I get a connexion reset.

and from access log :

1349962782.169  9 10.XXX.XXX.XXX TCP_MISS/401 436 GET
http://www.si-diamant.fr/ - HIER_DIRECT/94.124.232.64 -




2012/10/11 Wolfgang Breyha wbre...@gmx.net:
 Alexandre Chappaz wrote, on 11.10.2012 14:45:
 Is this a regression? Shoudl I file a bug?

 There already is a bug and a proposed fix
 http://bugs.squid-cache.org/show_bug.cgi?id=3655

 Greetings, Wolfgang
 --
 Wolfgang Breyha wbre...@gmx.net | http://www.blafasel.at/
 Vienna University Computer Center | Austria



Re: [squid-users] NTLM passthu

2012-10-11 Thread Alexandre Chappaz
Applied the patch on both 3.2.1 and 3.2.2 . Same result.
I'll post on your bug report.

In the meantime, is there some additional info that could help to debug?


2012/10/11 Wolfgang Breyha wbre...@gmx.net:
 Alexandre Chappaz wrote, on 11.10.2012 15:42:
 Yes I have seen this bug and applied the patch right now.

 with patch applied, behavior is a bit different :

 after asking for credentials, I get a connexion reset.

 Did you use 3.2.2 or 3.2.1? My patch is for 3.2.1. Don't know if it still
 works on 3.2.2.

 If it doesn't work on 3.2.1 either it's bad because this is not trivial to 
 debug.

 Maybe you want to comment on my bugreport that my patch doesn't fix it for 
 you.

 Greetings, Wolfgang
 --
 Wolfgang Breyha wbre...@gmx.net | http://www.blafasel.at/
 Vienna University Computer Center | Austria



Re: [squid-users] NTLM passthu

2012-10-11 Thread Alexandre Chappaz
Hi,

In fact I made a wrong manipulation while appling the patch.
When applied correctly, the provided patch does fix the pinning
problem and the authentaction to IIS works.

thanks
Alex

2012/10/11 Wolfgang Breyha wbre...@gmx.net:
 Alexandre Chappaz wrote, on 11.10.2012 15:57:
 Applied the patch on both 3.2.1 and 3.2.2 . Same result.
 I'll post on your bug report.

 In the meantime, is there some additional info that could help to debug?

 At least I can't help in this matter because my knowledge about squid source
 code is still very limited. I thought I understood all the stuff about pinning
 and ntlm/negotiate passthrough. It was enough to fix our troubles, but
 obviously not to fix yours;-) I currently do not have the spare time to debug
 any further. Sorry.

 Greetings, Wolfgang
 --
 Wolfgang Breyha wbre...@gmx.net | http://www.blafasel.at/
 Vienna University Computer Center | Austria



[squid-users] squid 3.2.1 : assertion failed on reconfigure

2012-10-09 Thread Alexandre Chappaz
Hi,

I am having a frequent issue since upgrade to squid 3.2.1-20120817-r11648
only one worker configured.
frequently dies with the following message in cache.log
Says report this, so reporting I am!

2012/10/08 14:02:01 kid1| Could not parse headers from on disk object
2012/10/08 14:02:01 kid1| WARNING: An error inside Squid has caused an
HTTP reply without Date:. Please report this:
2012/10/08 14:02:01 kid1| StoreEntry-key: DAAE3F7903C505691D3DBAF0C7764E53
2012/10/08 14:02:01 kid1| StoreEntry-next: 0x1d74118
2012/10/08 14:02:01 kid1| StoreEntry-mem_obj: 0x4c9eba0
2012/10/08 14:02:01 kid1| StoreEntry-timestamp: -1
2012/10/08 14:02:01 kid1| StoreEntry-lastref: 1349697721
2012/10/08 14:02:01 kid1| StoreEntry-expires: -1
2012/10/08 14:02:01 kid1| StoreEntry-lastmod: -1
2012/10/08 14:02:01 kid1| StoreEntry-swap_file_sz: 0
2012/10/08 14:02:01 kid1| StoreEntry-refcount: 1
2012/10/08 14:02:01 kid1| StoreEntry-flags:
CACHABLE,DISPATCHED,PRIVATE,FWD_HDR_WAIT,VALIDATED
2012/10/08 14:02:01 kid1| StoreEntry-swap_dirn: -1
2012/10/08 14:02:01 kid1| StoreEntry-swap_filen: -1
2012/10/08 14:02:01 kid1| StoreEntry-lock_count: 3
2012/10/08 14:02:01 kid1| StoreEntry-mem_status: 0
2012/10/08 14:02:01 kid1| StoreEntry-ping_status: 2
2012/10/08 14:02:01 kid1| StoreEntry-store_status: 1
2012/10/08 14:02:01 kid1| StoreEntry-swap_status: 0
2012/10/08 14:02:01 kid1| Could not parse headers from on disk object
2012/10/08 14:02:01 kid1| WARNING: An error inside Squid has caused an
HTTP reply without Date:. Please report this:
2012/10/08 14:02:01 kid1| StoreEntry-key: 222DCAAD7BE504DF43338A35A6F3D170
2012/10/08 14:02:01 kid1| StoreEntry-next: 0x2b32698
2012/10/08 14:02:01 kid1| StoreEntry-mem_obj: 0x534b6d0
2012/10/08 14:02:01 kid1| StoreEntry-timestamp: -1
2012/10/08 14:02:01 kid1| StoreEntry-lastref: 1349697721
2012/10/08 14:02:01 kid1| StoreEntry-expires: -1
2012/10/08 14:02:01 kid1| StoreEntry-lastmod: -1
2012/10/08 14:02:01 kid1| StoreEntry-swap_file_sz: 0
2012/10/08 14:02:01 kid1| StoreEntry-refcount: 1
2012/10/08 14:02:01 kid1| StoreEntry-flags:
CACHABLE,DISPATCHED,PRIVATE,FWD_HDR_WAIT,VALIDATED
2012/10/08 14:02:01 kid1| StoreEntry-swap_dirn: -1
2012/10/08 14:02:01 kid1| StoreEntry-swap_filen: -1
2012/10/08 14:02:01 kid1| StoreEntry-lock_count: 3
2012/10/08 14:02:01 kid1| StoreEntry-mem_status: 0
2012/10/08 14:02:01 kid1| StoreEntry-ping_status: 2
2012/10/08 14:02:01 kid1| StoreEntry-store_status: 1
2012/10/08 14:02:01 kid1| StoreEntry-swap_status: 0
2012/10/08 14:02:01 kid1| Could not parse headers from on disk object
2012/10/08 14:02:01 kid1| WARNING: An error inside Squid has caused an
HTTP reply without Date:. Please report this:
2012/10/08 14:02:01 kid1| StoreEntry-key: EF553578592F558D4F29A99A2B954197
2012/10/08 14:02:01 kid1| StoreEntry-next: 0x204c718
2012/10/08 14:02:01 kid1| StoreEntry-mem_obj: 0x5296840
2012/10/08 14:02:01 kid1| StoreEntry-timestamp: -1
2012/10/08 14:02:01 kid1| StoreEntry-lastref: 1349697721
2012/10/08 14:02:01 kid1| StoreEntry-expires: -1
2012/10/08 14:02:01 kid1| StoreEntry-lastmod: -1
2012/10/08 14:02:01 kid1| StoreEntry-swap_file_sz: 0
2012/10/08 14:02:01 kid1| StoreEntry-refcount: 1
2012/10/08 14:02:01 kid1| StoreEntry-flags:
CACHABLE,DISPATCHED,PRIVATE,FWD_HDR_WAIT,VALIDATED
2012/10/08 14:02:01 kid1| StoreEntry-swap_dirn: -1
2012/10/08 14:02:01 kid1| StoreEntry-swap_filen: -1
2012/10/08 14:02:01 kid1| StoreEntry-lock_count: 3
2012/10/08 14:02:01 kid1| StoreEntry-mem_status: 0
2012/10/08 14:02:01 kid1| StoreEntry-ping_status: 2
2012/10/08 14:02:01 kid1| StoreEntry-store_status: 1
2012/10/08 14:02:01 kid1| StoreEntry-swap_status: 0
2012/10/08 14:02:01 kid1| WARNING: 10 swapin MD5 mismatches
2012/10/08 14:02:01 kid1| Could not parse headers from on disk object
2012/10/08 14:02:01 kid1| WARNING: An error inside Squid has caused an
HTTP reply without Date:. Please report this:
2012/10/08 14:02:01 kid1| StoreEntry-key: A27A9B4B747D4D9B36BACDDFAAD6A266
2012/10/08 14:02:01 kid1| StoreEntry-next: 0x2ae43f8
2012/10/08 14:02:01 kid1| StoreEntry-mem_obj: 0x51523a0
2012/10/08 14:02:01 kid1| StoreEntry-timestamp: -1
2012/10/08 14:02:01 kid1| StoreEntry-lastref: 1349697721
2012/10/08 14:02:01 kid1| StoreEntry-expires: -1
2012/10/08 14:02:01 kid1| StoreEntry-lastmod: -1
2012/10/08 14:02:01 kid1| StoreEntry-swap_file_sz: 0
2012/10/08 14:02:01 kid1| StoreEntry-refcount: 1
2012/10/08 14:02:01 kid1| StoreEntry-flags:
CACHABLE,DISPATCHED,PRIVATE,FWD_HDR_WAIT,VALIDATED
2012/10/08 14:02:01 kid1| StoreEntry-swap_dirn: -1
2012/10/08 14:02:01 kid1| StoreEntry-swap_filen: -1
2012/10/08 14:02:01 kid1| StoreEntry-lock_count: 3
2012/10/08 14:02:01 kid1| StoreEntry-mem_status: 0
2012/10/08 14:02:01 kid1| StoreEntry-ping_status: 2
2012/10/08 14:02:01 kid1| StoreEntry-store_status: 1
2012/10/08 14:02:01 kid1| StoreEntry-swap_status: 0
2012/10/08 14:02:01 kid1| Could not parse headers from on disk object
2012/10/08 14:02:01 kid1| WARNING: An error inside Squid has caused an
HTTP reply without Date:. Please report this:

[squid-users] 3.2.1 : assertion failed

2012-09-20 Thread Alexandre Chappaz
Hi,

I am using squid 3.2.1 in a heavy load environnement.
Since upgrading from 3.1 to 3.2.1, we are having stability issues,
with the only worker restarting frequently with errors :

assertion failed: comm.cc:163: !fd_table[conn-fd].closing()
and then the parent squid process is trying to restart the kid1 and :
2012/09/19 15:55:25 kid1| assertion failed: store.cc:1854: isEmpty()

until the parent process gives up.
Sep 19 15:55:49 xxx squid[2991]: Squid Parent: (squid-1) process
7274 will not be restarted due to repeated, frequent failures
Sep 19 15:55:49 xxx squid[2991]: Exiting due to repeated, frequent failures


I have only 1 worker.
I have 2 cache_dir :

one is a ramdisk and one is a standard HD folder
cache_dir aufs /var/cache/squid-mem 2000 16 256 max-size=2048
cache_dir aufs /var/cache/squid 20480 16 256


Anyone experiencing the same behaviour?

thanks
Alex