Hello,
I have my squid configuration set to require authentication.
Does anyone know how squid physically puts the box up resquesting the
username and password? I know squid passes the information put inot
this box to the selected authentication program (like ncsa_auth), but
how does squid make
Hello,
Could someone tell me how squid recognizes the end of a GET sequence? I
assume the end of a PUT session is similar?
For example, when squid sends a GET request for a specific html page,
the answering server sends the requested data, but how does squid know
when the data transmission strea
Hello,
I managed to get squid to accept a single file that I can push to it
from a MS Windows application that I am developing.
Now I am trying to send two during the same session. But I am having
problems.
BTW: squid is listening on 216.19.43.110:3128, and my Windows platform
is pushing from 1
Hello,
Henrik Nordstrom wrote:
>
> What does the requests you send to Squid look like?
A typical request looks like:
PUT http://learning.plans/cachepurger HTTP/1.0
Date: Wed Oct 06 01:14:10 2004 GMT
Server: ISP Systems CachePusher 1.0
Content-Type: text/html
Content-Length: 2232
Last-Modified:
Hello,
Henrik Nordstrom wrote:
>
> On Tue, 5 Oct 2004, OTR Comm wrote:
>
> > Like I said, during a multiple file push session, the first entry shows
> > up in cache.log and gets cached, but the other entries do not show up in
> > cache.log, and do not get cached. But
Hello,
I made a work-around for my problem! Now I create a new socket
instantiation before pushing each file to squid and close the socket
after I receive an 'HTTP/1.0 200 OK' response.
I realize that this is not the most efficient way to communicate through
a socket, but it allows me to continu
Hello,
It appears that web servers also open and close the socket while
servicing GETs. I watched snort dumps of different traffic sessions
between squid and other web servers, and they all opened and closed the
interface during their particular session with squid.
So, it seems like my work-arou
Hello,
Henrik Nordstrom wrote:
>
> On Wed, 6 Oct 2004, OTR Comm wrote:
>
> > I have the cache.log and snort dumps for both squid GETs and my
> > PushCache PUTs sessions for the same pages if that would be helpful. The
> > combined dumps are 12 pages so I shouldn
Henrik Nordstrom wrote:
>
> On Thu, 7 Oct 2004, OTR Comm wrote:
>
> > I do have "Proxy-Connection: Keep-Alive" in my header.
>
> Good.
>
> Do you also get one back from Squid? If not the pushCache patch needs to
> be extended.
I don't get any
Hello,
> No headers at all, just a "HTTP/1.0 200 OK" line?
That's right!
> > Does this mean that squid (the pushcache patched version) is ignoring my
> > "Proxy-Connection: Keep-Alive" header?
>
> Yes, and in addition not being very friendly about it..
Oh well, looks like I have some coding t
Hello,
> The places in Squid generating HTTP replies (which is somewhat different
> from relaying an upstream reply) are:
>
> ftp.c
> gopher.c
> errorpage.c
> cachemgr.c
> internal.c
>
> All uses httpReplySetHeaders() to initiate the HTTP reply headers, and
> then adds/delete
> It depends, but for the connection to be able to be kept persistent in
> HTTP/1.0 the following criterias need to be fulfilled:
>
> a) The reply-body must have a known length, as indicated by the
> Content-length header.
Would I have a reply-body if I am pushing? I think I understand this
wit
Hello,
Where is it that squid determines the cache directory, subdirectory, and
filename to store a cache file?
I see in storeLog() where e->swap_dirn and e->swap_filen are written to
store.log, but e->swap_dirn doesn't give me the directory/subdirectory.
I guess it is in either store.c, store_c
>
> See fs/ufs/store_dir_ufs.c
I have store_dir.c in the pushcache patch, but not store_dir_ufs.c.
>
> > I see in storeLog() where e->swap_dirn and e->swap_filen are written to
> > store.log, but e->swap_dirn doesn't give me the directory/subdirectory.
>
> swap_filen gives you the cache file
> Which version of Squid is this based on?
2.5.STABLE5-CVS
Thanks,
Murrah Boswell
Hello,
I have asked this question before, but I still can't figure it out!
When a file is written to cache, where does Squid figure out which cache
directory to store the file in?
I see in store_swapout.c where e->swap_filen and e->swap_dirn are
assigned, but if I write these out witha debug sta
Hello,
I can send Login Alerts to all users, Special Messages to all users,
Group Messages to all members of a given group and Personal Messages to
individuals. The Login Alerts appear to all users when they login to
the system, and they only appear once.
Special Messages appear both to people w
I use Standard C, not Perl in this system.
Murrah Boswell
Hello,
I can send Login Alerts to all users, Special Messages to all users,
Group Messages to all members of a given group and Personal Messages to
individuals. The Login Alerts appear to all users when they login to
the system, and the
Hello,
I am running squid-3.0-PRE3-20030924 and have squidGuard-1.2 as my
redirector. I have hacked squidGuard to support MySQL queries. When I
run squidGuard in test mode from the command line, I can query MySQL
with no problems, and I can write to a 'debugging' file while I am
testing my code
Hello,
This may seem like a dumb question, but...
I have squid running with authentication and with squidGuard as a
redirect program. All this is working okay. I have set some debugging
hooks in the squidGuard code to watch operation and how squid and
squidGuard interface.
My question is this,
Henrik Nordstrom wrote:
> Because
>
> a) Redirectors is really meant for redirecting the requests to local known
> mirrors.
>
> b) The rules in your redirector may differ for differen users.
>
> > When does squid check it's cache for the information on any given
> > request? Is it after the ca
Hello,
I am using squid-3.0-PRE3-20031028.
I get the following message pairs periodically (different process ID
each time) in my syslog:
Squid Parent: child process 6889 exited due to signal 6
Squid Parent: child process 8118 started
and it appears that squid has restarted itself. However, the
Hello,
I have squid running with squidGuard as a redirector and ncsa_auth for
authentication. I have put some debugging hooks (mostly some counters)
in the squidGuard code, and find that even if I start multiple sessions
with different userIDs under squid, all the squidGuard sessions share
the va
Hello,
Does squid record or know about the size (in bytes) of each GET? If
not, is there any way to get this info from the Web Server?
If so, what structure does it use to record this info? I want to pass
the size of each GET to a modified verion of squidGuard so I can do some
quota checking!
Hello,
What is the maximum number of redirector children that squid can
support. I assume that squid doesn't have a limit, but what is the
system overhead associated with each redirector child?
I am just wondering how many redirector children I should specify for a
system that is potentially sup
> The main thing to worry about is the memory requirements of running very
> many redirectors.
Can you give some idea of how much memory is required to support each
redirector, or is this a fuction of which redirector is used and what
the redirector is doing? In my case, I am using squidGuard.
Hello,
I have redirector_children 10 in my config file, but I keep getting the
entry below, over and over again in my cache.log when I go to
http://money.cnn.com/best/bplive:
2003/12/18 23:01:30| Starting Squid Cache version 3.0-PRE3-CVS for
i686-pc-linux-gnu...
2003/12/18 23:01:30| Process ID 6
Yes, Squid has permission to run the redirector. Squid runs as 'nobody'
and the redirector is owned by 'nobody' with 755 permissions.
Murrah Boswell
Duane Wessels wrote:
>
> > Is this telling me that my redirectors are dying from an error in the
> > redirector code, or what?
>
> Make sure that
Do you think it could have something to do with the convoluted way that
ar.atwola.com is generating the dynamic ads since all I get are broken
links to their ads? I mean, what does the link
http://ar.atwola.com/link/93183014/aol do anyway?
Murrah Boswell
Duane Wessels wrote:
>
> > Is this telli
; On Fri, 19 Dec 2003, OTR Comm wrote:
>
> > Yes, Squid has permission to run the redirector. Squid runs as 'nobody'
> > and the redirector is owned by 'nobody' with 755 permissions.
>
> Please try running the helper manually as nobody
>
> # su nobody
> /path/to/helper and arguments
>
> Regards
> Henrik
Hello,
I have read in the Squid code someplace, but can't remember where now,
but what does Squid expect back from the authentication program? I use
ncsa_auth, and I see in ncsa_auth.c:
u = (user_data *)hash_lookup(hash, user);
if (u == NULL) {
printf("ERR\n");
Clint,
I can do this if your ISP client has a MySQL database installed.
Murrah Boswell
Clint Sim wrote:
>
> Hi,
>
> An ISP that I consult for is running a free access promotion over the
> Christmas period and would like users who log into this service to be
> redirected to a "We're giving you
Hello,
If anyone is interested, I have written a basic auth_param routine that
authenticates against a MySQL database. I call it mysql_auth and it is
written in C. I also wrote a simple, Web based interface (also in C) for
adding new Squid Users to MySQL for mysql_auth.
The tarball is 29436 btye
gt; Regards
> Henrik
>
> On Tue, 23 Dec 2003, OTR Comm wrote:
>
> > Hello,
> >
> > If anyone is interested, I have written a basic auth_param routine that
> > authenticates against a MySQL database. I call it mysql_auth and it is
> > written in C. I also wrot
Hello,
I am trying to figure something out. When Squid is configured to
authenticate, how does it keep up with the different session for
individual users who have logged on?
I have looed into this before, and actually asked questions to the group
about various aspects of Squid authentication, bu
No offense, but could you guys take this discussion out of this list
please?
It is interesting, but IMHO, it eally doesn't belong here.
Thanks,
Murrah Boswell
[EMAIL PROTECTED] wrote:
>
> What you dont realize that that the majority of the traffic with p2p is *not*
> the downloads themselves bu
Hello,
Does anyone know of a way, or even if it is possible, to have Squid
interfaced to the Glimpse webbot, or any webbot or spider? Or directly
coupled to the Glimpse search engine?
I am working on a proof of concept to see if I can couple the
Glimpse/Harvest distributed search engine to Squid
> O'Reilly released "Squid: The Definitive Guide" a couple of days
> ago. Here is their web page for it:
>
> http://www.oreilly.com/catalog/squid/
>
> Has anyone received a copy yet? Looks like Amazon and Barnes and
> Noble are yet shipping it.
I ordered a copy from Amazon today and they s
Hello,
Is it possible to setup a search engine, like Glimpse or Swish-e, to
catalog and search against the information in the Squid cache?
To minimize bandwidth on certain remote locations, I would like to
develop a spider to 'feed' information into squid cache, and then have
the search engine wo
> Technicallly it should be possible, but you need to write another
> retreiver spider for the engine knowing how to read the squid cache files
> instead of fetching from the web or indexing local files.
>
> The format of the cache files are described in the programmers guide and
> iirc there is e
Okay, I figured out (sort of) how the purge utility is extracting the
url from the file header.
Now, how does squid which cache file goes with which cache file. For
example, I completely erased all my cache files and started over with a
clean slate. Then I went to http://www.openldap.org/ and ch
Hello,
Is it possible to have wget 'feed' data into squid? I tried running
squid on port 80 and ran wget (pointed
at port 80) with:
wget -m -k -K -E http://www.indo.com/culture/dance_music.html
but nothing appeared in the squid cache.
Thanks,
Murrah Boswell
> The proper way would be to set up Squid on its default port of 3128 or a
> common proxy port like 8080. Then set the proxy variable for wget (something
> like http_proxy=http://squidmachine:3128) so wget will request URLs through
> Squid.
>
> If you're trying to pre-fetch data, you might also be
> The easiest way to check is to look at access.log and the 4th column.
> If it says TCP_MISS/200 then it means Squid is getting the file directly.
> if it says TCP_HIT/200 or TCP_IMS_HIT/304 then Squid is getting it from the
> disk cache or memory cache, respectively.
My 4th column in access.log,
Hello,
So now I have wget 'feeding' to Squid's cache.
I use a redirector with squid, so every request is going to my
redirector (as it should). However, I believe that I am overloading my
redirector.
Is there any way to tell squid not to use the redirector_program if the
session is coming from
Henrik Nordstrom wrote:
>
> On Tue, 10 Feb 2004, OTR Comm wrote:
>
> > Is there any way to tell squid not to use the redirector_program if the
> > session is coming from wget?
>
> See redirector_access.
I have authentication turned on and I have a user named wget.
OTR Comm wrote:
>
> Henrik Nordstrom wrote:
> >
> > On Tue, 10 Feb 2004, OTR Comm wrote:
> >
> > > Is there any way to tell squid not to use the redirector_program if the
> > > session is coming from wget?
> >
> > See redirector_access.
>
> ident is not related to authentication. You want proxy_auth.
Thanks muchly, that did it.
> If there was no complain on the acl line then verify spelling.
I moved redirector_access deny wget_prog to follow 'acl wget_prog
proxy_auth wget' and that fixed the error.
I also added 'http_access allo
Hello,
I have a 80GB drive on a system that I would like to dedicate to a squid
server. The notes in squid.conf say that I should subtract 20% and use
that number for the Mbytes field for cache_dir. So I would have 64000.
The question is, what is a reasonable L1 and L2 to put for this setting?
> > I have a 80GB drive on a system that I would like to dedicate to a squid
> > server. The notes in squid.conf say that I should subtract 20% and use
> > that number for the Mbytes field for cache_dir. So I would have 64000.
>
> You should do that to start with. After Squid has been running w
Hello,
I ma trying to setup a squid system that uses wget to 'feed' data into
and then allows authenticated users to access the cached data in the
system but not go beyond the cached data. That is, if the data is
avalable in the cache, then it is presented to the user, but if the data
is not avai
Henrik Nordstrom wrote:
>
> On Mon, 16 Feb 2004, OTR Comm wrote:
>
> > So, how can I stop suqid from getting data offsite except for user that
> > wget comes in as?
>
> See miss_access.
>
> You probably also want to enable offline_mode unless user access is al
I just rebooted my server and restarted squid and several consecutive
entries like this appeared in my store.log:
1076992457.790 RELEASE -1 CE8669ED92F5F708F87752CD9666DFAF
? ? ? ? ?/? ?/? ? ?
What does this mean? Has something been purged from the cache?
T
> > acl wget_prog proxy_auth wget
> > acl our_networks src 192.168.1.0/24 ...
> > redirector_access deny wget_prog
> >
> > http_access allow password
> > http_access allow wget_prog
> > #http_access allow our_networks (Commented out for this test)
> > http_access deny all
> >
> > miss_access deny
Henrik Nordstrom wrote:
>
> On Tue, 17 Feb 2004, OTR Comm wrote:
>
> > acl wget_prog proxy_auth wget
> > acl our_networks src 192.168.1.0/24 ...
> > redirector_access deny wget_prog
> >
> > http_access allow password
>
> How is password
> Wwwoffle should be useful for this job.
Thanks for the lead, it does look interesting, but I need to stay with
Squid and wget for other functionality in the system that I am
developing.
Thank you,
Murrah Boswell
Hello,
Is it possible to have a master cache server that updates client cache
servers based upon queries sent from the clients to the master?
That is, if a query to a client cache server has a MISS, then the client
will query the master server for data.
Along similar lines, is it possible to hav
Hello,
For anyone who is interested, amazon.com just shipped my copy of 'Squid:
The Definitive Guid,' Duane Wessells a month earlier than they
origionally expected.
Murrah Boswell
Hello,
Scott Phalen wrote:
>
> I have two Windows Update servers internal in my network. By changing
> certain registry keys I can have the clients use those servers to download
> updates. Unfortunately I have 3000+ computers and changing them all is
> nearly impossible.
>
> Does anyone have a
Hello,
I am still trying to limit outside access from my squid proxy to just
one user, i.e., wget.
I turn offline_mode 'on' and define a rule for miss_access like so:
acl wget_prog proxy_auth wget
miss_access allow wget_prog
This works okay, but I have a problem still.
When I try to access a s
I think I figured it out:
acl squidsearch url_regex [-i]
^http://216.19.43.110/cgi-bin/squidsearch/squidsearch2.pl
miss_access allow squidsearch
and turn these back on
hierarchy_stoplist cgi-bin ?
acl QUERY urlpath_regex cgi-bin \?
no_cache deny QUERY
Thanks,
Murrah Boswell
Hello,
Jim_Brouse/[EMAIL PROTECTED] wrote:
>
> Does squid try to go out and update webpages that users frequently visit,
> like if I visit www.kernel.org in the morning will it keep checking whether
> it has an up to date page even if a user is not requesting that site or
> does squid only update
Hello,
I only allow one of my authenticated users to access sites not stored in
the cache with 'miss_access allow'. When other users try to access a
site not in the cache, they receive the Forwarding Denied error page.
If I want to redirect the Forwarding Denied error to a cgi handler and
captur
Hello,
I have problems understanding deny_info.
>
> You can always negate acls with ! if this makes your life easier.
> deny_info looks for the last ACL on the access line where the request was
> denied. Any ! should not be specified to deny_info.
I have a rule like so:
deny_info http://216.1
Hello,
> deny_info uses the last acl on the http_access line denying access, so by
> defining "dummy" acls which always matches you can have detailed control
> per http_access line which deny_info message is used.
Can you give me an example of a "dummy" acl that always matches?
Currently for htt
Hello,
Still not working!
>
> acl somename src 0.0.0.0/0
I setup an acl like so:
acl fderror src 0.0.0.0/0
>
> I think you want somehting like this:
>
> http_access deny ADVERTISE
> http_access allow our_networks password
> http_access deny all
>
> As for when/how to use deny_info this dep
Hello,
> > Then I added:
> >
> > deny_info http://216.19.43.110/cgi-bin/squidsearch/FD_Handler.cgi?url=%s
> > fderror
>
> Did you also add fderror last on the access line for which you want this
> redirection to happen?
What I have is:
acl fderror src 0.0.0.0/0
http_access deny ADVERTISE fderr
Hello,
I opted for the easy way out. I rewrote the standard
ERR_FORWARDING_DENIED to be a redirector:
http://www.w3.org/TR/html4/loose.dtd";>
Forwarding Denied
http://216.19.43.110/cgi-bin/squidsearch/FD_Handler.cgi?url=%U";>
Forwarding Denied.
Not as elegant as I would like
Hello,
Is it possible to get squid to also send the user ident when it 'calls'
ERR_FORWARDING_DENIED? That is, the URL goes is sent in %U, but can I
get the user ident also?
Thanks,
Murrah Boswell
Hello,
I added an additional case to errorConvert, just for debugging, i.e.,
case 'C':
if (r->auth_user_request) {
p = "[UNKNOWN]";
} else {
p = "[unknown]";
}
break;
I wanted to see if r->auth_user_request is true in errorConvert.
Then I
Hello,
> Unfortunately there is no % tag for the user name. Should not be hard to
> add one I guess. See src/errorpage.c.
I am using squid-3.0 so I looked in errorpage.cc and found the
errorConvert(char token, ErrorState * err) function.
I am not too good with c++ so please excuse my ignorance a
Hello,
> Examples on how most of these can be accessed can be found in
> ClientHttpRequest::logRequest() and clientPrepareLogWithRequestDetails()
> (both found in client_side.cc) where the information is prepared for
> logging in access.log.
Thanks Henrik - This was the lead I needed!
I found th
Hello,
Could someone explain the relationship between the swap.state file and
the actual files in the L2 directories?
Is the swap.state a database where Squid does it's cache checking and
the L2 directory files where the data is presented from?
Also, if one of the cache files is deleted, does th
Hello,
> > Is the swap.state a database where Squid does it's cache checking and
> > the L2 directory files where the data is presented from?
>
> Yes.
What database format is swap.state in?
Are there any existing tools that can pinpoint a particular entry in the
cache by name?
If not, can you
Hello,
Am I correct in understanding that the first thing that Squid does when
it receives a purge request (after it has verified proper authority,
host, port, etc.) is remove the cache reference from memory with
removeClientStoreReference(&sc, http) and then do the removal from
swap.state and the
Hello,
When a cache item is updated, is the L2 file for that item 'touch'ed?
I.e, is the date of the file changed?
Thanks,
Murrah Boswell
Hello,
When squidclient is used in ping mode, e.g.
/usr/local/squid/bin/squidclient -g 5 -h 209.145.208.8 -p 8939
http://216.19.43.110
2004-03-01 11:33:11 [1]: 0.131 secs, 7.557252 KB/s
2004-03-01 11:33:12 [2]: 0.001 secs, 997.00 KB/s
2004-03-01 11:33:13 [3]: 0.001 secs, 997.00 KB/s
2004-
Hello,
Does anyone know how I can access the fields in the swap.state file
using the perl unpack function?
I have read that records in swap.state are 48 byte fixed-size, but I
don't know what the binary layout of each record is, so I can't
determine a particular field size.
I want to get to the
Hello,
> please note that field alignment applies as per the requirements your
> platform so there may be padding between smaller and larger fields. On x86
> this padding is seen between the op and swap_file_number fields.
I am on an x86 machine.
>
> Detailed layout on x86: offset(length)
>
Hello,
I got the unpacking fixed!
>
> ($metaop,$metapad,$metafilenum,$metatimestamp,$metalastref,$metaexpires,$metalastmod,
> $metafilesz,$metarefcount,$metaflags,$metakey) = unpack $binary_layout,
> $record;
I had my unpack incorrect, it should be
($metaop,$metafilenum,$metatimestamp,$metalas
Hello,
> Note: I meant store.log above.
Thank you for the clarification and your earlier help! I figured out
the unpacking, so I can read the records in swap.state now. I also
figured out how I can take the filenum and recreate the path to it
relative to ../var/cache.
$full_path = sprintf("%0
Hello,
I am using Squid Version 3.0-PRE3-CVS
Does anyone know what could cause 'r->client_addr' in redirect.cc to
evaluate to the gateway address of the machine that Squid is running on
even for people coming in from outside the machine?
That is, when Squid calls the redirector (squidGuard), the
Hello,
Disregard this question, it was in my NAT configuration.
Thanks,
Murrah Boswell
OTR Comm wrote:
>
> Hello,
>
> I am using Squid Version 3.0-PRE3-CVS
>
> Does anyone know what could cause 'r->client_addr' in redirect.cc to
> evaluate to the gateway ad
Hello,
Geir Fossum wrote:
>
> Hi,
>
> I'm running the computersystems at a school.
> I wonder if there is a simple way to let the teachers toggle internetaccess
> on/off via a webpage and a ON/OFF button ?
> Which in turn reconfigures Squid and restarts the service.
I am working on a system, cu
84 matches
Mail list logo