Re: [squid-users] upload bandwidth control and delay pools
On Wed, Jan 2, 2013 at 4:16 PM, Amos Jeffries wrote: > On 3/01/2013 6:03 a.m., Nick Rogers wrote: >> >> Hi, >> >> I have a question concerning delay pools and upload bandwidth control. >> I know in the past with squid 2.x and earlier 3.x versions, it was not >> possible to restrict upload bandwidth (squid requests to web servers) >> using delay pools. >> >> However, now there is a feature that is new to me, client delay pools, >> which appears to insert bandwidth buckets between a client and squid. >> Can someone please explain the difference between the old delay pools >> feature and the newer client delay pools directive? As I understand, >> the old delay pools affects traffic between a remote webserver and >> squid, and the new client delay pools affects traffic between squid >> and the client. I am curious what the different primary use cases are >> between the two. > > > The primary use-case is upload vs download traffic. The server pools > restrict what gets read from the server. The client pools restrict what gets > read from the client. Write restrictions are still dependent on TOS / QoS > setup. > > >> And finally, is there now a way to limit upload rate using squid, >> where upload is from the perspective of the client (e.g., end-user >> uploading a file to a webserver)? > > > No. more correctly it is end-user uploading to Squid which is limited. > > Large uploads which are short-circuited by HITs, server connection errors, > auth challenges, or ICAP/eCAP rejected have large amounts of traffic which > only gets delivered to Squid and then dropped. > > Amos Thanks for clarifying. So client_delay_parameters affects speed of an end-user uploading to squid (i.e., client requests and uploads) and delay_paramaters affects speed of squid downloading from a server? Does client_delay_parameters affect speed of transferring a file from squid to an end-user (e.g., when serving cached content)? If a file that is cached is requested by an end-user (i.e., not retrieved from a remote web server), does delay_paramaters have any effect? -Nick
Re: [squid-users] upload bandwidth control and delay pools
On 3/01/2013 6:03 a.m., Nick Rogers wrote: Hi, I have a question concerning delay pools and upload bandwidth control. I know in the past with squid 2.x and earlier 3.x versions, it was not possible to restrict upload bandwidth (squid requests to web servers) using delay pools. However, now there is a feature that is new to me, client delay pools, which appears to insert bandwidth buckets between a client and squid. Can someone please explain the difference between the old delay pools feature and the newer client delay pools directive? As I understand, the old delay pools affects traffic between a remote webserver and squid, and the new client delay pools affects traffic between squid and the client. I am curious what the different primary use cases are between the two. The primary use-case is upload vs download traffic. The server pools restrict what gets read from the server. The client pools restrict what gets read from the client. Write restrictions are still dependent on TOS / QoS setup. And finally, is there now a way to limit upload rate using squid, where upload is from the perspective of the client (e.g., end-user uploading a file to a webserver)? No. more correctly it is end-user uploading to Squid which is limited. Large uploads which are short-circuited by HITs, server connection errors, auth challenges, or ICAP/eCAP rejected have large amounts of traffic which only gets delivered to Squid and then dropped. Amos
[squid-users] upload bandwidth control and delay pools
Hi, I have a question concerning delay pools and upload bandwidth control. I know in the past with squid 2.x and earlier 3.x versions, it was not possible to restrict upload bandwidth (squid requests to web servers) using delay pools. However, now there is a feature that is new to me, client delay pools, which appears to insert bandwidth buckets between a client and squid. Can someone please explain the difference between the old delay pools feature and the newer client delay pools directive? As I understand, the old delay pools affects traffic between a remote webserver and squid, and the new client delay pools affects traffic between squid and the client. I am curious what the different primary use cases are between the two. And finally, is there now a way to limit upload rate using squid, where upload is from the perspective of the client (e.g., end-user uploading a file to a webserver)? Thanks much. -Nick
Re: [squid-users] upload data report
[cut] > > > "probably"? "probably", because i am not confident enough with my understanding with the output. [cut] > > > The '<' means data sent to client. The '>' means data received from client. > The format omitting these characters is the total sum of both. > the confusion part is the actual value that i am looking for whether in upload or download. value always comes in "<" with this value not with ">" for example here is when i uploaded 2.2 MB of file to live.com 139811.654 485143 10.51.100.240 TCP_MISS/200 18155070 181 CONNECT snt121.mail.live.com:443 - DIRECT/65.55.68.103 in this log i am download approx 3.2 MB of file 1355739469.389 11759 10.51.100.240 TCP_MISS/200 4077890 1917 GET http://software-files-a.cnet.com/s/software/12/84/20/79/ccsetup325.exe? - DIRECT/92.122.213.10 application/octet-stream however in both logs you can see two values 1) 18155070 181 (upload log) , 2) 4077890 1917 (download log) so the question is. does "<" (value) with method "CONNECT" means data sent to client and on the other hand "<" (value) with method "GET" means data receive from the client? are they totally inverse of each other when methods are change. > Amos >
Re: [squid-users] upload data report
On 15/12/2012 10:41 p.m., Muhammad Yousuf Khan wrote: > > >Yes. This is because every transaction in HTTP has data flowing in both >directions. > >%>st logs the size of transaction for request. now i am confused. as per squid document http://www.squid-cache.org/Versions/v2/2.7/cfgman/logformat.html default log formate of squid log is "logformat squid %ts.%03tu %6tr %>a %Ss/%03Hs % Yes. actually i am confused bacause and i can not understand the purpose of %st because as per my finding % None of these are random numbers. They are all precise octet measures. The most common thing to do in HTTP is to load pages and objects. for example i test an upload on my live.com email account and the size of that file was 2.2 MB here is the log this is default log of access.log as mantioned in the official document. probably based on only "% "probably"? 139811.654 485143 10.51.100.240 TCP_MISS/200 18155070 CONNECT snt121.mail.live.com:443 - DIRECT/65.55.68.103 - this is my created log formate containing both values %st and the value that i get by %>st not giving me the upload size. 139811.654 485143 10.51.100.240 TCP_MISS/200 18155070 181 CONNECT snt121.mail.live.com:443 - DIRECT/65.55.68.103 - so the confusing part is second log entry. i found nothing but a figure of 181 (as %>st) which is no near to 2 MB in any case. however the value of %st? The '<' means data sent to client. The '>' means data received from client. The format omitting these characters is the total sum of both. can i just "cat" access.log file and "grep" only "CONNECT" value. will this not help me in my case. ? for example "cat access.log | grep CONNECT" CONNECT is a tunnel. A lot of data often goes both ways in tunnels. The data you get out of CONNECT is the sum of a whole series of requests and replies headers, bodies and all. If that 18 MB (nowhere near 2.2 MB!) is logged by the default squid log format then it is the sum total size of all pages, images, CSS, scripts fetched down that tunnel, possibly including a HTML formatted display version of the file uploaded. Amos
Re: [squid-users] upload data report
[cut] > > > Yes. This is because every transaction in HTTP has data flowing in both > directions. > > %>st logs the size of transaction for request. now i am confused. as per squid document http://www.squid-cache.org/Versions/v2/2.7/cfgman/logformat.html default log formate of squid log is "logformat squid %ts.%03tu %6tr %>a %Ss/%03Hs %st because as per my finding %st and the value that i get by %>st not giving me the upload size. 139811.654 485143 10.51.100.240 TCP_MISS/200 18155070 181 CONNECT snt121.mail.live.com:443 - DIRECT/65.55.68.103 - so the confusing part is second log entry. i found nothing but a figure of 181 (as %>st) which is no near to 2 MB in any case. however the value of %st? can i just "cat" access.log file and "grep" only "CONNECT" value. will this not help me in my case. ? for example "cat access.log | grep CONNECT" please correct me if doing something wrong i am not very experienced with SQUID. Thanks > You can also log the size of just the headers and subtract one from the > other to get body octet sizes (if any). > > But in practice if you are billing it is best to use %st and bill on total > transaction bytes sent regardless of direction. Thanks for the tip :) but i am not billing however just wanted to know only the upload status peruser and on destination bases. so that concern department could investigate what users are uploading. > > Amos
Re: [squid-users] upload data report
On 15/12/2012 2:02 a.m., Muhammad Yousuf Khan wrote: On Fri, Dec 14, 2012 at 2:22 PM, Amos Jeffries wrote: On 14/12/2012 9:21 p.m., Muhammad Yousuf Khan wrote: i want to check how much data has been uploaded by users like we have the ability to see download reports via Sarg reporting tool. i know we can not decrypt HTTPS traffic, i dont even want to see the file names and size. but we want to see how much data has been uploaded by who and where with only the upload over all size. like we have Sarg reporting for downloading but now we want also to track uploading data. my squid is running in proxy mode. Thanks. You need to log the details. Create a custom log format and use it in an access_log line. http://www.squid-cache.org/Doc/config/logformat http://www.squid-cache.org/Doc/config/access_log thanks for the help. i was reading in an article that says if i define 2 different log file one for upload log and second for download log sarg would be able to make two reports. separately there for i create another log format with "%>st" however i still get too much entries.or more or less the same amount of entries in both log files. Yes. This is because every transaction in HTTP has data flowing in both directions. %>st logs the size of transaction for request. You can also log the size of just the headers and subtract one from the other to get body octet sizes (if any). But in practice if you are billing it is best to use %st and bill on total transaction bytes sent regardless of direction. Amos
Re: [squid-users] upload data report
On Fri, Dec 14, 2012 at 2:22 PM, Amos Jeffries wrote: > On 14/12/2012 9:21 p.m., Muhammad Yousuf Khan wrote: >> >> i want to check how much data has been uploaded by users like we have >> the ability to see download reports via Sarg reporting tool. i know we >> can not decrypt HTTPS traffic, i dont even want to see the file names >> and size. but we want to see how much data has been uploaded by who >> and where with only the upload over all size. >> >> like we have Sarg reporting for downloading but now we want also to >> track uploading data. >> >> my squid is running in proxy mode. >> >> Thanks. > > > You need to log the details. Create a custom log format and use it in an > access_log line. > > http://www.squid-cache.org/Doc/config/logformat > http://www.squid-cache.org/Doc/config/access_log thanks for the help. i was reading in an article that says if i define 2 different log file one for upload log and second for download log sarg would be able to make two reports. separately there for i create another log format with "%>st" however i still get too much entries.or more or less the same amount of entries in both log files. here is my squid.conf logformat aciupload %ts.%03tu %6tr %>a %Ss/%03Hs %>st %rm %ru %un %Sh/%st? please help. here is the log of both files entry from "tailf /var/log/squid/access.log | grep 10.51.100.240" 1355489243.474532 10.51.100.240 TCP_MISS/200 1316 POST http://safebrowsing.clients.google.com/safebrowsing/downloads? - DIRECT/173.194.34.174 application/vnd.google.safebrowsing-update 1355489357.963570 10.51.100.240 TCP_CLIENT_REFRESH_MISS/200 455 GET http://urlfilter.vmn.net/vmnsbf/stamp.txt - DIRECT/69.50.130.33 text/plain 1355489380.508 136971 10.51.100.240 TCP_MISS/200 16391 CONNECT safebrowsing-cache.google.com:443 - DIRECT/173.194.34.164 - entry from "tailf /var/log/squid/accessupload.log | grep 10.51.100.240" 1355489243.474532 10.51.100.240 TCP_MISS/200 1428 POST http://safebrowsing.clients.google.com/safebrowsing/downloads? - DIRECT/173.194.34.174 application/vnd.google.safebrowsing-update 1355489357.963570 10.51.100.240 TCP_CLIENT_REFRESH_MISS/200 123 GET http://urlfilter.vmn.net/vmnsbf/stamp.txt - DIRECT/69.50.130.33 text/plain 1355489380.508 136971 10.51.100.240 TCP_MISS/200 199 CONNECT safebrowsing-cache.google.com:443 - DIRECT/173.194.34.164 - just FYI: 10.51.100.240 is my ip address. since i am a newbie therefore please help/correct me if i am making any mistake in logformate or any other suggestion/option would be highly appreciated. Thanks. > > Amos
Re: [squid-users] upload data report
On 14/12/2012 9:21 p.m., Muhammad Yousuf Khan wrote: i want to check how much data has been uploaded by users like we have the ability to see download reports via Sarg reporting tool. i know we can not decrypt HTTPS traffic, i dont even want to see the file names and size. but we want to see how much data has been uploaded by who and where with only the upload over all size. like we have Sarg reporting for downloading but now we want also to track uploading data. my squid is running in proxy mode. Thanks. You need to log the details. Create a custom log format and use it in an access_log line. http://www.squid-cache.org/Doc/config/logformat http://www.squid-cache.org/Doc/config/access_log Amos
[squid-users] upload data report
i want to check how much data has been uploaded by users like we have the ability to see download reports via Sarg reporting tool. i know we can not decrypt HTTPS traffic, i dont even want to see the file names and size. but we want to see how much data has been uploaded by who and where with only the upload over all size. like we have Sarg reporting for downloading but now we want also to track uploading data. my squid is running in proxy mode. Thanks.
Re: [squid-users] Upload of files not working
Chema cueto mailto:chemacg_at_gmail.com?Subject=Re:%20[squid-users]%20Upload%20of%20files%20not%20working>> writes: > Hi, i've been looking for any information on this problem i have and > have found nothing, my problem isn't the well known problem of the 1MB > limit, it's true that i can upload small files, but even files with > 800Kb fails some times. > The problem is that i can't upload any file (of certain size, the > smallest do upload) using megaupload and it's kind. > I've seen that when uploading with dropbox (https://www.dropbox.com) i > can upload any file of any size without problems if i use the "basic > uploader". > I've also seen that the file i want to upload is sent from my PC to the > PC with squid running on it at LAN speed (8-10Mb/s) (with gkrellm and > the upload bar of megaupload, dropbox and such), but when i use the > "basic uploader" of dropbox the file is sent directly from my PC at WAN > speed (~100Kb/s) > When i stop squid this problem disappear. > I'm running squid version 3.1.6 on Gentoo and have > arno-iptables-firewall enabled. > Any one can help me or say where to look? acces.log, cache.log and > store.log are total gibberish. > Thanks. Nobody knows??
[squid-users] Upload of files not working
Hi, i've been looking for any information on this problem i have and have found nothing, my problem isn't the well known problem of the 1MB limit, it's true that i can upload small files, but even files with 800Kb fails some times. The problem is that i can't upload any file (of certain size, the smallest do upload) using megaupload and it's kind. I've seen that when uploading with dropbox (https://www.dropbox.com) i can upload any file of any size without problems if i use the "basic uploader". I've also seen that the file i want to upload is sent from my PC to the PC with squid running on it at LAN speed (8-10Mb/s) (with gkrellm and the upload bar of megaupload, dropbox and such), but when i use the "basic uploader" of dropbox the file is sent directly from my PC at WAN speed (~100Kb/s) When i stop squid this problem disappear. I'm running squid version 3.1.6 on Gentoo and have arno-iptables-firewall enabled. Any one can help me or say where to look? acces.log, cache.log and store.log are total gibberish. Thanks.
[squid-users] Upload Limit
Is it possible to limit the upload by it's rate and not by it's size in squid?
Re: [squid-users] Upload log for Squid
Thanks I understood. If I use Common Logfile Format then I can select downloading and uploading traffic by type of request and status code. But how then to determine what the request was taken from the cache and which came from the server? if I ignore the this fact it can make inaccurate calculation of the traffic. 2009/7/30 Waitman Gobble : > Alexandr Popov wrote: >> >> Hi All, >> Prompt me do squid log in which are stored on users' queries to the >> server with an indication of their size (such as sending a email by >> POST method in web interface ). I want use it for counting upload >> traffic.In my opinion in access.log stored only download traffic - is >> not it?. >> >> Thanks >> >> Sorry for my bad english. >> > > hi, > > probably want to set access log to CLF and grep POST requests. > > i made some 'ultimate paranoia' scripts in php (well at least that's what my > ex wife called it, i call it 'feeling it when someone googles you' which > isn't necessarily paranoia really) if you want. lemme know. ex: > http://waitman.net/sgs/fdat.php > > they work well with CLF. don't tally bytes, bits, traffic, etc. but that > shouldn't be difficult. > > waitman > > > >
Re: [squid-users] Upload log for Squid
Alexandr Popov wrote: Hi All, Prompt me do squid log in which are stored on users' queries to the server with an indication of their size (such as sending a email by POST method in web interface ). I want use it for counting upload traffic.In my opinion in access.log stored only download traffic - is not it?. Thanks Sorry for my bad english. hi, probably want to set access log to CLF and grep POST requests. i made some 'ultimate paranoia' scripts in php (well at least that's what my ex wife called it, i call it 'feeling it when someone googles you' which isn't necessarily paranoia really) if you want. lemme know. ex: http://waitman.net/sgs/fdat.php they work well with CLF. don't tally bytes, bits, traffic, etc. but that shouldn't be difficult. waitman
[squid-users] Upload log for Squid
Hi All, Prompt me do squid log in which are stored on users' queries to the server with an indication of their size (such as sending a email by POST method in web interface ). I want use it for counting upload traffic.In my opinion in access.log stored only download traffic - is not it?. Thanks Sorry for my bad english.
Re: [squid-users] upload
so that request_body_max_size mean LIMIT / block is there anyway to not block but limit upload like delaypoll do ? On Fri, Dec 26, 2008 at 11:10 AM, Amos Jeffries wrote: > ░▒▓ ɹɐzǝupɐɥʞ ɐzɹıɯ ▓▒░ wrote: >> >> On Thu, Dec 25, 2008 at 6:56 PM, Ken Peng wrote: >>> >>> request_body_max_size 0 KB that mean no max size ? or ? >>> >>> means no size limited. see squid.conf. >>> >> >> if i put : >> request_body_max_size 100 KB >> then user only can upload 100KB >> or can be more than 100 KB but they will get delay > > More than 100KB and they will get an error page. > > Amos > -- > Please be using > Current Stable Squid 2.7.STABLE5 or 3.0.STABLE11 > Current Beta Squid 3.1.0.3 > -- -=-=-=-= Personal Blog http://my.blog.or.id ( lagi belajar ) Hot News !!! : Pengin punya Layanan SMS PREMIUM ? Contact me ASAP. dapatkan Share revenue MAXIMAL tanpa syarat traffic...
Re: [squid-users] upload
░▒▓ ɹɐzǝupɐɥʞ ɐzɹıɯ ▓▒░ wrote: On Thu, Dec 25, 2008 at 6:56 PM, Ken Peng wrote: request_body_max_size 0 KB that mean no max size ? or ? means no size limited. see squid.conf. if i put : request_body_max_size 100 KB then user only can upload 100KB or can be more than 100 KB but they will get delay More than 100KB and they will get an error page. Amos -- Please be using Current Stable Squid 2.7.STABLE5 or 3.0.STABLE11 Current Beta Squid 3.1.0.3
Re: [squid-users] upload
On Thu, Dec 25, 2008 at 6:56 PM, Ken Peng wrote: > > > >> request_body_max_size 0 KB >> >> that mean no max size ? or ? > > means no size limited. see squid.conf. > if i put : request_body_max_size 100 KB then user only can upload 100KB or can be more than 100 KB but they will get delay
Re: [squid-users] upload
request_body_max_size 0 KB that mean no max size ? or ? means no size limited. see squid.conf.
Re: [squid-users] upload
request_body_max_size 0 KB that mean no max size ? or ? request_body_max_size 100 KB <-- mean what ? On Thu, Dec 25, 2008 at 6:38 AM, Amos Jeffries wrote: > Ken Peng wrote: >> >> >> >>> is upload can be limit from squid ? >> >> >> limits the size or what else? >> squid supports POST method well. > > http://www.squid-cache.org/Doc/config/request_body_max_size/ > > Amos > -- > Please be using > Current Stable Squid 2.7.STABLE5 or 3.0.STABLE11 > Current Beta Squid 3.1.0.3 > -- -=-=-=-= Personal Blog http://my.blog.or.id ( lagi belajar ) Hot News !!! : Pengin punya Layanan SMS PREMIUM ? Contact me ASAP. dapatkan Share revenue MAXIMAL tanpa syarat traffic...
Re: [squid-users] upload
Ken Peng wrote: is upload can be limit from squid ? limits the size or what else? squid supports POST method well. http://www.squid-cache.org/Doc/config/request_body_max_size/ Amos -- Please be using Current Stable Squid 2.7.STABLE5 or 3.0.STABLE11 Current Beta Squid 3.1.0.3
Re: [squid-users] upload
is upload can be limit from squid ? limits the size or what else? squid supports POST method well.
Re: [squid-users] upload
In my experience. Uploads through a reverse proxy will add some latency. May make the uploads unusable. It may be advisable to upload directly to the origin server instead. J 2008/12/24 ░▒▓ ɹɐzǝupɐɥʞ ɐzɹıɯ ▓▒░ : > is upload can be limit from squid ? >
[squid-users] upload
is upload can be limit from squid ?
Re: [squid-users] upload images via squid
On 11.09.07 13:13, Techwww wrote: > I used Squid as reverse proxy before Apache web server. > I want to let users upload images via squid to real server. > Can squid handle this case?thanks. it should - I don't know about any problem which would disallow that (except configuration, of course) -- Matus UHLAR - fantomas, [EMAIL PROTECTED] ; http://www.fantomas.sk/ Warning: I wish NOT to receive e-mail advertising to this address. Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu. The 3 biggets disasters: Hiroshima 45, Tschernobyl 86, Windows 95
[squid-users] upload images via squid
Hello, I used Squid as reverse proxy before Apache web server. I want to let users upload images via squid to real server. Can squid handle this case?thanks. ___ 雅虎邮箱，以安全著称，是值得信赖的邮箱专家！ http://mail.yahoo.com.cn/
Re: [squid-users] Upload issue
ons 2006-11-29 klockan 11:16 +0100 skrev Daniel Stellwagen: > I can upload files if I use the firewall rule directly for the client > machine without the proxy. > > I don't know if you could follow me. Have I got a firewall > misconfiguration here? It does sound like a firewall issue to me. Time to dig into some ethereal/wireshark captures of the traffic I think. Regards Henrik signature.asc Description: Detta är en digitalt signerad meddelandedel
[squid-users] Upload issue
Hi,
I need some hints about the following issue.
I upload files from a browser of a client machine to a typo3-Site over
my proxy machine version 2.6.4.
My first configuration works fine:
If I use a Broadband-DSL-Router with FW I can upload
every size to the site.
Know the second configuration:
I go over a Firewall-1 with an special rule for my squid-box to reach
the internet. Here I have following strange behaviour:
- I can never upload files bigger than 1 MB
(request_body_max_size 0 KB).
- I can upload one file with under 1 MB then I take another one
again under 1MB and know the upload hangs and after a few minutes
I get an timeout and the following entry in the squid-access-log:
115683 172.16.241.101 TCP_MISS/502 1526 POST
http://xx/typo3/tce_file.php - DIRECT/62.157.173.38 test/html
I can upload files if I use the firewall rule directly for the client
machine without the proxy.
I don't know if you could follow me. Have I got a firewall
misconfiguration here?
Thx for any hint.
d a n i e l
--
--
Daniel Stellwagen
EDV
BRUNATA Wärmemesser GmbH & Co. KG
Aidenbachstraße 40
81379 München
Telefon (089) 7 85 95 - 776
Telefax (089) 7 85 95 - 755
Daniel.Stellwagen at brunata-muenchen.de
www.brunata-muenchen.de
Re: [squid-users] Upload
On Fri, 6 Aug 2004, vs 1984 wrote: I can see the downloads in the access.log but i also want to see the upload, i.e. if anyone has uploaded something to yahoo mail or yahoo briefcase. Is ther any way out If you use a custom log format (available in Squid-3.0 or as a patch to 2.5) then you can specify to include the content-length request header. This will indicate the size of POST/PUT requests. Regards Henrik
[squid-users] Upload
Hi I can see the downloads in the access.log but i also want to see the upload, i.e. if anyone has uploaded something to yahoo mail or yahoo briefcase. Is ther any way out Please help me Thanks in advance __ Do you Yahoo!? New and Improved Yahoo! Mail - 100MB free storage! http://promotions.yahoo.com/new_mail
[squid-users] Upload bandwidth limits (was: Putting upper limit on Uploading.)
Hello list, I would like to limit the bandwidth that users in my network use to upload stuff. I googled around and found the following message in the [squid-users] archive: --begin quote-- From: Henrik Nordstrom <[EMAIL PROTECTED]> Date: 25 Jul 2003 13:52:04 +0200 Subject: Re: [squid-users] Putting upper limit on Uploading. fre 2003-07-25 klockan 10.51 skrev ads squid: > Hi can I put limit on uploading data speed that is for > example 2Kbps using squid. So that I will get better > download speed. Not with Squid, but you should be able to use traffic shaping to do more or less the same thing I think. Regards Henrik -end quote- I want to state that conventional traffic shaping (CBQ, HTB & co.) has absolutely no way to know about the intricate acl system in my squid.conf. The only way you could shape uploading outside the squid is to put an agregate bandwidth cap on all the squid connections, and that is not an acceptable solution as it hurts everything, including simple browsing. Or, maybe use that controversial IMQ device to shape the data that comes from the users to squid, which is another problem, as IMQ is not part of the standard kernel, AFAIK. I believe that the proper way to do it would be a duplicate set of delay pools with separate but similar configuration directives which would only apply on the uploading part of the data streams. Most of the code should be reused from the current delay pools, I suppose... Comment please! Mihai Buha
Re: [squid-users] Upload bandwidth limits (was: Putting upper limit on Uploading.)
On Thu, 26 Feb 2004, Mihai BUHA wrote: > I would like to limit the bandwidth that users in my network use > to upload stuff. > > I want to state that conventional traffic shaping (CBQ, HTB & > co.) has absolutely no way to know about the intricate acl system > in my squid.conf. Either of tcp_outgoing_tos or tcp_outgoing_address can be used for provided access control hints to traffic shapers if required. > I believe that the proper way to do it would be a duplicate set > of delay pools with separate but similar configuration directives > which would only apply on the uploading part of the data > streams. Most of the code should be reused from the current > delay pools, I suppose... Of course something like delay pools can be implemented for uploaded traffic as well. It is just a matter of having it implemented. Now I have no intention to claim the following applies to you, but history has shown that many people seem to be offended if the answer to their question is that the feature they ask for is not yet implemented in Squid because nobody has needed it badly enough to see to have it implemented and that they are welcome to see to have it implemented. Because of this I usually don't answer with this answer if there is alternative approaches which could solve the problem. Open source is a community thing, and gets developed by the community. The more active the community is in the development of an opens source project, the more progress the project makes. Some years ago Squid had the fortune of being sponsored (indirectly) by a US government contract. This is no longer the case and the current development is mostly driven by a few individuals mostly on spare time basis. A more active participation in the development process by members of the Squid community is highly welcomed by the current developers. If there is interest in this please contact [EMAIL PROTECTED] and pay a visit to http://devel.squid-cache.org/. Regards Henrik
Re: Ats.: Ats.: [squid-users] Upload ban by domain and POST/GET size
Hi, At 13.19 16/06/2003, Henrik Nordstrom wrote: > 2. Thaks for the script. I am forced to use SquidNT (porter to > NT), as my small Linux router would be kill such app as Squid. Is > there a way to do similar code for windows? Well.. the same script should run fine under the cygwin environment on NT I think, but I have not tried the SquidNT port with external helpers. You can try too with the sh port on MinGW+MSYS, or to translate the script to perl: perl scripts works fine with SquidNT. Regards Guido - Guido Serassio Acme Consulting S.r.l. Via Gorizia, 69 10136 - Torino - ITALY Tel. : +39.011.3249426 Fax. : +39.011.3293665 Email: [EMAIL PROTECTED] WWW: http://www.acmeconsulting.it/
Re: Ats.: Ats.: [squid-users] Upload ban by domain and POST/GET size
On Monday 16 June 2003 12.59, Andrius Kriučkovas wrote: > 1. Could you implement this ACL type in the next squid version? :) > Because you have a global setting, I think it is wise to have > adequate ACL. This pretty much depends on my customers. I agree that it would be best done as an ACL instead of a global option but is not a function I am likely to implement on my spare time. > 2. Thaks for the script. I am forced to use SquidNT (porter to > NT), as my small Linux router would be kill such app as Squid. Is > there a way to do similar code for windows? Well.. the same script should run fine under the cygwin environment on NT I think, but I have not tried the SquidNT port with external helpers. > I think this is std_input and std_err_output? The script uses stdin/stdout, not stderr. If you write anything to stderr then it will end up in cache.log. Regards Henrik -- Donations welcome if you consider my Free Squid support helpful. https://www.paypal.com/xclick/business=hno%40squid-cache.org If you need commercial Squid support or cost effective Squid or firewall appliances please refer to MARA Systems AB, Sweden http://www.marasystems.com/, [EMAIL PROTECTED]
Re: Ats.: [squid-users] Upload ban by domain and POST/GET size
On Monday 16 June 2003 12.20, Andrius Kriučkovas wrote: > > As you note the built in request_body_max_size is a bit too > > limited for your purpose, but you should be able to make a custom > > acl via external_acl_type for this based on the Content-Length > > header. > > Hi, > > Maybe you have exact eamples of this one? I am quite newbie here. > Doesn't that means that I have to write some sort of app here? Correct. As the function you ask for does not exist built into Squid something needs to be written to implement it. In this case what is required is a small program which can compare two integers.. This simple shell script will probably work for most purposes #!/bin/sh while read length max; do if [ "$length" -gt "$max" ]; then echo ERR else echo OK fi done Regards Henrik -- Donations welcome if you consider my Free Squid support helpful. https://www.paypal.com/xclick/business=hno%40squid-cache.org If you need commercial Squid support or cost effective Squid or firewall appliances please refer to MARA Systems AB, Sweden http://www.marasystems.com/, [EMAIL PROTECTED]
Ats.: [squid-users] Upload ban by domain and POST/GET size
> > How can this be done? I know the global directive > > request_body_max_size xxx kB, but I cannot combine it with specific > > domains (perhaps other ACL). I've got suggestions to use > delay-pools, > > but I am not shure if they limit upload trafic. > > As you note the built in request_body_max_size is a bit too limited > for your purpose, but you should be able to make a custom acl via > external_acl_type for this based on the Content-Length header. Hi, Maybe you have exact eamples of this one? I am quite newbie here. Doesn't that means that I have to write some sort of app here?
Re: [squid-users] Upload ban by domain and POST/GET size
On Monday 16 June 2003 10.27, Andrius Kriučkovas wrote: > How can this be done? I know the global directive > request_body_max_size xxx kB, but I cannot combine it with specific > domains (perhaps other ACL). I've got suggestions to use > delay-pools, but I am not shure if they limit upload trafic. As you note the built in request_body_max_size is a bit too limited for your purpose, but you should be able to make a custom acl via external_acl_type for this based on the Content-Length header. Regards Henrik -- Donations welcome if you consider my Free Squid support helpful. https://www.paypal.com/xclick/business=hno%40squid-cache.org If you need commercial Squid support or cost effective Squid or firewall appliances please refer to MARA Systems AB, Sweden http://www.marasystems.com/, [EMAIL PROTECTED]
[squid-users] Upload ban by domain and POST/GET size
Hello, I am looking for solution with Squid (actually SquidNT 2.5STABLE3) to ban upload by two criteria: 1. ACL domain/url AND 2. POST/GET method size upper limit(like 500 bytes, 2Kb and so on). This is for limiting user sending large mail messages through web-mailers. How can this be done? I know the global directive request_body_max_size xxx kB, but I cannot combine it with specific domains (perhaps other ACL). I've got suggestions to use delay-pools, but I am not shure if they limit upload trafic. Any suggestions? Thanx in advance.
[squid-users] Upload problem with files greater 1 MB Part II
ok I found it "request_body_max_size" was the problem - default 1 meg Mit freundlichen Grüssen :-) Alexander Messner --- Graffinity Pharmaceuticals AG Im Neuenheimer Feld 518-519 --- D-69120 Heidelberg Tel: 06221/6510-152 --- Fax: 06221/6510-111 mailto: [EMAIL PROTECTED] --- http://www.graffinity.com ** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.graffinity.com **
Re: [squid-users] Upload problem with files greater 1 MB Part II
ons 2003-06-04 klockan 14.27 skrev Messner, Alexander: > Sorry I forgot > Squid 2.4 stable 6, the squid.conf is original, only some acls are made. > all is running on a Suse 8.0 x386 machine > > following remote server. problems. " Files less< > https://www.paypal.com/xclick/business=hno%40squid-cache.org Please consult the Squid FAQ and other available documentation before asking Squid questions, and use the squid-users mailing-list when no answer can be found. Private support questions is only answered for a fee or as part of a commercial Squid support contract. If you need commercial Squid support or cost effective Squid and firewall appliances please refer to MARA Systems AB, Sweden http://www.marasystems.com/, [EMAIL PROTECTED]
[squid-users] Upload problem with files greater 1 MB Part II
Sorry I forgot Squid 2.4 stable 6, the squid.conf is original, only some acls are made. all is running on a Suse 8.0 x386 machine http://www.graffinity.com ** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.graffinity.com **
Re: [squid-users] Upload problem with files greater 1MB
"Messner, Alexander" wrote: > > when I want to upload a file i.e. to www.gmx.de or www.e-gcn.com I become the > following error message from squid: "Error Sending Request: Error sending data to > remote server. Possible causes include remote server error and transient network > problems. " Files less than 1 Meg are no problem > The problem doesn´t appear when I try this direct above the gateway. > Any ideas? Which version of squid are you using ? On which platform/os/version ? M.
[squid-users] Upload problem with files greater 1MB
when I want to upload a file i.e. to www.gmx.de or www.e-gcn.com I become the following error message from squid: "Error Sending Request: Error sending data to remote server. Possible causes include remote server error and transient network problems. " Files less than 1 Meg are no problem The problem doesn´t appear when I try this direct above the gateway. Any ideas? Thanks a lot ** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.graffinity.com **
