Re: Ip::Address performance

2010-11-19 Thread Pieter De Wit
Hey Guys, I am joining the thread a bit late and I might miss a few things, but wouldn't this be a simple solution: (From memory, this is pretty close to the "union" one Alex suggested) NB : There is a very very small chance that an IPv6 address can be converted into an IPv4 address, from me

Feature: quota control

2009-02-21 Thread Pieter De Wit
Hi Guys, I would like to offer my time in working on this feature - I have not done any squid dev, but since I would like to see this feature in Squid, I thought I would take it on. I have briefly contacted Amos off list and we agreed that there is no "set in stone" way of doing this. I woul

Re: Feature: quota control

2009-03-30 Thread Pieter De Wit
gister in the same way. I am just thowing ideas around - maybe they should be targeted for Squid 4, who knows :) What you guys think ? Cheers, Pieter - Original Message - From: "Adrian Chadd" To: "Amos Jeffries" Cc: "Robert Collins" ; "Mark Nottin

Re: Feature: quota control

2009-03-30 Thread Pieter De Wit
On Mon, 30 Mar 2009 11:38:31 -0600, Alex Rousskov wrote: > On 03/30/2009 03:16 AM, Pieter De Wit wrote: > >> I gave this some thought. Why don't we build a system close to >> sendmail's milter system. An API where by clients can plug in and offer >> servi

Re: Feature: quota control

2009-03-30 Thread Pieter De Wit
Ok - so here is how I see this : * We need to agree (maybe a strong word) on a traffic "limiting" standard. (Think how the limits are implemented, rather than done - if the object size is known, pass that to the "limiter", if not, everytime data is RX'ed using something like a session id or so)

Re: Mysterious acts of 3.1

2009-04-06 Thread Pieter De Wit
Hi Amos, I am going to take a swing at things here and say it something to do with the thread that you create. Something (some global variable etc) is not locked in a mutex or you are using a non-thread-safe function/procedure. It's most likely in the first couple of lines of the function/proc

Re: SourceLayout: where to put Delay*?

2009-04-09 Thread Pieter De Wit
I vote for: trafficcontrol/ tcontrol/ tc/ ? - Original Message - From: "Kinkie" To: Sent: Friday, April 10, 2009 10:08 AM Subject: Re: SourceLayout: where to put Delay*? On Thu, Apr 9, 2009 at 11:42 PM, Alex Rousskov wrote: Hello, Where should we put the following traffic shapi

Re: Squid Idea

2009-12-15 Thread Pieter De Wit
Hi Thomas, You sure can - the option is called "cache_peer_acl" - google it for some examples. BTW - This is the squid-dev group, not the "general support" one - I think your query is more suited to the general support one. From the top of my head, it's email is sq...@squid-cache.org Cheers,

Re: [RFC] Package download pages

2012-01-22 Thread Pieter De Wit
Hi Guys, I might miss something here, but how about: /mirrors/ <-- Mirror info here /downloads/ <-- Packages, with a link to "mirrors" Under /downloads/ we could have /major_version/version/files.bla e.g: /downloads/3.1/3.1.7/squid-3.1.7.deb /Version can still link to /downloads/ Cheers, Pi

Re: [RFC] cache architecture

2012-01-23 Thread Pieter De Wit
Hi Amos, My 2c :) I know you have noted it already, but please please don't change the start to something like another project does (start up dirty scan - I have personally seen a 12 hour plus start up time). Why they still on that, who knows...anyways, back to the email here :) Alex, sorry

Re: [RFC] cache architecture

2012-01-24 Thread Pieter De Wit
Perhaps a 9) Implement dual IO queues - I *think* the IO has been moved into it's own thread, if not, the queuing can still be applied. Any form of checking the cache is going to effect squid, so how do we ensure we are idle, dual queues :) Queue 1 holds the requests for squid, queue 2 holds

Re: [RFC] cache architecture

2012-01-24 Thread Pieter De Wit
Sorry - my mail client messes with the layout, I will double space from now on :) Spotted a few mistakes with my suggestion: On 24/01/2012 23:02, Pieter De Wit wrote: Perhaps a 9) Implement dual IO queues - I *think* the IO has been moved into it's own thread, if not, the queuing can

Re: [RFC] cache architecture

2012-01-24 Thread Pieter De Wit
Hard to implement given the current "leg work" is already done ? How well does the current version of squid handle multicores and can this take advantage of cores ? Should be easy. We have not exactly checked and cocumented the DiskIO library API. But The current AIO handles SMP exactly as w

Re: Squid and SSI

2012-01-30 Thread Pieter De Wit
Hi - Sorry for jumping in :) On Tue, 31 Jan 2012, Amos Jeffries wrote: On 28.01.2012 09:46, goro goro wrote: Dear Sir(s) Greetings and welcome.     I Am a system administrator at an ISP, Squid is at the Heart of it, Caching is important to me , as is Through Put. I have Been trying for m

Storing of information

2012-02-10 Thread Pieter De Wit
Hi Guys, So I saw on the mailing list the question about quotas came up again. I thought I would give it a shot (planning etc) and I was wondering, does "Squid" have a way to store data ? In Quota you will have Bandwidth (bytes, not per second) that has to be checked/adjusted and updated to

Re: Storing of information

2012-02-10 Thread Pieter De Wit
On 11/02/2012 15:43, Amos Jeffries wrote: On 11/02/2012 8:34 a.m., Pieter De Wit wrote: Hi Guys, So I saw on the mailing list the question about quotas came up again. I thought I would give it a shot (planning etc) and I was wondering, does "Squid" have a way to store data ? In

BZR Errors

2012-02-10 Thread Pieter De Wit
Hi All, Following the wiki instructions from: http://wiki.squid-cache.org/BzrInstructions?action=show&redirect=Squid3VCS I am running into the following errors (clean BZR install on Ubuntu 12.04 dev branch) :~/sou

Re: Storing of information

2012-02-10 Thread Pieter De Wit
I like the idea of pushing it off into ICAP. That does being up the problem that things like auth loops, errors and related self-DoS events are omitted from the quota counts. Also tunnels are adapted only for the HTTP headers portion, once they get to the blind-tunnel parts its direct byte sh

Re: Storing of information

2012-02-11 Thread Pieter De Wit
* the parsing bottleneck gets crunched several times: on first arrival, in the ICAP server, and on return to Squid, * the ICAP server bypass optimization can't be used since quote needs to measure every byte, * tunneled data does not get sent to ICAP services, Not exactly perfect service, but

Re: Storing of information

2012-02-17 Thread Pieter De Wit
The download even if known-length can be aborted at any time, also the backend system may change the quota at any time as well. So IMO the best idea is to collpase the requests all down to a request asking for N bytes and passing along any parameters which the quota backend needs. The basic

Re: Storing of information

2012-02-17 Thread Pieter De Wit
ICAP is not ideal for implementing control points other than at the beginning of messages. It would be awkward and performance-expensive to use ICAP for quota control if you want to change things in the middle of a transaction. ICAP also lacks proactive notifications from the ICAP server to Squi

Re: BZR Errors

2012-02-17 Thread Pieter De Wit
On 11/02/2012 20:49, Pieter De Wit wrote: Hi All, Following the wiki instructions from: http://wiki.squid-cache.org/BzrInstructions?action=show&redirect=Squid3VCS <http://wiki.squid-cache.org/BzrInstructions?action=show&redirect=Squid3VCS> I am running into the following err