Re: Next Squid get-together

2008-06-23 Thread Adrian Chadd
If someone wants to fly me to Europe? I'll come! Adrian On Mon, Jun 23, 2008, Mark Nottingham wrote: > July 30-Aug 1. > > My tickets are currently to London, and they're going to be ticketed > when the US wakes up on Monday. I also found out that our Stockholm > office is in the process o

Re: Squid, events, and file descriptors

2008-06-23 Thread Adrian Chadd
On Mon, Jun 23, 2008, Bradley Kite wrote: > Hi all, > > I have a problem that I am currently trying to diagnose. Please > correct me if you think this should be on the -users list instead, but > I think its a bug and I need further help trying to diagnose it. Ruh roh! > Dropping the squid server

Re: Next Squid get-together

2008-06-22 Thread Adrian Chadd
I'm still trying to find dates which do not clash with mnot and AUSNOG08. I'll revisit this stuff Thursday afternoon; I have some exams to fail. :) Adrian On Mon, Jun 23, 2008, Amos Jeffries wrote: > Adrian Chadd wrote: > >Ok. > > > >Amos, Robert, Mark, (

Re: Next Squid get-together

2008-06-22 Thread Adrian Chadd
; >> > > one, but scheduling EU didn't come together. > >> > > > >> > > I can still make anywhere in Europe July 30 - August 1, but am > >> > > ticketing on Monday. Any takers? Milan? London? Dublin? > >> > > > >> > > WRT

Re: Next Squid get-together

2008-06-20 Thread Adrian Chadd
On Sat, Jun 21, 2008, Amos Jeffries wrote: > >Mnot said he'll be back in Australia sometime in August? > > Thats where things were before discussion move on to another Eurpoean > get-together. I was hoping someone had more details behind the scenes by > now. There's nothing formalised yet. As

Re: Next Squid get-together

2008-06-20 Thread Adrian Chadd
Noone made any decisions? :) I'll be in Sydney in the first couple of weeks of july, and possibly some time in August. I haven't yet booked tickets so I haven't got any firm dates for being there. Mnot said he'll be back in Australia sometime in August? Adrian On Sat, Jun 21, 2008, Amos Jeffr

Re: delay pools snmp stats

2008-06-16 Thread Adrian Chadd
ater on when I get the time. adrian > > > > On m??n, 2008-06-16 at 22:49 +0800, Adrian Chadd wrote: > > Patch against Squid-2.HEAD: > > > > http://www.creative.net.au/diffs/20080716-delay_snmp-1.diff > > > > > > > > Adrian > > >

Re: delay pools snmp stats

2008-06-16 Thread Adrian Chadd
Patch against Squid-2.HEAD: http://www.creative.net.au/diffs/20080716-delay_snmp-1.diff Adrian On Mon, Jun 16, 2008, Adrian Chadd wrote: > Here's a snippet from my aggregate-level delay pools SNMP stats work: > > [EMAIL PROTECTED]:~/work/squid/sf/delay_snmp/src$ snmpwalk -M

delay pools snmp stats

2008-06-16 Thread Adrian Chadd
Here's a snippet from my aggregate-level delay pools SNMP stats work: [EMAIL PROTECTED]:~/work/squid/sf/delay_snmp/src$ snmpwalk -M /usr/share/snmp/mibs/:. -m ALL -v 1 -c public 127.0.0.1:3401 cacheDelayPoolSummaryTable SQUID-MIB::cacheDelayPoolIndex.1 = INTEGER: 1 SQUID-MIB::cacheDelayPoolIndex

Re: Bug #1893; why's it incomplete?

2008-06-12 Thread Adrian Chadd
On Thu, Jun 12, 2008, Henrik Nordstrom wrote: > Two brain cells fired and I think I now have the design for how Vary > should work. Somewhat different from today, and still one corner case to > figure out how to deal with (how to efficiently handle when Vary differs > among the variants) [snip]

Re: Bug #1893; why's it incomplete?

2008-06-12 Thread Adrian Chadd
On Thu, Jun 12, 2008, Henrik Nordstrom wrote: > Vary as such isn't that crazy, only our implementation or any other > trying to implement vary with some efficiency.. but it takes a while for > the concept to sink in properly. > > The current Vary processing really should be thrown out entirely, a

Re: Squid 3 HEAD - compiler options

2008-06-11 Thread Adrian Chadd
Don't omit the frame pointer in 64 bit mode, it makes walking the stack for things like profiling callgraphs impossible. Adrian On Thu, Jun 12, 2008, Amos Jeffries wrote: > > Just for the sake of consistency and preference for better > > troubleshooting and testing, are there any CFLAGS that I

Re: Bug #1893; why's it incomplete?

2008-06-11 Thread Adrian Chadd
On Thu, Jun 12, 2008, Henrik Nordstrom wrote: > On tor, 2008-06-12 at 09:40 +0800, Adrian Chadd wrote: > > Argh! > > > > Please start putting relevant details into: > > > > http://wiki.squid-cache.org/Features/VaryProcessing > > Why, when there is a bugzil

Re: Bug #1893; why's it incomplete?

2008-06-11 Thread Adrian Chadd
ent-Encoding: gzip > Vary: Accept-Encoding > > [ gzip'd content ] > > > HTTP/1.1 200 OK > Content-Type: application/foo > Cache-Control: max-age=30 > > [ plain content ] > > > > > On 12/06/2008, at 10:57 AM, Benno Rice wrote: > >

Re: aio #2: why aren't we doing async writes?

2008-06-11 Thread Adrian Chadd
On Wed, Jun 11, 2008, Henrik Nordstrom wrote: > On ons, 2008-06-11 at 20:01 +0800, Adrian Chadd wrote: > > > What I need to do is get this Sun box actually running Solaris and try to > > get dtrace to tell me what time is spent in the main thread blocking on > > disk wri

Re: Bug #1893; why's it incomplete?

2008-06-11 Thread Adrian Chadd
On Wed, Jun 11, 2008, Henrik Nordstrom wrote: > On ons, 2008-06-11 at 17:50 +0800, Adrian Chadd wrote: > > > Are there any objections to removing this patch from Squid-2.HEAD and > > documenting this discussion (and other Vary related stuff) on a wiki page? > > No pro

Re: aio #2: why aren't we doing async writes?

2008-06-11 Thread Adrian Chadd
On Wed, Jun 11, 2008, Henrik Nordstrom wrote: > Oh, forgot to say that there is #define's in store_asyncufs.h tuning > this. But the non-default settings hasn't been tested in a very very > long time.. (2000 timeframe) Yeah, I'm testing async write at the moment. But I'm not exactly testing it wi

Re: aio #2: why aren't we doing async writes?

2008-06-11 Thread Adrian Chadd
On Wed, Jun 11, 2008, Henrik Nordstrom wrote: > Simply because when testing on Linux they very rarely block, with the fs > buffers absorbing them fully as long as you don't run too short on > memory. Ah. > But yes, when you reach the absolute limit of what the drives can > sustain the buffers wi

Re: aio completion notification?

2008-06-11 Thread Adrian Chadd
On Wed, Jun 11, 2008, Henrik Nordstrom wrote: > On ons, 2008-06-11 at 17:47 +0800, Adrian Chadd wrote: > > How would it work? The diskd queues are all sysv msgq's which can't be > > polled as filedescriptors. What would wake up the main Squid process? > > make d

Re: Bug #1893; why's it incomplete?

2008-06-11 Thread Adrian Chadd
On Wed, Jun 11, 2008, Henrik Nordstrom wrote: [snip] > Probably better to rethink the patch to use the "vary id" as a timestamp > instead, marking objects with an older update time as stale. Are there any objections to removing this patch from Squid-2.HEAD and documenting this discussion (and ot

aio #2: why aren't we doing async writes?

2008-06-11 Thread Adrian Chadd
Subject says it all - open, read and unlink are async, but write and close aren't. Why is at least write not async? Adrian -- - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support - - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -

Re: aio completion notification?

2008-06-11 Thread Adrian Chadd
On Wed, Jun 11, 2008, Henrik Nordstrom wrote: > > All the callback does is read into a temp buffer, and re-schedules for > > read IO. > > Yes.. > > The point of this wakeup is to break the select/poll/epoll/kqueue sleep. I found that in the CVS history. > It could obviously be optimized to onl

aio completion notification?

2008-06-11 Thread Adrian Chadd
So perusing the aio code in preparation to disassocate it from the Squid fs code, I found that there's a pipe being used as a notification/wakeup mechanism. Basically, thread completion writes a ! into the pipe; this wakes up the main squid loop and calls a PF callback. All the callback does is r

Bug #1893; why's it incomplete?

2008-06-10 Thread Adrian Chadd
Henrik, Whats incomplete about the Variant invalidation support in PURGE/CLR in Squid-2.HEAD? Adrian -- - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support - - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -

Re: X-Vary-Options patch

2008-06-07 Thread Adrian Chadd
have less opportunity to mess things up. > > Also, it's important to realise that at some point it's more > worthwhile to take an approach like TCN and describe the available > variants, rather than match against selecting headers. > > Cheers, > > >

Re: X-Vary-Options patch

2008-06-06 Thread Adrian Chadd
URI into two entries; those whose > Accept-Encoding contains the list value "gzip", and those that don't. > Is that correct? > > Also, I'm assuming the origin would still need to send > Vary: Accept-Encoding > to work properly with downstream caches. &g

Re: Round-Robin becomes unbalanced when a peer dies and comes back

2008-06-06 Thread Adrian Chadd
On Fri, Jun 06, 2008, Kinkie wrote: > I'm not an admin, but I agree. .. he's already (privately) agreed to it. > > K > > > > On 6/6/08, Adrian Chadd <[EMAIL PROTECTED]> wrote: > > On Fri, Jun 06, 2008, Mark Nottingham wrote: > >>

Re: Making PEER_TCP_MAGIC_COUNT a cache_peer option

2008-06-06 Thread Adrian Chadd
On Fri, Jun 06, 2008, Amos Jeffries wrote: > >Looks fine - but you need to add some code to the configuration file > >-generator- so it spits out the option when building the cache_peer line. > > What do you mean Adran? I thought it would just be a default setting > added at the top of the cache

Re: Making PEER_TCP_MAGIC_COUNT a cache_peer option

2008-06-05 Thread Adrian Chadd
On Fri, Jun 06, 2008, Mark Nottingham wrote: > > > Squid will consider a peer dead when it has ten connect failures; this > is hardcoded in as PEER_TCP_MAGIC_COUNT. > The attached patch makes it a per-peer configuration option, > defaultin

Re: Round-Robin becomes unbalanced when a peer dies and comes back

2008-06-05 Thread Adrian Chadd
On Fri, Jun 06, 2008, Mark Nottingham wrote: > Patch attached to bug. .. looks fine to me. Squid admins: Can we just please hook Mark up with CVS repository access so he can commit these sorts of patches after review? :) I don't like seeing stuff fall between the cracks because we're too busy.

Re: Round-Robin becomes unbalanced when a peer dies and comes back

2008-06-05 Thread Adrian Chadd
On Fri, Jun 06, 2008, Mark Nottingham wrote: > Patch attached to bug. .. why haven't you just been given CVS commit access already? :) Adrian

Re: Round-Robin becomes unbalanced when a peer dies and comes back

2008-06-05 Thread Adrian Chadd
Hm, that sounds right. You're basically having to recalculate/reconverge your peer weightings, and thats the sensible way to do it. Adrian On Fri, Jun 06, 2008, Mark Nottingham wrote: > Oh, I chopped off the last part; if people agree with that plan, I'll > produce a patch. > > > On 06/06/20

Re: header-to-header latency

2008-06-05 Thread Adrian Chadd
On Fri, Jun 06, 2008, Mark Nottingham wrote: > A while back I filed: > http://www.squid-cache.org/bugs/show_bug.cgi?id=2345 > > Any thoughts? I think its fine. Adrian -- - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support - - $25/pm entry-level VPSes w/ capped ba

Re: Adding SCTP support

2008-06-03 Thread Adrian Chadd
> >> the right way to go about achieving this ? > >> > >> But, in general, it seems like a proxy would be a perfect place to use > >> something like SCTP, especially where the origin server may not have SCTP > >> support. It also seems like the cli

Re: 2.7 logfile modules documentation

2008-06-03 Thread Adrian Chadd
On Tue, Jun 03, 2008, Henrik Nordstrom wrote: > The documentation on how to use the different logfile modules seems to > be missing in 2.7. .. I don't think I wrote any! The reason I was hoping Squid-2.7 would be released early in the year is that it would happen -before- my college semester star

Re: Trying to add SNMP section

2008-06-02 Thread Adrian Chadd
rian On Mon, Jun 02, 2008, Adrian Chadd wrote: > I'm trying to add SNMP delay pool statistics. I'm having a heck of a time > trying to figure out whats busted in my SNMP code thus far. > > The diff: http://www.creative.net.au/diffs/squid-20080602-snmp1.diff > > The co

Trying to add SNMP section

2008-06-02 Thread Adrian Chadd
I'm trying to add SNMP delay pool statistics. I'm having a heck of a time trying to figure out whats busted in my SNMP code thus far. The diff: http://www.creative.net.au/diffs/squid-20080602-snmp1.diff The correct OID (.1.3.6.1.4.1.3495.1.4.4.1.1) shows up during initialisation, but my handler f

Re: Adding SCTP support

2008-06-01 Thread Adrian Chadd
use SCTP for HTTP delivery would seem to > be the potential to improve throughput via SCTP multi-streaming. > > Adrian Chadd wrote: > | Hi, > | > | I've spoken to some SCTP related people about this before. > | The trouble is: > | > | * NOone's fleshed o

Re: Adding SCTP support

2008-05-31 Thread Adrian Chadd
Hi, I've spoken to some SCTP related people about this before. The trouble is: * NOone's fleshed out how HTTP over SCTP should look; * Noone's fleshed out how servers should choose HTTP over TCP vs SCTP. They're the much more pressing questions. Adrian On Sat, May 31, 2008, Pranav Desai wrot

Re: RFC: changing cachemgr URL

2008-05-29 Thread Adrian Chadd
On Thu, May 29, 2008, Kinkie wrote: > Hi all, >I'd like to have everyone's input on the option of moving cachemgr > from its current "location" to a proper HTTP squid-internal-* prefix. > This would make the development of cachemgr-related tools much easier. Whats limiting atm? adrian > >

Re: Another squid get-together?

2008-05-27 Thread Adrian Chadd
On Wed, May 28, 2008, Robert Collins wrote: > > If Squid folks are seriously interested in coming to AU, I could > > easily host in Sydney (with a good view of the harbour). Generally, > > airfares are cheapest in April and Sept/Oct. > > Sydney is extremely easy for me to attend :P. :) Well

maximum request size ACL diff

2008-05-26 Thread Adrian Chadd
Hi, Here's a small diff (thanks to benno!) which implements a simple fast ACL lookup for the maximum request size. This allows Squid administrators to restrict POST/upload sizes based on a variety of available request information. I'd like to commit this to Squid-2.HEAD, squid-2.7 and if possible

Re: Another squid get-together?

2008-05-26 Thread Adrian Chadd
ntation on store URL rewriting and its usefulness in the real world. (A Squid/caching conference in Australia?..) Adrian > > > > On 27/05/2008, at 10:57 AM, Adrian Chadd wrote: > > >I'm up for anything in Australia; when are you going to be in > >M

Re: Another squid get-together?

2008-05-26 Thread Adrian Chadd
I'm up for anything in Australia; when are you going to be in Melbourne for any appreciable stretch of time? adrian On Tue, May 27, 2008, Mark Nottingham wrote: > Hey, > > I'm going to be in the US and Europe this summer, and am wondering if > there's interest in another meetup. If it's int

2.7stable1 ?

2008-05-17 Thread Adrian Chadd
Does anyone have any objections to 2.7.STABLE1 being released? Henrik, would you mind kicking this off? I'm still not comfortable pulling it off. Thanks, Adrian -- - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support - - $25/pm entry-level VPSes w/ capped bandwidth c

Re: Problems with Limecast Server

2008-05-17 Thread Adrian Chadd
On Sat, May 17, 2008, Sven K??hler wrote: > >>So actually, the mp3stream is found and played by my mp3-players. Yet, > But at the moment, i'm completely irritated. > When i run a "wget http://streamserver"; first, and then play the file > with mplayer, everything sounds OK. > But when i run "mpl

Re: XMIN(size_t, ssize_t) ?

2008-05-17 Thread Adrian Chadd
On Sat, May 17, 2008, Henrik Nordstrom wrote: > `-Wsign-compare' > I have this flag as a candidate warning flag in my build script, but not > activated as there is a bit of work to prune out the false alerts.. Where about is this script again? I really should use it. Adrian -- - Xenion - ht

Re: Problems with Limecast Server

2008-05-17 Thread Adrian Chadd
Dig out wireshark and take a look at the data. Take a look at the timestamps of the data too; both going into Squid and being written out from Squid. The trouble here may be IO scheduling. Squid never -ever- was assumed to be streaming data that had any form of real-time like scheduling.. Adria

Re: Problems with Limecast Server

2008-05-17 Thread Adrian Chadd
Well, the problem is now well-understood. Can you think of any way to identify that the request is going to result in a non-HTTP response? There's a couple of possibilities that I can think of - either add support to squid to handle this, or add in logic to Squid to determine the request needs to

Re: Problems with Limecast Server

2008-05-16 Thread Adrian Chadd
On Fri, May 16, 2008, Sven K?hler wrote: > Any thoughts, on how to handle this? > I wish, squid would handle this case gracefully somehow. Its not HTTP; it doesn't really matter if its HTTP-like. Steven Wilton has some patches to Squid-2.6 which implement "full transparency" on non-HTTP looking

Re: XMIN(size_t, ssize_t) ?

2008-05-15 Thread Adrian Chadd
On Thu, May 15, 2008, Alex Rousskov wrote: > > .. which explains the strange bugs that someone is seeing with Squid-2.HEAD > > and the store update stuff. > > Interesting bug. FWIW, it looks like g++ automatically detects the above > error and says: > warning: comparison between signed and unsign

XMIN(size_t, ssize_t) ?

2008-05-15 Thread Adrian Chadd
A strange bug in the store update and store client code, with me to blame. the store client code does this: new_callback(cbdata, nr, XMIN(sc->copy_size, sz)); Now, sc->copy_size is size_t (unsigned); sz is ssize_t (signed); its passing 4096 bytes (copy_size) in when sz is -1. I'm guessing so

Re: error pages, completed (for English)

2008-05-15 Thread Adrian Chadd
On Fri, May 16, 2008, Amos Jeffries wrote: > FMI, Were there any src/ code changes for this? or just errors/ ? The playpen account has a perl script to do the stylesheet include. Thats about it. > I'm fully occupied for a few days now. But will look at the HTML > standards on those ASAP. They'

error pages, completed (for English)

2008-05-14 Thread Adrian Chadd
I've completed migrating the English error pages into the "CSS" form. Here's the overview: http://cacheboy.blogspot.com/2008/05/error-page-update-phase-2.html The SVN repository of mine has a playpen/errors directory which includes the originals, the modified files and a build script to include t

Re: status of internal redirectors?

2008-05-08 Thread Adrian Chadd
On Thu, May 08, 2008, Matt Benjamin wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA256 > > It was... .. where? Adrian -- - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support - - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -

Re: development project proposal

2008-05-08 Thread Adrian Chadd
Squid-2.6 isn't open for fresh features at the moment. It may or may not be that difficult to merge it into Squid-2.HEAD and then merge it down into Squid-2.7 once thats been released and is tested stable. How big a diff is it? Could you put it into a bugzilla entry? Adrian On Wed, May 07, 20

Re: zph and squid-3.0

2008-05-06 Thread Adrian Chadd
On Wed, May 07, 2008, Amos Jeffries wrote: > I added it as a simple cross-port. Seeing as it's been well tested as a > patch on 2.6. even if not integrated until recently. > > The polish was going to go in 3.1 when I have time. > > Any other votes for/against? I'm against it in 3.0 on principle

Re: status of internal redirectors?

2008-05-06 Thread Adrian Chadd
On Wed, May 07, 2008, Mark Nottingham wrote: > Is the internal rewrite work going to go into a release any time soon? > It looks quite useful. Its in Squid-2.HEAD. > Also, from browsing through the code briefly, it looks like it would > be fairly easy to hook things up so that you could confi

squid-2.HEAD / Cacheboy code reorganisation: almost complete

2008-05-04 Thread Adrian Chadd
This is aimed more as a "how I think things should be done" post as this stuff isn't yet in Squid-2.HEAD. Still, I think its worth pointing out. I've almost finished my first round of code reorganisation along the lines I suggested on squid-dev a few months ago (and some people disagreed with.) I

64-bit oprofile + squid

2008-04-30 Thread Adrian Chadd
I figured out how to extract sensible callgraph oprofile reporting out of a 64 bit install. Notes are here: http://code.google.com/p/cacheboy/wiki/CodeProfiling Basically - it seems the "omit-frame-pointer" optimisation GCC does stops the inclusion of what oprofile needs to walk the callgraph.

Re: Benchmarking Squid

2008-04-29 Thread Adrian Chadd
On Tue, Apr 29, 2008, Alex Rousskov wrote: > > Don't forget other key things which affect scalability, such as concurrent > > connection count and memory usage. > > The number of active concurrent connections is just request rate > multiplied by response time. The number of idle persistent connec

Re: Benchmarking Squid

2008-04-29 Thread Adrian Chadd
On Wed, Apr 30, 2008, Amos Jeffries wrote: > >The metrics depend on the workload, but in general you need at least > >rate/throughput, response time, hit ratio (if caching), and errors. No > >single metric is meaningful. You can optimize one and "freeze" others at > >reasonable levels and workload

Re: New cachemgr capability

2008-04-27 Thread Adrian Chadd
I see no reason to keep it windows-specific. Just put the line that logs "reconfiguring" before you call reconfigure.. :) Adrian On Sun, Apr 27, 2008, Guido Serassio wrote: > Hi, > > In the way to merge into 2.HEAD all the Windows port stuff, one of > the remains is the addition of reconfigur

Re: squid-2.HEAD: proposed patch for max-age + no-cache combination

2008-04-27 Thread Adrian Chadd
On Sun, Apr 27, 2008, Alexander V. Lukyanov wrote: > Hello! > > Currently it is possible for squid to send out Cache-Control: max-age=XXX, > no-cache > combination. But max-age does not make any sense when there is a no-cache > flag. > > Here is a patch to fix it. The patch skips setting max-ag

Re: squid-2.HEAD: proposed patch for non-broken keep-alive case

2008-04-27 Thread Adrian Chadd
On Sun, Apr 27, 2008, Alexander V. Lukyanov wrote: > Hello! > > It seems that squid currently considers broken the case of keep-alive when > there is no Content-Length and the transfer encoding is chunked. > I think it is not quite correct, as chunked encoding allows to determine > reply body end.

Re: squid DTD project question

2008-04-27 Thread Adrian Chadd
I've never heard of it. It may just be an old, stale project which was never completed enough to fold into Squid. Would you mind sharing your system for detecting duplicates in your own cache? That may be a good starting point. Adrian On Mon, Apr 21, 2008, Darius BUFNEA wrote: > > Dear Sirs,

Re: SMP scalability goal

2008-04-24 Thread Adrian Chadd
On Thu, Apr 24, 2008, Alex Rousskov wrote: > My wording may have been poor. I assume we always use a quad box. Add > SMP support to Squid. Test Squid3 on that quad box with SMP disabled > (that is what I called single-core performance on a quad box). Test with > SMP enabled and configure Squid to

Re: SMP scalability goal

2008-04-24 Thread Adrian Chadd
A few points. * The single-core squid performance won't be the same as dual/quad core, so you can't assume that. I know this makes your assumptions difficult. * Basically, your single->dual core performance will generally expose the OSes parallelism for processing certain things, mostly netwo

Re: mem_node memory usage in 2.x

2008-04-22 Thread Adrian Chadd
On Tue, Apr 22, 2008, Henrik Nordstrom wrote: > tis 2008-04-22 klockan 19:35 +0800 skrev Adrian Chadd: > > yeah, thats pretty invalid. :) I wonder if your method for returning > > RSS is valid. > > RSS is Resident Set Size, the number of in-core memory pages currently >

Re: mem_node memory usage in 2.x

2008-04-22 Thread Adrian Chadd
On Tue, Apr 22, 2008, Guido Serassio wrote: > >(Linux, Solaris, Windows? :) give the above a whirl and let me know what > >the > >output is? > > This code is not so clean for Windows: no rusage(), no bzero() and > some include files are missing ... Oh, I know it won't compile for Windows. I re

Re: ZPH patches for Squid

2008-04-21 Thread Adrian Chadd
On Tue, Apr 22, 2008, Amos Jeffries wrote: > If anyone has any info that might help Marin could you mail it to me or > him please. Store the hit information in the MemObject; include it in swap metadata. > >Hello, > > > >I've practically finished the patch porting for the Squid source code > >w

mem_node memory usage in 2.x

2008-04-20 Thread Adrian Chadd
(This also may be an issue in Squid-3, as the mem_node class stores the data inline.) I did a little poking with the FreeBSD allocator - it allocates non-tiny objects on page boundaries with a size rounded up to the next page. [EMAIL PROTECTED] ~]$ ./test1 test1 131072 allocating 12, then 4096 by

Re: client_side and comm_close

2008-04-19 Thread Adrian Chadd
On Sat, Apr 19, 2008, Alex Rousskov wrote: > > But now you have a better understanding of the bugs that are introduced > > with AsyncCalls. You can then plan design changes to the client-side code > > to work around these. > > I am not sure how to rephrase this so that it is clear, but client-sid

Re: client_side and comm_close

2008-04-19 Thread Adrian Chadd
On Sat, Apr 19, 2008, Henrik Nordstrom wrote: > I don't remember why comm_close was made async, but the more I think > about it I think it's most likely wrong. comm_close SHOULD invalidate > any pending comm operations on that fd, anything else just leads to > nightmares. The back-end of comm_clo

Re: client_side and comm_close

2008-04-18 Thread Adrian Chadd
On Fri, Apr 18, 2008, Alex Rousskov wrote: > > I'd suggest another option - roll back all of the async calls changes to the > > comm code, stabilise the codebase without it and re-evaluate what should > > occur (in smaller chunks, rather than dropping in a new comm manager) > > before reintroducin

Re: client_side and comm_close

2008-04-18 Thread Adrian Chadd
On Wed, Apr 16, 2008, Alex Rousskov wrote: > In short, we have several related problems here: (a) client_side code is > incapable of reliably identifying whether comm_close has been called; > (b) ConnStateData::isOpen may not work anymore; (c) client_side code > uses many different ways to identif

Re: XPROF_STATS update for amd64?

2008-04-14 Thread Adrian Chadd
On Mon, Apr 14, 2008, Henrik Nordstrom wrote: > > Current generation of Intel CPU is not affected. > > > > So the results could be totally unreliable :-) > > That problem is visible in even in x86 code on dual core AMD or SMP > systems.. Guys, The profiling abilities of current-generation

Re: TPROXY support in Squid 2

2008-04-09 Thread Adrian Chadd
On Wed, Apr 09, 2008, Henrik Nordstrom wrote: > ons 2008-04-09 klockan 17:36 +0800 skrev Adrian Chadd: > > > The ipt_bind call from forward.c should go into comm_openex. Kind of > > > pointless with the new flag otherwise.. You said you had done this, but > > > not in

Re: [MERGE] Merged from trunk

2008-04-09 Thread Adrian Chadd
I'd really like to see the shuffling around seperated from the integration of the tproxy4 code - ie, (at least) two seperate commits. I'm not sure how bzr works with merging in changes from other repos - will there be some sort of history included, or just this one patch? Adrian On Thu, Apr 1

Re: TPROXY support in Squid 2

2008-04-09 Thread Adrian Chadd
On Tue, Apr 08, 2008, Henrik Nordstrom wrote: > > http://www.creative.net.au/diffs/20080408-tproxy-fix-2.diff > > using -3 instead of -2 looks better... but incomplete. Oops! Try http://www.creative.net.au/diffs/20080409-squid2-tproxy-4.diff > You need to add the new ipt_* files to the EXTRA_s

Re: Problem with CVS pserver?

2008-04-09 Thread Adrian Chadd
Squid-2! Adrian On Wed, Apr 09, 2008, Amos Jeffries wrote: > Benno Rice wrote: > >I've started getting this today: > > > > > cvs -z9 -d :pserver:[EMAIL PROTECTED]:/squid co squid > >open /dev/null failed > >Operation not supported > > > >Has something broken on the CVS server? > > > > The cent

Re: [MERGE] eCAP support, part 1: Loadable modules and ICAP-independent Squid core.

2008-04-08 Thread Adrian Chadd
On Tue, Apr 08, 2008, Alex Rousskov wrote: > > I'd like to see the pconn stuff with AsyncCalls sorted out first before > > more potentially disruptive stuff is included. > > Why wait? The two issues are unrelated, being worked on by different > folks, and the suggested changes are relatively beni

Re: [MERGE] eCAP support, part 1: Loadable modules and ICAP-independent Squid core.

2008-04-08 Thread Adrian Chadd
On Tue, Apr 08, 2008, Alex Rousskov wrote: > Hi, > > FYI: I will commit this tomorrow if there are still no objections. I'd like to see the pconn stuff with AsyncCalls sorted out first before more potentially disruptive stuff is included. Adrian

Re: TPROXY support in Squid 3

2008-04-08 Thread Adrian Chadd
On Tue, Apr 08, 2008, Adrian Chadd wrote: > Take 3: http://www.creative.net.au/diffs/20080408-tproxy-fix-2.diff * restored the global flag which indicates "tproxy"ness; renamed to enable_spoof_srv * moved the tproxy "bind" stuff into comm.c, with a flag to comm_openex()

Re: Squid Throughput/Performance Testing

2008-04-08 Thread Adrian Chadd
Polygraph takes a while to setup right. It depends on how hard you wish to hit the proxy. I also use httperf/apachebench in specific configurations to stress certain parts of the Squid codebase. Adrian On Tue, Apr 08, 2008, Bradley Kite wrote: > Hi all. > > I'm interested in the performance

Re: TPROXY support in Squid 3

2008-04-08 Thread Adrian Chadd
On Tue, Apr 08, 2008, Henrik Nordstrom wrote: > > tis 2008-04-08 klockan 14:28 +0800 skrev Adrian Chadd: > > Take 2: includes initial modularisation (untested; I'll test it at home > > this weekend when I get my tproxy box back online) and configure magic > > (

Re: TPROXY support in Squid 3

2008-04-07 Thread Adrian Chadd
Take 2: includes initial modularisation (untested; I'll test it at home this weekend when I get my tproxy box back online) and configure magic (with placeholders for tproxy4/freebsd.) http://www.creative.net.au/diffs/20080408-tproxy-fix-2.diff TODO: * pull out the capabilities stuff, removing th

Re: TPROXY support in Squid 3

2008-04-07 Thread Adrian Chadd
On Mon, Apr 07, 2008, Amos Jeffries wrote: > We have come up with a 'final-beta' patch for squid-3 now. > http://treenet.co.nz/projects/squid/patches/tproxy-squid-3_20080407.patch > Just waiting on Laszlo final approval. > > It's pretty much: > > * adding a COMM_TRANSPARENT flag to comm_openex(

Re: TPROXY support in Squid 3

2008-04-07 Thread Adrian Chadd
On Tue, Apr 08, 2008, Henrik Nordstrom wrote: > tis 2008-04-08 klockan 09:57 +1200 skrev Amos Jeffries: > > But, baby steps people: > > - Get it in > > - Get it tested. > > - Polish into a class. > > > > So far we are at #1 > > And I won't approve the change of sprinkling #if LINUX_TPROXY4

Re: TPROXY support in Squid 3

2008-04-07 Thread Adrian Chadd
On Mon, Apr 07, 2008, Henrik Nordstrom wrote: > I say it shouldn't even be a SERVER_SPOOF define. Make the generic parts > always compiled, doing nothing if spoofing capabilities is not > available. That makes it easier to do then. I'll go off and start doing that to Squid-2.HEAD. Adrian --

Re: SSL transparent proxy hack?

2008-04-07 Thread Adrian Chadd
There's stuff in Squid-3 (sslbump) for pulling apart the SSL stream. A more lightweight version to implement basic ACL processing and act as a sort of stepping stone for further testing wouldn't be that difficult to code up. Adrian On Mon, Apr 07, 2008, [EMAIL PROTECTED] wrote: > Assuming thi

Re: TPROXY support in Squid 3

2008-04-07 Thread Adrian Chadd
In fact, there shouldn't be any LINUX_TPROXY* defines in the main codetree. There should be a "SERVER_SPOOF" define which ties in all of the connection tracking stuff, and a clean cut API for doing TPROXY2/TPROXY4/etc socket manipulation. Gah, this makes me want to just ignore more classwork and f

Re: Headers/body separation

2008-04-07 Thread Adrian Chadd
On Mon, Apr 07, 2008, Henrik Nordstrom wrote: > I didn't test 2.6 today, but I know from earlier that it falls back on > miss on large response headers. > > Testing again to be sure and indeed it does. And not even a warning in > cache.log about it.. Cute. Ok. Can we now release Squid-2.7 ? :)

Re: Headers/body separation

2008-04-07 Thread Adrian Chadd
On Mon, Apr 07, 2008, Henrik Nordstrom wrote: > Running a test on 2.7 now to see how it actually behaves in the > situation.. and it's fine. With the object in-memory is serves a cache > hit, and with the object on disk we get a "swapin failure" and fallback > on cache miss. Fully acceptable and n

Re: [MERGE] Support large response headers

2008-04-07 Thread Adrian Chadd
On Mon, Apr 07, 2008, Henrik Nordstrom wrote: > m??n 2008-04-07 klockan 13:58 +0800 skrev Adrian Chadd: > > The first snippet of refactoring, which has been committed: > > > > http://www.squid-cache.org/Versions/v2/HEAD/changesets/12032.patch > >

Re: [MERGE] Support large response headers

2008-04-06 Thread Adrian Chadd
On Mon, Apr 07, 2008, Henrik Nordstrom wrote: > m??n 2008-04-07 klockan 01:07 +0800 skrev Adrian Chadd: > > > As discussed on IRC, I'm not sure where in 2.5/2.6 the response > > status/headers > > are allowed to grow past 4k _AND_ be parsed. > > >From wha

Re: [MERGE] Support large response headers

2008-04-06 Thread Adrian Chadd
On Sun, Apr 06, 2008, Henrik Nordstrom wrote: > Resubmissions as I haven't received any comments on the previous merge > request. > > This patch fixes Bug #2001 by reworking how the client_side_*.cc code > deals with response headers. Instead of parsing the headers again it > clones the already pa

delay pools statistics + delayed ACL completed

2008-04-06 Thread Adrian Chadd
I've just committed the statistics + delayed ACL stuff to Squid-2. Next: client-side delay pools ACL code. I'll create a new SF branch for that. Adrian -- - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support - - $25/pm entry-level VPSes w/ capped bandwidth charges ava

Re: squid-2 dataflow and copying changes

2008-04-05 Thread Adrian Chadd
On Sat, Apr 05, 2008, Henrik Nordstrom wrote: > It would also be good to look into a temporary fix for 2.7 as the above > is probably not 2.7 material. Well, its sort of related - the one or two places where I'm currently passing in a buffer via storeClientCopy() can be turned into a storeClientR

squid-2 dataflow and copying changes

2008-04-04 Thread Adrian Chadd
G'day, One of my contracts is to improve dataflow and reduce copying in Squid-2. I've got one major bug in Squid-2.HEAD / Squid-2.7 to fix (>4k response headers for disk objects) which will probably be fixed as part of this work. This'll involve bringing over various parts of my Squid-2 work in s

<    1   2   3   4   5   6   7   8   9   10   >