Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-15 Thread Mark Crispin
On Thu, 15 Oct 2009, Ico wrote: GNU/Linux There is no such thing. I don't care about Richard Stallman's megalomanic fantasies. particulary the versions using glibc as the C library. Which would be most if not all of the mainstream GNU/Linux distributions. Nonsense. The bug is in a C compi

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-15 Thread Mark Crispin
On Thu, 15 Oct 2009, Ico Doornekamp wrote: There were - and still are -- sites that run UW IMAP on platforms that do not have a select() call able to handle more then 1024 file descriptors. Name one. BSD and Linux systems are perfectly capable of handling more than 1024 file descriptors in th

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-15 Thread Mark Crispin
On Thu, 15 Oct 2009, Volker Schwicking wrote: Obviously someone named Tom from Alcatel Lucent created a patch that makes uw-imap use poll() instead of select() about 2 years ago. Mark, did you ever receive that patch mentioned? Do you still have it? Changing select() to poll() in the UW IMAP di

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-15 Thread Mark Crispin
On Thu, 15 Oct 2009, Volker Schwicking wrote: Mark, neither of us is trying to get anything done FOR us. WE (together) are trying to fix a problem for US (notice the capitalized letters). So why, after being repeatedly told that the problem is ultimately due to an incorrect definition in a gli

RE: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-15 Thread Esh, Thomas D (Tom)
map-uw-boun...@mailman2.u.washington.edu > [mailto:imap-uw-boun...@mailman2.u.washington.edu] On Behalf > Of Volker Schwicking > Sent: Thursday, October 15, 2009 8:42 AM > To: UW IMAP Software Interest List > Subject: Re: [Imap-uw] problem/bug/limitation in uw-client-library > &g

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-15 Thread Volker Schwicking
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 With a little help i just discovered something quite interesting. http://markmail.org/message/yqbkwigyl7mmj5gd#query:linux%20select()%201024%20file%20descriptor%20limit%20uw-imap+page:1+mid:khkis6mcfw2ab67n+state:results If that URL breakes, try this

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-15 Thread Volker Schwicking
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > For crying out loud, if you people want everything done for you without > having to do any work by yourself, then you should be using Microsoft > products and not open source. This will be my only comment concerning this discussion-issue. Dont expce

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-14 Thread Ico
* On 2009-10-14 Mark Crispin wrote : > On Wed, 14 Oct 2009, Ico wrote: > >> The whole thing is frustrating. > > You are frustrated because you repeatedly try the same thing and expect > different results. No, I am frustrated because the uw-imap library happens to be used in PHP, and does not

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-14 Thread Mark Crispin
Hi Dave. Thank you! That is exactly what I was getting at. It's rather sad the definition isn't copied from the system's descriptor limit, and even more that it's necessary to add the #ifndef to enable overriding it (not to mention the fact that a different symbol needs to be overriden in BS

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-14 Thread Mark Crispin
On Wed, 14 Oct 2009, Ico wrote: The whole thing is frustrating. You are frustrated because you repeatedly try the same thing and expect different results. Try something different. Look at those include files and see if you can figure out the way to do an equivalent override to that in BSD.

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-14 Thread Mark Crispin
On Wed, 14 Oct 2009, Oswald Buddenhagen wrote: i'm sure there is a way to influence the limit, possibly as simple as #defining __FD_SETSIZE before including sys/types.h (of course, finding that out experimentally is *way* simpler than actually reading the glibc sources :D). I looked for somethi

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-14 Thread Ico
Hi Volker, * On 2009-10-14 Volker Schwicking wrote : > Ok, after some playing around with dpkg-buildpackage and getting the > right environment with debootstrap (etch with etch-backports because of > the dpkg-devel and glibc2.2 requirements) i finally got the library > running with apache-mp

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-14 Thread Volker Schwicking
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Try to run `dpkg-buildpackage` instead. This will result in the > compelete automated debian build, including all patches. You'll end up > with a .deb in the parent directory. > > Ico > Ok, after some playing around with dpkg-buildpackage and gett

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-14 Thread Ico
* On 2009-10-14 Volker Schwicking wrote : > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > > > Insert following fragment somewhere in the top of the imap_open > > function in src/c-client/imap4r1.c > > I just tried to compile the debian source-package according to the > instructions in

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-14 Thread Volker Schwicking
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Insert following fragment somewhere in the top of the imap_open > function in src/c-client/imap4r1.c I just tried to compile the debian source-package according to the instructions in the README. I did this: vol...@vs:~/uw-imap$ patch -p0 < \ uw

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-14 Thread Oswald Buddenhagen
On Tue, Oct 13, 2009 at 04:34:43PM -0700, Mark Crispin wrote: > On Wed, 14 Oct 2009, Oswald Buddenhagen wrote: > >>That is an implementation issue within the Linux kernel. There are other > >>possible implementations in which that interface would be more efficient, > >no, it's an inherent problem.

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-14 Thread Ico
* On 2009-10-14 Mark Crispin wrote : > On Wed, 14 Oct 2009, Ico Doornekamp wrote: >> I think I have understood these two pretty well. Like I said, the linux >> FD_SETSIZE limit is well known and well documented. From 'man select' : >> : Executing FD_CLR() or FD_SET() with a value of fd that i

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-13 Thread Mark Crispin
On Wed, 14 Oct 2009, Ico Doornekamp wrote: I think I have understood these two pretty well. Like I said, the linux FD_SETSIZE limit is well known and well documented. From 'man select' : : Executing FD_CLR() or FD_SET() with a value of fd that is negative or is : equal to or larger than FD_SETS

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-13 Thread Oswald Buddenhagen
On Tue, Oct 13, 2009 at 02:35:35PM -0700, Mark Crispin wrote: > On Tue, 13 Oct 2009, Oswald Buddenhagen wrote: >> this has nothing to do with baby-computer thinking. select() is simply >> an incredibly inefficient interface, as it requires transforming the >> bitmap(s) into wakeup lists on every ca

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-13 Thread Ico Doornekamp
* On 2009-10-13 Mark Crispin wrote : > On Tue, 13 Oct 2009, Ico Doornekamp wrote: >> I do completely agree with all you write above, but unfortunately this >> does not solve the problem the original poster states: the combination >> uw-imap/linux/php/apache/whatevermore does not scale above 1

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-13 Thread Mark Crispin
On Tue, 13 Oct 2009, Ico Doornekamp wrote: I do completely agree with all you write above, but unfortunately this does not solve the problem the original poster states: the combination uw-imap/linux/php/apache/whatevermore does not scale above 1024 open file descriptors (= a few hundred websites

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-13 Thread Oswald Buddenhagen
On Tue, Oct 13, 2009 at 11:33:54AM -0700, Mark Crispin wrote: > Doubling FD_SETSIZE to 2048 would increase the fd_set by a whole 128 > bytes. Oh, the horror! How can we possibly afford it? [Excuse the > venomous sarcasm, but this sort of baby-computer thinking has been an > ongoing problem

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-13 Thread Ico Doornekamp
* On 2009-10-13 Mark Crispin wrote : > The comments in posix_types.h are definitely worth reading, as they betray > more baby-computer thinking. Worse, there is a __kernel_fd_set definition > which implies that the Linux kernel is incapable of handling programs > which are compiled with l

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-13 Thread Mark Crispin
In BSD, you can define FD_SETSIZE to some higher value than 1024 prior to the inclusion of . The only thing that FD_SETSIZE does is define the default capacity of the FD_SET; the kernel is quite happy to access a larger fd_set. Doubling FD_SETSIZE to 2048 would increase the fd_set by a whole

Re: [Imap-uw] problem/bug/limitation in uw-client-library

2009-10-13 Thread Ico Doornekamp
* On 2009-10-13 Volker Schwicking wrote : > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > Hello, > > i just searched the archives but couldnt find any reference regarding > this bug/problem/limitation in the client-library. > > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=478193 >

[Imap-uw] problem/bug/limitation in uw-client-library

2009-10-13 Thread Volker Schwicking
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hello, i just searched the archives but couldnt find any reference regarding this bug/problem/limitation in the client-library. http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=478193 Quick Summary: - - apache with 1024+ open file descriptors - - ph