Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
On Thu, Mar 01, 2007 at 12:28:00PM +0100, Eric Dumazet ([EMAIL PROTECTED]) wrote: On Thursday 01 March 2007 12:20, Evgeniy Polyakov wrote: On Thu, Mar 01, 2007 at 12:14:44PM +0100, Eric Dumazet ([EMAIL PROTECTED]) wrote: On Thursday 01 March 2007 11:59, Evgeniy Polyakov wrote: Yes

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
On Thu, Mar 01, 2007 at 12:41:37PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: I also changed client socket to nonblocking mode with the same result in epoll server. If you will find it broken, please send me corrected to test too

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
-- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
of additional libs (according to debian testing dependencies on my very light installation), so with my miserable 1-1.6 kb/sec do not expect it today :) -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
On Thu, Mar 01, 2007 at 01:43:36PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: I separated epoll and kevent servers, since originally kevent server included additional kevent features, but then new ones were added and I moved slowly

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
On Thu, Mar 01, 2007 at 01:34:23PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: Document Length:3521 bytes Concurrency Level: 8000 Time taken for tests: 16.686737 seconds Complete requests: 8 Failed requests

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
is always zero, i.e. kweb_kevent_remove() is always called? Yes. Ingo -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
On Thu, Mar 01, 2007 at 02:32:42PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: [...] that is why number for kevent is higher - it uses edge-triggered handler (which you asked to remove from epoll), [...] no - i did not 'ask

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
On Thu, Mar 01, 2007 at 02:12:50PM +0100, Eric Dumazet ([EMAIL PROTECTED]) wrote: On Thursday 01 March 2007 12:47, Evgeniy Polyakov wrote: Could you provide at least remote way to find it? Sure :) I only found the same problem at http://lkml.org/lkml/2006/10/27/3 but without

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
on that? Ingo -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
On Thu, Mar 01, 2007 at 05:43:50PM +0300, Evgeniy Polyakov ([EMAIL PROTECTED]) wrote: On Thu, Mar 01, 2007 at 02:12:50PM +0100, Eric Dumazet ([EMAIL PROTECTED]) wrote: On Thursday 01 March 2007 12:47, Evgeniy Polyakov wrote: Could you provide at least remote way to find

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
On Thu, Mar 01, 2007 at 03:47:17PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: CPU: AMD64 processors, speed 2210.08 MHz (estimated) Counted CPU_CLK_UNHALTED events (Cycles outside of halt state) with a unit mask of 0x00 (No unit mask) count

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
On Thu, Mar 01, 2007 at 04:09:42PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: I can tell you that the problem (at least on my machine) comes from : gettimeofday(tm, NULL); in evserver_epoll.c yeah, that's another

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
On Thu, Mar 01, 2007 at 04:32:37PM +0100, Eric Dumazet ([EMAIL PROTECTED]) wrote: On Thursday 01 March 2007 16:23, Evgeniy Polyakov wrote: They are there, since ab runs only 50k requests. If I change it to something noticebly more than 50/80k, ab crashes: # ab -c8000 -t 600 -n8

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
On Thu, Mar 01, 2007 at 04:41:27PM +0100, Eric Dumazet ([EMAIL PROTECTED]) wrote: On Thursday 01 March 2007 16:32, Eric Dumazet wrote: On Thursday 01 March 2007 16:23, Evgeniy Polyakov wrote: They are there, since ab runs only 50k requests. If I change it to something noticebly more than

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-03-01 Thread Evgeniy Polyakov
(no logs). Default mpm-apache2 with bunch of threads - about 8k req/s. Default thttpd (disabled logging) - about 2k req/s Btw, all your tests are network bound, try to decrease html page size to get actual event processing speed out of that machines. -- Evgeniy Polyakov - To unsubscribe

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-28 Thread Evgeniy Polyakov
te correctly, judging from > the numerous train wrecks that I've been called in to salvage over the > last ten years or so. 130 lines skipped... I have only one question - wasn't it too lazy to write all that? :) > Cheers, > - Michael -- Evgeniy Polyakov - To unsubscribe from

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-28 Thread Evgeniy Polyakov
from the numerous train wrecks that I've been called in to salvage over the last ten years or so. 130 lines skipped... I have only one question - wasn't it too lazy to write all that? :) Cheers, - Michael -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe

Re: A quick fio test (was Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3)

2007-02-27 Thread Evgeniy Polyakov
g set to 1 or default (full). So syslets have small problems with small number of iodepth - its performance is about 34mb/sec and then increases to 36 with iodepth grow. While libaio decreases from 38 down to 36 mb/sec. iodepth_low=1 helps syslets to have 37mb/sec with iodepth=32, with 3200 and 1

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
ontainer_of()) - it is exactly as in epoll storage - both were created with the smallest possible overhead in mind. -- Evgeniy Polyakov - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at ht

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
in epoll() there are two queues. > - Davide > -- Evgeniy Polyakov - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
event-based rings of IO requests, if request happens to block (which should be avaided as much as possible), then it continues on behalf of sleeping thread. > Ingo -- Evgeniy Polyakov - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body o

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
On Tue, Feb 27, 2007 at 01:13:28PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: > > * Evgeniy Polyakov <[EMAIL PROTECTED]> wrote: > > > > [...] But it is true that for most kernel programmers, threaded > > > programming is much easier to understand, and we n

Re: threadlets as 'naive pool of threads', epoll, some measurements

2007-02-27 Thread Evgeniy Polyakov
On Tue, Feb 27, 2007 at 01:15:42PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: > > So, ok, no micro-thread name. > > thanks! :) no problem! > Ingo -- Evgeniy Polyakov - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the bo

Re: A quick fio test (was Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3)

2007-02-27 Thread Evgeniy Polyakov
On Tue, Feb 27, 2007 at 12:29:08PM +0100, Jens Axboe ([EMAIL PROTECTED]) wrote: > On Tue, Feb 27 2007, Evgeniy Polyakov wrote: > > My two coins: > > # cat job > > [global] > > bs=8k > > size=1g > > direct=0 > > ioengine=sync > > iodepth=32 >

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
On Tue, Feb 27, 2007 at 06:52:22AM -0500, Theodore Tso ([EMAIL PROTECTED]) wrote: > On Tue, Feb 27, 2007 at 01:28:32PM +0300, Evgeniy Polyakov wrote: > > Obviously there are bugs, it is simply how things work. > > And debugging state machine code has exactly the same complexity a

Re: A quick fio test (was Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3)

2007-02-27 Thread Evgeniy Polyakov
wrong permissions, it can not be opened. -- Evgeniy Polyakov - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://w

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
On Tue, Feb 27, 2007 at 07:24:19AM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: > > * Evgeniy Polyakov <[EMAIL PROTECTED]> wrote: > > > On Mon, Feb 26, 2007 at 01:51:23PM +0100, Ingo Molnar ([EMAIL PROTECTED]) > > wrote: > > > > > >

Re: threadlets as 'naive pool of threads', epoll, some measurements

2007-02-27 Thread Evgeniy Polyakov
On Tue, Feb 27, 2007 at 09:27:57AM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: > > * Evgeniy Polyakov <[EMAIL PROTECTED]> wrote: > > > > > Enough, you say micro-thread design is superior - ok, that is your > > > > point. > > > > > >

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
ure. No one will crate purely event based model for socket or VFS processing - event is completion of the request - data in the buffer, data was sent and so one - it is also possible to add events into middle of the processing especially if operation can be logically separated - like sendfile. &g

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 06:18:51PM -0800, Davide Libenzi (davidel@xmailserver.org) wrote: > On Mon, 26 Feb 2007, Evgeniy Polyakov wrote: > > > 2. its notifications do not go through the second loop, i.e. it is O(1), > > not O(ready_num), and notifications happens direc

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
anism, one of its usage models is AIO, another ones are signals, file events, timers, whatever... You drawn a line - kevent is not needed - that is your point. I wanted to hear definitive wordsa half a year ago, but community kept silence. Eventually things are done. Thanks. > Ingo --

Re: threadlets as 'naive pool of threads', epoll, some measurements

2007-02-27 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 09:23:38PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: > > * Evgeniy Polyakov <[EMAIL PROTECTED]> wrote: > > > > no. Please read the evserver_threadlet.c code. There's no kevent in > > > there. There's no epoll

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 12:04:51PM -0800, Linus Torvalds ([EMAIL PROTECTED]) wrote: > > > On Mon, 26 Feb 2007, Evgeniy Polyakov wrote: > > > > Will you argue that people do things like > > num = epoll_wait() > > for (i=0; i > process(event[i])? >

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 12:04:51PM -0800, Linus Torvalds ([EMAIL PROTECTED]) wrote: On Mon, 26 Feb 2007, Evgeniy Polyakov wrote: Will you argue that people do things like num = epoll_wait() for (i=0; inum; ++i) { process(event[i])? } I have several times told you that I

Re: threadlets as 'naive pool of threads', epoll, some measurements

2007-02-27 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 09:23:38PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: no. Please read the evserver_threadlet.c code. There's no kevent in there. There's no epoll() in there. All that you can see there is the natural behavior

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
. Ingo -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 06:18:51PM -0800, Davide Libenzi (davidel@xmailserver.org) wrote: On Mon, 26 Feb 2007, Evgeniy Polyakov wrote: 2. its notifications do not go through the second loop, i.e. it is O(1), not O(ready_num), and notifications happens directly from internals

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
can be logically separated - like sendfile. Ingo -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http

Re: threadlets as 'naive pool of threads', epoll, some measurements

2007-02-27 Thread Evgeniy Polyakov
On Tue, Feb 27, 2007 at 09:27:57AM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: Enough, you say micro-thread design is superior - ok, that is your point. note that threadlets are not 'micro-threads'. A threadlet is more

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
On Tue, Feb 27, 2007 at 07:24:19AM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: On Mon, Feb 26, 2007 at 01:51:23PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: Even having main

Re: A quick fio test (was Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3)

2007-02-27 Thread Evgeniy Polyakov
wrong permissions, it can not be opened. -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
On Tue, Feb 27, 2007 at 06:52:22AM -0500, Theodore Tso ([EMAIL PROTECTED]) wrote: On Tue, Feb 27, 2007 at 01:28:32PM +0300, Evgeniy Polyakov wrote: Obviously there are bugs, it is simply how things work. And debugging state machine code has exactly the same complexity as debugging multi

Re: A quick fio test (was Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3)

2007-02-27 Thread Evgeniy Polyakov
On Tue, Feb 27, 2007 at 12:29:08PM +0100, Jens Axboe ([EMAIL PROTECTED]) wrote: On Tue, Feb 27 2007, Evgeniy Polyakov wrote: My two coins: # cat job [global] bs=8k size=1g direct=0 ioengine=sync iodepth=32 rw=read [file] filename=/home/user/test sync: READ: io

Re: threadlets as 'naive pool of threads', epoll, some measurements

2007-02-27 Thread Evgeniy Polyakov
On Tue, Feb 27, 2007 at 01:15:42PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: So, ok, no micro-thread name. thanks! :) no problem! Ingo -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
On Tue, Feb 27, 2007 at 01:13:28PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: [...] But it is true that for most kernel programmers, threaded programming is much easier to understand, and we need to engineer the kernel for what

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
requests, if request happens to block (which should be avaided as much as possible), then it continues on behalf of sleeping thread. Ingo -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
() there are two queues. - Davide -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-27 Thread Evgeniy Polyakov
storage - both were created with the smallest possible overhead in mind. -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read

Re: A quick fio test (was Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3)

2007-02-27 Thread Evgeniy Polyakov
libaio decreases from 38 down to 36 mb/sec. iodepth_low=1 helps syslets to have 37mb/sec with iodepth=32, with 3200 and 10k it does not play any role. -- Jens Axboe -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
m = epoll_wait() for (i=0; i Linus -- Evgeniy Polyakov - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 12:56:33PM -0600, Chris Friesen ([EMAIL PROTECTED]) wrote: > Evgeniy Polyakov wrote: > > >I never ever tried to say _everything_ must be driven by events. > >IO must be driven, it is a must IMO. > > Do you disagree with Linus' post about th

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 10:19:03AM -0800, Arjan van de Ven ([EMAIL PROTECTED]) wrote: > On Mon, 2007-02-26 at 20:37 +0300, Evgeniy Polyakov wrote: > > > I tend to agree. > > Yes, some loads require event driven model, other can be done using > > threads. > > event

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
ting on futexes), then other events (probably). Eventually it will be the same from different point of view :) Anyway, I _do_ hope we understood each other that both events and threads can co-exist, although board was not drawn. My point is that many things can be done using event just bec

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
t was optimized to have event register structure less than a cache line. What I can not agree with, is that IO is a thread based stuff. > one can always find the point and workload where say 40,000 threads > start trashing the L2 cache, but where 40,000 queued special requests > are still

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
On Sun, Feb 25, 2007 at 02:44:11PM -0800, Linus Torvalds ([EMAIL PROTECTED]) wrote: > > > On Thu, 22 Feb 2007, Evgeniy Polyakov wrote: > > > > My tests show that with 4k connections per second (8k concurrency) more > > than 20k connections of 80k total block in

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
nding which is required to be pollable). 2. its notifications do not go through the second loop, i.e. it is O(1), not O(ready_num), and notifications happens directly from internals of the appropriate subsystem, which does not require special wakeup (although it can be done too). >

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 01:51:23PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: > > * Evgeniy Polyakov <[EMAIL PROTECTED]> wrote: > > > Even having main dispatcher as epoll/kevent loop, the _whole_ > > threadlet model is absolutely micro-thread in nature and n

Re: threadlets as 'naive pool of threads', epoll, some measurements

2007-02-26 Thread Evgeniy Polyakov
if you would test it in your environment after all that empty kevent releases. Enough, you say micro-thread design is superior - ok, that is your point. > Ingo -- Evgeniy Polyakov - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body o

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 01:39:23PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: > > * Evgeniy Polyakov <[EMAIL PROTECTED]> wrote: > > > > > Kevent is a _very_ small entity and there is _no_ cost of > > > > requeueing (well, there is list_add guard

Re: threadlets as 'naive pool of threads', epoll, some measurements

2007-02-26 Thread Evgeniy Polyakov
and admins at paid work setup my internet connection down to miserable bytes per second (who said that hacked/social engineered 1mb/sec can live forever?), so expect it tomorrow), via epia one is under stress testing right now. > Ingo -- Evgeniy Polyakov - To unsubscribe from thi

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 11:35:17AM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: > > * Evgeniy Polyakov <[EMAIL PROTECTED]> wrote: > > > Btw, 'evserver' in the name means 'event server', so you might think > > about changing the name :) > > why should i change

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
e set-nonblocking calls because they are not > needed under threadlets. > > [ to build this code, copy it into the async-test/ directory and build > it there - or copy the *.h files from async-test/ directory into your > build directory. ] Ok, right now I'm compiling kevent/t

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
blem. If I will complete setup today before I go climbing (I need to do some paid job too), I will post results here and in my blog (without political correctness). Btw, 'evserver' in the name means 'event server', so you might think about changing the name :) Stay tuned. > Ingo --

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
from the disk, eventually they wake up, thing which wakes them up _is_ an event. > Ingo -- Evgeniy Polyakov - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
will postpone scholastic masturbation about event vs process context in IO. One sentence only - page fault and filename lookup both wait - they wait for new page is ready or inode is read from the disk, eventually they wake up, thing which wakes them up _is_ an event. Ingo -- Evgeniy

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
climbing (I need to do some paid job too), I will post results here and in my blog (without political correctness). Btw, 'evserver' in the name means 'event server', so you might think about changing the name :) Stay tuned. Ingo -- Evgeniy Polyakov - To unsubscribe from this list

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
. [ to build this code, copy it into the async-test/ directory and build it there - or copy the *.h files from async-test/ directory into your build directory. ] Ok, right now I'm compiling kevent/threadlet tree on my test machines. Ingo -- Evgeniy Polyakov - To unsubscribe

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 11:35:17AM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: Btw, 'evserver' in the name means 'event server', so you might think about changing the name :) why should i change the name? The 'outer' loop, which feeds

Re: threadlets as 'naive pool of threads', epoll, some measurements

2007-02-26 Thread Evgeniy Polyakov
second (who said that hacked/social engineered 1mb/sec can live forever?), so expect it tomorrow), via epia one is under stress testing right now. Ingo -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 01:39:23PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: Kevent is a _very_ small entity and there is _no_ cost of requeueing (well, there is list_add guarded by lock) - after it is done, process can start real

Re: threadlets as 'naive pool of threads', epoll, some measurements

2007-02-26 Thread Evgeniy Polyakov
. Ingo -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 01:51:23PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: Even having main dispatcher as epoll/kevent loop, the _whole_ threadlet model is absolutely micro-thread in nature and not state machine/event. Evgeniy, i'm

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
subsystem, which does not require special wakeup (although it can be done too). Ingo -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
On Sun, Feb 25, 2007 at 02:44:11PM -0800, Linus Torvalds ([EMAIL PROTECTED]) wrote: On Thu, 22 Feb 2007, Evgeniy Polyakov wrote: My tests show that with 4k connections per second (8k concurrency) more than 20k connections of 80k total block in tcp_sendmsg() over gigabit lan

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
in cache, and produce spectacular numbers. Ingo -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
it is unbeatable. Threading in turn can be done a higher-layer abstraction model - thread can wrap around the whole transaction with all related data flows, but not thread per IO. Linus -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 10:19:03AM -0800, Arjan van de Ven ([EMAIL PROTECTED]) wrote: On Mon, 2007-02-26 at 20:37 +0300, Evgeniy Polyakov wrote: I tend to agree. Yes, some loads require event driven model, other can be done using threads. event driven model is really complex though

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
On Mon, Feb 26, 2007 at 12:56:33PM -0600, Chris Friesen ([EMAIL PROTECTED]) wrote: Evgeniy Polyakov wrote: I never ever tried to say _everything_ must be driven by events. IO must be driven, it is a must IMO. Do you disagree with Linus' post about the difficulty of treating open

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-26 Thread Evgeniy Polyakov
, dispatching events from ring buffer or queue from each cpu is the smallest one, but not spawning a thread per read. Linus -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-25 Thread Evgeniy Polyakov
On Sun, Feb 25, 2007 at 08:04:15PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: > > * Evgeniy Polyakov <[EMAIL PROTECTED]> wrote: > > > Kevent is a _very_ small entity and there is _no_ cost of requeueing > > (well, there is list_add guarded by lock) - after it is d

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-25 Thread Evgeniy Polyakov
used ab -c8000 -n8 $url for via epia likely two/three times less. > Ingo -- Evgeniy Polyakov - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-25 Thread Evgeniy Polyakov
On Sun, Feb 25, 2007 at 09:21:35PM +0300, Evgeniy Polyakov ([EMAIL PROTECTED]) wrote: > > Do you have any link where i could check the type of HTTP parsing and > > send transport you are (or will be) using? What type of http client are > > you using to measure, with prec

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-25 Thread Evgeniy Polyakov
On Sun, Feb 25, 2007 at 06:54:37PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: > > * Evgeniy Polyakov <[EMAIL PROTECTED]> wrote: > > > > hm, what tree are you using as a base? The syslet patches are > > > against v2.6.20 at the moment. (the x86 PDA chang

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-25 Thread Evgeniy Polyakov
On Sun, Feb 25, 2007 at 06:45:05PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: > > * Evgeniy Polyakov <[EMAIL PROTECTED]> wrote: > > > My main concern was only about the situation, when we ends up with > > truly bloking context (like network), and this resul

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-25 Thread Evgeniy Polyakov
On Sun, Feb 25, 2007 at 06:23:38PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: > > * Evgeniy Polyakov <[EMAIL PROTECTED]> wrote: > > > On Wed, Feb 21, 2007 at 10:13:55PM +0100, Ingo Molnar ([EMAIL PROTECTED]) > > wrote: > > > this is the v3 relea

Re: all syscalls initially taking 4usec on a P4? Re: nonblocking UDPv4 recvfrom() taking 4usec @ 3GHz?

2007-02-25 Thread Evgeniy Polyakov
l overhead itself is very small no matter which type of the CPU is used - athlon is about 300 nsec, via epia about 1.4 usec), but the whole function can take quite a lot of time. > Pavel > > -- > (english) http://www.l

Threadlet/syslet v4 bug report.

2007-02-25 Thread Evgeniy Polyakov
f8 ff [ 894.598875] EIP: [] cachemiss_thread+0xa/0xc6 SS:ESP 0068:ca6aff94 -- Evgeniy Polyakov - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.

Re: [patch 00/13] Syslets, "Threadlets", generic AIO support, v3

2007-02-25 Thread Evgeniy Polyakov
KERNEL_CS | get_kernel_rpl(); -- Evgeniy Polyakov - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/

Re: Threadlet/syslet v4 bug report.

2007-02-25 Thread Evgeniy Polyakov
On Sun, Feb 25, 2007 at 05:33:10PM +0300, Evgeniy Polyakov ([EMAIL PROTECTED]) wrote: > Hi Ingo. > > I tried to create web server application for threadlets to show (will > not write what I wanted to show, but you might guess :) > > I started threadlet-test from async-test-v4

Re: Threadlet/syslet v4 bug report.

2007-02-25 Thread Evgeniy Polyakov
On Sun, Feb 25, 2007 at 05:33:10PM +0300, Evgeniy Polyakov ([EMAIL PROTECTED]) wrote: Hi Ingo. I tried to create web server application for threadlets to show (will not write what I wanted to show, but you might guess :) I started threadlet-test from async-test-v4 and got following bug

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-25 Thread Evgeniy Polyakov
| get_kernel_rpl(); -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/

Threadlet/syslet v4 bug report.

2007-02-25 Thread Evgeniy Polyakov
8d be c4 02 00 00 89 f0 89 fa e8 ab f8 ff [ 894.598875] EIP: [c012ab99] cachemiss_thread+0xa/0xc6 SS:ESP 0068:ca6aff94 -- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-25 Thread Evgeniy Polyakov
On Sun, Feb 25, 2007 at 06:23:38PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: On Wed, Feb 21, 2007 at 10:13:55PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: this is the v3 release of the syslet/threadlet subsystem: http

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-25 Thread Evgeniy Polyakov
On Sun, Feb 25, 2007 at 06:45:05PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: My main concern was only about the situation, when we ends up with truly bloking context (like network), and this results in having thousands of threads doing

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-25 Thread Evgeniy Polyakov
On Sun, Feb 25, 2007 at 06:54:37PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: hm, what tree are you using as a base? The syslet patches are against v2.6.20 at the moment. (the x86 PDA changes will probably interfere with it on v2.6.21

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-25 Thread Evgeniy Polyakov
On Sun, Feb 25, 2007 at 09:21:35PM +0300, Evgeniy Polyakov ([EMAIL PROTECTED]) wrote: Do you have any link where i could check the type of HTTP parsing and send transport you are (or will be) using? What type of http client are you using to measure, with precisely what options

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-25 Thread Evgeniy Polyakov
-- Evgeniy Polyakov - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/

Re: [patch 00/13] Syslets, Threadlets, generic AIO support, v3

2007-02-25 Thread Evgeniy Polyakov
On Sun, Feb 25, 2007 at 08:04:15PM +0100, Ingo Molnar ([EMAIL PROTECTED]) wrote: * Evgeniy Polyakov [EMAIL PROTECTED] wrote: Kevent is a _very_ small entity and there is _no_ cost of requeueing (well, there is list_add guarded by lock) - after it is done, process can start real work

Re: all syscalls initially taking 4usec on a P4? Re: nonblocking UDPv4 recvfrom() taking 4usec @ 3GHz?

2007-02-25 Thread Evgeniy Polyakov
of time. Pavel -- (english) http://www.livejournal.com/~pavelmachek (cesky, pictures) http://atrey.karlin.mff.cuni.cz/~pavel/picture/horses/blog.html -- Evgeniy Polyakov - To unsubscribe from this list: send

<    3   4   5   6   7   8   9   10   11   12   >