Alright i think i have a clue know...
Anyway if you though decide to use nio i can just
advise to use mina.
I think its easy to use and a lot of people who have
experiance with nio said mina greatly simplify things.
And you should be able to easily use the
StreamIoHandler in the way you want so yo
Johannes Zillmann wrote:
please correct me if i'm wrong, but if i understood
all right there are 2 choices...
(1) message based communication
(2) stream based communication
In case of (2) you won't come along without one thread
per connection.
In general, you are correct. But Nutch's IPC is s
Well,
i understood that. But the thing is...
There is the "message" or better "event" based
communication paradigm and there is the "thread" based
communication paradigm.
Is there an alternative to that both possibility ?
I at least see no one in what doug described.
Either you have one thread pe
Hi Johannes,
right, but in case you have 200 boxes and each box need to open 4
different connections to the master.
Than the master has 200 * 4 connections = 800 threads = the limit of
the 2.4 kernel.
In case you open only one conenction per box you are also limited to
run 800 boxes per mast
Hello Doug,
--- Doug Cutting <[EMAIL PROTECTED]> schrieb:
> Mina's stream io
> handler requires a separate thread per connection:
please correct me if i'm wrong, but if i understood
all right there are 2 choices...
(1) message based communication
(2) stream based communication
In case of (2) y
Not sure if it will help, but I think memcached uses
epoll
http://www.xmailserver.org/linux-patches/epoll.txt
and handles potentially thousands of concurrent
connections.
Earl
--- Doug Cutting <[EMAIL PROTECTED]> wrote:
> Stefan Groschupf wrote:
> > do you know apache mina?
> > http://director
I've looked at it, but I don't think it solves the problem. We
need stream-based handling with thousands of connections. Mina's
stream io handler requires a separate thread per connection:
Hmm, to bad. :-/
I understand that IPC is one of the most critical components of nutch
and it would
Stefan Groschupf wrote:
do you know apache mina?
http://directory.apache.org/subprojects/network/
this is a nice introducing.
http://directory.apache.org/subprojects/network/mina.pdf
I've looked at it, but I don't think it solves the problem. We need
stream-based handling with thousands of co
Hi Doug,
do you know apache mina?
http://directory.apache.org/subprojects/network/
this is a nice introducing.
http://directory.apache.org/subprojects/network/mina.pdf
I know you are trying to stay as much as possible independent from
third party libraries, but may
but mina looks very interest
