...
> > svn st | grep ? | awk '{print "svn add "$2}' | sh
>
> I'm not sure I buy the unix/pipe analogy -- Where is the pipeline in
> droids?
For a crawler:
queue -> protocol -> parse -> handler
The different stages have filter or processing changes of the stream
which determines how (much) tasks make it finally to the handlers.
>
> To me the core concept of Droids is a Queue<Task> and the plumbing to
> keep a bunch of Workers running the Tasks. In addition, Droids
> delivers a bunch of utilities to help many standard use cases (some
> include text processing pipeline).
yes, the core is invoking and logging like you said.
>
> Maybe the 'lego' analogy is more fitting? (if an analogy is necessary)
jeje, it fits both (like said cocoon for robot development). ;)
>
> >
> > There is as well another typical use case for droids. I will call them
> > "racer" (anagram of crawler). Racer are not trying to extract new
> > tasks
> > they start with a limited number of task that are defined in the
> > initQueue method.
> >
>
> Perhaps "walker" is a better term? Racer sounds faster, but walking
> is on par with crawling :)
Actually no, a racer is normally much faster then a crawler. A crawler
does:
queue -> protocol -> parse -> link extraction/task injection -> handler
A racer can do
queue -> handler
which will be nearly always be faster.
> (btw, Claw Err is an anagram of crawler)
http://www.websters-online-dictionary.org/We/WebCrawler.html
for webcrawler: as well Brewer, Career, ...
>
>
>
> > I will try to add tonight an example of a file racer since I have a
> > nice
> > use case (I need to clean up the names of various files in a
> > directory -
> > removing special characters and bring them in a special form).
> >
>
> thanks! that would be great.
> If you do a directory based example, i'll extend it to IMAP...
Cwel.
I added the droid in 695705.
salu2
http://svn.apache.org/viewvc/labs/droids/trunk/src/examples/java/org/apache/droids/examples/?pathrev=695705
--
Thorsten Scherler thorsten.at.apache.org
Open Source Java consulting, training and solutions
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
