I don't really follow the idea of Droids as a task-oriented worker framework. You mention Quartz, which does include most of the functionality you talk about. Also, you can use it externally to trigger any Droid related process. My view is that even keeping Droids within the scope of web crawling, there is significant work to be done until it becomes flexible enough to address a variety of use cases out of the box. Trying to broaden the scope of the project is a tall order, but decoupling the crawling core functionality from the scheduling functionality makes perfect sense. Eugen.
On Tue, Feb 8, 2011 at 4:23 PM, Tony Dietrich <[email protected]> wrote: > +1 for more documentation and working examples. > > I've been monitoring this project for some time now, and tried several > projects to see if I could use it .. unfortunately, I always run into the > same dead end .. simply not knowing exactly what features are needed, what > features are available and what features can be used to my advantage. > > I also have frequently wondered why so much of this project is focussed on > web-crawling. Yes, I know this was the original inspiration for the project, > but tbh, a reusable task-oriented worker framework which can be used to > achieve any task for which a worker can be written is equally useful... > especially if it could have some sort of scheduling built-it. > IMO, it would pay to make droids-core totally independent of any > task-focussed implementation. At the moment, although its possible to write > such a droid, it isn't exactly clear how to do so from what little examples > there are around... the few examples concentrate solely on the integration > of a web-crawler and the other technologies such as indexing. > > One of my efforts was to see if I could somehow merge Quartz and Droids to > provide such a feature-set, with Quartz triggering a droid .. I got most of > the work done, then ran into the 'what bit of Droids does this?' problem. > > So ... documentation and examples from someone who knows the droids > framework a lot better than me, please .. pretty please? > > Tony > > -----Original Message----- > From: Chapuis Bertil [mailto:[email protected]] > Sent: 08 February 2011 12:11 > To: [email protected] > Subject: Re: Semantic of droids > > Agree. However I think before discussing the semantic we should clarify the > current concepts and provide a more accurate documentation with working > examples. > > > On 8 February 2011 12:58, Vik Tara <[email protected]> wrote: > > > > > > > Maybe that the use of a good metaphor will help anybody to understand > > > the droids way of work. > > > > > I have not started to use droids yet - but have been watching it. > > > > Anything that makes it easier to understand would certainly help me :) > > > > > > > -- > Bertil Chapuis > Agimem Sàrl > http://www.agimem.com > >
