On 05/23/2011 01:53 PM, Eugen Paraschiv wrote:
Unfortunately there may be a significant issue with the functionality as well. I'm having some difficulty crawling a site based on depth (only crawling up to a certain depth). This is related to https://issues.apache.org/jira/browse/DROIDS-56 and the ongoing discussion there. The gist of it is that, if I'm not missing something, DROIDS-56 removed the existing validator functionality (although the validators themselves are still in the droids codebase), without replacing it with something else. A suggestion was made to use the filters to achieve the same functionality, but that is not possible without some work. This means that the only way to crawl a site now is to crawl all of it, with no regards to depth, which I see as a major problem. Any thoughts on this? If it's OK, I would start work on a temporary small temporary patch for this, and follow up with more work in 0.2, so that the timeline for the release is not affected to much. Thanks.
Do we want to hold off for a patch, or release knowing you have to search the whole path? I think I've got everything to where the release artifacts will be clean.
