Hello, a few years ago, the HttpComponents team at Jakarta received a code donation of "Norbert, the (no)robots.txt parser". It came without a community, nobody asked for it since, so it resides mostly forgotten in our SVN repository at [1]. The Droids lab might find this code useful.
On a related matter... when we discussed the HttpComponents project scope in early 2005, http-spider was named as a potential component, see the respective section in [2]. There was always the disclaimer that a community would have to form to turn that idea into reality. We're currently more than busy with the Core and Client components, and we'll be pushing to become a TLP before the year is out. Maybe when Droids grows out of the lab, you'll consider us as a potential home? What you're doing seems to be exactly what Oleg suggested for http-spider. cheers, Roland [1] http://svn.apache.org/repos/asf/jakarta/httpcomponents/norobots-rfc/trunk/src/java/org/apache/http/norobots/ [2] http://mail-archives.apache.org/mod_mbox/jakarta-httpcomponents-dev/200501.mbox/[EMAIL PROTECTED] --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
