Hi Jerome, > Yes, the fetcher can't rely on the document mime-type. > The only thing we can use for filtering is the document's URL. > So, another alternative, could be to exclude only files extensions that > are > registered in the mime-type repository > (some well known file extensions) but for which no parser is activated. > And > accepting all other ones. > So that the .foo files will be fetched...
Yup, the key phrase is "well known". It would sort of be an optimization, or heuristic, to save some work on the regex... Cheers, Chris > > Jérôme ------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://ads.osdn.com/?ad_idv37&alloc_id865&op=click _______________________________________________ Nutch-developers mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-developers
