better url-normalizer basic
---------------------------

                 Key: NUTCH-1098
                 URL: https://issues.apache.org/jira/browse/NUTCH-1098
             Project: Nutch
          Issue Type: Improvement
          Components: fetcher
    Affects Versions: 1.3
         Environment: Any
            Reporter: Radim Kolar
             Fix For: 1.4
         Attachments: urlnormalizer.patch

Basic URL normalizer lacks 2 important features

Encode space in URL into %20 to unbreak httpclient and possibly others who do 
not expect space inside URL

Ability to decode %33 encoding in URL. This is important for avoiding duplicates

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to