[jira] [Created] (NUTCH-2030) ParseZip plugin is not able to extract language from zip document,this could solve that problem.

Tue, 02 Jun 2015 06:20:01 -0700 

Eyeris Rodriguez Rueda created NUTCH-2030:
---------------------------------------------

             Summary: ParseZip plugin is not able to extract language from zip 
document,this could solve that problem.
                 Key: NUTCH-2030
                 URL: https://issues.apache.org/jira/browse/NUTCH-2030
             Project: Nutch
          Issue Type: Improvement
          Components: parser, plugin
         Environment: Linux Mint 17 qiana, 4 GB Ram,Core I3.
            Reporter: Eyeris Rodriguez Rueda
            Priority: Minor
             Fix For: 1.11, 2.3.1


Actually parse-zip plugin don´t extract language from zip document, therefore 
lang field is empty in solr or elastic. If the package(.zip) contains a list of 
documents so the lang field could be multivalued to support that list of 
languages. A simple change to parse-zip pluging could fix this problem. I will 
use Language Identifier class from tika and analyze each document inside.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to