[ 
https://issues.apache.org/jira/browse/CONNECTORS-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14043141#comment-14043141
 ] 

Karl Wright commented on CONNECTORS-984:
----------------------------------------

bq. Plus 'stream_name' as possible - for backwards compatibility

Anything that makes the Tika extractor behave more like Solr Cloud, the better.

bq. one idea: copy(or move?) mimetype mapping from core to Tika connector's 
tab: info--> CONNECTORS-654

Well, you can't move it in 1.7 because of backwards compatibility.  It could be 
added to the Tika Extractor as a separate feature, but I think it would be best 
to create a new, separate extension->mime type transformation connector.  Then 
it could be used even without TIka, and removed everywhere else in 2.0.  I 
think you would want a separate ticket for that work though.


> Give Tika's metadata some hints
> -------------------------------
>
>                 Key: CONNECTORS-984
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-984
>             Project: ManifoldCF
>          Issue Type: Improvement
>          Components: Amazon CloudSearch output connector
>    Affects Versions: ManifoldCF 1.7
>            Reporter: Shinichiro Abe
>             Fix For: ManifoldCF 1.7
>
>
> Component: Tika connector
> Currently in trunk code, we don't set data in Tika's metadata object.
> We likely have to give metadata some hints to detect and extract from 
> document.
> * resourceName
> * ContentType
> * stream size
> * charset(new feature)
> * Password handling(new feature)
> Also, when TikaException(e.g. parsing error at PDFBox/POI) is thrown, we need 
> to decide to ignore or not about the parsing document. Solr Cell has 
> 'ignoreTikaException' param. When TikaException is thrown, if true, metadata 
> only is indexed, if false, Solr responds server error and the document is not 
> indexed.
> Reference-->Solr Cell:
> http://svn.apache.org/viewvc/lucene/dev/trunk/solr/contrib/extraction/src/java/org/apache/solr/handler/extraction/ExtractingDocumentLoader.java?view=markup#l142



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to