[ https://issues.apache.org/jira/browse/TIKA-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856039#comment-16856039 ]
Tim Allison commented on TIKA-2790: ----------------------------------- I was able to get 4x improvement in speed, which is still slower than Optimaize and, far, far slower than Yalder. IIUC, both Optimaize and Yalder do not process the full string. Rather, they sample or have some kind of stopping criterion. I think we can work towards that in our own wrapper of OpenNLP, and, hopefully, we can push that upstream back into OpenNLP. > Consider switching lang-detection in tika-eval to open-nlp > ---------------------------------------------------------- > > Key: TIKA-2790 > URL: https://issues.apache.org/jira/browse/TIKA-2790 > Project: Tika > Issue Type: Improvement > Reporter: Tim Allison > Priority: Major > Attachments: fra_mixed_100000_0.0_0.txt, langid_20190509.zip, > langid_20190510.zip, langid_20190514.zip, langid_20190514_plus_minus_1.zip > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)