[
https://issues.apache.org/jira/browse/TIKA-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856135#comment-16856135
]
Tim Allison edited comment on TIKA-2790 at 6/4/19 9:38 PM:
-----------------------------------------------------------
[~kkrugler], I may be misunderstanding the code, but it looks like Yalder is
stopping after normalizing 85 characters and identifying 330 known ngrams. The
original string is 3390 characters long.
was (Author: [email protected]):
[~kkrugler], I may be misunderstanding the code, but it looks like Yalder is
stopping after normalizing 85 characters and identifying 330 known ngrams.
> Consider switching lang-detection in tika-eval to open-nlp
> ----------------------------------------------------------
>
> Key: TIKA-2790
> URL: https://issues.apache.org/jira/browse/TIKA-2790
> Project: Tika
> Issue Type: Improvement
> Reporter: Tim Allison
> Priority: Major
> Attachments: fra_mixed_100000_0.0_0.txt, hasEnough.png,
> langid_20190509.zip, langid_20190510.zip, langid_20190514.zip,
> langid_20190514_plus_minus_1.zip, timeVsLength.png
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
