[
https://issues.apache.org/jira/browse/TIKA-5062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18143966#comment-18143966
]
ASF GitHub Bot commented on TIKA-5062:
--------------------------------------
tballison merged PR #3598:
URL: https://github.com/apache/tika/pull/3598
> Improve text/binary classification
> ----------------------------------
>
> Key: TIKA-5062
> URL: https://issues.apache.org/jira/browse/TIKA-5062
> Project: Tika
> Issue Type: Task
> Reporter: Tim Allison
> Priority: Minor
>
> Since the beginning of time, Tika has used a heuristic fallback TextDetector
> if MimeTypes couldn't find a match. The heuristics were based on ascii and
> utf-8, not legacy encoded text.
> We should experiment to see if we can get a small model to outperform the
> current heuristic and be robust against legacy encoded text.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
