Tim Allison created TIKA-5062:
---------------------------------
Summary: Improve text/binary classification
Key: TIKA-5062
URL: https://issues.apache.org/jira/browse/TIKA-5062
Project: Tika
Issue Type: Task
Reporter: Tim Allison
Since the beginning of time, Tika has used a heuristic fallback TextDetector if
MimeTypes couldn't find a match. The heuristics were based on ascii and utf-8,
not legacy encoded text.
We should experiment to see if we can get a small model to outperform the
current heuristic and be robust against legacy encoded text.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
