[
https://issues.apache.org/jira/browse/TIKA-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272754#comment-17272754
]
Nick Burch commented on TIKA-3282:
----------------------------------
Thanks for this patch and test file
If you have a copy of OneNote handy, and don't mind a quick bit of extra
work... It'd be great to try putting in a few other non-ASCII character types
(eg chinese and emoji) just to check if it's a simple fix to handle them (eg
stored as UTF-8 or similar), or if it's loads of work and we should just do
non-English european-ish characters for now with this patch!
> OneNote Parser breaks non-ASCII Characters
> ------------------------------------------
>
> Key: TIKA-3282
> URL: https://issues.apache.org/jira/browse/TIKA-3282
> Project: Tika
> Issue Type: Bug
> Components: parser
> Affects Versions: 1.24, 1.25, 1.24.1
> Reporter: Adrian Diemer
> Priority: Major
>
> The OneNote parser doesn't seem to handle non-ASCII characters correctly.
> The reason for that seems to be that the characterset US_ASCII is used
> instead of ISO_8859_1
> [here|https://github.com/apache/tika/blob/91ef4693363d31dba05de9eec1ab2d52a298c6b5/tika-parsers/tika-parsers-classic/tika-parsers-classic-modules/tika-parser-microsoft-module/src/main/java/org/apache/tika/parser/microsoft/onenote/OneNoteTreeWalker.java#L448].
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
