[ https://issues.apache.org/jira/browse/TIKA-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael McCandless updated TIKA-720: ------------------------------------ Attachment: English_EBCDIC.txt > EBCDIC encoding not detected > ---------------------------- > > Key: TIKA-720 > URL: https://issues.apache.org/jira/browse/TIKA-720 > Project: Tika > Issue Type: Bug > Components: parser > Reporter: Michael McCandless > Priority: Minor > Attachments: English_EBCDIC.txt > > > I have a test file encoded in EBCDIC, but Tika fails to detect it. > Not sure we can realistically fix this; I have no idea how (and, > realistically, one really ought to convert out of EBCDIC on export > from a mainframe...). > Here's what Tika detects: > {noformat} > Shift_JIS: confidence=51 > Big5: confidence=40 > GB18030: confidence=10 > KOI8-R: confidence=5 > windows-1252: confidence=5 > windows-1253: confidence=2 > IBM866: confidence=1 > windows-1251: confidence=1 > windows-1250: confidence=1 > {noformat} > The test file decodes fine as cp500; eg in Python just run this: > {noformat} > import codecs > codecs.getdecoder('cp500')(open('English_EBCDIC.txt').read()) > {noformat} -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira