[ https://issues.apache.org/jira/browse/TIKA-1599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Markus Jelsma updated TIKA-1599: -------------------------------- Attachment: TIKA-1599-crazy-files.tar.gz Here are some crazy files from our tests : * maszol - no title reported in characters() method * newyorker - incorrectly closes a DIV tag and therefore misses the closing NAV tag. See line ~249 * rtlnieuws-emptystackexception - our content handler trips over something, causing ESE in endElement() * techhive - some date block is not reported in SAX events * aljazeera2 - there is no title because the div in the head * assemblydems - moved the title tag from the head section to the bottom of the page * events - title text not reported in the content handler's characters() method * greenenergy4us - page actually manages to have two bodies AND and DOCTYPE on top of every article > Switch from TagSoup to JSoup > ---------------------------- > > Key: TIKA-1599 > URL: https://issues.apache.org/jira/browse/TIKA-1599 > Project: Tika > Issue Type: Improvement > Components: parser > Affects Versions: 1.7, 1.8 > Reporter: Ken Krugler > Assignee: Ken Krugler > Priority: Minor > Attachments: TIKA-1599-crazy-files.tar.gz, > tagsoup_vs_jsoup_reports.zip > > > There are several Tika issues related to how TagSoup cleans up HTML > ([TIKA-381], [TIKA-985], maybe [TIKA-715]), but TagSoup doesn't seem to be > under active development. > On the other hand I know of several projects that are now using > [JSoup|https://github.com/jhy/jsoup], which is an active project (albeit only > one main contributor) under the MIT license. > I haven't looked into how hard it would be to switch this dependency. -- This message was sent by Atlassian JIRA (v6.3.4#6332)