Sean Finan created CTAKES-372:
---------------------------------
Summary: Penn TreeBank Tokenizer could use some attention
Key: CTAKES-372
URL: https://issues.apache.org/jira/browse/CTAKES-372
Project: cTAKES
Issue Type: Improvement
Components: ctakes-core
Affects Versions: future enhancement
Reporter: Sean Finan
Priority: Minor
The ptb tokenizer currently in use by ctakes has some inconsistencies. See
https://issues.apache.org/jira/browse/CTAKES-371 It also does not seem to
incorporate some of the clinical rules set out in
http://clear.colorado.edu/compsem/documents/treebank_guidelines.pdf
Some major refactoring is also in order ... as are numerous test cases.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
