On 3/29/11 7:45 AM, Vuong Dao Nghe wrote:
Hi all,
Is there anyway that opennlp can recognize the word with some special characters
like: "!" "," ":" etc.
For example:
The normal sentence: "This is good"
But some time: "This is good!!!! "
And I see opennlp can not find the word "good" since it is attached to "!!!!"
(without any space).
Is there a way or option on command that help opennlp find these words stick
with other special characters?
The tokenizer should be able to do that. It should break
your sentence into:
This
is
good
!
!
!
Which result do you get from the tokenizer? good!!! ?
Jörn
