Hello,
Examples of characters that cause tokenization: space . ! " { } [ /
Examples of characters that do not cause tokenization: # $ % ^ _ + = * @ ~
I looked on languagetool.wikidot.com and on http://www.languagetool.org/, but I
did not find a list of the characters that cause tokenization. What characters
cause tokenization?
Regards,
Mike Unwalla
Contact: www.techscribe.co.uk/techw/contact.htm
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Languagetool-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/languagetool-devel
