On 03/14/2013 02:06 PM, Andreas Niekler wrote:
i'll create a jira issue and implement a flag wether to set <SPLIT> or just delete the whitespace. I hope this will do it then.
Thanks, it will be helpful, and if you want also create a jira to add a German detokenizer
dictionary. Jörn
