Do you have a need for tokens that contain spaces? Otherwise, space-separated tokens appear a pretty good approach.
-- Richard On 14.10.2013, at 21:59, Thomas Zastrow <[email protected]> wrote: > Hello, > > In any case, I think its a little bit oldschool to identify tokens and > additional annotations just with spaces between them ... what about a > nice XML format (no, not that ISO crap .. what about TCF [1])? Or maybe > NEGRA? > > Best, > > Tom > > [1] > http://weblicht.sfs.uni-tuebingen.de/weblichtwiki/index.php/The_TCF_Format
