Could someone define "sigram" for me? It is used as a type of token in StandardTokenizer. I know it relates to the CJK stuff, but I'm curious about the term "sigram" and what it means, specifically in the context of the StandardTokenizer.

Thanks, 
        Erik


--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]



Reply via email to