subject:"\[sqlite\] FTS Tokenizer \(separator\)"

Re: [sqlite] FTS Tokenizer (separator)

2011-12-09 Thread Richard Hipp

On Fri, Dec 9, 2011 at 6:48 AM, Ephraim Stevens wrote: > Greetings All, > > From section seven of the FTS3/FTS4 documentation: > > A term is a contiguous sequence of eligible characters, where eligible > characters are all alphanumeric characters, the "_" character, and

[sqlite] FTS Tokenizer (separator)

2011-12-09 Thread Ephraim Stevens

Greetings All, >From section seven of the FTS3/FTS4 documentation: A term is a contiguous sequence of eligible characters, where eligible characters are all alphanumeric characters, the "_" character, and all characters with UTF codepoints greater than or equal to 128. All other characters are