Re: [sqlite] FTS4 + unicode61 tokenizer performance issue

2013-06-11 Thread Valentine Silvansky
Ok, I'm working on a simple project, which will reproduce a problem. Valentine. 11.06.2013, в 17:30, Dan Kennedy написал(а): > On 06/11/2013 08:20 PM, Valentine Silvansky wrote: >> Hi all! >> >> I have a custom-built sqlite with FTS4 and unicode61 tokenizer for it.

[sqlite] FTS4 + unicode61 tokenizer performance issue

2013-06-11 Thread Valentine Silvansky
Hi all! I have a custom-built sqlite with FTS4 and unicode61 tokenizer for it. I've got the only one table "messages": CREATE VIRTUAL TABLE messages USING FTS4(body TEXT, tokenize=unicode61); So, I populate this table with ~100k entries, each one is a sentence (or a short message) in english o