subject:"\[sqlite\] FTS4 \+ unicode61 tokenizer performance issue"

Re: [sqlite] FTS4 + unicode61 tokenizer performance issue

2013-06-11 Thread Valentine Silvansky

Ok, I'm working on a simple project, which will reproduce a problem. Valentine. 11.06.2013, в 17:30, Dan Kennedy написал(а): > On 06/11/2013 08:20 PM, Valentine Silvansky wrote: >> Hi all! >> >> I have a custom-built sqlite with FTS4 and unicode61 tokenizer for it. I've

Re: [sqlite] FTS4 + unicode61 tokenizer performance issue

2013-06-11 Thread Dan Kennedy

On 06/11/2013 08:20 PM, Valentine Silvansky wrote: Hi all! I have a custom-built sqlite with FTS4 and unicode61 tokenizer for it. I've got the only one table "messages": CREATE VIRTUAL TABLE messages USING FTS4(body TEXT, tokenize=unicode61); So, I populate this table with ~100k entries,

[sqlite] FTS4 + unicode61 tokenizer performance issue

2013-06-11 Thread Valentine Silvansky

Hi all! I have a custom-built sqlite with FTS4 and unicode61 tokenizer for it. I've got the only one table "messages": CREATE VIRTUAL TABLE messages USING FTS4(body TEXT, tokenize=unicode61); So, I populate this table with ~100k entries, each one is a sentence (or a short message) in english