[sqlite] ICU and FTS5

2016-03-10 Thread Dan Kennedy
On 03/10/2016 02:56 AM, Tim Uy wrote: > Will the ICU tokenizer work with FTS5, or does some work need to be done to > port it over (slight pun intended). It doesn't work with FTS5. Both FTS3/4 and FTS5 allow for user-defined tokenizers, but the interface is not the same. So the ICU tokenizer wou

[sqlite] ICU and FTS5

2016-03-09 Thread Tim Uy
Will the ICU tokenizer work with FTS5, or does some work need to be done to port it over (slight pun intended).