Re: [sqlite] Why sqlite fts5 Unicode61 Tokenizer does not support CJK(Chinese Japanese Krean)?

Hello, full text search index can be used to see how the text is tokenized for both FTS4 and FTS5. for FTS4, fts3tokenize can be used too. sqlite> CREATE VIRTUAL TABLE icu_zh_cn USING fts3tokenize(icu, zh_CN); sqlite> SELECT token, start, end, position FROM icu_zh_cn WHERE INPUT='为什么不支持中文 fts5

[sqlite] an error in FTS5 document

Hello, I found an error in a code example in the FTS5 document. https://sqlite.org/fts5.html#extending_fts5 sqlite3_bind_pointer(pStmt, (void*), "fts5_api_ptr"); sqlite3_bind_pointer needs a parameter index and a pointer to destructor too, so I think it should be