Re: [sqlite] Seeking documentation on writing own Tokenizer

2008-10-15 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Jonathon wrote:
> I am interested in writing my own tokenizer for sqlite3.  I've gone through
> Google, as well as the sqlite documentation and unfortunately, I haven't
> found anything helpful. 

See the source directory
http://www.sqlite.org/cvstrac/dir?d=sqlite/ext/fts3 specifically the
README.tokenizers file.  You can use the builtin tokenizers as well as
the icu one as examples.

Roger
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (GNU/Linux)

iD8DBQFI9nx+mOOfHg372QQRAmH/AJ99iK5yV8R/clJmVoYTqrqdbY0PGQCbBjgC
jj9cElxK/hxNdnkWtaBMImU=
=NeQt
-END PGP SIGNATURE-
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users


[sqlite] Seeking documentation on writing own Tokenizer

2008-10-15 Thread Jonathon
Hello all,

I am interested in writing my own tokenizer for sqlite3.  I've gone through
Google, as well as the sqlite documentation and unfortunately, I haven't
found anything helpful.  I am interested in writing my own tokenizer so that
I could perform "partial string" matches in sqlite's full-text search
(FTS3).  For example, I would like to find the word 'some' in the string:
'/path/to/some/file'.

Can someone point me in the right direction on what I would need to do to
implement my own Tokenizer?

Thanks,
Jon
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users