On Fri, Jun 15, 2012 at 9:26 AM, Philip Bennefall <phi...@blastbay.com>wrote:
> I understand that, but let's say that I already have a virtual fts table > created that I set to use the Porter tokenizer, how then would I go about > rebuilding and retokenizing this table with the simple tokenizer at a later > time? Would I need to create an entirely new table? What I'm wondering is > basically how I might take an existing fts virtual table, change its > tokenizer and then rebuild the index? > Yes. You'll need to DROP or RENAME the original table, then CREATE the new one. > > Kind regards, > > Philip Bennefall > ----- Original Message ----- > From: Richard Hipp > To: phi...@blastbay.com ; General Discussion of SQLite Database > Sent: Friday, June 15, 2012 3:14 PM > Subject: Re: [sqlite] Porter Stemmer > > > > > > On Fri, Jun 15, 2012 at 9:00 AM, Philip Bennefall <phi...@blastbay.com> > wrote: > > I had another quick question. If I have built an fts table using the > stemmer tokenizer, and then I later decide that I want to change to the > simple one, is there an easy way to do this? I see the "rebuild" command, > can I somehow tell that to change the tokenizer as well? I see the > reference to custom ones, but what about the internal implementations? > > > If you change your tokenizer, you need to retokenize all of the source > text. > > > > Kind regards, > > Philip Bennefall > ----- Original Message ----- > From: Richard Hipp > To: phi...@blastbay.com ; General Discussion of SQLite Database > Sent: Friday, June 15, 2012 1:03 PM > Subject: Re: [sqlite] Porter Stemmer > > > > > > > On Fri, Jun 15, 2012 at 5:51 AM, Philip Bennefall <phi...@blastbay.com> > wrote: > > Hi all, > > Is the algorithm used in the stemming tokenizer in SqLite's fts > extension equivalent to the C implementation found at > http://tartarus.org/~martin/PorterStemmer/ > > > The built-in Porter stemmer is a copy/paste from the above link. > > > > ? > > I am asking this because some sources say that there are improved > versions of this algorithm released much later than 2000/2001. Does > SqLite's implementation differ in any significant ways from the C > implementation found at the above URL? > > Kind regards, > > Philip Bennefall > _______________________________________________ > sqlite-users mailing list > sqlite-users@sqlite.org > http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users > > > > > -- > D. Richard Hipp > d...@sqlite.org > _______________________________________________ > sqlite-users mailing list > sqlite-users@sqlite.org > http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users > > > > > -- > D. Richard Hipp > d...@sqlite.org > _______________________________________________ > sqlite-users mailing list > sqlite-users@sqlite.org > http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users > -- D. Richard Hipp d...@sqlite.org _______________________________________________ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
