On 2008-04-14 21:33, Nicolas BOUTHORS wrote:
> This is SQLite you are talking about !
> It's not like if it were a real SQL backend.
> 
> So yes, it's normal

94 minutes minus 17 mins user+real = 77 minutes... waiting.

I suspect the dspam SQLite code is not taking advantage of
SQLites transaction mode and being able to batch 1000's of
updates in one call. It should take about 10 minutes.

I need SQLite for PDAs and sub-notebooks where there isn't
enough spare ram to even think about using MySQL/Postgress.

--markc

> Mark Constable nous disait:
> > Is this normal.. an hour and a half to merge 3.8M tokens ?
> > 
> > dspam 3.8.0 on a AMD 6000+ w/ 2Gb ram.
> > 
> > SQLitePragma   "synchronous = OFF"
> > 
> >  # time dspam_merge ian markc nod32 -o newuser
> >  Destination user: newuser
> >  Merging user: ian
> >  processed 1041991 tokens
> >  Merging user: markc
> >  processed 1843771 tokens
> >  Merging user: nod32
> >  processed 1044561 tokens
> >  storing merged tokens...
> >  completed.
> > 
> >  real    94m46.316s
> >  user    7m20.648s
> >  sys     9m59.551s
> > 
> > --markc
> > 
> 
> 

Reply via email to