Peter Salisbury writes:
> 2008/9/30 Jean-Francois Dockes <[EMAIL PROTECTED]>:
> > If Peter can spare some time to do more testing, I'd be quite
> > interested by the output of the following sequence:
> > - Add "loglevel = 4" to ~/.recoll/recoll.conf
> > - Uninstall the 3 helper packages, then:
> > time recollindex -z 2> /tmp/rcllog-znopack.txt
> > time recollindex 2> /tmo/rcllog-nopack.txt
> > - Reinstall the 3 packages then:
> > time recollindex -z 2> /tmp/rcllog-zpack.txt
> > time recollindex 2> /tmo/rcllog-pack.txt
> >
>
> Sorry it's taken a while, but here is the output you requested:
> [skipped test results]
Thanks a lot for running these tests and sending the results.
It's quite reassuring that initial indexing works as expected.
About later indexing passes, I had another look at how Recoll *really*
works (as opposed to how I thought it worked :) ) and in fact, for file
types with missing helper applications, indexing is always retried (so that
it succeeds as soon as the helper is installed). Trying to execute the
filters wastes quite a lot of time.
This explains why the times go down after the helper is installed: the
files get indexed the first time, then nothing further happens if they stay
unchanged.
Recoll 1.11 has been modified to work slightly differently: executing a
missing filter is only tried once per indexing pass. The program then
remembers the failure and doesn't retry.
The files still get indexed at the first indexing pass following helper
installation, and there is almost no performance penalty for missing
helpers, best of both worlds (hopefully).
Thanks again for prompting me to implement this well-needed change.
Regards,
J.F. Dockes
> $ time recollindex -z 2>rcllog-znopack.txt
>
> real 8m48.449s
> user 3m49.958s
> sys 2m57.675s
>
> $ time recollindex 2>rcollog-nopack.txt
>
> real 0m45.619s
> user 0m23.909s
> sys 0m13.069s
>
> re-install:
> zlib1g-dev (1:1.2.3.3.dfsg-12)
> libid3-3.8.3-dev (3.8.3-7.2)
> libimage-exiftool-perl (7.30-1)
> pstotext (1.9-4)
>
> $ time recollindex -z 2>rcllog-zpack.txt
>
> real 16m23.720s
> user 9m59.989s
> sys 3m45.342s
>
> $ time recollindex 2>rcllog-pack.txt
>
> real 0m28.198s
> user 0m16.405s
> sys 0m4.676s
>
> The initial indexing is quicker without the helpers as you'd expect,
> but the re-indexing is slower.
>
> I can't send you the logs I'm afraid as they would be around 100MB but
> I had a look in the re-indexing log when the helpers were absent and
> there are lots of lines like this:
>
> :4:../internfile/internfile.cpp:357:FileInterner::internfile. ipath []
> :4:../utils/execmd.cpp:163:ExecCmd::doexec: ((nil)|0x9828eac)
> /usr/share/recoll/filters/rclimg
> {/home/peter/.gkrellm2-0/themes/minegue-beta/timer/bg_timer.png}
> Can't locate Image/ExifTool.pm in @INC (@INC contains: /etc/perl
> /usr/local/lib/perl/5.10.0 /usr/local/share/perl/5.10.0 /usr/lib/perl5
> /usr/share/perl5 /usr/lib/perl/5.10 /usr/share/perl/5.10
> /usr/local/lib/site_perl .) at /usr/share/recoll/filters/rclimg line
> 61.
> BEGIN failed--compilation aborted at /usr/share/recoll/filters/rclimg line
> 61.
> :2:../internfile/mh_exec.cpp:71:MimeHandlerExec: command status 0x200:
> /usr/share/recoll/filters/rclimg
> :2:../internfile/internfile.cpp:412:FileInterner::internfile:
> next_document error
> [/home/peter/.gkrellm2-0/themes/minegue-beta/timer/bg_timer.png]
> :2:../internfile/internfile.cpp:494:FileInterner::internfile:
> conversion ended with no doc
> :4:../rcldb/rcldb.cpp:1027:Db::add: docid 17360 updated
> [/home/peter/.gkrellm2-0/themes/minegue-beta/timer/bg_timer.png , ]
> :4:../internfile/internfile.cpp:109:FileInterner::FileInterner:
> [/home/peter/.gkrellm2-0/themes/minegue-beta/bg_grid.png] mime
> [(null)] preview 0
> :4:../internfile/internfile.cpp:170:FileInterner::FileInterner:
> image/png [/home/peter/.gkrellm2-0/themes/minegue-beta/bg_grid.png]
> :4:../internfile/internfile.cpp:357:FileInterner::internfile. ipath []
> :4:../utils/execmd.cpp:163:ExecCmd::doexec: ((nil)|0x97116b4)
> /usr/share/recoll/filters/rclimg
> {/home/peter/.gkrellm2-0/themes/minegue-beta/bg_grid.png}
> Can't locate Image/ExifTool.pm in @INC (@INC contains: /etc/perl
> /usr/local/lib/perl/5.10.0 /usr/local/share/perl/5.10.0 /usr/lib/perl5
> /usr/share/perl5 /usr/lib/perl/5.10 /usr/share/perl/5.10
> /usr/local/lib/site_perl .) at /usr/share/recoll/filters/rclimg line
> 61.
> BEGIN failed--compilation aborted at /usr/share/recoll/filters/rclimg line
> 61.
> :2:../internfile/mh_exec.cpp:71:MimeHandlerExec: command status 0x200:
> /usr/share/recoll/filters/rclimg
> :2:../internfile/internfile.cpp:412:FileInterner::internfile:
> next_document error
> [/home/peter/.gkrellm2-0/themes/minegue-beta/bg_grid.png]
> :2:../internfile/internfile.cpp:494:FileInterner::internfile:
> conversion ended with no doc
>
> HTH, Peter
--
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
