Philip Meyer;647712 Wrote:
>
> I'm not sure how the scanner works now, but assume it needs to read
> content back out of the DB when deciding how to process each file
> scanned. As it looks like there aren't any tidy-up phases any more, it
> must be running queries or reading content back out to determine if
> adding a new song to an album, whether the album should become a
> compilation, etc.
>
As far as I can see from the code it does some reading, but to know for
sure one would have to enable logging on the database.
Philip Meyer;647712 Wrote:
>
> If that is the case, the scanner is going to become increasingly
> inefficient as the number of songs increases.
>
I have a generated library with 50 000 very small FLAC files and I can
scan that within 10-15 minutes.
I also did some test with a generated library with same size as my
normal FLAC library with 3500 tracks and the result were:
- Real library (91 GB): full rescan 92 seconds
- flactruncate.pl library (31 MB): full rescan 32 seconds
- My random generated flac library (15 MB): full rescan 25 seconds
So the scanning time is greatly affected by the file size. If the FLAC
file size results in a linear performance loss related to library size,
it would mean that a 50 000 FLAC library would take about 25-40 minutes
in my setup.
I'm not sure if JJZolx is using a generated library with full size FLAC
files or if it's a library with small FLAC files.
One thing that should be mentioned is that my generated library doesn't
have any album covers, so if the performance is somehow related to
artwork handling that won't be seen in my tests, at least not until
I've added album covers to the test library.
If there is an interest, I'll try to run some more tests in my
environment with different library sizes. However, I can't run
realistic tests of scanning performance because of limited disc space
to store full size FLAC files, but I can run tests to compare
SQLite/MySQL with small FLAC files or to compare browsing performance
which should be independent of FLAC file size.
The only issue is that I only have a virtual environment, so it's not
going to be 100% accurate and comparable with a real environment.
--
erland
Erland Isaksson ('My homepage' (http://erland.isaksson.info))
(Developer of 'many plugins/applets'
(http://wiki.slimdevices.com/index.php/User:Erland). If my answer
helped you and you like to encourage future presence on this forum
and/or third party plugin/applet development, 'donations are always
appreciated' (http://erland.isaksson.info/donate))
------------------------------------------------------------------------
erland's Profile: http://forums.slimdevices.com/member.php?userid=3124
View this thread: http://forums.slimdevices.com/showthread.php?t=89391
_______________________________________________
discuss mailing list
discuss@lists.slimdevices.com
http://lists.slimdevices.com/mailman/listinfo/discuss
