Re: [SlimDevices: Beta] Scanning performance 7.5.6 vs 7.6.1 with WAL

2011-08-12 Thread Michael Herger
Need more checkpoints? Could those of you encountering the Windows db malformed issue tell me what Windows version you're using? -- Michael ___ beta mailing list beta@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/beta

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread Michael Herger
I will point out there are some strange file names in 8.5 format in the Cache That's interesting indeed. Jim - do you see the same in your non-working version? But different in the working version? This has been pointed out before in this thread, but I wonder if it is significant? I'm

Re: [SlimDevices: Beta] Scanning performance 7.5.6 vs 7.6.1 with WAL

2011-08-12 Thread slate
At home: Windows 7 Home Premium At work: Windows 7 Enterprise -- slate Main: Receiver (Audiocom) - Beresford Caiman+ (Gatorized) - Carver A-500x - BW 704 Office: Receiver - Luxman L-210 - Stax SR84 Pro/Superlux HD668B Server: Zotac IONITX-A, 4 GB, 1 TB WD EADS, Win7 w. 7.6 (SQLite w. High

Re: [SlimDevices: Beta] Scanning performance 7.5.6 vs 7.6.1 with WAL

2011-08-12 Thread Michael Herger
At home: Windows 7 Home Premium At work: Windows 7 Enterprise 32 or 64 bits? -- Michael ___ beta mailing list beta@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/beta

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread Michael Herger
I still didn't read any reason why WAL needs to be in 7.6.1 ? Because it's supposed to fix the database locked issues we've seen in some cases. -- Michael ___ beta mailing list beta@lists.slimdevices.com

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread Michael Herger
I've been playing with the Windows build of Version: 7.6.1 - r33044. I immediately ran into the corrupted database trap. I can get myself into a runnable state by going back to r33011, running a scan, and then upgrading to the latest build. If I stop SBS and clear the Cache, I get stuck

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread erland
mherger;649125 Wrote: I've been playing with the Windows build of Version: 7.6.1 - r33044. I immediately ran into the corrupted database trap. I can get myself into a runnable state by going back to r33011, running a scan, and then upgrading to the latest build. If I stop SBS and clear

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread Michael Herger
Are we sure these aren't caused by something triggering a rescan while another rescan is in progress ? That's what the change should allow to do. If it doesn't then we have to fix it. I just tried to do the following in r33019 (before WAL): 1. Shutdown SBS and clear Cache folder 2. Start

Re: [SlimDevices: Beta] Scanning performance 7.5.6 vs 7.6.1 with WAL

2011-08-12 Thread slate
mherger;649121 Wrote: At home: Windows 7 Home Premium At work: Windows 7 Enterprise 32 or 64 bits? -- Michael At home: Windows 7 Home Premium 32 bit At work: Windows 7 Enterprise 64 bit -- slate Main: Receiver (Audiocom) - Beresford Caiman+ (Gatorized) - Carver A-500x - BW 704

Re: [SlimDevices: Beta] Handheld option disappears with SBS 7.6?

2011-08-12 Thread Wirrkopf
bits;646187 Wrote: It's really only the Symbian and Blackberry users that have any numbers that have been left behind. There are so many Smartphone OS! I use BADA from Samsung and there isnĀ“t a native app for the squeezebox. I NEED a handheld skin! -- Wirrkopf

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread Michael Herger
Is there something particular going wrong under Windows? Yes, the corrupted database problem is only on Windows. It might be related to long file names and how sqlite and/or perl deal with them in this case. I modified the code to use short names instead of what we're using now, and the

Re: [SlimDevices: Beta] Scanning performance 7.5.6 vs 7.6.1 with WAL

2011-08-12 Thread JJZolx
Windows Server 2003 SP2, 32-bit. -- JJZolx JJZolx's Profile: http://forums.slimdevices.com/member.php?userid=10 View this thread: http://forums.slimdevices.com/showthread.php?t=89513

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread Michael Herger
I'm using iTunes and Music IP integration, and so have no music folder set. That's a different issue, not related to WAL or SQLite: http://bugs.slimdevices.com/show_bug.cgi?id=17358 Unfortunately there's no easy fix for this issue. -- Michael ___

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread JJZolx
mherger;649119 Wrote: I will point out there are some strange file names in 8.5 format in the Cache That's interesting indeed. Jim - do you see the same in your non-working version? But different in the working version? Yes, I've said it a couple of times in this thread. There

Re: [SlimDevices: Beta] Handheld option disappears with SBS 7.6?

2011-08-12 Thread pippin
No. There are only two Smartphone OSs. Plus some wannabes and some legacy systems that will go away anyway. Although you have a point. Back when I did the iPeng skin it wasn't possible to do a good smartphone UI using HTML and JavaScript because the browsers were not up to it, I wonder whether

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread erland
mherger;649131 Wrote: I just tried to do the following in r33019 (before WAL): 1. Shutdown SBS and clear Cache folder 2. Start SBS and let it initiate a rescan 3. In the web interface try to Browse by Music Folder Please file a bug report and make sure Andy is CCed to it (or

Re: [SlimDevices: Beta] Handheld option disappears with SBS 7.6?

2011-08-12 Thread Michael Herger
Couldn't the Logitech App's HTML/JS be added to the server as a skin, too? I think this could work with a few changes (there's some native code involved in server detection - which needed to be disabled for this case). The bigger issue I'm seeing is whether there are any browsers which are

Re: [SlimDevices: Beta] Handheld option disappears with SBS 7.6?

2011-08-12 Thread pippin
WebOS comes to mind. RIM also uses webkit in the new devices, don't they? Microsoft probably not. -- pippin --- see iPeng, the Squeezebox iPhone remote and *New: iPeng for iPad*, at penguinlovesmusic.com pippin's

Re: [SlimDevices: Beta] Scanning performance 7.5.6 vs 7.6.1 with WAL

2011-08-12 Thread JJZolx
Interesting... I finally got a full rescan with SQLite comparable to the MySQL performance in 7.6.1. A little faster, actually. I got it by stopping the server and running a VACUUM operation on all three of the databases. Discovering files/directories: D:\slim\65\music (1 of 1) Complete

Re: [SlimDevices: Beta] Scanning performance 7.5.6 vs 7.6.1 with WAL

2011-08-12 Thread Michael Herger
Interesting... I finally got a full rescan with SQLite comparable to the MySQL performance in 7.6.1. A little faster, actually. I got it by stopping the server and running a VACUUM operation on all three of the databases. Jim - did you have time to test the file name change I proposed? --

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread JohnB
Firstly - I apologise for posting here as I'm neither a developer nor a bete-tester as such, though I have been using/testing the 7.6.1 beta builds. However, in view of the discussion about 33044 I thought this might be useful. I'm running Windows 7 64 bit. I was using 33011 but I then

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread garym
JohnB;649189 Wrote: Firstly - I apologise for posting here as I'm neither a developer nor a bete-tester as such, though I have been using/testing the 7.6.1 beta builds. However, in view of the discussion about 33044 I thought this might be useful. I'm running Windows 7 64 bit. I was

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread JohnB
Thanks garym. I was really hoping that my experience, and the logs, might assist others in resolving the problem that JJZolx and others have described (i.e. that 33044 is fine when there is an existing database but it has show stopping problems when the cache is cleared or when it is a new

Re: [SlimDevices: Beta] Lms?

2011-08-12 Thread tamanaco
FYI... I've been getting some good results using Whitebear Media Server with my SBS server. I posted some pictures in the Whitebear thread where you can see how the Revue interface looks and functions with Whitebear. See posts 96-98 http://forums.slimdevices.com/showthread.php?t=48521 --

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread Michael Herger
Andy/Michael, how is the cache handled during upgrades? Could the above indicate that WAL might not be used be unless you manually delete the Cache directory ? See my other posting re. 8.3 vs. long filenames: scanner and server aren't accessing the same logs, due to some oddity in the file

Re: [SlimDevices: Beta] Scanning performance 7.5.6 vs 7.6.1 with WAL

2011-08-12 Thread MeSue
mherger;649115 Wrote: Could those of you encountering the Windows db malformed issue tell me what Windows version you're using? Windows Home Server -- MeSue SUE 1 Duet | 2 Booms | 1 Radio | 1 Touch (beta) | 1 SB2 HP MediaSmart EX470 | Squeezebox Server 7.5 | iPod Touch w/ iPeng

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread dsdreamer
mherger;649207 Wrote: Andy/Michael, how is the cache handled during upgrades? Could the above indicate that WAL might not be used be unless you manually delete the Cache directory ? See my other posting re. 8.3 vs. long filenames: scanner and server aren't accessing the same logs,

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread Andy Grundman
On Aug 12, 2011, at 10:42 AM, dsdreamer wrote: mherger;649207 Wrote: Andy/Michael, how is the cache handled during upgrades? Could the above indicate that WAL might not be used be unless you manually delete the Cache directory ? See my other posting re. 8.3 vs. long filenames:

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread MeSue
After getting the malformed database with 33044, I installed 33011 and let it scan last night, which was successful. This morning I installed 33048 and tried to do a new and changed scan. It usually takes 10-20 minutes, but was still going after 45 minutes and appeared to be stuck, so I aborted

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread pallfreeman
I kept rescanning until no more files were deleted (as shown in the logs). Code: Library Statistics Total Tracks: 183,488 Total Albums: 17,087 Total Artists: 9,031 Total Genres: 454 Total Playing Time: 15130:58:08 Music Scan Details Discovering

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread andyg
We think the bug on Windows with filenames has been fixed. Please give r33068 a test when it shows up on the nightly download page in a few minutes. -- andyg andyg's Profile:

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread JJZolx
Ah, you've renamed the databases to library.db persist.db artwork.db Looks like it fixes the problem for me. :-) How is this going to affect our friends developing third party plugins? One thing that I see on a server where I did _not_ clear the cache is that there are

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread andyg
The shm/wal files don't stay around unless you've force-killed the server or it crashed. You can just delete them. 3rd party plugins should never care what the database filenames are. -- andyg andyg's Profile:

Re: [SlimDevices: Beta] Handheld option disappears with SBS 7.6?

2011-08-12 Thread bklaas
pippin;649154 Wrote: WebOS comes to mind. RIM also uses webkit in the new devices, don't they? Microsoft probably not. That about sums it up perfectly I think (though I don't pay attention enough to M$'s mobile OS to know whether it has a webkit browser or not). I've even heard RIMs browser

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread JJZolx
andyg;649260 Wrote: The shm/wal files don't stay around unless you've force-killed the server or it crashed. You can just delete them. Interesting. The files are never removed on my server when SBS is shut down. I guess that means the way I run SBS as a service using srvany.exe, which runs

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread Andy Grundman
On Aug 12, 2011, at 1:31 PM, JJZolx wrote: andyg;649260 Wrote: The shm/wal files don't stay around unless you've force-killed the server or it crashed. You can just delete them. Interesting. The files are never removed on my server when SBS is shut down. I guess that means the way I

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread kesey
Andy, r33068 installed and worked sweet as pie with my Sheevaplug. Many thanks to you and to Michael for all the work you've been doing to get 7.6.1 off the blocks, and for the good humour/wit you both unfailingly show. It's a pleasure to be part of the Squeeze family. regards, kesey

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread JJZolx
andyg;649277 Wrote: On Aug 12, 2011, at 1:31 PM, JJZolx wrote: andyg;649260 Wrote: The shm/wal files don't stay around unless you've force-killed the server or it crashed. You can just delete them. Interesting. The files are never removed on my server when SBS is shut down. I

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread verypsb
pallfreeman;649071 Wrote: After moving a bunch of albums from one directory to another, I did full rescans. There was a bug in my script and I needed to move a small number elsewhere, so I did a new/changed scan. 33001 was fine. 33044 not so fine. Repeated rescans: Removing deleted files:

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread JJZolx
verypsb;649283 Wrote: Has anyone investigated ( fixed) this issue? I've seen several reports that deleting/renaming files causes issues... (Not tested it myself) I'll test it. -- JJZolx JJZolx's Profile:

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread slate
And we are back running again with 33068. Clear cache/malformed db issue is gone Still 50% slower than before WAL, but also stil much faster than 7.5 Library Statistics Total Tracks: 9,018 Total Albums: 813 Total Artists: 388 Total Genres: 52 Total Playing Time: 679:04:10 Music Scan

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread JJZolx
pallfreeman;649071 Wrote: After moving a bunch of albums from one directory to another, I did full rescans. There was a bug in my script and I needed to move a small number elsewhere, so I did a new/changed scan. 33001 was fine. 33044 not so fine. Repeated rescans: Removing deleted files:

Re: [SlimDevices: Beta] Impossible to stop SBS

2011-08-12 Thread signor_rossi
I see this too since a few days. I tried to understand the start-up script and think that this portion doesn't work any-more as intended: PID=$(pgrep slimserver.pl) doesn't return the PID any-more, probably because the sbs process now shows up as 'perl' and not 'slimserver.pl' in top as it

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread JohnB
Uninstalled 33068 completely and did clean install of 33068 - worked fine. On my system (W7 64bit) the only curious thing is the difference in statistics, between 33011 and 33068 33011: Total Tracks: 21,813 Total Albums: 3,765 Total Artists: 1,549 Total Genres: 46 Total Playing Time: 2734:00:20

Re: [SlimDevices: Beta] Impossible to stop SBS

2011-08-12 Thread Triode
I believe this is due to changing the shebang line, try changing the first line of slimserver.pl back to: Code: #!/usr/bin/perl -- Triode Triode's Profile:

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread dsdreamer
As has already been confirmed, the 33068 build is working well under Windows 7, even if the Cache is cleared before a new scan. -- dsdreamer -- Dreamer, easy in the chair that really fits you...

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread reinholdk
Trying to help with testing, I just installed r33068 on a virtual machine that had no SBS before (running Win7 Enterprise as the guest os). The initial scan succeeded and reports the same number of tracks as my SBS 7.5.4 on the host PC. (The music folder on the host was mounted to a drive in the

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread verypsb
JJZolx;649329 Wrote: Yes, I've just tested this and can confirm that it is broken. Only 1/2 of the tracks that it reports being removed are actually removed during each new changed scan. Bug filed: http://bugs.slimdevices.com/show_bug.cgi?id=17438 And is it still really slow? (when

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread JJZolx
reinholdk;649355 Wrote: The number of albums are different, though. Don't know whether this is expected due to the modified scanner process. You should have the same number of albums. Remember that the library settings, particularly whether or not you group multi-disc albums, can affect the

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread JohnB
JohnB;649339On my system (W7 64bit) the only curious thing is the difference in statistics, between 33011 and 33068[/QUOTE Wrote: Apologies - I forgot to set up the Guess Tags again. I'll rescan. -- JohnB JohnB's

Re: [SlimDevices: Beta] Scanning performance 7.5.6 vs 7.6.1 with WAL

2011-08-12 Thread JJZolx
Performance with SQLite under 7.6.1 is now excellent. Very close to what it was before the WAL changes. A full scan of my library is down to 12:30. -- JJZolx JJZolx's Profile:

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread reinholdk
JJZolx;649360 Wrote: You should have the same number of albums. Remember that the library settings, particularly whether or not you group multi-disc albums, can affect the count. You're right, this setting was different, because still at the default value in the VM. The new scan now has

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread JohnB
Apologies for saying there was a difference in library statistics in post #151. This was purely because I had forgotten to redefine the Guess Tags after a complete re-install. (I've amended the post to make that clear.) 33068 seems to work fine. -- JohnB

[SlimDevices: Beta] My Music menu order

2011-08-12 Thread Phil Meyer
In the Web UI, within My Music I have noticed that I now get UPNP devices listed at the top of the menu. Is this the correct default place for them to appear? I'd expect them nearer the bottom of the list (as they may come and go, depending on what other software apps are running on the

Re: [SlimDevices: Beta] Scanning performance 7.5.6 vs 7.6.1 with WAL

2011-08-12 Thread Phil Meyer
Performance with SQLite under 7.6.1 is now excellent. Very close to what it was before the WAL changes. A full scan of my library is down to 12:30. I tried switching to MySQL, which initially seems really fast too, but the further through the scan the slower it got. It was crawling - maxing out

Re: [SlimDevices: Beta] Scanning performance 7.5.6 vs 7.6.1 with WAL

2011-08-12 Thread Phil Meyer
I grabbed latest SVN version, switched prefs back to SQLite, deleted my cache DBs, and rescanned. SBS 7.6.1 SQLite scan still takes longer than 7.5.6 for me (by a few minutes). ___ beta mailing list beta@lists.slimdevices.com

Re: [SlimDevices: Beta] Scanning performance 7.5.6 vs 7.6.1 with WAL

2011-08-12 Thread Phil Meyer
I grabbed latest SVN version, switched prefs back to SQLite, deleted my cache DBs, and rescanned. Scan finished, apparently successfully, but the Web UI reports 0 albums with 0 songs by 0 artists.. I can still browse artists and the list looks okay, but it's really slow.

Re: [SlimDevices: Beta] Scanning performance 7.5.6 vs 7.6.1 with WAL

2011-08-12 Thread JJZolx
Philip Meyer;649385 Wrote: Browsing Artists seems very slow. Navigating in Web UI to the first page of Browse Artists, takes about 45 secs. That's the giant SBS brain fart that most people see with 7.6. I only see it once each time the server starts, although it's less than 15-20 seconds on

Re: [SlimDevices: Beta] SQLite WAL in 7.6.1 - please test

2011-08-12 Thread erland
If I've understood correctly the MusicIP and iTunes integrations currently checks the timestamp of the iTunes and MusicIp libraries and trigger a rescan if they have changed. Is there any risk that such rescan will occur at the same time as a full rescan is in progress ? If so, has anyone tried

Re: [SlimDevices: Beta] My Music menu order

2011-08-12 Thread erland
I agree, they should be sorted somewhere below the standard browse items or even in a separate section for UPnP/DLNA servers. It's probably the same bug as you saw earlier where the MusicIP Mood Mix menu was sorted wrong, I suspect it has to be solved the same way as in MusicIP plugin where