Re: Improving http://tests.winehq.org/data/

2007-10-26 Thread Francois Gouget
On Thu, 25 Oct 2007, James Hawkins wrote: [...] I don't think that's fair to long tests, say msi:install. I don't think we have any long-running tests right now (except the 'ftp' tests but that's probably a bug). All the tests that time out do so because they do stuff that pops up a MessageBox

Re: Improving http://tests.winehq.org/data/

2007-10-26 Thread Huw Davies
On Fri, Oct 26, 2007 at 12:51:17AM +0200, Francois Gouget wrote: So I had a closer look at the tests that failed to run: ... * rpcrt4:server crashes and then times out with the message box that says: This program has performed an illegal operation and will be shut down.

Re: Improving http://tests.winehq.org/data/

2007-10-26 Thread Robert Shearman
Huw Davies wrote: On Fri, Oct 26, 2007 at 12:51:17AM +0200, Francois Gouget wrote: So I had a closer look at the tests that failed to run: ... * rpcrt4:server crashes and then times out with the message box that says: This program has performed an illegal operation and will be

Re: Improving http://tests.winehq.org/data/

2007-10-26 Thread Francois Gouget
On Fri, 26 Oct 2007, Robert Shearman wrote: [...] Win9x's rpcrt4 is quite buggy and I don't think it's worth the trouble of diagnosing what is happening and trying to work around it, both with the crash and the test failures. Then rpcrt4_test should detect this and skip the server test.

Re: Improving http://tests.winehq.org/data/

2007-10-26 Thread Jakob Eriksson
Francois Gouget wrote: On Fri, 26 Oct 2007, Robert Shearman wrote: [...] Win9x's rpcrt4 is quite buggy and I don't think it's worth the trouble of diagnosing what is happening and trying to work around it, both with the crash and the test failures. Then rpcrt4_test should detect

Improving http://tests.winehq.org/data/

2007-10-25 Thread Francois Gouget
Here are some things I noticed while using this site. Let me know if I it would help to make bug reports for these: * Some result entries are red with a dash in them and a blue border. See the Windows 98 results for http://test.winehq.org/data/200710241000/ I assume these means that the

Re: Improving http://tests.winehq.org/data/

2007-10-25 Thread James Hawkins
On 10/25/07, Francois Gouget [EMAIL PROTECTED] wrote: Here are some things I noticed while using this site. Let me know if I it would help to make bug reports for these: * Some result entries are red with a dash in them and a blue border. See the Windows 98 results for

Re: Improving http://tests.winehq.org/data/

2007-10-25 Thread Juan Lang
- if it did not run because the tested dll did not exist at all, then it's not a test failure and thus the background should be green. A typical case would be the crypt32 tests on Windows 98. Actually, that's a poor case. From the Dll info section of the Windows 98 test:

Re: Improving http://tests.winehq.org/data/

2007-10-25 Thread James Hawkins
On 10/25/07, Francois Gouget [EMAIL PROTECTED] wrote: Here are some things I noticed while using this site. Let me know if I it would help to make bug reports for these: * Some result entries are red with a dash in them and a blue border. See the Windows 98 results for

Re: Improving http://tests.winehq.org/data/

2007-10-25 Thread Francois Gouget
On Thu, 25 Oct 2007, Juan Lang wrote: - if it did not run because the tested dll did not exist at all, then it's not a test failure and thus the background should be green. A typical case would be the crypt32 tests on Windows 98. Actually, that's a poor case. From the Dll info

re: Improving http://tests.winehq.org/data/

2007-10-25 Thread Dan Kegel
James wrote: Looking at the test data, all of the msi:install tests timeout. I just ran the install tests in XP running under vmware on a 3ghz machine. The tests took 9m41s. That completely blows away the 2min timeout. There's nothing wrong with the tests, they just take a long time. I don't

Re: Improving http://tests.winehq.org/data/

2007-10-25 Thread Dan Kegel
I noticed that oleaut32's typelib test failed on windows: typelib.c:65:Loading type library typelib.c:1208: Test failed: LoadTypeLibEx(wszName, REGKIND_NONE, typelib) returned 80029c4a, expected S_OK (0) Is this because winetest.exe didn't include the files dlls/oleaut32/tests/*.tlb?

Re: Improving http://tests.winehq.org/data/

2007-10-25 Thread Francois Gouget
On Thu, 25 Oct 2007, James Hawkins wrote: [...] Looking at the test data, all of the msi:install tests timeout. I I believe that's because of this: * msi:automation and msi:install both time out because of this message: Service 'TestService' (TestService) could not be installed.

Re: Improving http://tests.winehq.org/data/

2007-10-25 Thread James Hawkins
On 10/25/07, Dan Kegel [EMAIL PROTECTED] wrote: James wrote: Looking at the test data, all of the msi:install tests timeout. I just ran the install tests in XP running under vmware on a 3ghz machine. The tests took 9m41s. That completely blows away the 2min timeout. There's nothing wrong

Re: Improving http://tests.winehq.org/data/

2007-10-25 Thread Dan Kegel
On 10/25/07, James Hawkins [EMAIL PROTECTED] wrote: 1) runtest could take an option --skip-long-tests which would skip all tests that had that option set, and I don't think that's fair to long tests, say msi:install. There will always be people that don't want to wait for the tests, and