Brian Vincent wrote:

I
PS - still looking for ideas for the agenda, if you have any, let me
know. Also let me know if you'd like to present something.


Apart from all of Wine, I'm always interested in the conformance
testing. I believe it's crucial in speeding up Wines' development.
For each bug found, it is often a good idea to write an automatic
regression test.


Maybe we can extend on the winetest.exe infrastructure. I would like to see testing done in realtime - we now have a turnaround of maybe 3-4 days for a test developer like myself. I do a tiny, tiny patch, and then wait 3-4 days to see how it behaves on 6 platforms.


What I would like to see: a "cluster" of Windows machines with different versions, all waiting eagerly for a small test.exe to appear. A dispatcher receives tests and then distributes it to waiting Windows machines. As soon as machine has run a test, it is rebooted. Preferrably from a clean vmware image.


Mockup example:


[EMAIL PROTECTED]:~/src/wine/dlls/kernel/tests$ make testgrid_file
i586-mingw32msvc-gcc -c -I. -I. -I../../../include -I../../../include -D_REENTRANT -fPIC -Wall -pipe -mpreferred-stack-boundary=2 -fno-strict-aliasing -gstabs+ -Wpointer-arith -g -O2 -o file.cross.o file.c
file.c:1: warning: -fPIC ignored for target (all code is position independent)
i586-mingw32msvc-gcc alloc.cross.o atom.cross.o change.cross.o codepage.cross.o comm.cross.o console.cross.o directory.cross.o drive.cross.o environ.cross.o file.cross.o format_msg.cross.o generated.cross.o heap.cross.o locale.cross.o module.cross.o mailslot.cross.o path.cross.o pipe.cross.o process.cross.o profile.cross.o thread.cross.o time.cross.o timer.cross.o virtual.cross.o testlist.cross.o -o kernel32_crosstest.exe -lkernel32
i586-mingw32msvc-strip kernel32_crosstest.exe
upx kernel32_crosstest.exe
gpg --sign kernel32_crosstest.exe > kernel32_crosstest.sig
tar -cf kernel32_crosstest.tar kernel32_crosstest.exe kernel32_crosstest.sig
wget http://testgrid.winehq.org/gridtest.cgi --post-file=kernel32_crosstest.tar --output-document=testgrid_file.txt
[EMAIL PROTECTED]:~/src/wine/dlls/kernel/tests$
[EMAIL PROTECTED]:~/src/wine/dlls/kernel/tests$
[EMAIL PROTECTED]:~/src/wine/dlls/kernel/tests$ cat testgrid_file.txt
Windows 2000 begin:
file.c:1384: Test failed: DeleteFileA: error 3
file: 487732 tests executed, 0 marked as todo, 1 failure.
End Windows 2000.
Windows 98 begin:
file.c:804: Test failed: MoveFileA: unexpected error 3
file.c:1384: Test failed: DeleteFileA: error 3
file: 487732 tests executed, 0 marked as todo, 2 failures.
End Windows 98.
Windows XP begin:
file: 487732 tests executed, 0 marked as todo, 0 failures.
End Windows XP.
Windows NT4 begin:
file: 487732 tests executed, 0 marked as todo, 0 failures.
End Windows NT4.
[EMAIL PROTECTED]:~/src/wine/dlls/kernel/tests$
[EMAIL PROTECTED]:~/src/wine/dlls/kernel/tests$
[EMAIL PROTECTED]:~/src/wine/dlls/kernel/tests$




regards,
Jakob




Reply via email to