Hi Ian and All,

I tested the release candidate's llvmpipe OS Mesa on VTK's regression suite. it did fairly well 99% pass, however there are some regressions and segv's compared to OS Mesa in 9.1.5, which passes 100%. (data below)

There's a volunteer who graciously runs nightly regression suite nightly against various Mesa builds and makes these dashboards public[1]. Here's the list of failed tests for last night's OS Mesa run (on 2.1 Mesa 9.3.0-devel (git-ff3cb37)) , http://open.cdash.org/viewTest.php?onlyfailed&buildid=3003558. visit the above link, if you click on red "failed" links, you can see an image diff, or in the case of tests failed with status "OTHER_FAULT" a stack trace. How nice is that?

Have you considered using VTK for pre-release validation? I'd never suggest that it be your only validation, for one thing it's only using OpenGL 2.1 + common extensions, so it won't give anywhere near complete coverage of Open GL. But, the nice thing about VTK is the level of testing that it goes through. Because of this it could be used as a reference by comparing regression test results using Mesa against those attained with recent NVIDIA hardware + drivers, which provide 100% coverage in VTK and 100% of the tests pass, or even between various Mesa renderers as some are less buggy than others. it's quite easy to set up and run and the web interface is very helpful for examining the results displaying image diffs etc.

btw, historically VTK has only used OpenGL 1.1 features with OS Mesa. In VTK master branch VTK will now take advantage of whatever Open GL features Mesa provides with OS Mesa. We've also made an attempt to visit any features that were specifically disabled because of bugs in Mesa. We've added a build flag VTK_IGNORE_GLDRIVER_BUGS that will enable all such features for validation of new Mesa releases. If you're curious about which Mesa was used in a given VTK dashboard submission look at the output of the LoadOpenGLExtension test it prints out OpenGL's vendor, version, renderer strings.

Thanks for all the great work, I'm looking forward to the 9.2.0 release.
Burlen

[1]
http://open.cdash.org/index.php?project=VTK&filtercount=1&showfilters=1&field1=buildname/string&compare1=63&value1=Mesa

here's info about my test run of your release candidate:

mesa config
./configure --disable-xvmc --disable-glx --disable-dri --with-dri-drivers= --with-gallium-drivers=swrast --enable-texture-float --disable-shared-glapi --disable-egl --with-egl-platforms= --enable-gallium-llvm --with-llvm-prefix=/work/apps/llvm/3.2 --enable-osmesa --prefix=/work/apps/mesa-9.2.0 --with-osmesa-bits=32

VTK git b3e976b

1633: GL_VENDOR: VMware, Inc.
1633: GL_VERSION: 2.1 Mesa 9.2.0-rc1
1633: GL_RENDERER: Gallium 0.4 on llvmpipe (LLVM 3.2, 128 bits)

99% tests passed, 10 tests failed out of 1827

Total Test time (real) = 542.40 sec

The following tests FAILED:
        693 - vtkFiltersHybridPython-largeImageOffset (OTHER_FAULT)
        694 - vtkFiltersHybridPython-largeImageParallel (OTHER_FAULT)
        706 - vtkFiltersHybridTcl-largeImageOffset (SEGFAULT)
        707 - vtkFiltersHybridTcl-largeImageParallel (SEGFAULT)
        1562 - vtkRenderingCorePython-TestOpacity2 (Failed)
        1573 - vtkRenderingCoreTcl-TestOpacity2 (Failed)
1690 - vtkRenderingOpenGLCxx-TestTransformCoordinateUseDouble (Failed)
        1726 - vtkRenderingParallelCxx-MPI-TestPShadowMapPass (Failed)
        1778 - vtkRenderingVolumePython-cursor3D (OTHER_FAULT)
        1811 - vtkViewsInfovisCxx-TestConeLayoutStrategy (Failed)
Errors while running CTest


here's output from one of the above that segv's for the rc but not the other versions of Mesa that we have coverage for.
$ctest -R vtkFiltersHybridPython-largeImageOffset --verbose
UpdateCTestConfiguration from :/work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/DartConfiguration.tcl Parse Config file:/work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/DartConfiguration.tcl
 Add coverage exclude regular expressions.
 Add coverage exclude: vtk.*TCLInit.cxx
 Add coverage exclude: vtk[^\.]+(Java|Python|Tcl).cxx
 Add coverage exclude: .*vtkOpenGLState.*
 Add coverage exclude: .*Testing.Cxx.*cxx
 Add coverage exclude: .*Testing.Cxx.*h
 Add coverage exclude: .*moc_.*cxx
 Add coverage exclude: .*/Utilities/.*
 Add coverage exclude: .*/ThirdParty/.*
UpdateCTestConfiguration from :/work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/DartConfiguration.tcl Parse Config file:/work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/DartConfiguration.tcl
Test project /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0
Constructing a list of tests
Done constructing a list of tests
Checking test dependency graph...
Checking test dependency graph end
test 693
    Start 693: vtkFiltersHybridPython-largeImageOffset

693: Test command: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/bin/vtkpython "--enable-bt" "/work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/Utilities/vtkTclTest2Py/rtImageTest.py" "/work/ext/ParaView/sqtk-pv/VTK/Filters/Hybrid/Testing/Python/largeImageOffset.py" "-D" "/work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/ExternalData/Testing" "-T" "/work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/Testing/Temporary" "-V" "/work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/ExternalData/Filters/Hybrid/Testing/Data/Baseline/largeImageOffset.png" "-A" "/work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/Utilities/vtkTclTest2Py"
693: Test timeout computed to be: 1500
693: vtk version 6.1.0
693: <DartMeasurement name="ImageError" type="numeric/double">0</DartMeasurement><DartMeasurement name="BaselineImage" type="text/string">Standard</DartMeasurement><DartMeasurement name="WallTime" type="numeric/double">0.562795</DartMeasurement> 693: <DartMeasurement name="CPUTime" type="numeric/double">0.75</DartMeasurement>
693: =========================================================
693: Process id 27799 Caught SIGSEGV code 128
693: Program Stack:
693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtksys-6.1.so.1(+0x51cda) [0x7fbfad4b5cda]
693:   /lib/x86_64-linux-gnu/libc.so.6(+0x364a0) [0x7fbfadc034a0]
693: /work/apps/mesa-9.2.0/lib/libOSMesa32.so.8(+0x3a6da8) [0x7fbf9c6c9da8] 693: /work/apps/mesa-9.2.0/lib/libOSMesa32.so.8(+0x39827a) [0x7fbf9c6bb27a] 693: /work/apps/mesa-9.2.0/lib/libOSMesa32.so.8(+0x2eda98) [0x7fbf9c610a98] 693: /work/apps/mesa-9.2.0/lib/libOSMesa32.so.8(OSMesaDestroyContext+0x12) [0x7fbf9c7e78a2] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkRenderingOpenGL-6.1.so.1(_ZN23vtkOSOpenGLRenderWindow22DestroyOffScreenWindowEv+0xa1) [0x7fbf9b288131] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkRenderingOpenGL-6.1.so.1(_ZN23vtkOSOpenGLRenderWindow13DestroyWindowEv+0xf6) [0x7fbf9b287f24] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkRenderingOpenGL-6.1.so.1(_ZN23vtkOSOpenGLRenderWindow8FinalizeEv+0x43) [0x7fbf9b28831f] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkRenderingOpenGL-6.1.so.1(_ZN23vtkOSOpenGLRenderWindowD1Ev+0x2b) [0x7fbf9b287b57] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkRenderingOpenGL-6.1.so.1(_ZN23vtkOSOpenGLRenderWindowD0Ev+0x18) [0x7fbf9b287c20] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkCommonCore-6.1.so.1(_ZN13vtkObjectBase18UnRegisterInternalEPS_i+0xfd) [0x7fbfaad45ef9] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkCommonCore-6.1.so.1(_ZN9vtkObject18UnRegisterInternalEP13vtkObjectBasei+0x303) [0x7fbfaad481a9] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkCommonCore-6.1.so.1(_ZN13vtkObjectBase10UnRegisterEPS_+0x34) [0x7fbfaad45dae] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkRenderingCore-6.1.so.1(_ZN15vtkRenderWindow10UnRegisterEP13vtkObjectBase+0x127) [0x7fbf9e7334e9] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkIOImport-6.1.so.1(_ZN11vtkImporter15SetRenderWindowEP15vtkRenderWindow+0x1fd) [0x7fbf81b6f39d] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkIOImport-6.1.so.1(_ZN11vtkImporterD1Ev+0x30) [0x7fbf81b6f450] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkIOImport-6.1.so.1(_ZN14vtk3DSImporterD2Ev+0x3cc) [0x7fbf81b6e1f4] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkIOImport-6.1.so.1(_ZN14vtk3DSImporterD0Ev+0x18) [0x7fbf81b6e248] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkCommonCore-6.1.so.1(_ZN13vtkObjectBase18UnRegisterInternalEPS_i+0xfd) [0x7fbfaad45ef9] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkCommonCore-6.1.so.1(_ZN9vtkObject18UnRegisterInternalEP13vtkObjectBasei+0x303) [0x7fbfaad481a9] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkCommonCore-6.1.so.1(_ZN13vtkObjectBase10UnRegisterEPS_+0x34) [0x7fbfaad45dae] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkCommonCore-6.1.so.1(_ZN19vtkSmartPointerBaseD1Ev+0x45) [0x7fbfaad71357] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkWrappingPython27Core-6.1.so.1(_ZN13vtkPythonUtil19RemoveObjectFromMapEP7_object+0xc3) [0x7fbfab118b25] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/lib/libvtkWrappingPython27Core-6.1.so.1(+0x3e076) [0x7fbfab126076]
693:   /usr/lib/libpython2.7.so.1.0(+0xded37) [0x7fbfad7aed37]
693:   /usr/lib/libpython2.7.so.1.0(PyDict_SetItem+0x6e) [0x7fbfad82a99e]
693:   /usr/lib/libpython2.7.so.1.0(_PyModule_Clear+0x130) [0x7fbfad7fc290]
693:   /usr/lib/libpython2.7.so.1.0(PyImport_Cleanup+0x18b) [0x7fbfad7fc71b]
693:   /usr/lib/libpython2.7.so.1.0(Py_Finalize+0x11b) [0x7fbfad777fdb]
693:   /usr/lib/libpython2.7.so.1.0(Py_Exit+0x8) [0x7fbfad7782f8]
693:   /usr/lib/libpython2.7.so.1.0(+0xa8424) [0x7fbfad778424]
693:   /usr/lib/libpython2.7.so.1.0(PyErr_PrintEx+0x205) [0x7fbfad7774b5]
693: /usr/lib/libpython2.7.so.1.0(PyRun_SimpleFileExFlags+0x1fe) [0x7fbfad72dcae]
693:   /usr/lib/libpython2.7.so.1.0(Py_Main+0xbdc) [0x7fbfad72f9cc]
693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/bin/vtkpython(main+0x223) [0x401878] 693: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xed) [0x7fbfadbee76d] 693: /work/ext/ParaView/sqtk-pv/vtk-build-mesa-9.2.0/bin/vtkpython() [0x4014e9]
693: =========================================================
693:
1/1 Test #693: vtkFiltersHybridPython-largeImageOffset ...***Exception: Other 1.42 sec

0% tests passed, 1 tests failed out of 1

Total Test time (real) =   1.88 sec

The following tests FAILED:
        693 - vtkFiltersHybridPython-largeImageOffset (OTHER_FAULT)
Errors while running CTest


On 08/19/2013 05:05 PM, Ian Romanick wrote:
Mesa 9.2 release candidate 1 is now available for testing.

The tag in the GIT repository for Mesa 9.2-rc1 is 'mesa-9.2-rc1'.

Mesa 9.2 release candidate 1 is available for download at
ftp://freedesktop.org/pub/mesa/9.2/

md5sums:

866e9a1b3ce72b822671ee8106821aec  MesaLib-9.2.0-rc1.tar.bz2
4506de8ad53e8dc16ba10508e1b9783b  MesaLib-9.2.0-rc1.tar.gz
d4f91a3982bed348291c69c92d883acc  MesaLib-9.2.0-rc1.zip

I have verified building from the .tar.bz2 file by doing:

tar -xjf Mesa-9.2.0-rc1.tar.bz2
cd Mesa-9.2.0-rc1
./configure --enable-gallium-llvm --with-llvm-shared-libs
make -j6
make install

I have also verified that I pushed the tag.

I had originally intended to start doing RCs several weeks ago. However, basically, I forgot. The 9.2 release is scheduled for this Thursday. If folks would like to delay the due to the non-availability of RCs, please speak up. I'd rather not, but, since I fell down on the job, I won't argue if others would like a delay.

Thanks to Sven Joachim for reminding me. :)
_______________________________________________
mesa-dev mailing list
mesa-dev@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/mesa-dev

_______________________________________________
mesa-dev mailing list
mesa-dev@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/mesa-dev

Reply via email to