Hi ParaView list,
I am trying to set up a offscreen rendering setup with the current ParaView master (g5493984) and OSMesa. The target platform is a CPU-only cluster with several nodes, each containing four sockels with AMD Bulldozer CPUs (64 physical cores per node). I get everything up and running in parallel, connections via rc work perfectly and I can load my data. But the problems start with rendering the data. Do you have any recommendations which versions of OSMesa and llvmpipe are tested and stable? The recommendations in the wiki http://www.paraview.org/Wiki/ParaView/ParaView_And_Mesa_3D#OSMesa.2C_Mesa_without_graphics_hardware http://www.paraview.org/Wiki/ParaView/Users_Guide/Parallel_Rendering Look a bit outdated to me. E.g. - Mesa 9.2.5 (and newer versions) already split libgl and libglu which versions are recommended? - does OSMesa Gallium llvmpipe run with llvm X.Y (e.g. 3.3) ? - what do I have to set for the DISPLAY environment with OSMesa ? - is it necessary/forbidden to have a X11 server running in that setup (on the server nodes)? - I am confused if the mentioned "SOFTWARE_DEPTH_BITS=31" bug is already fixed in mesa - are some of my dependencies (OpenMPI, gcc, python) too new/old ? I configured the server side with a whole bunch of flags now: cmake -DCMAKE_INSTALL_PREFIX=$HOME/bin/paraview-4.1.0-1008-g5493984 \ -DPARAVIEW_BUILD_QT_GUI=OFF -DBUILD_TESTING=OFF \ -DCMAKE_BUILD_TYPE=Debug -DPARAVIEW_ENABLE_CATALYST=OFF \ -DPARAVIEW_ENABLE_PYTHON=ON -DPARAVIEW_USE_MPI=ON \ -DPARAVIEW_USE_SYSTEM_MPI4PY=ON -DVTK_USE_X=OFF \ -DOPENGL_INCLUDE_DIR=$MESA_ROOT/include \ -DOSMESA_INCLUDE_DIR=$MESA_ROOT/include -DVTK_OPENGL_HAS_OSMESA=ON \ -DOPENGL_gl_LIBRARY=IS-NOTFOUND \ -DOPENGL_glu_LIBRARY=$MESA_ROOT/lib/libGLU.so \ -DOSMESA_LIBRARY=$MESA_ROOT/lib/libOSMesa.so -DVTK_USE_OFFSCREEN=ON \ -DPARAVIEW_BUILD_PLUGIN_AdiosReader=ON \ -DVTK_Group_MPI=ON -DVTK_Group_Imaging=ON -DVTK_Group_Rendering=ON \ -DVTK_XDMF_USE_MPI=ON -DXDMF_BUILD_MPI=ON \ -GNinja ~/src/ParaView and I am starting my servers with mpiexec -npernode 8 -n 32 `which pvserver` --use-offscreen-rendering \ -sp=$NUM_PORT -rc -ch=$HEAD_NODE and used the following separately compiled dependencies: - python 2.7.5 - icet 2.1.1 (probably compiled again by paraview) - gcc 4.8.2 - OpenMPI 1.7.4 (with infiniband support) - cmake 2.8.10 I tried a couple of flags for more than two weeks, three different OSMesa versions, environment tweaks, ... but never ended up with a stable setup (as soon as server side rendering kicks in). I can trigger that by loading a sphere, setting the remote/local rendering threshold to 0MB. and usually end up with an error in OpenGLInit (see attached). Do you have any ideas? Best regards, Axel Huebl -- Axel Huebl Diploma Student Phone +49 351 260 3582 https://www.hzdr.de/crp Computational Radiation Physics Laser Particle Acceleration Division Helmholtz-Zentrum Dresden - Rossendorf e.V. Bautzner Landstrasse 400, 01328 Dresden POB 510119, D-01314 Dresden Vorstand: Prof. Dr.Dr.h.c. R. Sauerbrey Prof. Dr.Dr.h.c. P. Joehnk VR 1693 beim Amtsgericht Dresden
pvserver:14882 terminated with signal 11 at PC=7ffa825f2b1f SP=7fff658441b8. Backtrace: /lib/x86_64-linux-gnu/libc.so.6(+0x92b1f)[0x7ffa825f2b1f] /lib/x86_64-linux-gnu/libc.so.6(+0x7d700)[0x7ffa825dd700] /lib/x86_64-linux-gnu/libc.so.6(vsscanf+0x60)[0x7ffa825d18c0] /lib/x86_64-linux-gnu/libc.so.6(_IO_sscanf+0x87)[0x7ffa825bd3f7] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkRenderingOpenGL-pv4.1.so.1(_ZN25vtkOpenGLExtensionManager20ReadOpenGLExtensionsEv+0x200)[0x7ffa77166ec0] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkRenderingOpenGL-pv4.1.so.1(_ZN25vtkOpenGLExtensionManager6UpdateEv+0x4b)[0x7ffa7716611b] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkRenderingOpenGL-pv4.1.so.1(_ZN25vtkOpenGLExtensionManager18ExtensionSupportedEPKc+0x17)[0x7ffa77160f47] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkRenderingOpenGL-pv4.1.so.1(_ZN21vtkOpenGLRenderWindow17OpenGLInitContextEv+0x4a)[0x7ffa771aacaa] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkRenderingOpenGL-pv4.1.so.1(_ZN21vtkOpenGLRenderWindow10OpenGLInitEv+0xd)[0x7ffa771a96bd] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkRenderingOpenGL-pv4.1.so.1(_ZN23vtkOSOpenGLRenderWindow5StartEv+0xd)[0x7ffa7726835d] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkRenderingCore-pv4.1.so.1(_ZN15vtkRenderWindow14DoStereoRenderEv+0x10)[0x7ffa890bd690] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkRenderingCore-pv4.1.so.1(_ZN15vtkRenderWindow10DoFDRenderEv+0x6c7)[0x7ffa890bea77] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkRenderingCore-pv4.1.so.1(_ZN15vtkRenderWindow10DoAARenderEv+0x80d)[0x7ffa890be35d] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkRenderingCore-pv4.1.so.1(_ZN15vtkRenderWindow6RenderEv+0xdf)[0x7ffa890bf90f] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkPVClientServerCoreRendering-pv4.1.so.1(_ZN15vtkPVRenderView6RenderEbb+0x5e6)[0x7ffa7da7c136] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkPVClientServerCoreRendering-pv4.1.so.1(_ZN15vtkPVRenderView11StillRenderEv+0x3c)[0x7ffa7da791fc] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkPVServerManagerApplication-pv4.1.so.1(_Z22vtkPVRenderViewCommandP26vtkClientServerInterpreterP13vtkObjectBasePKcRK21vtkClientServerStreamRS5_Pv+0x13e7)[0x7ffa8abbc457] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkClientServer-pv4.1.so.1(_ZN26vtkClientServerInterpreter19CallCommandFunctionEPKcP13vtkObjectBaseS1_RK21vtkClientServerStreamRS4_+0x14b)[0x7ffa86cae97b] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkClientServer-pv4.1.so.1(_ZN26vtkClientServerInterpreter20ProcessCommandInvokeERK21vtkClientServerStreami+0x14a)[0x7ffa86caec7a] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkClientServer-pv4.1.so.1(_ZN26vtkClientServerInterpreter17ProcessOneMessageERK21vtkClientServerStreami+0x3e6)[0x7ffa86caf6d6] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkClientServer-pv4.1.so.1(_ZN26vtkClientServerInterpreter13ProcessStreamERK21vtkClientServerStream+0x1d)[0x7ffa86cafabd] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkPVServerImplementationCore-pv4.1.so.1(_ZN16vtkPVSessionCore21ExecuteStreamInternalERK21vtkClientServerStreamb+0xf9)[0x7ffa89bd1c39] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkPVServerImplementationCore-pv4.1.so.1(_ZN16vtkPVSessionCore30ExecuteStreamSatelliteCallbackEv+0xa5)[0x7ffa89bd2265] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkParallelCore-pv4.1.so.1(_ZN25vtkMultiProcessController10ProcessRMIEiPvii+0x150)[0x7ffa860884b0] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkParallelCore-pv4.1.so.1(_ZN25vtkMultiProcessController20BroadcastProcessRMIsEii+0x79)[0x7ffa860886b9] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/libvtkParallelCore-pv4.1.so.1(_ZN25vtkMultiProcessController11ProcessRMIsEii+0x2b5)[0x7ffa86088d85] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/pvserver(main+0x209)[0x4018e9] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xed)[0x7ffa8258176d] /home/huebl/bin/paraview-4.1.0-1008-g5493984/lib/paraview-4.1/pvserver[0x401951]
smime.p7s
Description: S/MIME Cryptographic Signature
_______________________________________________ Powered by www.kitware.com Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html Please keep messages on-topic and check the ParaView Wiki at: http://paraview.org/Wiki/ParaView Follow this link to subscribe/unsubscribe: http://public.kitware.com/mailman/listinfo/paraview
