Actually, this is the configure and make command for the timing info I reported earlier in this thread that Barry said was slow. So, lots more external packages as well as cuda support. I had NJ=16 for this case and was building on a front end for a test bed system that is not very busy - I was probably the only user at the time. But the disk space was NFS mounted.
Dave configure \ --PETSC_DIR=$PETSC_DIR \ --PETSC_ARCH=$PETSC_ARCH \ --download-cmake=yes \ --download-superlu=yes \ --download-superlu_dist=yes \ --download-hwloc=yes \ --download-sundials=yes \ --download-ml=yes \ --download-hypre=yes \ --download-spai=yes \ --download-blacs=yes \ --download-pastix=yes \ --download-mumps=yes \ --download-scalapack=yes \ --download-parmetis=yes \ --download-metis=yes \ --download-ptscotch=yes \ --with-mpi=1 \ --with-mpi-dir=$MPI_ROOT \ --with-openmp=1 \ --with-pthreadclasses=1 \ --with-threadcomm=1 \ --with-cholmod=1 \ --with-cholmod-dir=$PACKAGE_ROOT/SuiteSparse \ --with-umfpack=1 \ --with-umfpack-dir=$PACKAGE_ROOT/SuiteSparse \ --with-blas-lapack-dir=$MKL_ROOT \ --with-cuda=1 \ --with-cuda-arch=sm_20 \ --with-cuda-dir=$CUDA_ROOT \ --with-thrust=1 \ --with-cusp=1 \ --with-cusp-dir=$PACKAGE_ROOT/cusp \ --with-txpetscgpu=1 \ --with-txpetscgpu-dir=$PACKAGE_ROOT/txpetscgpu \ --with-shared-libraries \ --with-debugging=0 \ --with-make-np=$NJ \ --FOPTFLAGS="-O3" \ --COPTFLAGS="-O3" \ --CXXOPTFLAGS="-O3" \ --CUDAOPTFLAGS="-O3" \ --CPPFLAGS="-DGPU_BLAS -I$CUDA_ROOT/include" \ --with-c2html=0 \ --with-large-file-io=1 make all ________________________________________ From: petsc-dev-bounces at mcs.anl.gov [petsc-dev-bounces at mcs.anl.gov] on behalf of Satish Balay [ba...@mcs.anl.gov] Sent: Monday, February 25, 2013 4:13 PM To: For users of the development version of PETSc Subject: Re: [petsc-dev] make -j not supported? Why??? The build script here is doing both configure and make. configure is sequential and slow. Satish On Mon, 25 Feb 2013, Barry Smith wrote: > Parallel build prints someting like: > > >>>>>>>> > ========================================== > Building PETSc using CMake with 5 build threads > ========================================== > Re-run cmake file: Makefile older than: ../CMakeLists.txt > > if it looks like > > libfast in: /home/balay/spetsc/src > libfast in: /home/balay/spetsc/src/sys > libfast in: /home/balay/spetsc/src/sys/classes > > then send configure.log to petsc-maint at mcs.anl.gov so we can see why it is > not using cmake. > > Your compile times are very high, likely you are compiling on some central > file server and all files (including .o) are being moved back and forth > across your network doing the build which will be slow and parallelism won't > help much. It is much better to build on a disk on the machine you are > building for, much faster. > > Barry > > On Feb 25, 2013, at 5:06 PM, "Nystrom, William D" <wdn at lanl.gov> wrote: > > > How do I make sure I am using the cmake based build and not the legacy > > build? My build process > > looks like the following: > > > > NJ=16 > > > > configure \ > > --PETSC_DIR=$PETSC_DIR \ > > --PETSC_ARCH=$PETSC_ARCH \ > > --download-cmake=yes \ > > --download-f-blas-lapack=yes \ > > --with-mpi=1 \ > > --with-mpi-dir=$MPI_ROOT \ > > --with-openmp=1 \ > > --with-pthreadclasses=1 \ > > --with-threadcomm=1 \ > > --with-shared-libraries \ > > --with-debugging=0 \ > > --with-make-np=$NJ \ > > --FOPTFLAGS="-O3" \ > > --COPTFLAGS="-O3" \ > > --CXXOPTFLAGS="-O3" \ > > --with-c2html=0 \ > > --with-large-file-io=1 > > > > make all > > > > ________________________________________ > > From: petsc-dev-bounces at mcs.anl.gov [petsc-dev-bounces at mcs.anl.gov] > > on behalf of Barry Smith [bsmith at mcs.anl.gov] > > Sent: Monday, February 25, 2013 3:49 PM > > To: For users of the development version of PETSc > > Subject: Re: [petsc-dev] make -j not supported? Why??? > > > > On Feb 25, 2013, at 2:30 PM, Tim Tautges <tautges at mcs.anl.gov> wrote: > > > >> but why its need to not support otherwise-standard make options? > >> Similarly, PETSC_MAKE_STOP_ON_ERROR instead of make -k? > > > > Hmm, with the cmake based build -k seems to work fine, it keeps on going > > compiling everything it can. Without the -k it stops when the first compile > > fails. So it is supporting the "otherwise-standard make options". > > > > Yes, the legacy build which is only a fallback for when cmake fails, is > > funky. Are you using it? If so, let us know why and we'll try to improve > > the cmake version so that you don't need the legacy; even I don't use it > > any more. > > > > Barry > > > >> > >> - tim > >> > >> -- > >> ================================================================ > >> "You will keep in perfect peace him whose mind is > >> steadfast, because he trusts in you." Isaiah 26:3 > >> > >> Tim Tautges Argonne National Laboratory > >> (tautges at mcs.anl.gov) (telecommuting from UW-Madison) > >> phone (gvoice): (608) 354-1459 1500 Engineering Dr. > >> fax: (608) 263-4499 Madison, WI 53706 > >> > > > >