Actually, I tried just creating a domain object (since the address sanitizer was complaining about that code to start with). Simply creating that object gave me a core dump, so I suppose the issue must be there. I got the following message when running the code with -objects_dump flag on the command line, but couldn’t find a problem with the code (I’ve attached it here with only the relevant functions).
Thanks a lot for your help! The following objects were never freed ----------------------------------------- [0] Vec seq y [0] VecCreate() in /home/yyy910805/petsc/src/vec/vec/interface/veccreate.c [0] Vec seq Vec_0x84000000_0 [0] VecCreate() in /home/yyy910805/petsc/src/vec/vec/interface/veccreate.c [0] Vec seq Vec_0x84000000_1 [0] VecCreate() in /home/yyy910805/petsc/src/vec/vec/interface/veccreate.c [0] VecScatter seq VecScatter_0x84000000_2 [0] VecScatterCreate() in /home/yyy910805/petsc/src/vec/vscat/interface/vscreate.c [0] VecScatter seq VecScatter_0x84000000_3 [0] VecScatterCreate() in /home/yyy910805/petsc/src/vec/vscat/interface/vscreate.c [0] VecScatter seq VecScatter_0x84000000_4 [0] VecScatterCreate() in /home/yyy910805/petsc/src/vec/vscat/interface/vscreate.c [0] VecScatter seq VecScatter_0x84000000_5 [0] VecScatterCreate() in /home/yyy910805/petsc/src/vec/vscat/interface/vscreate.c Attempting to use an MPI routine after finalizing MPICH ------------------------------------------------------------------------------------------------------------------------------------------------- From: Matthew Knepley <knep...@gmail.com> Sent: Sunday, March 3, 2019 11:28 AM To: Yuyun Yang <yyan...@stanford.edu> Cc: Zhang, Junchao <jczh...@mcs.anl.gov>; petsc-users@mcs.anl.gov Subject: Re: [petsc-users] AddressSanitizer: attempting free on address which was not malloc()-ed On Sun, Mar 3, 2019 at 1:03 PM Yuyun Yang via petsc-users <petsc-users@mcs.anl.gov<mailto:petsc-users@mcs.anl.gov>> wrote: I tried compiling without the sanitizer and running on valgrind. Got a bunch of errors “Uninitialised value was created by a stack allocation at 0x41B280: ComputeVel_qd::computeVel(double*, double, int&, int)”. There is no memory management code here, so other parts of the code must be relevant. Thanks, Matt HEAP SUMMARY: ==74== in use at exit: 96,637 bytes in 91 blocks ==74== total heap usage: 47,774 allocs, 47,522 frees, 308,253,653 bytes allocated LEAK SUMMARY: ==74== definitely lost: 0 bytes in 0 blocks ==74== indirectly lost: 0 bytes in 0 blocks ==74== possibly lost: 0 bytes in 0 blocks ==74== still reachable: 96,637 bytes in 91 blocks ==74== suppressed: 0 bytes in 0 blocks The error is located in the attached code (I’ve extracted only the relevant functions), but I couldn’t figure out what is wrong. Is this causing the memory corruption/double free error that happens when I execute the code? Thanks a lot for your help. Best regards, Yuyun From: Zhang, Junchao <jczh...@mcs.anl.gov<mailto:jczh...@mcs.anl.gov>> Sent: Friday, March 1, 2019 7:36 AM To: Yuyun Yang <yyan...@stanford.edu<mailto:yyan...@stanford.edu>> Subject: Re: [petsc-users] AddressSanitizer: attempting free on address which was not malloc()-ed On Fri, Mar 1, 2019 at 1:02 AM Yuyun Yang <yyan...@stanford.edu<mailto:yyan...@stanford.edu>> wrote: Actually, I also saw a line at the beginning of valgrind saying "shadow memory range interleaves with an existing memory mapping. ASan cannot proceed properly. ABORTING." I guess the code didn't really run through valgrind since it aborted. Should I remove the address sanitizer flag when compiling? From the message, it seems ASan (not valgrind) aborted. You can try to compile without sanitizer and then run with valgrind. If no problem, then it is probably a sanitizer issue. Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Yuyun Yang Sent: Thursday, February 28, 2019 10:54:57 PM To: Zhang, Junchao Subject: Re: [petsc-users] AddressSanitizer: attempting free on address which was not malloc()-ed Hmm, still getting the same error from address sanitizer even though valgrind shows no errors and no leaks are possible. Should I ignore that error? My results did run alright. Best, Yuyun Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Zhang, Junchao <jczh...@mcs.anl.gov<mailto:jczh...@mcs.anl.gov>> Sent: Wednesday, February 27, 2019 8:27:17 PM To: Yuyun Yang Cc: Matthew Knepley; petsc-users@mcs.anl.gov<mailto:petsc-users@mcs.anl.gov> Subject: Re: [petsc-users] AddressSanitizer: attempting free on address which was not malloc()-ed Try the following to see if you can catch the bug easily: 1) Get error code for each petsc function and check it with CHKERRQ; 2) Link your code with a petsc library with debugging enabled (configured with --with-debugging=1); 3) Run your code with valgrind --Junchao Zhang On Wed, Feb 27, 2019 at 9:04 PM Yuyun Yang <yyan...@stanford.edu<mailto:yyan...@stanford.edu>> wrote: Hi Junchao, This code actually involves a lot of classes and is pretty big. Might be an overkill for me to send everything to you. I'd like to know if I see this sort of error message, which points to this domain file, is it possible that the problem happens in another file (whose operations are linked to this one)? If so, I'll debug a little more and maybe send you more useful information later. Best regards, Yuyun Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Zhang, Junchao <jczh...@mcs.anl.gov<mailto:jczh...@mcs.anl.gov>> Sent: Wednesday, February 27, 2019 6:24:13 PM To: Yuyun Yang Cc: Matthew Knepley; petsc-users@mcs.anl.gov<mailto:petsc-users@mcs.anl.gov> Subject: Re: [petsc-users] AddressSanitizer: attempting free on address which was not malloc()-ed Could you provide a compilable and runnable test so I can try it? --Junchao Zhang On Wed, Feb 27, 2019 at 7:34 PM Yuyun Yang <yyan...@stanford.edu<mailto:yyan...@stanford.edu>> wrote: Thanks, I fixed that, but I’m not actually calling the testScatters() function in my implementation (in the constructor, the only functions I called are setFields and setScatters). So the problem couldn’t have been that? Best, Yuyun From: Zhang, Junchao <jczh...@mcs.anl.gov<mailto:jczh...@mcs.anl.gov>> Sent: Wednesday, February 27, 2019 10:50 AM To: Yuyun Yang <yyan...@stanford.edu<mailto:yyan...@stanford.edu>> Cc: Matthew Knepley <knep...@gmail.com<mailto:knep...@gmail.com>>; petsc-users@mcs.anl.gov<mailto:petsc-users@mcs.anl.gov> Subject: Re: [petsc-users] AddressSanitizer: attempting free on address which was not malloc()-ed On Wed, Feb 27, 2019 at 10:41 AM Yuyun Yang via petsc-users <petsc-users@mcs.anl.gov<mailto:petsc-users@mcs.anl.gov>> wrote: I called VecDestroy() in the destructor for this object – is that not the right way to do it? In Domain::testScatters(), you have many VecDuplicate(,&out), You need to VecDestroy(&out) before doing new VecDuplicate(,&out); How do I implement CHECK ALL RETURN CODES? For each PETSc function, do ierr = ...; CHKERRQ(ierr); From: Matthew Knepley <knep...@gmail.com<mailto:knep...@gmail.com>> Sent: Wednesday, February 27, 2019 7:24 AM To: Yuyun Yang <yyan...@stanford.edu<mailto:yyan...@stanford.edu>> Cc: petsc-users@mcs.anl.gov<mailto:petsc-users@mcs.anl.gov> Subject: Re: [petsc-users] AddressSanitizer: attempting free on address which was not malloc()-ed You call VecDuplicate() a bunch, but VecDestroy() only once in the bottom function. This is wrong. Also, CHECK ALL RETURN CODES. This is the fastest way to find errors. Matt On Wed, Feb 27, 2019 at 2:06 AM Yuyun Yang via petsc-users <petsc-users@mcs.anl.gov<mailto:petsc-users@mcs.anl.gov>> wrote: Hello team, I ran into the address sanitizer error that I hope you could help me with. I don’t really know what’s wrong with the way the code frees memory. The relevant code file is attached. The line number following domain.cpp specifically referenced to the vector _q, which seems a little odd, since some other vectors are constructed and freed the same way. ==1719==ERROR: AddressSanitizer: attempting free on address which was not malloc()-ed: 0x61f0000076c0 in thread T0 #0 0x7fbf195282ca in __interceptor_free (/usr/lib/x86_64-linux-gnu/libasan.so.2+0x982ca) #1 0x7fbf1706f895 in PetscFreeAlign /home/yyy910805/petsc/src/sys/memory/mal.c:87 #2 0x7fbf1731a898 in VecDestroy_Seq /home/yyy910805/petsc/src/vec/vec/impls/seq/bvec2.c:788 #3 0x7fbf1735f795 in VecDestroy /home/yyy910805/petsc/src/vec/vec/interface/vector.c:408 #4 0x40dd0a in Domain::~Domain() /home/yyy910805/scycle/source/domain.cpp:132 #5 0x40b479 in main /home/yyy910805/scycle/source/main.cpp:242 #6 0x7fbf14d2082f in __libc_start_main (/lib/x86_64-linux-gnu/libc.so.6+0x2082f) #7 0x4075d8 in _start (/home/yyy910805/scycle/source/main+0x4075d8) 0x61f0000076c0 is located 1600 bytes inside of 3220-byte region [0x61f000007080,0x61f000007d14) allocated by thread T0 here: #0 0x7fbf19528b32 in __interceptor_memalign (/usr/lib/x86_64-linux-gnu/libasan.so.2+0x98b32) #1 0x7fbf1706f7e0 in PetscMallocAlign /home/yyy910805/petsc/src/sys/memory/mal.c:41 #2 0x7fbf17073022 in PetscTrMallocDefault /home/yyy910805/petsc/src/sys/memory/mtr.c:183 #3 0x7fbf170710a1 in PetscMallocA /home/yyy910805/petsc/src/sys/memory/mal.c:397 #4 0x7fbf17326fb0 in VecCreate_Seq /home/yyy910805/petsc/src/vec/vec/impls/seq/bvec3.c:35 #5 0x7fbf1736f560 in VecSetType /home/yyy910805/petsc/src/vec/vec/interface/vecreg.c:51 #6 0x7fbf1731afae in VecDuplicate_Seq /home/yyy910805/petsc/src/vec/vec/impls/seq/bvec2.c:807 #7 0x7fbf1735eff7 in VecDuplicate /home/yyy910805/petsc/src/vec/vec/interface/vector.c:379 #8 0x4130de in Domain::setFields() /home/yyy910805/scycle/source/domain.cpp:431 #9 0x40c60a in Domain::Domain(char const*) /home/yyy910805/scycle/source/domain.cpp:57 #10 0x40b433 in main /home/yyy910805/scycle/source/main.cpp:242 #11 0x7fbf14d2082f in __libc_start_main (/lib/x86_64-linux-gnu/libc.so.6+0x2082f) SUMMARY: AddressSanitizer: bad-free ??:0 __interceptor_free ==1719==ABORTING Thanks very much! Yuyun -- What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead. -- Norbert Wiener https://www.cse.buffalo.edu/~knepley/<http://www.cse.buffalo.edu/~knepley/> -- What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead. -- Norbert Wiener https://www.cse.buffalo.edu/~knepley/<http://www.cse.buffalo.edu/~knepley/>
#include "domain.hpp" using namespace std; Domain::Domain(const char *file) : _file(file),_delim(" = "),_inputDir("unspecified_"),_outputDir(" "), _bulkDeformationType("linearElastic"), _momentumBalanceType("quasidynamic"), _sbpType("mfc_coordTrans"),_operatorType("matrix-based"), _sbpCompatibilityType("fullyCompatible"), _gridSpacingType("variableGridSpacing"), _isMMS(0),_loadICs(0), _order(4),_Ny(-1),_Nz(-1),_Ly(-1),_Lz(-1), _vL(1e-9), _q(NULL),_r(NULL),_y(NULL),_z(NULL),_y0(NULL),_z0(NULL),_dq(-1),_dr(-1), _bCoordTrans(-1) { // load data from file loadData(_file); // check domain size and set grid spacing in y direction if (_Ny > 1) { _dq = 1.0 / (_Ny - 1.0); } else { _dq = 1; } // set grid spacing in z-direction if (_Nz > 1) { _dr = 1.0 / (_Nz - 1.0); } else { _dr = 1; } checkInput(); // perform some basic value checking to prevent NaNs setFields(); setScatters(); } // destructor Domain::~Domain() { // free memory VecDestroy(&_q); VecDestroy(&_r); VecDestroy(&_y); VecDestroy(&_z); VecDestroy(&_y0); VecDestroy(&_z0); // set map iterator, free memory from VecScatter map<string,VecScatter>::iterator it; for (it = _scatters.begin(); it != _scatters.end(); it++) { VecScatterDestroy(&(it->second)); } } // construct coordinate transform, setting vectors q, r, y, z PetscErrorCode Domain::setFields() { PetscErrorCode ierr = 0; #if VERBOSE > 1 string funcName = "Domain::setFields"; ierr = PetscPrintf(PETSC_COMM_WORLD,"Starting %s in %s.\n",funcName.c_str(),FILENAME); CHKERRQ(ierr); #endif // generate vector _y with size _Ny*_Nz ierr = VecCreate(PETSC_COMM_WORLD,&_y); CHKERRQ(ierr); ierr = VecSetSizes(_y,PETSC_DECIDE,_Ny*_Nz); CHKERRQ(ierr); ierr = VecSetFromOptions(_y); CHKERRQ(ierr); ierr = PetscObjectSetName((PetscObject) _y, "y"); CHKERRQ(ierr); // duplicate _y into _z, _q, _r ierr = VecDuplicate(_y,&_z); CHKERRQ(ierr); ierr = PetscObjectSetName((PetscObject) _z, "z"); CHKERRQ(ierr); ierr = VecDuplicate(_y,&_q); CHKERRQ(ierr); ierr = PetscObjectSetName((PetscObject) _q, "q"); CHKERRQ(ierr); ierr = VecDuplicate(_y,&_r); CHKERRQ(ierr); ierr = PetscObjectSetName((PetscObject) _r, "r"); CHKERRQ(ierr); // construct coordinate transform PetscInt Ii,Istart,Iend,Jj = 0; PetscScalar *y,*z,*q,*r; ierr = VecGetOwnershipRange(_q,&Istart,&Iend);CHKERRQ(ierr); // return pointers to local data arrays (the processor's portion of vector data) ierr = VecGetArray(_y,&y); CHKERRQ(ierr); ierr = VecGetArray(_z,&z); CHKERRQ(ierr); ierr = VecGetArray(_q,&q); CHKERRQ(ierr); ierr = VecGetArray(_r,&r); CHKERRQ(ierr); // set vector entries for q, r (coordinate transform) and y, z (no transform) for (Ii=Istart; Ii<Iend; Ii++) { q[Jj] = _dq*(Ii/_Nz); r[Jj] = _dr*(Ii-_Nz*(Ii/_Nz)); // matrix-based, fully compatible, allows curvilinear coordinate transformation if (_sbpType.compare("mfc_coordTrans") ) { y[Jj] = (_dq*_Ly)*(Ii/_Nz); z[Jj] = (_dr*_Lz)*(Ii-_Nz*(Ii/_Nz)); } else { // hardcoded transformation (not available for z) if (_bCoordTrans > 0) { y[Jj] = _Ly * sinh(_bCoordTrans * q[Jj]) / sinh(_bCoordTrans); } // no transformation y[Jj] = q[Jj]*_Ly; z[Jj] = r[Jj]*_Lz; } Jj++; } // restore arrays ierr = VecRestoreArray(_y,&y); CHKERRQ(ierr); ierr = VecRestoreArray(_z,&z); CHKERRQ(ierr); ierr = VecRestoreArray(_q,&q); CHKERRQ(ierr); ierr = VecRestoreArray(_r,&r); CHKERRQ(ierr); return ierr; } // scatters values from one vector to another // used to get slip on the fault from the displacement vector, i.e., slip = u(1:Nz); shear stress on the fault from the stress vector sxy; surface displacement; surface heat flux PetscErrorCode Domain::setScatters() { PetscErrorCode ierr = 0; // set _y0 to be zero vector with length _Nz ierr = VecCreate(PETSC_COMM_WORLD,&_y0); CHKERRQ(ierr); ierr = VecSetSizes(_y0,PETSC_DECIDE,_Nz); CHKERRQ(ierr); ierr = VecSetFromOptions(_y0); CHKERRQ(ierr); ierr = VecSet(_y0,0.0); CHKERRQ(ierr); // set _z0 to be zero vector with length _Ny ierr = VecCreate(PETSC_COMM_WORLD,&_z0); CHKERRQ(ierr); ierr = VecSetSizes(_z0,PETSC_DECIDE,_Ny); CHKERRQ(ierr); ierr = VecSetFromOptions(_z0); CHKERRQ(ierr); ierr = VecSet(_z0,0.0); CHKERRQ(ierr); // set up scatter context to take values for y = 0 from body field and put them on a Vec of size Nz PetscInt *indices; IS is; // index set ierr = PetscMalloc1(_Nz,&indices); CHKERRQ(ierr); // we want to scatter from index 0 to _Nz - 1, i.e. take the first _Nz components of the vector to scatter from for (PetscInt Ii = 0; Ii<_Nz; Ii++) { indices[Ii] = Ii; } // creates data structure for an index set containing a list of integers ierr = ISCreateGeneral(PETSC_COMM_WORLD, _Nz, indices, PETSC_COPY_VALUES, &is); CHKERRQ(ierr); // creates vector scatter context, scatters values from _y (at indices is) to _y0 (at indices is) ierr = VecScatterCreate(_y, is, _y0, is, &_scatters["body2L"]); CHKERRQ(ierr); // free memory ierr = PetscFree(indices); CHKERRQ(ierr); ierr = ISDestroy(&is); CHKERRQ(ierr); //=============================================================================== // set up scatter context to take values for y = Ly from body field and put them on a Vec of size Nz // indices to scatter from PetscInt *fi; IS isf; ierr = PetscMalloc1(_Nz,&fi); CHKERRQ(ierr); // we want to scatter from index _Ny*_Nz - _Nz to _Ny*_Nz - 1, i.e. the last _Nz entries of the vector to scatter from for (PetscInt Ii = 0; Ii<_Nz; Ii++) { fi[Ii] = Ii + (_Ny*_Nz-_Nz); } ierr = ISCreateGeneral(PETSC_COMM_WORLD, _Nz, fi, PETSC_COPY_VALUES, &isf); CHKERRQ(ierr); // indices to scatter to PetscInt *ti; IS ist; ierr = PetscMalloc1(_Nz,&ti); CHKERRQ(ierr); for (PetscInt Ii = 0; Ii<_Nz; Ii++) { ti[Ii] = Ii; } ierr = ISCreateGeneral(PETSC_COMM_WORLD, _Nz, ti, PETSC_COPY_VALUES, &ist); CHKERRQ(ierr); ierr = VecScatterCreate(_y, isf, _y0, ist, &_scatters["body2R"]); CHKERRQ(ierr); // free memory ierr = PetscFree(fi); CHKERRQ(ierr); ierr = PetscFree(ti); CHKERRQ(ierr); ierr = ISDestroy(&isf); CHKERRQ(ierr); ierr = ISDestroy(&ist); CHKERRQ(ierr); //============================================================================== // set up scatter context to take values for z = 0 from body field and put them on a Vec of size Ny // indices to scatter from IS isf2; /* creates a data structure for an index set with a list of evenly spaced integers * locally owned portion of index set has length _Ny * first element of locally owned index set is 0 * change to the next index is _Nz (the stride) * takes indices [0, _Nz, 2*_Nz, ..., (_Ny-1)*_Nz] */ ierr = ISCreateStride(PETSC_COMM_WORLD, _Ny, 0, _Nz, &isf2); CHKERRQ(ierr); // indices to scatter to PetscInt *ti2; IS ist2; ierr = PetscMalloc1(_Ny,&ti2); CHKERRQ(ierr); // length _Ny for (PetscInt Ii=0; Ii<_Ny; Ii++) { ti2[Ii] = Ii; } ierr = ISCreateGeneral(PETSC_COMM_WORLD, _Ny, ti2, PETSC_COPY_VALUES, &ist2); CHKERRQ(ierr); ierr = VecScatterCreate(_y, isf2, _z0, ist2, &_scatters["body2T"]); CHKERRQ(ierr); // free memory ierr = PetscFree(ti2); CHKERRQ(ierr); ierr = ISDestroy(&isf2); CHKERRQ(ierr); ierr = ISDestroy(&ist2); CHKERRQ(ierr); //============================================================================== // set up scatter context to take values for z = Lz from body field and put them on a Vec of size Ny // indices to scatter from IS isf3; // takes indices [_Nz - 1, 2*_Nz - 1, ..., _Ny*_Nz - 1] ierr = ISCreateStride(PETSC_COMM_WORLD, _Ny, _Nz - 1, _Nz, &isf3); CHKERRQ(ierr); // indices to scatter to PetscInt *ti3; IS ist3; ierr = PetscMalloc1(_Ny,&ti3); CHKERRQ(ierr); for (PetscInt Ii = 0; Ii<_Ny; Ii++) { ti3[Ii] = Ii; } ierr = ISCreateGeneral(PETSC_COMM_WORLD, _Ny, ti3, PETSC_COPY_VALUES, &ist3); CHKERRQ(ierr); ierr = VecScatterCreate(_y, isf3, _z0, ist3, &_scatters["body2B"]); CHKERRQ(ierr); // free memory ierr = PetscFree(ti3); CHKERRQ(ierr); ierr = ISDestroy(&isf3); CHKERRQ(ierr); ierr = ISDestroy(&ist3); CHKERRQ(ierr); return ierr; }