Re: [naviserver-devel] Quest for malloc

2006-12-19 Thread Zoran Vasiljevic
On 19.12.2006, at 01:10, Stephen Deasey wrote: This program allocates memory in a worker thread and frees it in the main thread. If all free()'s put memory into a thread-local cache then you would expect this program to bloat, but it doesn't, so I guess it's not a problem (at least not on

Re: [naviserver-devel] Quest for malloc

2006-12-19 Thread Zoran Vasiljevic
On 19.12.2006, at 15:57, Vlad Seryakov wrote: Zoran, can you test it on Solaris and OSX so we'd know that is not Linux related problem. I have a Tcl library compiled with nedmalloc and when I link against it and make #define MemAlloc Tcl_Alloc #define MemFree Tcl_Free it runs fine.

Re: [naviserver-devel] Quest for malloc

2006-12-19 Thread Vlad Seryakov
Yes, please Zoran Vasiljevic wrote: On 19.12.2006, at 15:57, Vlad Seryakov wrote: Zoran, can you test it on Solaris and OSX so we'd know that is not Linux related problem. I have a Tcl library compiled with nedmalloc and when I link against it and make #define MemAlloc Tcl_Alloc #define

Re: [naviserver-devel] Quest for malloc

2006-12-19 Thread Zoran Vasiljevic
On 19.12.2006, at 16:06, Vlad Seryakov wrote: Yes, please ( I appended the code to the nedmalloc test program and renamed their main to main1) bash-2.03$ gcc -O3 -o tcltest tcltest.c -lpthread -DNDEBUG - DTCL_THREADS -I/usr/local/include -L/usr/local/lib -ltcl8.4g bash-2.03$ gdb

Re: [naviserver-devel] Quest for malloc

2006-12-19 Thread Vlad Seryakov
gdb may slow down concurrency, does it run without gdb, also does it run with solaris malloc? Zoran Vasiljevic wrote: On 19.12.2006, at 16:06, Vlad Seryakov wrote: Yes, please ( I appended the code to the nedmalloc test program and renamed their main to main1) bash-2.03$ gcc -O3 -o

Re: [naviserver-devel] Quest for malloc

2006-12-19 Thread Vlad Seryakov
I was suspecting Linux malloc, looks like it has problems with high concurrency, i tried to replace MemAlloc/Fre with mmap/munmap, and it crashes as well. #define MemAlloc mmalloc #define MemFree(ptr) mfree(ptr, gSize) void *mmalloc(size_t size) { return

Re: [naviserver-devel] Quest for malloc

2006-12-19 Thread Vlad Seryakov
yes, it crashes when number of threads are more than 1 with any size but not all the time, sometimes i need to run it several times, looks like it is random, some combination, not sure of what. I guess we never got that high concurrency in Naviserver, i wonder if AOL has randomm crashes.

Re: [naviserver-devel] Quest for malloc

2006-12-19 Thread Zoran Vasiljevic
On 19.12.2006, at 16:35, Vlad Seryakov wrote: yes, it crashes when number of threads are more than 1 with any size but not all the time, sometimes i need to run it several times, looks like it is random, some combination, not sure of what. I guess we never got that high concurrency in

Re: [naviserver-devel] Quest for malloc

2006-12-19 Thread Stephen Deasey
On 12/19/06, Vlad Seryakov [EMAIL PROTECTED] wrote: yes, it crashes when number of threads are more than 1 with any size but not all the time, sometimes i need to run it several times, looks like it is random, some combination, not sure of what. I guess we never got that high concurrency in

Re: [naviserver-devel] Quest for malloc

2006-12-19 Thread Vlad Seryakov
I converted all to use pthreads directly instead of Tcl wrappers, and now it does not crash anymore. Will continue testing but it looks like Tcl is the problem here, not ptmalloc Stephen Deasey wrote: On 12/19/06, Vlad Seryakov [EMAIL PROTECTED] wrote: yes, it crashes when number of threads

Re: [naviserver-devel] Quest for malloc

2006-12-19 Thread Vlad Seryakov
I have no idea, i spent too much time on this still without realizing what i am doing and what to expect :-))) Zoran Vasiljevic wrote: On 19.12.2006, at 17:08, Vlad Seryakov wrote: I converted all to use pthreads directly instead of Tcl wrappers, and now it does not crash anymore. Will

Re: [naviserver-devel] Quest for malloc

2006-12-19 Thread Stephen Deasey
On 12/19/06, Zoran Vasiljevic [EMAIL PROTECTED] wrote: On 19.12.2006, at 17:08, Vlad Seryakov wrote: I converted all to use pthreads directly instead of Tcl wrappers, and now it does not crash anymore. Will continue testing but it looks like Tcl is the problem here, not ptmalloc Where does

Re: [naviserver-devel] Quest for malloc

2006-12-19 Thread Vlad Seryakov
Right, with Ns_ functions it does not crash. Stephen Deasey wrote: On 12/19/06, Zoran Vasiljevic [EMAIL PROTECTED] wrote: On 19.12.2006, at 17:08, Vlad Seryakov wrote: I converted all to use pthreads directly instead of Tcl wrappers, and now it does not crash anymore. Will continue testing

Re: [naviserver-devel] Quest for malloc

2006-12-19 Thread Stephen Deasey
On 12/19/06, Vlad Seryakov [EMAIL PROTECTED] wrote: Right, with Ns_ functions it does not crash. Zoran will be happy... :-)

Re: [naviserver-devel] Quest for malloc

2006-12-19 Thread Zoran Vasiljevic
On 19.12.2006, at 20:42, Stephen Deasey wrote: On 12/19/06, Vlad Seryakov [EMAIL PROTECTED] wrote: Right, with Ns_ functions it does not crash. Zoran will be happy... :-) Not at all! So, I would like to know exactly how to reproduce the problem (what OS, machine, etc). Furthermore I