Re: [sqlite] Windows performance problems associated with malloc()

2010-12-20 Thread Max Vlasov
On Fri, Dec 17, 2010 at 7:29 PM, Richard Hipp wrote: > > For certain full-text search queries against a large database, we are > seeing > speeds which are 3x faster when using "-heap 300M" (the memsys5 memory > allocator) versus omitting the -heap option and thus using system

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-19 Thread Yoni Londner
Hi, Windows malloc is slow. There is nothing you can do about it. I have seen huge difference in the same code running on Linux vs Windows (Code which mostly do malloc/realloc/free). I am using google perftools (http://code.google.com/p/google-perftools/) to accelerate malloc. Actually, I am

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-18 Thread Cory Nelson
On Sat, Dec 18, 2010 at 7:29 AM, Marcus Grimm wrote: > Interesting. Thanks for pointing to this. > Please note that this reference is 9 years old, we observed > that problem by moving to VS2008, not in older versions. > Anyway, I agree that this threshold issue is wierd -

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-18 Thread Marcus Grimm
..@sqlite.org > [mailto:sqlite-users-boun...@sqlite.org] > On Behalf Of Marcus Grimm > Sent: Saturday, December 18, 2010 5:31 AM > To: General Discussion of SQLite Database > Subject: EXTERNAL:Re: [sqlite] Windows performance problems associated > with > malloc() > >>

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-18 Thread Marcus Grimm
] On Behalf Of Marcus Grimm >> Sent: Friday, December 17, 2010 9:21 AM >> To: General Discussion of SQLite Database >> Subject: Re: [sqlite] Windows performance problems associated with >> malloc() >> >>> An SQLite user has brought to our attention a performance issu

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-18 Thread Max Vlasov
On Fri, Dec 17, 2010 at 7:29 PM, Richard Hipp wrote: > If you have any large queries that you can run on windows using the > command-line shell, I would appreciate you timing those queries using the > new shells from the download page, both with "-heap 300M" and without it, >

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-18 Thread Ben Harper
This is low probability, but maybe the Fault Tolerant Heap is turned on for sqlite.exe? I believe you'll see the exe mentioned in here if that is the case: HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\FTH\State FTH was introduced in Windows 7. Ben ___

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-17 Thread Richard Hipp
On Fri, Dec 17, 2010 at 12:21 PM, Marcus Grimm wrote: > > I'm unable to run your sqlite3.exe: MSVCR100.dll no found. > I have uploaded new executables, built in such a way (I hope) that no longer requires MSVCR100.dll. Please try again and let me know if the new

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-17 Thread Shane Harrelson
- > From: sqlite-users-boun...@sqlite.org > [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Marcus Grimm > Sent: Friday, December 17, 2010 9:21 AM > To: General Discussion of SQLite Database > Subject: Re: [sqlite] Windows performance problems associated with malloc() > &

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-17 Thread Doug
...@sqlite.org] On Behalf Of Marcus Grimm Sent: Friday, December 17, 2010 9:21 AM To: General Discussion of SQLite Database Subject: Re: [sqlite] Windows performance problems associated with malloc() > An SQLite user has brought to our attention a performance issue in > SQLite that

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-17 Thread Drake Wilson
Quoth Richard Hipp , on 2010-12-17 15:12:58 -0500: > Can somebody with windows-foo please explain to me what I need to do to > vs2010 so that it generates exe file that doe not depend on non-standard > DLLs? AFAIK, the platform-approved solution is to distribute the C runtime

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-17 Thread John Drescher
On Fri, Dec 17, 2010 at 3:12 PM, Richard Hipp wrote: > On Fri, Dec 17, 2010 at 2:27 PM, John Drescher wrote: > >> > >> > I'm unable to run your sqlite3.exe: MSVCR100.dll no found. >> > >> That is visual studio 2010 runtime. >> > > Can somebody with

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-17 Thread Igor Tandetnik
On 12/17/2010 3:12 PM, Richard Hipp wrote: > Can somebody with windows-foo please explain to me what I need to do to > vs2010 so that it generates exe file that doe not depend on non-standard > DLLs? If you are building from the command line, specify /MT (/MTd for debug builds) in place of /MD

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-17 Thread Richard Hipp
On Fri, Dec 17, 2010 at 2:27 PM, John Drescher wrote: > > > > I'm unable to run your sqlite3.exe: MSVCR100.dll no found. > > > That is visual studio 2010 runtime. > Can somebody with windows-foo please explain to me what I need to do to vs2010 so that it generates exe file

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-17 Thread John Drescher
> > I'm unable to run your sqlite3.exe: MSVCR100.dll no found. > That is visual studio 2010 runtime. John ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-17 Thread Cory Nelson
On Fri, Dec 17, 2010 at 8:29 AM, Richard Hipp wrote: > I also observe that compiling for 64-bit using vs2010 (not an option with my > ancient version 2.95.3 gcc cross-compiler) that the queries are an > additional 2x faster.  I was surprised at the dramatic performance increase >

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-17 Thread A.J.Millan
From: "Richard Hipp" <d...@sqlite.org> To: "General Discussion of SQLite Database" <sqlite-users@sqlite.org>; <sqlite-...@sqlite.org> Sent: Friday, December 17, 2010 5:29 PM Subject: [sqlite] Windows performance problems associated with malloc() > An

Re: [sqlite] Windows performance problems associated with malloc()

2010-12-17 Thread Marcus Grimm
> An SQLite user has brought to our attention a performance issue in SQLite > that seems to be associated with malloc(). If you have insights or > corroborating experience with this issue please let me know. We recently had a malloc/free slowdown issue after changing to VS2008 in combination

[sqlite] Windows performance problems associated with malloc()

2010-12-17 Thread Richard Hipp
An SQLite user has brought to our attention a performance issue in SQLite that seems to be associated with malloc(). If you have insights or corroborating experience with this issue please let me know. SQLite supports a "zero-malloc option" (see http://www.sqlite.org/malloc.html#memsys5 for