Re: [sqlite] Big difference in performance between Python and gcc

2011-06-06 Thread Alessandro Marzocchi
2011/6/1 Dominique Pellé : > Alessandro Marzocchi wrote: > >> Hello, >>    I made some preliminary tests for an application storing big >> chunks of data in a sqlite database. I did firsts tests with python >> and they gave me quite impressive results. I then tried to make the >> same test using C.

Re: [sqlite] Big difference in performance between Python and gcc

2011-06-06 Thread Alessandro Marzocchi
On the weekend I had way to test the same code on a linux box... performance there are as expected (with C performing slightly better than python with a ~20% difference in execution times between the two). I'll try disabling thread, as they could give a big performance hit on win system. 2011/6/3

Re: [sqlite] Big difference in performance between Python and gcc

2011-06-02 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 06/02/2011 02:17 PM, Simon Slavin wrote: > Do you understand the strange result the OP reported ? There is no evidence that Python is any way relevant to this issue and the OP appears to have gone silent. I expect the actual cause is how SQLite w

Re: [sqlite] Big difference in performance between Python and gcc

2011-06-02 Thread Edzard Pasma
Op 2-jun-2011, om 23:17 heeft Simon Slavin het volgende geschreven: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > > On 2 Jun 2011, at 7:24pm, Roger Binns wrote: > >> (Incidentally I am the author of a "competing" Python SQLite >> binding and >> hence know exactly which SQLite API calls r

Re: [sqlite] Big difference in performance between Python and gcc

2011-06-02 Thread Simon Slavin
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 2 Jun 2011, at 7:24pm, Roger Binns wrote: > (Incidentally I am the author of a "competing" Python SQLite binding and > hence know exactly which SQLite API calls result from bits of Python hence > being very pedantic about getting these tests the s

Re: [sqlite] Big difference in performance between Python and gcc

2011-06-02 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 06/02/2011 04:38 AM, Simon Slavin wrote: > Python is a bytecode language. That isn't relevant in this case. The code that interfaces Python to SQLite is written in C. The amount of Python bytecode involved in this benchmark is irrelevant. On 0

Re: [sqlite] Big difference in performance between Python and gcc

2011-06-02 Thread Simon Slavin
On 2 Jun 2011, at 8:55am, Dominique Pellé wrote: > Roger Binns wrote: > >> While those are all valid, they don't address the underlying issue which is >> C code taking five times longer than Python code for the same SQLite >> operations. In addition that same "redundant" code is executed behind

Re: [sqlite] Big difference in performance between Python and gcc

2011-06-02 Thread Dominique Pellé
Roger Binns wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On 06/01/2011 12:25 PM, Dominique Pellé wrote: >> [Various optimisations] > > While those are all valid, they don't address the underlying issue which is > C code taking five times longer than Python code for the same SQLite

Re: [sqlite] Big difference in performance between Python and gcc

2011-06-01 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 06/01/2011 12:25 PM, Dominique Pellé wrote: > [Various optimisations] While those are all valid, they don't address the underlying issue which is C code taking five times longer than Python code for the same SQLite operations. In addition that sam

Re: [sqlite] Big difference in performance between Python and gcc

2011-06-01 Thread Dominique Pellé
Alessandro Marzocchi wrote: > Hello, >    I made some preliminary tests for an application storing big > chunks of data in a sqlite database. I did firsts tests with python > and they gave me quite impressive results. I then tried to make the > same test using C. I expected to get execution times

Re: [sqlite] Big difference in performance between Python and gcc

2011-06-01 Thread Jan Hudec
On Wed, Jun 01, 2011 at 09:25:04 +0200, Alessandro Marzocchi wrote: > However I was surprised as the performance got a lot > worse, with execution times being more than 3 times more. I tried > everything I could think of and also peeked at python module's source > but i couldn't find any way to get

[sqlite] Big difference in performance between Python and gcc

2011-06-01 Thread Alessandro Marzocchi
Hi Roger, thank for your answer. I tried to modify programs to match your suggestion, performances improved but are still far from pyhon's ones. (Sorry if this message starts a different thread but i had forwards of single messages disabled so i could not reply to the original post) C modif

Re: [sqlite] Big difference in performance between Python and gcc

2011-06-01 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 06/01/2011 12:25 AM, Alessandro Marzocchi wrote: > The only thing that this program does > is creating a database, making a table where a pair of integer maps > 8192-bytes blobs and writing 100k rows in it. Any suggestions of what > I could be doin

[sqlite] Big difference in performance between Python and gcc

2011-06-01 Thread Alessandro Marzocchi
Hello, I made some preliminary tests for an application storing big chunks of data in a sqlite database. I did firsts tests with python and they gave me quite impressive results. I then tried to make the same test using C. I expected to get execution times to be the same of those of python. How