Re: [sqlalchemy] Very slow inserts when using sqlalchemy core

2018-10-05 Thread adam . botbyl
Simon, The MySQLdb module performs this operation with very little difference to native (mysql < data.sql) speed, so I'm not concerned on that, the delta was <0.5 seconds In my original example (I didn't know I could pass a dict to the execute to have it fill in the parameters) I built the

Re: [sqlalchemy] Very slow inserts when using sqlalchemy core

2018-10-04 Thread adam . botbyl
Mike, Er, yeah, not TSQL, my old MSSQL days are showing :D meant a str() of sql I'm saying bindparms as the required input format of the params used to re-bind into the sql in the optimal way, for example execute(__table__.insert(), bindparams) would represent a list of dicts. I did a packet

Re: [sqlalchemy] Very slow inserts when using sqlalchemy core

2018-10-04 Thread adam . botbyl
Mike, No, I'm not calling execute 10k times, but I am doing what they do in your example with test_core_insert My code for that is: log.info('Executing sqlalchemy insert() with bindparams as execute param - session.execute(__table__.insert(), bindparams)')

[sqlalchemy] Very slow inserts when using sqlalchemy core

2018-10-04 Thread adam . botbyl
Hi all, Having some very and major performance issues using sqlalchemy to insert data, been trying many different ways but none seem to hold even a close candle to raw MySQLdb connections Versions: sqlalchemy: 1.2.9 MySQLdb: 1.3.13 (bound with mysql+mysqldb connector) MySQL: 14.14 Python: