To make more connections, call connect(), and/or use more session objects. Each session uses one connection.
If you see three connections, that means your script has only worked with three connections at once, such as, you opened three Session objects concurrently. Sqlalchemy does not initiate any concurrent operations on its own. Sent from my iPhone > On Apr 8, 2014, at 5:03 AM, Ni Wesley <nisp...@gmail.com> wrote: > > Hi all, > I have a question here. > > Here is my db init code snippet: > > engine = create_engine(db_url, > pool_size=100,max_overflow=150,echo=engine_echo,pool_recycle=3600) > session = scoped_session(sessionmaker(bind=engine)) > metadata = MetaData(bind=engine) > > Then, I use engine to do update/insert operations. > > There is no problem here, then I find during the performance test that, it's > too slow to insert/update mysql server. > When my script running, on mysql server, use mysql 'show processlist;' > command, I see only 2 or 3 active connections kept. > > Then,within my script, I use multiprocessing.pool(defaults to cpu core size, > which is 4 for me) to do mysql insert/update operations. > > Finally, I see 4 or 5 connections kept from mysql server. > > So, seems db operation is bottleneck because I cannot use more connections > yet. > > How to push the conncurrent connections up? I am sure script generating db > tasks are fast enough. > > Thanks. > Wesley > > -- > You received this message because you are subscribed to the Google Groups > "sqlalchemy" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to sqlalchemy+unsubscr...@googlegroups.com. > To post to this group, send email to sqlalchemy@googlegroups.com. > Visit this group at http://groups.google.com/group/sqlalchemy. > For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "sqlalchemy" group. To unsubscribe from this group and stop receiving emails from it, send an email to sqlalchemy+unsubscr...@googlegroups.com. To post to this group, send email to sqlalchemy@googlegroups.com. Visit this group at http://groups.google.com/group/sqlalchemy. For more options, visit https://groups.google.com/d/optout.
