Re: [sqlalchemy] Question about ShardedQuery Gevent parallelization

2018-08-23 Thread Carson Ip
Hi Mike, Thanks for your detailed reply and your work on sqlalchemy. When I was researching about the issue, I have already read your blog post about asyncio. It was very insightful. Let me briefly describe my setup. Benchmark setup: 2 MySQL database nodes, total 90 shards (databases). On

Re: [sqlalchemy] Question about ShardedQuery Gevent parallelization

2018-08-22 Thread Mike Bayer
On Wed, Aug 22, 2018 at 6:03 AM, Carson Ip wrote: > This is my first post here. > > Software / Library versions: (tho unrelated) > sqlalchemy version: 1.0.19 > db: MySQL 5.6 > db driver: mysqlclient 1.3.7 > > Background: > I have 6 databases with a total of hundreds of shards. I realize when I

[sqlalchemy] Question about ShardedQuery Gevent parallelization

2018-08-22 Thread Carson Ip
This is my first post here. Software / Library versions: (tho unrelated) sqlalchemy version: 1.0.19 db: MySQL 5.6 db driver: mysqlclient 1.3.7 Background: I have 6 databases with a total of hundreds of shards. I realize when I add more database hosts (and shards), my ShardedSession which