Re: [sqlalchemy] Speeding up inserts of lines with fast_executemany option of pyODBC

2018-01-02 Thread Jevgenij Kusakovskij
Great! Thanks a lot for all your help! On Tuesday, January 2, 2018 at 6:48:35 PM UTC+2, Mike Bayer wrote: > > On Tue, Jan 2, 2018 at 11:24 AM, Jevgenij Kusakovskij > wrote: > > I see... I should have warned that I am new to Python and that questions > of > > this caliber

Re: [sqlalchemy] Speeding up inserts of lines with fast_executemany option of pyODBC

2018-01-02 Thread Mike Bayer
On Tue, Jan 2, 2018 at 11:24 AM, Jevgenij Kusakovskij wrote: > I see... I should have warned that I am new to Python and that questions of > this caliber could be expected. > > If I may ask one more thing, I would like to check with you if it is > possible to achieve the same

Re: [sqlalchemy] Speeding up inserts of lines with fast_executemany option of pyODBC

2018-01-02 Thread Jevgenij Kusakovskij
I see... I should have warned that I am new to Python and that questions of this caliber could be expected. If I may ask one more thing, I would like to check with you if it is possible to achieve the same effect without any custom options by simply the executemany flag in the if clause. It

Re: [sqlalchemy] Speeding up inserts of lines with fast_executemany option of pyODBC

2018-01-02 Thread Mike Bayer
On Tue, Jan 2, 2018 at 9:54 AM, Jevgenij Kusakovskij wrote: >> @event.listens_for(SomeEngine, 'before_cursor_execute') >> def receive_before_cursor_execute(conn, cursor, statement, parameters, >> context, executemany): >> if

Re: [sqlalchemy] Speeding up inserts of lines with fast_executemany option of pyODBC

2018-01-02 Thread Jevgenij Kusakovskij
> > @event.listens_for(SomeEngine, 'before_cursor_execute') > def receive_before_cursor_execute(conn, cursor, statement, parameters, > context, executemany): > if context.execution_options.get('pyodbc_fast_execute', False): > cursor.fast_executemany = True Maybe I am missing

Re: [sqlalchemy] Speeding up inserts of lines with fast_executemany option of pyODBC

2018-01-02 Thread Mike Bayer
On Tue, Jan 2, 2018 at 6:46 AM, Jevgenij Kusakovskij wrote: > I would like to send a large pandas.DataFrame to a remote server running MS > SQL. I am using pandas-0.20.3, pyODBC-4.0.21 and sqlalchemy-1.1.13. > > My first attempt of tackling this problem can be reduced to

[sqlalchemy] Speeding up inserts of lines with fast_executemany option of pyODBC

2018-01-02 Thread Jevgenij Kusakovskij
I would like to send a large pandas.DataFrame to a remote server running MS SQL. I am using pandas-0.20.3, pyODBC-4.0.21 and sqlalchemy-1.1.13. My first attempt of tackling this problem can be reduced to following code: import sqlalchemy as sa engine =