Re: pyignite - performance issue

2023-03-14 Thread Ivan Daschinsky
It seems that epoll-shim can help to mitigate this issue without much code. вт, 14 мар. 2023 г. в 21:11, Ivan Daschinsky : > Yep, it has been broken since the introduction of epoll in the network > code. So kqueue support needs to be implemented. > > вт, 14 мар. 2023 г. в 19:22, Stephen

Re: pyignite - performance issue

2023-03-14 Thread Ivan Daschinsky
Yep, it has been broken since the introduction of epoll in the network code. So kqueue support needs to be implemented. вт, 14 мар. 2023 г. в 19:22, Stephen Darlington < stephen.darling...@gridgain.com>: > Macs don’t have epoll, so it doesn’t compile currently. > > On 14 Mar 2023, at 16:02, Igor

Re: pyignite - performance issue

2023-03-14 Thread Stephen Darlington
Macs don’t have epoll, so it doesn’t compile currently. > On 14 Mar 2023, at 16:02, Igor Sapego wrote: > > Unfortunately, we do not have Mac agents, so we can not detect when > compilation on Mac OS is broken, so yeah... > > Best Regards, > Igor > > > On Tue, Mar 14, 2023 at 2:48 PM Ivan

Re: pyignite - performance issue

2023-03-14 Thread Igor Sapego
Unfortunately, we do not have Mac agents, so we can not detect when compilation on Mac OS is broken, so yeah... Best Regards, Igor On Tue, Mar 14, 2023 at 2:48 PM Ivan Daschinsky wrote: > An ignite odbc driver works well on linux and windows OSes, but it seems > that it is impossible to

Re: pyignite - performance issue

2023-03-14 Thread Ivan Daschinsky
An ignite odbc driver works well on linux and windows OSes, but it seems that it is impossible to compile it on Mac OS. вт, 14 мар. 2023 г. в 14:47, Ivan Daschinsky : > Hi, Dren! > > Unfortunatelly, pyignite doesn't have an efficient native serialization > library, whereas psycopg2 has (it is a

Re: pyignite - performance issue

2023-03-14 Thread Ivan Daschinsky
Hi, Dren! Unfortunatelly, pyignite doesn't have an efficient native serialization library, whereas psycopg2 has (it is a thin wrapper around libpq). I would suggest two options: 1. Reduce a default batch size like this : `client.sql("SELECT * FROM TABLE", page_size=10)`. Default 1024 seems too

Re: pyignite - performance issue

2023-03-14 Thread Dren Butković
Ignite and py client versions: - Apache Ignite 2.13.0 - pyignite 0.5.2 On Tue, Mar 14, 2023 at 11:46 AM Zhenya Stanilovsky via user < user@ignite.apache.org> wrote: > Hi, plz append ignite and py client versions. > > > Hi, > > I made a speed comparison of retrieving data from Apache Ignite

Re: pyignite - performance issue

2023-03-14 Thread Zhenya Stanilovsky via user
Hi, plz append ignite and py client versions.   >Hi, >I made a speed comparison of retrieving data from Apache Ignite using several >methods. All records are in one table, I did not use any WHERE condition, only >a SELECT * FROM TABLE XYZ LIMIT 2. >Test results are: >Apache Ignite >*

pyignite - performance issue

2023-03-14 Thread Dren Butković
Hi, I made a speed comparison of retrieving data from Apache Ignite using several methods. All records are in one table, I did not use any WHERE condition, only a SELECT * FROM TABLE XYZ LIMIT 2. Test results are: Apache Ignite - Apache Ignite REST API - 0.52 seconds - JDBC - 4