-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Hi Julien, The server is an SSD-based Hyper-V virtual machine running Debian GNU/Linux with Python 3.9.2 and PostgreSQL 13. We have 32 GB of RAM and only 4 are used so there is no swapping and there is no I/O wait while looking at "top". There is no other application running on this server, and no other connected users while loading documents. I tried to look at pg_stat_activity but didn't found any useful information...
Thierry - -- - -- https://www.ulthar.net -- http://pyams.readthedocs.io On 2023-06-06 at 07:24, jul...@perdition.city wrote: > On Tue, Jun 06, 2023 at 09:17:18AM +0200, Thierry Florac wrote: > > Hi! > > Hello, > > > I'm working on a Pyramid application using ZODB and RelStorage to store > > Python objects into a PostgreSQL database. > > This application is a document management application using many file blobs > > which are stored on the filesystem (not in PostgreSQL), and a catalog is > > used to index documents metadatas. The application is running in an Apache > > process using mod_wsgi. > > My question is that we have another application which is used to transfer > > documents from another repository to this one; this application is only > > using one process and one thread to avoid ZODB conflicts on catalog > > updates; when the application is started, we handle approximately 120 > > transactions/minute and everything is OK but after 50 to 60 minutes, > > transactions rate is highly decreasing down to 30 tpm! > > While looking at server processes, it seems that most activity is related > > to PostgreSQL; I tried to disable autovacuum but it doesn't change > > anything! If I reload Apache service, the transaction rate is restarting at > > 120 tpm before decreasing after another hour of high activity... > > So, does anyone have any idea about the origin of this increase in > > PostgreSQL activity and performance decrease? > > > > Hard to say, is it I/O bound? CPU bound? Did you check pg_stat_activity? > Do you log slow queries? What's your server / postgresql configuration? > > > Best regards, > > Thierry > > -- > > https://www.ulthar.net -- http://pyams.readthedocs.io > > > > -- > > You received this message because you are subscribed to the Google Groups "pylons-discuss" group. > > To unsubscribe from this group and stop receiving emails from it, send an email to pylons-discuss+unsubscr...@googlegroups.com. > > To view this discussion on the web visit https://groups.google.com/d/msgid/pylons-discuss/CAPX_VWCNmjC6xvkRT8RnfHENEnP9KW2S3F5Eqc0BCt5M6y4ouA%40mail.gmail.com. > > -- > Julien Cigar > Belgian Biodiversity Platform (http://www.biodiversity.be) > PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 > No trees were killed in the creation of this message. > However, many electrons were terribly inconvenienced. > > -- > You received this message because you are subscribed to the Google Groups "pylons-discuss" group. > To unsubscribe from this group and stop receiving emails from it, send an email to pylons-discuss+unsubscr...@googlegroups.com. > To view this discussion on the web visit https://groups.google.com/d/msgid/pylons-discuss/gu7jtudne4gcfbfg2tnoyat2lgjawj46yfaqejw3v3cx3eyieg%40kizwmzrppuox. -----BEGIN PGP SIGNATURE----- Version: FlowCrypt Email Encryption 8.4.7 Comment: Seamlessly send and receive encrypted email wsBzBAEBCAAnBYJkfuaICZAeEMoZ8dg1JhYhBFGZiY9tHFonIsnSNh4Qyhnx 2DUmAABM4Af/XpkJXxLXwJxcXH+AWSC/4iXu64JRqOPQ5zcezr2ycd7YI9tk J557Y9cxbnK1v4S90FqLS0Z1lgwAmtzEiGOQ/f9ulW2Suimiw1hieAR+tvkV 0X4pooziZwi6vavu+ObnK+rOVYC8mPkowdn4wbn5R7ROZF5Mle3PkrtdSUc3 HHh1jOiwU3r5hMfIHLB6cEUUqnLAD0wZbZUaWm1eo6urdG+N6AAfue8obQdM neyBUfhHCPfYxcUMwaggsGH/AmP7iLofFQJkjWhXwgNKbsg5mZj1OTVDdaMZ XHHpCFkBfQrZaG5WwuK838qCuMTc8irqJXxYF2IFZ+iIFhMS3oLeIQ== =u64S -----END PGP SIGNATURE----- -- You received this message because you are subscribed to the Google Groups "pylons-discuss" group. To unsubscribe from this group and stop receiving emails from it, send an email to pylons-discuss+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/pylons-discuss/CAPX_VWBpyL%2BHSQ9QhJ4dWd1%3Do1YA8vBwLnF_RuHiwH-EqBiOkw%40mail.gmail.com.
0x1E10CA19F1D83526.asc
Description: application/pgp-keys
