george-zubrienko commented on issue #1202: URL: https://github.com/apache/polaris/issues/1202#issuecomment-2737219209
Additional update, it seems that current version performs pretty much as bad (under load) as the commit we used 2 months ago. Adding index `create index concurrently entities_active_lookup_by_name on entities_active (catalogid, parentid, typecode) include (name);`, along with seqscan=off helps to minimize transaction commit rejections by encouraging index lookups. This however doesn't guarantee no issues and webhost to db communication is quite unstable. I've just tested with 60 containers that do microbatch updates by staging batches into a table via Iceberg Java client and around 5% of requests issued towards Polaris from Trino or from Iceberg Java Client fail to go through. For such a low load Polaris also generates quite some load on the DB:  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
