Re: ERROR: too many dynamic shared memory segments

2020-01-31 Thread Thomas Munro
On Fri, Jan 31, 2020 at 11:05 PM Nicola Contu wrote: > Do you still recommend to increase max_conn? Yes, as a workaround of last resort. The best thing would be to figure out why you are hitting the segment limit, and see if there is something we could tune to fix that. If you EXPLAIN your queri

Re: ERROR: too many dynamic shared memory segments

2020-01-31 Thread Thomas Munro
On Thu, Jan 30, 2020 at 12:26 AM Thomas Munro wrote: > On Wed, Jan 29, 2020 at 11:24 PM Julian Backes wrote: > > we only had the "too many shared too many dynamic shared memory segments" > > error but no segmentation faults. The error started occurring after > > upgrading from postgres 10 to po

Re: PostgreSQL Installer issue

2020-01-31 Thread Adrian Klaver
On 1/31/20 12:27 PM, George Weaver wrote: Good afternoon, I am updating a PostgreSQL 10.3 installation to PostgreSQL 10.11 installation on Windows 10 using the EDB installer. On the Select Components dialog, all of the components are selected and not enabled: no component can be de-selected.

PostgreSQL Installer issue

2020-01-31 Thread George Weaver
Good afternoon, I am updating a PostgreSQL 10.3 installation to PostgreSQL 10.11 installation on Windows 10 using the EDB installer. On the Select Components dialog, all of the components are selected and not enabled: no component can be de-selected. George

Re: performance of loading CSV data with COPY is 50 times faster than Perl::DBI

2020-01-31 Thread Brian Dunavant
You can use COPY over DBI. https://metacpan.org/pod/DBD::Pg#COPY-support On Fri, Jan 31, 2020 at 2:03 PM Pavel Stehule wrote: > > > pá 31. 1. 2020 v 19:25 odesílatel Matthias Apitz > napsal: > >> >> Hello, >> >> Since ages, we transfer data between different DBS (Informix, Sybase, >> Oracle, a

Re: performance of loading CSV data with COPY is 50 times faster than Perl::DBI

2020-01-31 Thread Pavel Stehule
pá 31. 1. 2020 v 19:25 odesílatel Matthias Apitz napsal: > > Hello, > > Since ages, we transfer data between different DBS (Informix, Sybase, > Oracle, and now PostgreSQL) with our own written tool, based on > Perl::DBI which produces a CSV like export in a common way, i.e. an > export of Oracle

Re: performance of loading CSV data with COPY is 50 times faster than Perl::DBI

2020-01-31 Thread Adrian Klaver
On 1/31/20 10:24 AM, Matthias Apitz wrote: Hello, Since ages, we transfer data between different DBS (Informix, Sybase, Oracle, and now PostgreSQL) with our own written tool, based on Perl::DBI which produces a CSV like export in a common way, i.e. an export of Oracle can be loaded into Sybase

performance of loading CSV data with COPY is 50 times faster than Perl::DBI

2020-01-31 Thread Matthias Apitz
Hello, Since ages, we transfer data between different DBS (Informix, Sybase, Oracle, and now PostgreSQL) with our own written tool, based on Perl::DBI which produces a CSV like export in a common way, i.e. an export of Oracle can be loaded into Sybase and vice versa. Export and Import is done ro

Re: combination join against multiple tables

2020-01-31 Thread Steven Lembark
On Fri, 31 Jan 2020 14:01:17 + Geoff Winkless wrote: > a | c | c > +-+- > 1 | 111 | 211 > 1 | 112 | > 2 | 121 | > 2 | | 222 > 3 | | > 4 | 141 | > 5 | | 253 > 6 | | > 7 | | > 8 | | > 9 | | > 10 | | The c's look just like

Re: combination join against multiple tables

2020-01-31 Thread Steven Lembark
On Fri, 31 Jan 2020 14:01:17 + Geoff Winkless wrote: > Hi > > I have a query involving multiple tables that I would like to return > in a single query. That means returning multiple sets of the data > from the first base table, but that's acceptable for the simplicity > in grabbing all the d

Re: Add column with default value in big table - splitting of updates can help?

2020-01-31 Thread Adrian Klaver
On 1/31/20 5:43 AM, Durumdara wrote: Hello! a.) PG version is mainly 9.6, but some of the servers are 10.x or 11.x. b.) We have semi-automatic tool which get the a new modifications on databases, and execute them at once by database. So one SQL script by one database, under one transaction - w

Re: How to restore to empty database

2020-01-31 Thread Adrian Klaver
On 1/30/20 10:21 PM, Andrus wrote: Hi! These days 37 GB is relatively small, so you maybe getting into the realm of premature optimization. Do the 24 databases represent an entire cluster you are trying to transfer? Basically yes. Cluster contains also  small test database which actually doe

Re: combination join against multiple tables

2020-01-31 Thread Geoff Winkless
On Fri, 31 Jan 2020 at 15:25, David G. Johnston wrote: > On Friday, January 31, 2020, Geoff Winkless wrote: > >> Now the problem is that I would like to return all the rows from a, but >> with a single row where t2.b and t1.b match. >> > > So, the final,number of rows for each “a” is the larger

Re: combination join against multiple tables

2020-01-31 Thread David G. Johnston
On Friday, January 31, 2020, Geoff Winkless wrote: > Now the problem is that I would like to return all the rows from a, but > with a single row where t2.b and t1.b match. > So, the final,number of rows for each “a” is the larger row count of “b” and “c” having the same “a”. Furthermore for the

combination join against multiple tables

2020-01-31 Thread Geoff Winkless
Hi I have a query involving multiple tables that I would like to return in a single query. That means returning multiple sets of the data from the first base table, but that's acceptable for the simplicity in grabbing all the data in one hit. An example set: CREATE TABLE t1 (a int, b int, c int)

Re: Add column with default value in big table - splitting of updates can help?

2020-01-31 Thread Durumdara
Hello! a.) PG version is mainly 9.6, but some of the servers are 10.x or 11.x. b.) We have semi-automatic tool which get the a new modifications on databases, and execute them at once by database. So one SQL script by one database, under one transaction - whole or nothing. If something failed, we

RE: Need support on tuning at the time of index creation

2020-01-31 Thread Sandip Pradhan
Hi Peter, Thanks for your time. Out Postgresql version: 9.5.9.14. We are using COPY command to insert rows into the tables. While running COPY command, all indexes dropped. After successfully inserting all the rows, we are trying to create all those indexes. Example of index creation script:

RE: Need support on tuning at the time of index creation

2020-01-31 Thread Sandip Pradhan
Currently maintenance_work_mem set to 25 GB. Regards, [cid:image002.png@01D5D84D.47F72BC0] Sandip Pradhan Tech Lead BDGS SD IN BSS EOC_ECM 1 Mobile: 9830880856 sandip.prad...@ericsson.com Ericsson DLF IT Park - II, DLF SEZ Block 1A,

Re: ERROR: too many dynamic shared memory segments

2020-01-31 Thread Nicola Contu
Hi Thomas, unfortunately I can't find any core dump to help you more. Thanks for the fix, we are in the process of installing 12.1 in production, so we can still wait on this release and go live with 12.2 I will let you know at this point if I still get this after installing 12.2 trying to build a

Re: Need support on tuning at the time of index creation

2020-01-31 Thread Jayadevan M
On Fri, Jan 31, 2020 at 3:22 PM Sandip Pradhan wrote: > Hi Ron, > > Thanks for your time. > > We are using the version 9.5.9.14. > May be you could try tweaking maintenance_work_mem? Regards, Jayadevan

RE: Need support on tuning at the time of index creation

2020-01-31 Thread Sandip Pradhan
Hi Ron, Thanks for your time. We are using the version 9.5.9.14. Regards,   Sandip Pradhan Tech Lead   BDGS SD IN BSS EOC_ECM 1 Mobile: 9830880856 sandip.prad...@ericsson.com   Ericsson DLF IT Park - II, DLF SEZ Block 1A, Rajarhat 700156, Kolkata, West Bengal India ericsson.com -Original