pg_basebackup is taking more time than expected

2018-01-12 Thread Raghavendra Rao J S V
Hi All, We have database with the size of *425GB*. Out of this 425 GB, Around 40 to 60% of space occupied by the indexes. Ram allocated to this machine is 32GB and configuration parameters below. max_connections = 800 shared_buffers = 9GB effective_cache_size = 18GB work_mem = 10MB maintenance_w

Re: pg_basebackup is taking more time than expected

2018-01-12 Thread Stephen Frost
Greetings, * Raghavendra Rao J S V (raghavendra...@gmail.com) wrote: > We have database with the size of *425GB*. Out of this 425 GB, Around 40 to > 60% of space occupied by the indexes. Ram allocated to this machine is > 32GB and configuration parameters below. [...] > In order to take the backu

Re: pg_basebackup is taking more time than expected

2018-01-12 Thread pinker
It will not solve the problem, but maybe try with --checkpoint=fast option. -- Sent from: http://www.postgresql-archive.org/PostgreSQL-general-f1843780.html

Re: pg_basebackup is taking more time than expected

2018-01-13 Thread Raghavendra Rao J S V
Please let me know below details. pg_basebackup utility depends on which are the parameters? Is there any possibility to run the pg_basebackup in multi thread? To improve the speed of the backup of database using pg_basebackup utility we shutdown the database and started alone database services

Re: pg_basebackup is taking more time than expected

2018-01-13 Thread Stephen Frost
Greetings, Please don't top-post on the PG mailing lists. * Raghavendra Rao J S V (raghavendra...@gmail.com) wrote: > pg_basebackup utility depends on which are the parameters? I'm not sure what you're asking here. > Is there any possibility to run the pg_basebackup in multi thread? No, not t

Re: pg_basebackup is taking more time than expected

2018-01-13 Thread Raghavendra Rao J S V
Thank you very much for your prompt response. I am asking in my previous mail as, Does the pg_basebackup depends on any of the postgres configuration parameters likes shared buffer/maintanance_work_memory etc? If yes, which are those configuration parameters, I need to take care/increase the value

Re: pg_basebackup is taking more time than expected

2018-01-13 Thread Stephen Frost
Greetings, * Raghavendra Rao J S V (raghavendra...@gmail.com) wrote: > I am asking in my previous mail as, Does the pg_basebackup depends on any > of the postgres configuration parameters likes shared > buffer/maintanance_work_memory etc? If yes, which are those configuration > parameters, I need

Re: pg_basebackup is taking more time than expected

2018-01-15 Thread Raghavendra Rao J S V
I am looking for the help to minimise the time taken by the pg_basebackup utility. As informed Earlier we are taking the backup of the database using pg_basbackup utility using below command. $PGHOME/bin/pg_basebackup -p 5433 -U postgres -P -v -x --format=tar --gzip --compress=6 --pgdata=- -D /op

Re: pg_basebackup is taking more time than expected

2018-01-15 Thread David G. Johnston
On Mon, Jan 15, 2018 at 7:57 AM, Raghavendra Rao J S V < raghavendra...@gmail.com> wrote: > I am looking for the help to minimise the time taken by the pg_basebackup > utility. > > As informed Earlier we are taking the backup of the database using > pg_basbackup utility using below command. > > $P

RE: pg_basebackup is taking more time than expected

2018-01-15 Thread Kellner Thiemo
> According to our previous discussion, pg_basebackup is not depend on any of > the postgresql configuration parameters. If I go for gzip format we need to > compromise on time. You do not necessarily compromise on time when compressing. Actually, a speed gain compared to uncompressed is possib