Re: blending fast and temp space volumes

2018-02-22 Thread Claudio Freire
On Wed, Feb 21, 2018 at 5:09 PM, Peter Geoghegan wrote: > On Wed, Feb 21, 2018 at 12:07 PM, Claudio Freire > wrote: >> On Wed, Feb 21, 2018 at 4:50 PM, Peter Geoghegan wrote: >>> On Wed, Feb 21, 2018 at 7:53 AM, Rick Otten >>> wrote: >>>> side note:

Re: blending fast and temp space volumes

2018-02-21 Thread Claudio Freire
On Wed, Feb 21, 2018 at 4:50 PM, Peter Geoghegan wrote: > On Wed, Feb 21, 2018 at 7:53 AM, Rick Otten wrote: >> side note: The disadvantage of local SSD is that it won't survive "hitting >> the virtual power button" on an instance, nor can it migrate automatically >> to other hardware. (We have

Re: effective_io_concurrency on EBS/gp2

2018-02-05 Thread Claudio Freire
On Mon, Feb 5, 2018 at 8:26 AM, Vitaliy Garnashevich wrote: >> I mean, that the issue is indeed affected by the order of rows in the >> table. Random heap access patterns result in sparse bitmap heap scans, >> whereas less random heap access patterns result in denser bitmap heap >> scans. Dense sc

Re: effective_io_concurrency on EBS/gp2

2018-02-04 Thread Claudio Freire
On Sat, Feb 3, 2018 at 8:05 PM, Vitaliy Garnashevich wrote: > Looks like this behavior is not caused by, and does not depend on: > - variable performance in the cloud > - order of rows in the table > - whether the disk is EBS (backed by SSD or HDD), or ordinary SSD > - kernel version > > Does this

Re: effective_io_concurrency on EBS/gp2

2018-02-01 Thread Claudio Freire
On Wed, Jan 31, 2018 at 11:21 PM, hzzhangjiazhi wrote: > HI > > I think this parameter will be usefull when the storage using RAID > stripe , otherwise turn up this parameter is meaningless when only has one > device。 Not at all. Especially on EBS, where keeping a relatively full queue is ne

Re: effective_io_concurrency on EBS/gp2

2018-01-31 Thread Claudio Freire
On Wed, Jan 31, 2018 at 1:57 PM, Vitaliy Garnashevich wrote: > More tests: > > io1, 100 GB: > > effective_io_concurrency=0 > Execution time: 40333.626 ms > effective_io_concurrency=1 > Execution time: 163840.500 ms In my experience playing with prefetch, e_i_c>0 interferes with kernel read-ahea

Re: 8.2 Autovacuum BUG ?

2018-01-30 Thread Claudio Freire
On Tue, Jan 30, 2018 at 10:55 AM, pavan95 wrote: > Hello all, > > Will a sudden restart(stop/start) of a postgres database will generate this > huge WAL? Shouldn't

Re: 8.2 Autovacuum BUG ?

2018-01-24 Thread Claudio Freire
On Wed, Jan 24, 2018 at 8:50 AM, pavan95 wrote: > Hello all, > > One more interesting observation made by me. > > I have ran the below query(s) on production: > > SELECT > relname, > age(relfrozenxid) as xid_age, > pg_size_pretty(pg_table_size(oid)) as table_size > FROM pg_class > WHE

Re: 8.2 Autovacuum BUG ?

2018-01-23 Thread Claudio Freire
On Wed, Jan 24, 2018 at 3:54 AM, pavan95 wrote: > Hi Claudio, > > We didn't configure any replication to our production server. Which strace > are you talking about? > This one: https://linux.die.net/man/1/strace You can attach it to a process (assuming you have the necessary permissions) and i

Re: 8.2 Autovacuum BUG ?

2018-01-23 Thread Claudio Freire
On Tue, Jan 23, 2018 at 1:16 PM, Pavan Teja wrote: > On Jan 23, 2018 9:37 PM, "Claudio Freire" wrote: > > > > On Tue, Jan 23, 2018 at 11:39 AM, Pavan Teja > wrote: > >> Yes so many wals are continuing to be produced. >> >> Deleting the wals af

Re: 8.2 Autovacuum BUG ?

2018-01-23 Thread Claudio Freire
On Tue, Jan 23, 2018 at 11:39 AM, Pavan Teja wrote: > Yes so many wals are continuing to be produced. > > Deleting the wals after a backup of the database. > > Yes archiving mode is on. And the warning message in log file is > > " checkpoints are frequently occurring (1second apart). Consider > i

Re: Batch insert heavily affecting query performance.

2018-01-09 Thread Claudio Freire
On Wed, Dec 27, 2017 at 2:10 PM, Mike Sofen wrote: > In my experience, that 77ms will stay quite constant even if your db grew > to > 1TB. Postgres IS amazing. BTW, for a db, you should always have > provisioned IOPS or else your performance can vary wildly, since the SSDs > are shared. > > > >

Re: Need Help on wal_compression

2018-01-09 Thread Claudio Freire
On Tue, Jan 9, 2018 at 3:53 AM, Rambabu V wrote: > Hi Team, > > Daily 4000 Archive files are generating and these are occupying more > space, we are trying to compress wall files with using wal_compression > parameter, but we are not seeing any change in wal files count, could you > please help u

Re: pg_dump 3 times as slow after 8.4 -> 9.5 upgrade

2017-12-07 Thread Claudio Freire
On Thu, Dec 7, 2017 at 2:31 PM, Laurenz Albe wrote: > Gunther wrote: >> Something is wrong with the dump thing. And no, it's not SSL or whatever, >> I am doing it on a local system with local connections. Version 9.5 >> something. > > That's a lot of useful information. > > Try to profile where t