Re: [PERFORM] New server setup

On 21/03/13 13:44, David Rees wrote: On Thu, Mar 14, 2013 at 4:37 PM, David Boreham wrote: You might want to evaluate the performance you can achieve with a single-SSD (use several for capacity by all means) before considering a RAID card + SSD solution. Again I bet it depends on the applicatio

Re: [PERFORM] New server setup

On Wed, Mar 20, 2013 at 6:44 PM, David Rees wrote: > On Thu, Mar 14, 2013 at 4:37 PM, David Boreham wrote: >> You might want to evaluate the performance you can achieve with a single-SSD >> (use several for capacity by all means) before considering a RAID card + SSD >> solution. >> Again I bet it

Re: [PERFORM] New server setup

On 3/20/2013 7:44 PM, David Rees wrote: > On Thu, Mar 14, 2013 at 4:37 PM, David Boreham wrote: >> You might want to evaluate the performance you can achieve with a single-SSD >> (use several for capacity by all means) before considering a RAID card + SSD >> solution. >> Again I bet it depends on

Re: [PERFORM] New server setup

On 3/20/2013 6:44 PM, David Rees wrote: On Thu, Mar 14, 2013 at 4:37 PM, David Boreham wrote: You might want to evaluate the performance you can achieve with a single-SSD (use several for capacity by all means) before considering a RAID card + SSD solution. Again I bet it depends on the applica

Re: [PERFORM] New server setup

On Thu, Mar 14, 2013 at 4:37 PM, David Boreham wrote: > You might want to evaluate the performance you can achieve with a single-SSD > (use several for capacity by all means) before considering a RAID card + SSD > solution. > Again I bet it depends on the application but our experience with the ol

Re: [PERFORM] New server setup

On 16/03/13 07:06, Rick Otten wrote: I not convinced about the need for BBU with SSD - you *can* use them without one, just need to make sure about suitable longevity and also the presence of (proven) power off protection (as discussed previously). It is worth noting that using unproven or SSD kn

Re: [PERFORM] New server setup

On Fri, Mar 15, 2013 at 12:06 PM, Rick Otten wrote: >>> I not convinced about the need for BBU with SSD - you *can* use them >>> without one, just need to make sure about suitable longevity and also >>> the presence of (proven) power off protection (as discussed >>> previously). It is worth noting

Re: [PERFORM] New server setup

On Fri, Mar 15, 2013 at 06:06:02PM +, Rick Otten wrote: > >I don't think any drive that corrupts on power-off is suitable for a > >database, but for non-db uses, sure, I guess they are OK, though you > >have to be pretty money->constrainted to like that tradeoff. > > Wouldn't mission critical d

Re: [PERFORM] New server setup

>> I not convinced about the need for BBU with SSD - you *can* use them >> without one, just need to make sure about suitable longevity and also >> the presence of (proven) power off protection (as discussed >> previously). It is worth noting that using unproven or SSD known to be >> lacking po

Re: [PERFORM] New server setup

On 3/14/2013 3:37 PM, Mark Kirkwood wrote: I not convinced about the need for BBU with SSD - you *can* use them without one, just need to make sure about suitable longevity and also the presence of (proven) power off protection (as discussed previously). It is worth noting that using unproven o

Re: [PERFORM] New server setup

On 15/03/13 11:34, Bruce Momjian wrote: I don't think any drive that corrupts on power-off is suitable for a database, but for non-db uses, sure, I guess they are OK, though you have to be pretty money-constrainted to like that tradeoff. Agreed - really *all* SSD should have capacitor (or equ

Re: [PERFORM] New server setup

On Fri, Mar 15, 2013 at 10:37:55AM +1300, Mark Kirkwood wrote: > On 15/03/13 07:54, Bruce Momjian wrote: > >Only use SSDs with a BBU cache, and don't set SSD caches to > >write-through because an SSD needs to cache the write to avoid wearing > >out the chips early, see: > > > > http://momjian.u

Re: [PERFORM] New server setup

On 15/03/13 10:37, Mark Kirkwood wrote: Also, in terms of performance, the faster PCIe SSD do about as well by themselves as connected to a RAID card with BBU. Sorry - I meant to say "the faster **SAS** SSD do...", since you can't currently plug PCIe SSD into RAID cards (confusingly, some

Re: [PERFORM] New server setup

On 15/03/13 07:54, Bruce Momjian wrote: Only use SSDs with a BBU cache, and don't set SSD caches to write-through because an SSD needs to cache the write to avoid wearing out the chips early, see: http://momjian.us/main/blogs/pgblog/2012.html#August_3_2012 I not convinced about the ne

Re: [PERFORM] New server setup

On Tue, Mar 12, 2013 at 09:41:08PM +, Gregg Jaskiewicz wrote: > On 10 March 2013 15:58, Greg Smith wrote: > > On 3/1/13 6:43 AM, Niels Kristian Schjødt wrote: > > Hi, I'm going to setup a new server for my postgresql database, and I > am considering one of these: http://w

Re: [PERFORM] New server setup

On 3/13/2013 9:29 PM, Mark Kirkwood wrote: Just going through this now with a vendor. They initially assured us that the drives had "end to end protection" so we did not need to worry. I had to post stripdown pictures from Intel's s3700, showing obvious capacitors attached to the board before I

Re: [PERFORM] New server setup

On 14/03/13 09:16, David Boreham wrote: On 3/13/2013 1:23 PM, Steve Crawford wrote: What concerns me more than wear is this: InfoWorld Article: http://www.infoworld.com/t/solid-state-drives/test-your-ssds-or-risk-massive-data-loss-researchers-warn-213715 Referenced research paper: https://ww

Re: [PERFORM] New server setup

On 3/13/2013 1:23 PM, Steve Crawford wrote: What concerns me more than wear is this: InfoWorld Article: http://www.infoworld.com/t/solid-state-drives/test-your-ssds-or-risk-massive-data-loss-researchers-warn-213715 Referenced research paper: https://www.usenix.org/conference/fast13/understa

Re: [PERFORM] New server setup

On 13/03/2013 19:23, Steve Crawford wrote: On 03/13/2013 09:15 AM, John Lister wrote: On 13/03/2013 15:50, Greg Jaskiewicz wrote: SSDs have much shorter life then spinning drives, so what do you do when one inevitably fails in your system ? Define much shorter? I accept they have a limited no o

Re: [PERFORM] New server setup

On Mar 13, 2013, at 3:23 PM, Steve Crawford wrote: > On 03/13/2013 09:15 AM, John Lister wrote: >> On 13/03/2013 15:50, Greg Jaskiewicz wrote: >>> SSDs have much shorter life then spinning drives, so what do you do when >>> one inevitably fails in your system ? >> Define much shorter? I accept th

Re: [PERFORM] New server setup

On 3/13/2013 2:23 PM, Steve Crawford wrote: > On 03/13/2013 09:15 AM, John Lister wrote: >> On 13/03/2013 15:50, Greg Jaskiewicz wrote: >>> SSDs have much shorter life then spinning drives, so what do you do >>> when one inevitably fails in your system ? >> Define much shorter? I accept they have

Re: [PERFORM] New server setup

On 03/13/2013 09:15 AM, John Lister wrote: On 13/03/2013 15:50, Greg Jaskiewicz wrote: SSDs have much shorter life then spinning drives, so what do you do when one inevitably fails in your system ? Define much shorter? I accept they have a limited no of writes, but that depends on load. You can

Re: [PERFORM] New server setup

On 13/03/2013 15:50, Greg Jaskiewicz wrote: SSDs have much shorter life then spinning drives, so what do you do when one inevitably fails in your system ? Define much shorter? I accept they have a limited no of writes, but that depends on load. You can actively monitor the drives "health" level

Re: [PERFORM] New server setup

On 13 Mar 2013, at 15:33, John Lister wrote: > On 12/03/2013 21:41, Gregg Jaskiewicz wrote: >> >> Whilst on the hardware subject, someone mentioned throwing ssd into the mix. >> I.e. combining spinning HDs with SSD, apparently some raid cards can use >> small-ish (80GB+) SSDs as external cach

Re: [PERFORM] New server setup

On 12/03/2013 21:41, Gregg Jaskiewicz wrote: Whilst on the hardware subject, someone mentioned throwing ssd into the mix. I.e. combining spinning HDs with SSD, apparently some raid cards can use small-ish (80GB+) SSDs as external caches. Any experiences with that ? The new LSI/Dell cards do

Re: [PERFORM] New server setup

On 10 March 2013 15:58, Greg Smith wrote: > On 3/1/13 6:43 AM, Niels Kristian Schjødt wrote: > >> Hi, I'm going to setup a new server for my postgresql database, and I am >> considering one of these: http://www.hetzner.de/hosting/** >> produkte_rootserver/poweredge-**r720

Re: [PERFORM] New server setup

On 3/1/13 6:43 AM, Niels Kristian Schjødt wrote: Hi, I'm going to setup a new server for my postgresql database, and I am considering one of these: http://www.hetzner.de/hosting/produkte_rootserver/poweredge-r720 with four SAS drives in a RAID 10 array. Has any of you any particular comments/p

Re: [PERFORM] New server setup

In my recent experience PgPool2 performs pretty badly as a pooler. I'd avoid it if possible, unless you depend on other features. It simply doesn't scale. On 5 March 2013 21:59, Jeff Janes wrote: > On Tue, Mar 5, 2013 at 10:27 AM, Niels Kristian Schjødt < > nielskrist...@autouncle.com> wrote:

Re: [PERFORM] New server setup

On Tue, Mar 5, 2013 at 10:27 AM, Niels Kristian Schjødt < nielskrist...@autouncle.com> wrote: > Okay, thanks - but hey - if I put it at session pooling, then it says in > the documentation: "default_pool_size: In session pooling it needs to be > the number of max clients you want to handle at any

Re: [PERFORM] New server setup

Okay, thanks - but hey - if I put it at session pooling, then it says in the documentation: "default_pool_size: In session pooling it needs to be the number of max clients you want to handle at any moment". So as I understand it, is it true that I then have to set default_pool_size to 300 if I h

Re: [PERFORM] New server setup

Kristian Schjødt Sent: Tuesday, March 05, 2013 10:12 AM To: Kevin Grittner Cc: Craig James; pgsql-performance@postgresql.org Subject: Re: [PERFORM] New server setup Thanks, that was actually what I just ended up doing yesterday. Any suggestion how to tune pgbouncer? BTW, I have just bumped into

Re: [PERFORM] New server setup

Thanks, that was actually what I just ended up doing yesterday. Any suggestion how to tune pgbouncer? BTW, I have just bumped into an issue that caused me to disable pgbouncer again actually. My web application is querying the database with a per request based SEARCH_PATH. This is because I use

Re: [PERFORM] New server setup

On Tue, Mar 5, 2013 at 9:34 AM, Kevin Grittner wrote: > Niels Kristian Schjødt wrote: > >> So my question is, should I also get something like pgpool2 setup >> at the same time? Is it, from your experience, likely to increase >> my throughput a lot more, if I had a connection pool of eg. 20 >> co

Re: [PERFORM] New server setup

Niels Kristian Schjødt wrote: > So my question is, should I also get something like pgpool2 setup > at the same time? Is it, from your experience, likely to increase > my throughput a lot more, if I had a connection pool of eg. 20 > connections, instead of 300 concurrent ones directly? In my exp

Re: [PERFORM] New server setup

Thanks both of you for your input. Earlier I have been discussing my extremely high IO wait with you here on the mailing list, and have tried a lot of tweaks both on postgresql config, wal directly location and kernel tweaks, but unfortunately my problem persists, and I think I'm eventually dow

Re: [PERFORM] New server setup

pls choice PCI-E Flash for written heavy app Wales 在 2013-3-1，下午8:43，Niels Kristian Schjødt 写道： > Hi, I'm going to setup a new server for my postgresql database, and I am > considering one of these: > http://www.hetzner.de/hosting/produkte_rootserver/poweredge-r720 with four > SAS drives in

Re: [PERFORM] New server setup

On Fri, Mar 1, 2013 at 3:43 AM, Niels Kristian Schjødt < nielskrist...@autouncle.com> wrote: > Hi, I'm going to setup a new server for my postgresql database, and I am > considering one of these: > http://www.hetzner.de/hosting/produkte_rootserver/poweredge-r720 with > four SAS drives in a RAID 10

[PERFORM] New server setup

Hi, I'm going to setup a new server for my postgresql database, and I am considering one of these: http://www.hetzner.de/hosting/produkte_rootserver/poweredge-r720 with four SAS drives in a RAID 10 array. Has any of you any particular comments/pitfalls/etc. to mention on the setup? My applicati