RE: PostgreSQL suitable?

2017-12-19 Thread Kellner Thiemo
Hi Thank you all for your thoughts and the light shedding on this subject. I am very pleased to have got such engaged feedback and also that PostgreSQL seems to be so capable. I am quite sad that we most probably will not setup our DWH with it as RDBMS. It is, I fear, a quite in-house-political

Re: PostgreSQL suitable?

2017-12-19 Thread Stephen Frost
Greetings, * Vincenzo Romano (vincenzo.rom...@notorand.it) wrote: > 2017-12-19 17:32 GMT+01:00 Stephen Frost : > > * Vincenzo Romano (vincenzo.rom...@notorand.it) wrote: > >> 2017-12-19 16:48 GMT+01:00 Stephen Frost : > >> > * Vincenzo Romano (vincenzo.rom...@notorand.it) wrote: > >> >> Sorry, my

Re: PostgreSQL suitable?

2017-12-19 Thread Alexander Stoddard
On Tue, Dec 19, 2017 at 10:39 AM, Stephen Frost wrote: > Greetings, > > * James Keener (j...@jimkeener.com) wrote: > > Would a storage block level incremental like zfs work? > > This really depends on what you want out of your backups and just > exactly how the ZFS filesystem is set up. Remember

Re: PostgreSQL suitable?

2017-12-19 Thread Vincenzo Romano
Hi. 2017-12-19 17:32 GMT+01:00 Stephen Frost : > Greetings, > > * Vincenzo Romano (vincenzo.rom...@notorand.it) wrote: >> 2017-12-19 16:48 GMT+01:00 Stephen Frost : >> > * Vincenzo Romano (vincenzo.rom...@notorand.it) wrote: >> >> Sorry, my bad: I confused V10 with v11. >> >> But accordingly to a

Re: PostgreSQL suitable?

2017-12-19 Thread Stephen Frost
Greetings, * James Keener (j...@jimkeener.com) wrote: > Would a storage block level incremental like zfs work? This really depends on what you want out of your backups and just exactly how the ZFS filesystem is set up. Remember that any backup of PG that doesn't use PG's start/stop backup must b

Re: PostgreSQL suitable?

2017-12-19 Thread Stephen Frost
Greetings, * Vincenzo Romano (vincenzo.rom...@notorand.it) wrote: > 2017-12-19 16:48 GMT+01:00 Stephen Frost : > > * Vincenzo Romano (vincenzo.rom...@notorand.it) wrote: > >> Sorry, my bad: I confused V10 with v11. > >> But accordingly to a discussion with Bruce Momjan, table partitionin V10 is >

Re: PostgreSQL suitable?

2017-12-19 Thread Stephen Frost
Greetings Rakesh, * Rakesh Kumar (rakeshkumar...@mail.com) wrote: > > > There are multiple solutions to doing incremental backups with > > PostgreSQL, so I'm not sure why you're saying that they don't exist, > > because that's really not accurate. > > PG's incremental backup is essentially WAL l

Re: PostgreSQL suitable?

2017-12-19 Thread James Keener
Would a storage block level incremental like zfs work? On December 19, 2017 11:12:48 AM EST, Rakesh Kumar wrote: > >> There are multiple solutions to doing incremental backups with >> PostgreSQL, so I'm not sure why you're saying that they don't exist, >> because that's really not accurate. > >P

Re: PostgreSQL suitable?

2017-12-19 Thread Vincenzo Romano
2017-12-19 16:48 GMT+01:00 Stephen Frost : > * Vincenzo Romano (vincenzo.rom...@notorand.it) wrote: >> Sorry, my bad: I confused V10 with v11. >> But accordingly to a discussion with Bruce Momjan, table partitionin V10 is >> little more than syntactic sugar around old-fashioned table partitioning.

Re: PostgreSQL suitable?

2017-12-19 Thread Rakesh Kumar
> There are multiple solutions to doing incremental backups with > PostgreSQL, so I'm not sure why you're saying that they don't exist, > because that's really not accurate. PG's incremental backup is essentially WAL logs applied to a point in time. I am talking about true incremental backup wh

Re: PostgreSQL suitable?

2017-12-19 Thread Andreas Kretschmer
Am 19.12.2017 um 15:58 schrieb Vincenzo Romano: But accordingly to a discussion with Bruce Momjan, table partitionin V10 is little more than syntactic sugar around old-fashioned table partitioning. there is always room for improvements, but table-partitioning in pg10 is much, much better th

Re: PostgreSQL suitable?

2017-12-19 Thread Stephen Frost
Greetings, * Vincenzo Romano (vincenzo.rom...@notorand.it) wrote: > Sorry, my bad: I confused V10 with v11. > But accordingly to a discussion with Bruce Momjan, table partitionin V10 is > little more than syntactic sugar around old-fashioned table partitioning. Well, it's a bit more than that sin

Re: PostgreSQL suitable?

2017-12-19 Thread Stephen Frost
Greetings, * Rakesh Kumar (rakeshkumar...@mail.com) wrote: > I think with 100TB the biggest challenge will be taking backups. PG has no > real incremental backups offered in Oracle or SQLServer. There are multiple solutions to doing incremental backups with PostgreSQL, so I'm not sure why you're

Re: PostgreSQL suitable?

2017-12-19 Thread Vincenzo Romano
Sorry, my bad: I confused V10 with v11. But accordingly to a discussion with Bruce Momjan, table partitionin V10 is little more than syntactic sugar around old-fashioned table partitioning. Sub-table partition selection is linear in complexity. Il 19 dic 2017 15:55, "Alvaro Herrera" ha scritto:

Re: PostgreSQL suitable?

2017-12-19 Thread Tim Clarke
PG10 is happily in production - in active use here :) Tim Clarke IT Director Manifest Tel: +44 (0)1376 504510 | Mobile: +44 (0)7887 563420 | Main: +44 (0)1376 503500 | Fax: +44 (0)1376 503550 Blog: https://blog.manifest.co.uk/ | Web: https://www.manifest.co.uk/ 9 F

Re: PostgreSQL suitable?

2017-12-19 Thread Alvaro Herrera
Vincenzo Romano wrote: > I've not tested PG10. But it's not released for production yet! It definitely is, for a couple of months now. 10.1 (the first bugfix release) has been out for over a month. -- Álvaro Herrerahttps://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Suppor

Re: PostgreSQL suitable?

2017-12-19 Thread Vincenzo Romano
I've not tested PG10. But it's not released for production yet! Il 19 dic 2017 15:48, "Andreas Kretschmer" ha scritto: > > > Am 19.12.2017 um 15:07 schrieb Kellner Thiemo: > >> Hi >> >> We are developing a data warehouse of which the integration layer will >> start with over 100 TB of data. Ther

Re: PostgreSQL suitable?

2017-12-19 Thread Andreas Kretschmer
Am 19.12.2017 um 15:07 schrieb Kellner Thiemo: Hi We are developing a data warehouse of which the integration layer will start with over 100 TB of data. There are not many entities though we probably can partition and foremost we should use inheritance for the lab results. I just was wonder

Re: PostgreSQL suitable?

2017-12-19 Thread Vincenzo Romano
I think that table partitioning isn't suitable yet for a large number of partitions. Or a large number of partial indexes. This will be a challenge too. Il 19 dic 2017 15:07, "Kellner Thiemo" ha scritto: > Hi > > We are developing a data warehouse of which the integration layer will > start wit

Re: PostgreSQL suitable?

2017-12-19 Thread Chris Travers
On Tue, Dec 19, 2017 at 3:07 PM, Kellner Thiemo wrote: > Hi > > We are developing a data warehouse of which the integration layer will > start with over 100 TB of data. There are not many entities though we > probably can partition and foremost we should use inheritance for the lab > results. I j

Re: PostgreSQL suitable?

2017-12-19 Thread Rakesh Kumar
I think with 100TB the biggest challenge will be taking backups. PG has no real incremental backups offered in Oracle or SQLServer.