Re: [GENERAL] Large Database Restore

2007-05-21 Thread Richard Huxton
Lee Keel wrote: So then the best way to do this kind of backup\restore is to use pg_dump? Is there any plan in the future to be able to do some sort of file-level backup like SqlServer? Oh you *can* do a file-level backup, but only of the entire cluster. If you have information shared between

Re: [GENERAL] Large Database Restore

2007-05-18 Thread Alvaro Herrera
Richard Huxton escribió: > Alvaro Herrera wrote: > >Richard Huxton escribió: > >>Alvaro Herrera wrote: > >>>Lee Keel escribió: > So then the best way to do this kind of backup\restore is to use > pg_dump? > Is there any plan in the future to be able to do some sort of file-level >

Re: [GENERAL] Large Database Restore

2007-05-18 Thread Richard Huxton
Alvaro Herrera wrote: Richard Huxton escribió: Alvaro Herrera wrote: Lee Keel escribió: So then the best way to do this kind of backup\restore is to use pg_dump? Is there any plan in the future to be able to do some sort of file-level backup like SqlServer? Actually you can do single database

Re: [GENERAL] Large Database Restore

2007-05-18 Thread Alvaro Herrera
Richard Huxton escribió: > Alvaro Herrera wrote: > >Lee Keel escribió: > >>So then the best way to do this kind of backup\restore is to use pg_dump? > >>Is there any plan in the future to be able to do some sort of file-level > >>backup like SqlServer? > > > >Actually you can do single databases, b

Re: [GENERAL] Large Database Restore

2007-05-18 Thread Richard Huxton
Alvaro Herrera wrote: Lee Keel escribió: So then the best way to do this kind of backup\restore is to use pg_dump? Is there any plan in the future to be able to do some sort of file-level backup like SqlServer? Actually you can do single databases, but you must also include some other director

Re: [GENERAL] Large Database Restore

2007-05-18 Thread Alvaro Herrera
Lee Keel escribió: > So then the best way to do this kind of backup\restore is to use pg_dump? > Is there any plan in the future to be able to do some sort of file-level > backup like SqlServer? Actually you can do single databases, but you must also include some other directories besides the data

Re: [GENERAL] Large Database Restore

2007-05-18 Thread Lee Keel
Keel Cc: Michael Nolan; Ron Johnson; pgsql-general@postgresql.org Subject: Re: [GENERAL] Large Database Restore Lee Keel wrote: > Thanks to everyone for their input on this. After reading all the emails > and some of the documentation (section 23.3), I think this is all a little > more th

Re: [GENERAL] Large Database Restore

2007-05-18 Thread Richard Huxton
Lee Keel wrote: Thanks to everyone for their input on this. After reading all the emails and some of the documentation (section 23.3), I think this is all a little more than what I need. My database is basically read-only and all I was looking to do is to be able to take snap-shots of it and be

Re: [GENERAL] Large Database Restore

2007-05-18 Thread Lee Keel
s new directory to their database list, or will it just automatically show up when they refresh the service? _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michael Nolan Sent: Thursday, May 17, 2007 7:03 PM To: Ron Johnson; pgsql-general@postgresql.org Subject: Re: [GENERAL]

Re: [GENERAL] Large Database Restore

2007-05-17 Thread Michael Nolan
On 5/17/07, Ron Johnson <[EMAIL PROTECTED]> wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 05/17/07 16:49, Michael Nolan wrote: > I don't know if my database is typical (as there probably is no such > thing), but to restore a full dump (pg_dumpall) takes over 4 hours on my > backup ser

Re: [GENERAL] Large Database Restore

2007-05-17 Thread Ron Johnson
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 05/17/07 16:49, Michael Nolan wrote: > I don't know if my database is typical (as there probably is no such > thing), but to restore a full dump (pg_dumpall) takes over 4 hours on my > backup server, but to restore a low level backup (about 35GB)

Re: [GENERAL] Large Database Restore

2007-05-17 Thread Michael Nolan
I don't know if my database is typical (as there probably is no such thing), but to restore a full dump (pg_dumpall) takes over 4 hours on my backup server, but to restore a low level backup (about 35GB) and then process 145 WAL files (since Tuesday morning when the last low level backup was run)

Re: [GENERAL] Large Database Restore

2007-05-17 Thread Ron Johnson
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Yes, but that's not always a valid assumption. And still PITR must update the index at each "insert", which is much slower than the "bulk load then create index" of pg_dump. On 05/17/07 16:01, Ben wrote: > Yes, but the implication is that large datab

Re: [GENERAL] Large Database Restore

2007-05-17 Thread Ben
Yes, but the implication is that large databases probably don't update every row between backup periods. On Thu, 17 May 2007, Ron Johnson wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 05/17/07 11:04, Jim C. Nasby wrote: [snip] Ultimately though, once your database gets past a certa

Re: [GENERAL] Large Database Restore

2007-05-17 Thread Ron Johnson
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 05/17/07 11:04, Jim C. Nasby wrote: [snip] > > Ultimately though, once your database gets past a certain size, you > really want to be using PITR and not pg_dump as your main recovery > strategy. But doesn't that just replay each transaction? It

Re: [GENERAL] Large Database Restore

2007-05-17 Thread Jim C. Nasby
On Thu, May 17, 2007 at 08:19:08AM -0500, Lee Keel wrote: > I am restoring a 51GB backup file that has been running for almost 26 hours. > There have been no errors and things are still working. I have turned fsync > off, but that still did not speed things up. Can anyone provide me with the > op

[GENERAL] Large Database Restore

2007-05-17 Thread Lee Keel
I am restoring a 51GB backup file that has been running for almost 26 hours. There have been no errors and things are still working. I have turned fsync off, but that still did not speed things up. Can anyone provide me with the optimal settings for restoring a large database? Thanks in advan