Re: pgBackRest backup from standby

2018-02-19 Thread Martin Marques
El 19/02/18 a las 17:53, David Steele escribió: > On 2/19/18 3:41 PM, Don Seiler wrote: > >> I'm curious, why even copy the pg_log logs? They aren't needed for >> database restore or recovery. > > Also, relocating the log directory is easy using the log_directory > setting, so that's what I recom

Re: pgBackRest backup from standby

2018-02-19 Thread Don Seiler
On Mon, Feb 19, 2018 at 2:53 PM, David Steele wrote: > > Also, relocating the log directory is easy using the log_directory > setting, so that's what I recommend if it's an issue. Some users do > want to backup their logs. > > That's probably a lot better idea than symlinking anyway. I'll look t

Re: pgBackRest backup from standby

2018-02-19 Thread David Steele
On 2/19/18 3:41 PM, Don Seiler wrote: > On Mon, Feb 19, 2018 at 10:17 AM, David Steele > wrote: > > If pg_log is symlinked to PGDATA it will be copied.  pg_xlog is not > copied in any backup. > > > So an external pg_log directory symlinked into $PGDATA will h

Re: pgBackRest backup from standby

2018-02-19 Thread Don Seiler
On Mon, Feb 19, 2018 at 10:17 AM, David Steele wrote: > If pg_log is symlinked to PGDATA it will be copied. pg_xlog is not > copied in any backup. So an external pg_log directory symlinked into $PGDATA will have its log contents copied? I'm curious, why even copy the pg_log logs? They aren't

Re: pgBackRest backup from standby

2018-02-19 Thread David Steele
On 2/19/18 2:05 PM, Don Seiler wrote: > On Mon, Feb 19, 2018 at 12:39 PM, David Steele > wrote: > > > I read "open it for testing (or backups in this case)" as letting > recovery complete and promoting the cluster to a master before taking > the backup. >

Re: pgBackRest backup from standby

2018-02-19 Thread Don Seiler
On Mon, Feb 19, 2018 at 12:39 PM, David Steele wrote: > > > I read "open it for testing (or backups in this case)" as letting > recovery complete and promoting the cluster to a master before taking > the backup. > > Don, is that the case? If it is, I think there's a problem with or > without a ti

Re: pgBackRest backup from standby

2018-02-19 Thread David Steele
On 2/19/18 11:29 AM, Simon Riggs wrote: > On 19 February 2018 at 16:17, David Steele wrote: >>> > I did come up with a sort of Rube Goldberg-esque workaround for now >>> > involving using a clone of the prod standby VM from Veeam backup to >>> use >>> > as the backup source (after sto

Re: pgBackRest backup from standby

2018-02-19 Thread Simon Riggs
On 19 February 2018 at 16:17, David Steele wrote: >> > I did come up with a sort of Rube Goldberg-esque workaround for now >> > involving using a clone of the prod standby VM from Veeam backup to use >> > as the backup source (after stopping recovery and opening it as a >> > standa

Re: pgBackRest backup from standby

2018-02-19 Thread David Steele
On 2/19/18 10:32 AM, Don Seiler wrote: > On Mon, Feb 19, 2018 at 9:21 AM, David Steele > wrote: > > > Yes, they are typically very small.  The general exception to this rule > is if logs are stored in pg_log.  I recommend storing logs out of the > PGDATA d

Re: pgBackRest backup from standby

2018-02-19 Thread Don Seiler
On Mon, Feb 19, 2018 at 9:21 AM, David Steele wrote: > > Yes, they are typically very small. The general exception to this rule > is if logs are stored in pg_log. I recommend storing logs out of the > PGDATA dir as they can be quite large and don't really make sense to > restore to another serv

Re: pgBackRest backup from standby

2018-02-19 Thread David Steele
Hi Don, On 2/19/18 10:01 AM, Don Seiler wrote: > On Mon, Feb 19, 2018 at 8:53 AM, David Steele > wrote: > > Anything *not* in global (except pg_control), base, pg_tblspc, > pg_xact/pg_clog, and pg_multixact are copied from the primary. > > For example, pg

Re: pgBackRest backup from standby

2018-02-19 Thread Don Seiler
On Mon, Feb 19, 2018 at 8:53 AM, David Steele wrote: > Anything *not* in global (except pg_control), base, pg_tblspc, > pg_xact/pg_clog, and pg_multixact are copied from the primary. > > For example, pg_stat is copied from the primary so these stats are > preserved on a standby backup. > So if I

Re: pgBackRest backup from standby

2018-02-19 Thread David Steele
Hi Don, On 2/19/18 9:25 AM, Don Seiler wrote: > On Mon, Feb 19, 2018 at 8:18 AM, David Steele > wrote: > > It copies files that are not replicated from the primary so that a > primary-style backup is created. Anything that is replicated (which is > by far

Re: pgBackRest backup from standby

2018-02-19 Thread Don Seiler
On Mon, Feb 19, 2018 at 8:23 AM, David Steele wrote: > > Either is fine with me, but as Michael says I might miss postings to > -general. I'm sure somebody else would catch it, though. > OK, I'll make use of the issues tracker going forward. -- Don Seiler www.seiler.us

Re: pgBackRest backup from standby

2018-02-19 Thread Don Seiler
On Mon, Feb 19, 2018 at 8:18 AM, David Steele wrote: > It copies files that are not replicated from the primary so that a > primary-style backup is created. Anything that is replicated (which is > by far the bulk of the data) is copied from the standby. > OK so all data files would be copied fro

Re: pgBackRest backup from standby

2018-02-19 Thread David Steele
On 2/18/18 10:20 PM, Michael Paquier wrote: > On Sun, Feb 18, 2018 at 06:48:30PM -0600, Don Seiler wrote: >> On Sun, Feb 18, 2018 at 6:43 PM, Michael Paquier wrote: >>> You may want to contact the maintainers directly through github where >>> the project is maintained: >>> https://github.com/pgbac

Re: pgBackRest backup from standby

2018-02-19 Thread David Steele
Hi Don, On 2/18/18 7:34 PM, Don Seiler wrote: > > Looking to use pgBackRest to take a backup from a hot standby. I'm > reading that pgBackRest still needs to connect to the primary and copy > some files. My questions are: > > 1. What files does it need to copy? Config files? WAL files? It copi

Re: pgBackRest backup from standby

2018-02-18 Thread Michael Paquier
On Sun, Feb 18, 2018 at 06:48:30PM -0600, Don Seiler wrote: > On Sun, Feb 18, 2018 at 6:43 PM, Michael Paquier wrote: >> You may want to contact the maintainers directly through github where >> the project is maintained: >> https://github.com/pgbackrest/pgbackrest > > Is that the place to just as

Re: pgBackRest backup from standby

2018-02-18 Thread Don Seiler
On Sun, Feb 18, 2018 at 6:43 PM, Michael Paquier wrote: > > I am adding in CC: Stephen Frost and David Steele who work on the took. > I assumed Stephen was already on this list, and I communicate with him regularly on Slack as well but just throwing this out there on a Sunday night. > You may w

Re: pgBackRest backup from standby

2018-02-18 Thread Michael Paquier
On Sun, Feb 18, 2018 at 06:34:46PM -0600, Don Seiler wrote: > Looking to use pgBackRest to take a backup from a hot standby. I'm reading > that pgBackRest still needs to connect to the primary and copy some files. > My questions are: > > >1. What files does it need to copy? Config files? WAL

pgBackRest backup from standby

2018-02-18 Thread Don Seiler
Evening all. Looking to use pgBackRest to take a backup from a hot standby. I'm reading that pgBackRest still needs to connect to the primary and copy some files. My questions are: 1. What files does it need to copy? Config files? WAL files? 2. How does it connect? SSH? 3. Does pgBackRe