Re: Replication between different architectures

2021-10-13 Thread Phil Endecott
Tom Lane wrote: "Phil Endecott" writes: Is replication going to work from an x86-64 master to an arm64 replica? The hard part of this is usually whether the operating systems are identical. If they have different locale data, you may find that indexes on text columns appear out-of

Replication between different architectures

2021-10-13 Thread Phil Endecott
Dear Experts, Is replication going to work from an x86-64 master to an arm64 replica? These are AWS EC2 instances, both 64-bit. I may eventually move them all to ARM, but have a mix of architectures temporarily. What could possibly go wrong ?! (If it does fail, will I notice before it's too lat

Re: Why can't I drop a tablespace?

2021-07-14 Thread Phil Endecott
Tom Lane wrote: "Phil Endecott" writes: Thanks Laurenz. I was looking at the source for "alter table set tablespace" yesterday trying to work out what is supposed to happen. There is a comment at tablecmds.c line 3989: "Thanks to the magic of MVCC, an error anywhere

Re: Why can't I drop a tablespace?

2021-07-12 Thread Phil Endecott
Laurenz Albe wrote: On Fri, 2021-07-09 at 20:04 +0100, Phil Endecott wrote: =# create tablespace tempspace location "/db_temp"; =# alter table requests set tablespace tempspace; That didn't work; I think disk space had actually reached zero: PANIC: could not write to file &

Re: Why can't I drop a tablespace?

2021-07-10 Thread Phil Endecott
Phil Endecott wrote: Yesterday I had a disk-nearly-full problem, and decided to try to resolve it by moving one large table to a spare disk in a new tablespace: =# create tablespace tempspace location "/db_temp"; =# alter table requests set tablespace tempspace; That didn't wor

Why can't I drop a tablespace?

2021-07-09 Thread Phil Endecott
Dear Experts, Yesterday I had a disk-nearly-full problem, and decided to try to resolve it by moving one large table to a spare disk in a new tablespace: =# create tablespace tempspace location "/db_temp"; =# alter table requests set tablespace tempspace; That didn't work; I think disk space ha

Re: Limitting full join to one match

2018-12-06 Thread Phil Endecott
Hi Ron, Ron wrote: On 12/05/2018 06:34 PM, Phil Endecott wrote: Dear Experts, I have a couple of tables that I want to reconcile, finding rows that match and places where rows are missing from one table or the other: db=> select * from a; +++ |date| amo

Re: Limitting full join to one match

2018-12-06 Thread Phil Endecott
John W Higgins wrote: On Wed, Dec 5, 2018 at 4:34 PM Phil Endecott < spam_from_pgsql_li...@chezphil.org> wrote: Dear Experts, I have a couple of tables that I want to reconcile, finding rows that match and places where rows are missing from one table or the other: ... So my quest

Limitting full join to one match

2018-12-05 Thread Phil Endecott
Dear Experts, I have a couple of tables that I want to reconcile, finding rows that match and places where rows are missing from one table or the other: db=> select * from a; +++ |date| amount | +++ | 2018-01-01 | 10.00 | | 2018-02-01 | 5.00 |

Re: Filtering before join with date_trunc()

2018-10-15 Thread Phil Endecott
Thanks all for the replies. Tom Lane wrote: > You're expecting too much. That often seems to be the case. > I think you're also expecting the system to deduce that it can apply an > inequality on one join column to the other one. It doesn't; only equality > constraints have any sort of transiti

Filtering before join with date_trunc()

2018-10-15 Thread Phil Endecott
Dear Experts, I have a few tables with "raw" timestamsps like this: +---+--+ | time | pressure | +---+--+ | 2018-09-14 00:00:07.148378+00 | 1007.52 | | 2018-09-14 00:10:07.147506+00 | 1007.43 | | 20

RE: Why the index is not used ?

2018-10-08 Thread Phil Endecott
ROS Didier wrote: Can you give some examples of these encryption function that doesn't salt the data. encrypt(data, 'motdepass', 'aes') Regards, Phil.

RE: Why the index is not used ?

2018-10-07 Thread Phil Endecott
Hello Didier, Your email is didier@edf.fr. Are you working at Electricite de France, and storing actual customers' credit card details? How many millions of them? Note that this mailing list is public; people looking for targets with poor security from which they can harvest credit card nu

Re: Text-indexing UTF-8 bytea, convert_from() immutability, null bytes...

2018-10-07 Thread Phil Endecott
Hi Andrew, Thanks for your great reply. Andrew Gierth wrote: "Phil" == Phil Endecott writes: Phil> As a hack I tried ALTER FUNCTION to make it immutable, A better approach is to wrap it in a function of your own which is declared immutable, rather than hacking the cata

Text-indexing UTF-8 bytea, convert_from() immutability, null bytes...

2018-10-06 Thread Phil Endecott
Dear Experts, I have a table that contains bytea data which sometimes is UTF-8 text. When it is - and that is indicated by another column - I want to text-search index it. Something like this: db=> create index ix on tbl using gin (to_tsvector('english',body)) where is_utf8_text; (Note my cl

Re: During promotion, new master tries to archive same segment twice

2018-08-16 Thread Phil Endecott
Adrian Klaver wrote: On 08/16/2018 01:48 AM, Phil Endecott wrote: Adrian Klaver wrote: On 08/15/2018 01:25 PM, Phil Endecott wrote: Dear Experts, The above is not clear to me. My best guess: It's not part of the error for the archive command; it's just the next thing in th

Re: During promotion, new master tries to archive same segment twice

2018-08-16 Thread Phil Endecott
Adrian Klaver wrote: On 08/15/2018 01:25 PM, Phil Endecott wrote: Dear Experts, Here is my latest issue with replication: I have 3 systems, X, Y and Z. Initially X is replicated to Y and Y is replicated to Z; in each case the replication involves log-shipping using archive_command and

Re: During promotion, new master tries to archive same segment twice

2018-08-16 Thread Phil Endecott
David Steele wrote: On 8/15/18 4:25 PM, Phil Endecott wrote: - Should my archive_command detect the case where it is asked to write the same file again with the same contents, and report success in that case? Yes. There are a number of cases where the same WAL segment can be pushed more

During promotion, new master tries to archive same segment twice

2018-08-15 Thread Phil Endecott
Dear Experts, Here is my latest issue with replication: I have 3 systems, X, Y and Z. Initially X is replicated to Y and Y is replicated to Z; in each case the replication involves log-shipping using archive_command and restore_command (via a 4th system called "backup") and then streaming. T

Re: Replication failure, slave requesting old segments

2018-08-13 Thread Phil Endecott
Adrian Klaver wrote: "If you set up a WAL archive that's accessible from the standby, these solutions are not required, since the standby can always use the archive to catch up provided it retains enough segments. *This is dependent on verification that the archiving is working properly. A belt

Re: Replication failure, slave requesting old segments

2018-08-13 Thread Phil Endecott
Adrian Klaver wrote: On 08/12/2018 03:54 PM, Stephen Frost wrote: Greetings, * Phil Endecott (spam_from_pgsql_li...@chezphil.org) wrote: OK. I think this is perhaps a documentation bug, maybe a missing warning when the master reads its configuration, and maybe (as you say) a bad default

Re: Replication failure, slave requesting old segments

2018-08-13 Thread Phil Endecott
Adrian Klaver wrote: On 08/12/2018 02:56 PM, Phil Endecott wrote: Anyway.  Do others agree that my issue was the result of wal_keep_segments=0 ? Only as a sub-issue of the slave losing contact with the master. The basic problem is maintaining two separate operations, archiving and streaming

Re: Replication failure, slave requesting old segments

2018-08-12 Thread Phil Endecott
Stephen Frost wrote: * Phil Endecott (spam_from_pgsql_li...@chezphil.org) wrote: Stephen Frost wrote: >* Phil Endecott (spam_from_pgsql_li...@chezphil.org) wrote: >>2018-08-11 00:12:15.536 UTC [7954] LOG: restored log file "0001000700D0" from archive >>20

Re: Replication failure, slave requesting old segments

2018-08-12 Thread Phil Endecott
Phil Endecott wrote: > On the master, I have: > > wal_level = replica > archive_mode = on > archive_command = 'ssh backup test ! -f backup/postgresql/archivedir/%f && >scp %p backup:backup/postgresql/archivedir/%f' > > O

Re: Replication failure, slave requesting old segments

2018-08-12 Thread Phil Endecott
Hi Adrian, Adrian Klaver wrote: On 08/11/2018 12:42 PM, Phil Endecott wrote: Hi Adrian, Adrian Klaver wrote: Looks like the master recycled the WAL's while the slave could not connect. Yes but... why is that a problem?  The master is copying the WALs to the backup server using scp,

Re: Replication failure, slave requesting old segments

2018-08-12 Thread Phil Endecott
Hi Stephen, Stephen Frost wrote: * Phil Endecott (spam_from_pgsql_li...@chezphil.org) wrote: archive_command = 'ssh backup test ! -f backup/postgresql/archivedir/%f && scp %p backup:backup/postgresql/archivedir/%f' This is really not a sufficie

Re: Replication failure, slave requesting old segments

2018-08-11 Thread Phil Endecott
Hi Adrian, Adrian Klaver wrote: Looks like the master recycled the WAL's while the slave could not connect. Yes but... why is that a problem? The master is copying the WALs to the backup server using scp, where they remain forever. The slave gets them from there before it starts streaming.

Replication failure, slave requesting old segments

2018-08-11 Thread Phil Endecott
Dear Experts, I recently set up replication for the first time. It seemed to be working OK in my initial tests, but didn't cope when the slave was down for a longer period. This is all with the Debian stable packages of PostgreSQL 9.6. My replication setup involves a third server, "backup",