constant crashing hardware issue and thank you TAKE AWAY

2024-04-17 Thread jack
I discovered that one of the memory sticks in the machine was damaged. Running memtest86 on the machine generated many RAM errors. This was causing the strange bi-polar errors in postgresql. The hardware technician explained that he sees this often and that there is no one cause for such

re: constant crashing hardware issue and thank you

2024-04-15 Thread jack
It seems that the hardware may in fact be the issue. I ran the exact same process during the night on a much slower machine (4 core Xeon E5-1620 v4 32G Ram) and it worked fine. It did not crash and completed all the updates on 113 million records successfully. I will be bringing the i9 in for

Re: constant crashing

2024-04-14 Thread jack
machine is a machine from only 4 years ago which should have no issues. On Sunday, April 14th, 2024 at 8:50 PM, Adrian Klaver wrote: > > > On 4/14/24 14:50, jack wrote: > > Reply to list also > Ccing list > > > Hello, > > I am not sure what "locale&

re: constant crashing

2024-04-14 Thread jack
The CSV files are being produced by another system, a WIndows app on a Windows machine. I then copy them to a USB key and copy them onto the ubuntu machine. The data is then imported via the COPY command. COPY master (field01,field02..fieldX) FROM '/data/file.text' DELIMITER E'\t' The fields

re: constant crashing

2024-04-14 Thread jack
To show you how bi-polar this is really becoming, I tried a work-around... I took the table called us113 with 113 million records and tried to break it down into 10 smaller tables each having about 10 million records, using the following code: \set ECHO all \set ON_ERROR_STOP on -- Create 10

re: constant crashing

2024-04-14 Thread jack
Here is the table structure: The fields being updated are the ones that are NOT named field##. Except for "3fc" which I left as is to show that it is named differently in the unlikely chance that this would be causing problems. CREATE TABLE main ( field01 character(10) COLLATE

re: constant crashing

2024-04-14 Thread jack
Here is an excerpt of /var/log/postgresql/postgresql-16-main.log 2024-04-14 12:17:42.321 EDT [7124] LOG: checkpoint starting: wal 2024-04-14 12:17:43.153 EDT [1227] LOG: server process (PID 7289) was terminated by signal 11: Segmentation fault 2024-04-14 12:17:43.153 EDT [1227] DETAIL: Failed

re: constant crashing

2024-04-14 Thread jack
The full error reads: server closed the connection expectantly This probably means the server terminated abnormally before or while processing the request. error: connection to server was lost PostgreSQL 16.2 I also believe it is a resource issue which can be rectified with a setting, but which

constant crashing

2024-04-14 Thread jack
Hello, I am trying to load about 1.4 billion records into a postgresql table. The data is in about 100 individual CSV files which I load individually into the table using the COPY command. After the data is loaded I perform updates to the data, and this is when I get errors. Some updates work,

How does pg index page optimize dead tuples?

2023-04-19 Thread jack...@gmail.com
this one? please give me a code example,thanks. jack...@gmail.com

what's hsitoric MVCC Snapshot?

2023-03-05 Thread jack...@gmail.com
*committed* transactions between xmin and xmax. * * note: all ids in xip[] satisfy xmin <= xip[i] < xmax */ TransactionId *xip; I can't understand the historic MVCC snapshots? can you give me a scenario to describe this? jack...@gmail.com

Give me details of some attributes!!

2023-02-26 Thread jack...@gmail.com
is that these three bit can have only one to be set 1 at most. 3. t_cid is a combo CID? what's a CID? give me an example please. -- jack...@gmail.com

How to write a new tuple into page?

2023-02-01 Thread jack...@gmail.com
Hi, I'm trying to construct a new tuple type, that's not heaptuple, When I get a tupleTableSlot, I will get data info from it and the I will constuct a new tuple, and now I need to put it into a physical page, how should I do? -- jack...@gmail.com

How to create a new operator inpg for spec data type?

2023-01-31 Thread jack...@gmail.com
I need to create a new operator like '<->' and its syntax is that text1 <-> text2, for the usage like this: 'a' <-> 'b' = 'a1b1', so how could I realize this one? Can you give me some exmaples. -- jack...@gmail.com

Re: Re: How could I elog the tupleTableSlot to the fronted terminal?

2023-01-31 Thread jack...@gmail.com
>On 2023-Jan-30, jack...@gmail.com wrote: > >> For example, I use "insert into t values(1)"; and I 'll get a tupleTableSlot, >> >> And Now I want to get the real data , that's 1, and then use elog() func >> to print it. Could you give m

How could I elog the tupleTableSlot to the fronted terminal?

2023-01-30 Thread jack...@gmail.com
to change? -- jack...@gmail.com

what kind of hash algorithm is used by hash_bytes()?

2023-01-02 Thread jack...@gmail.com
jack...@gmail.com -- I can't understand the hash_bytes() func in src/backend/access/hash/hashfunc.c, it's published by a paper or others? Can you give me some materials to study it in depth?

How to repair my plan modify error?

2022-12-03 Thread jack...@gmail.com
jacktby(at)gmail(dot)com -- Hello, I'm trying to modify pg codes for my personal project. And after I finish modify planner, I get this. postgres=# create table tt(a int); CREATE TABLE postgres=# \d tt ERROR: btree index keys must be ordered by attribute here are the patches of my

modify planner codes, get failed

2022-12-02 Thread jack...@gmail.com
jack...@gmail.com -- Hello, I'm trying to modify pg codes for my personal project. And after I finish modify planner, I get this. postgres=# create table tt(a int); CREATE TABLE postgres=# \d tt ERROR: btree index keys must be ordered by attribute the patches are below 0001

there is no an example in reloptions.c for string?

2022-10-30 Thread jack...@gmail.com
jack...@gmail.com -- here is the codes for pg16. static relopt_string stringRelOpts[] = { /* list terminator */ {{NULL}} }; And I add my string type arguments here, it can't work well. When I debug, it comes to func allocateReloptStruct

Re: Re: Does it equal to execute "CREATE ACCESS METHOD"?

2022-10-29 Thread jack...@gmail.com
thanks for your advice, I realize my problems, can you give me some materials like some study routine for pg-internal? -- jack...@gmail.com >"jack...@gmail.com" writes: >> When I add >> "{ oid => '6015', oid_symbol => 'SPB_

Re: Re: Does it equal to execute "CREATE ACCESS METHOD"?

2022-10-29 Thread jack...@gmail.com
"jack...@gmail.com" writes: > When I add > "{ oid => '6015', oid_symbol => 'SPB_AM_OID', > descr => 'SPB index access method', > amname => 'spb', amhandler => 'spbhandler', amtype => 'i' }," > in pg_am.dat > and add > "{ oid =

Re: Does it equal to execute "CREATE ACCESS METHOD"?

2022-10-29 Thread jack...@gmail.com
's not my require. And I need to know add those in pg_proc.dat and pg_am.dat, if it won't create access method for spb, what else I need to do? -- jack...@gmail.com

Does it equal to execute "CREATE ACCESS METHOD"?

2022-10-29 Thread jack...@gmail.com
's not my require. And I need to know add those in pg_proc.dat and pg_am.dat, if it won't create access method for spb, what else I need to do? -- jack...@gmail.com

Re: Re: access method xxx does not exist

2022-10-29 Thread jack...@gmail.com
Hi, On Sat, Oct 29, 2022 at 08:15:54PM +0800, jack...@gmail.com wrote: > On 2022-10-29 19:19:28 +0800, jack...@gmail.com wrote: > > I'm trying to add a new index, but when I finish it, I use “ create index > > xxx_index on t1 using xxx(a); ”,it gives me access method

Re: Re: access method xxx does not exist

2022-10-29 Thread jack...@gmail.com
On 2022-10-29 19:19:28 +0800, jack...@gmail.com wrote: > I'm trying to add a new index, but when I finish it, I use “ create index > xxx_index on t1 using xxx(a); ”,it gives me access method "my_index" does not > exist > And I don't know where this message is from, can yo

回复: access method xxx does not exist

2022-10-29 Thread jack...@gmail.com
dat for my index. And I add codes in contrib and backend/access/myindex_name, is there any other places I need to add some infos? Who can help me? jack...@gmail.com

access method xxx does not exist

2022-10-29 Thread jack...@gmail.com
dat for my index. And I add codes in contrib and backend/access/myindex_name, is there any other places I need to add some infos? Who can help me? jack...@gmail.com

can you give me a sql example to explain this?

2022-10-25 Thread jack...@gmail.com
lt * node), regardless of the context of the VALUES list. It's up to parse * analysis to reject that where not valid. */ List*valuesLists; /* untransformed list of expression lists */ I need to understand what this is used for? jack...@gmail.com

Re: Re: please give me select sqls examples to distinct these!

2022-10-25 Thread jack...@gmail.com
> On Oct 25, 2022, at 7:55 AM, jack...@gmail.com wrote: > >  > > typedef enum SetOperation > { > SETOP_NONE = 0, > SETOP_UNION, > SETOP_INTERSECT, > SETOP_EXCEPT > } SetOperation; > jack...@gmail.com Please use just text. What ‘diale

please give me select sqls examples to distinct these!

2022-10-25 Thread jack...@gmail.com
typedef enum SetOperation { SETOP_NONE = 0, SETOP_UNION, SETOP_INTERSECT, SETOP_EXCEPT } SetOperation; jack...@gmail.com

How to get the selectStatement parse tree info?

2022-10-24 Thread jack...@gmail.com
me nothing,https://files.slack.com/files-pri/T0FS7GCKS-F048MD5BTME/quzk_6bk0sug60__f_0wh2l.png jack...@gmail.com

How to find an oid that's not uesd now?

2022-10-23 Thread jack...@gmail.com
I'm adding a new index in pg, but I find this. Duplicate OIDs detected: Duplicate OIDs detected: 357 357 found 1 duplicate OID(s) in catalog data found 1 duplicate OID(s) in catalog data what sql should I run to find one?

RE: PostgreSQL debug log doesn't record whole procedure(from receiving request to sending response)

2021-11-15 Thread Chen, Yan-Jack (NSB - CN/Hangzhou)
expect, even when you take into account ------ Yan-Jack Chen (陈雁) Tel: +8613957141340 Addr: No.567 XinCheng Rd, Binjiang District, Hangzhou, China, 310053 -Original Message- From: Tom Lane Sent: 2021年11月15日 23:09 To: Chen, Yan-Jack (NSB - CN/Han

Re: Static memory, shared memory

2021-01-11 Thread Jack Orenstein
 On Sat, Jan 9, 2021 at 12:18 PM Tom Lane wrote: > Jack Orenstein writes: > > I am writing a Postgres extension, and thought that I had memory > > corruption, (thanks for the --enable-cassert lead). I might, but It now > > looks like I need to understand the use of shar

Understanding GIN indexes

2021-01-11 Thread Jack Orenstein
be way off. Is there a presentation or paper that explains how GIN works? Jack Orenstein

Static memory, shared memory

2021-01-09 Thread Jack Orenstein
clarify my confusion, and perhaps point me at a tutorial on correct usage of the interfaces for LWLocks and shared memory, (I haven't been able to find one). Thank you. Jack Orenstein

Finding memory corruption in an extension

2021-01-08 Thread Jack Orenstein
, but this crash occurs without the index.) I'm interested in advice on how to go about hunting down my problem. Something along the lines of a debugging malloc, or valgrind, for Postgres. Jack Orenstein

Missing declaration of _PG_init()

2021-01-08 Thread Jack Orenstein
appears to be involved in programming language extensions, and the function is declared in plpgsql.h. Looking at various contrib modules, I see explicit declarations of _PG_init(void). Should _PG_init(void) be declared in someplace included by postgres.h or fmgr.h? Jack Orenstein

Re: Crashing on insert to GIN index

2021-01-03 Thread Jack Orenstein
Thank you, the missing STORAGE clause was the problem. As for the non-standard coding: I did start out with more correct coding, and it wandered off as I tried to figure out what was causing the crash. Jack Orenstein On Sun, Jan 3, 2021 at 7:57 PM Tom Lane wrote: > Jack Orenstein wri

Crashing on insert to GIN index

2021-01-03 Thread Jack Orenstein
ect, and that the PG_RETURN_POINTER statement is being reached. I have been reading the Postgres docs, and comparing my code to the examples in contrib, and cannot see what I'm doing wrong. Can anyone see a problem in what I've described? Or point me in the right direction to debug this problem? Thanks. Jack Orenstein

Btree vs. GIN

2021-01-01 Thread Jack Orenstein
to subsume GIN index capabilities? Jack Orenstein

Very large table: Partition it or not?

2020-12-16 Thread Jack Orenstein
query times will grow with table size, and that partitioning, combined with parallel query execution can address that problem. I'm more wondering about problems in maintaining tables and indexes once we have 10B, 20B, ... rows. Jack Orenstein

Re: Yum repository RPM behind release

2020-09-30 Thread Jack Douglas
> That happens when you modify the config file Thank you, that makes sense of course — and I had to change the config file to set `enabled=1` to enable the testing repo when we first installed.

Re: Yum repository RPM behind release

2020-09-30 Thread Jack Douglas
manually uninstall and re-install to get the stable repo in the list in /etc/yum.repos.d/pgdg-redhat-all.repo rpm -qa | grep pgdg rpm -e pgdg-redhat-repo-42.0-14.noarch dnf install -y https://download.postgresql.org/pub/repos/yum/reporpms/EL-8-x86_64/pgdg-redhat-repo-latest.noarch.rpm Jack

Yum repository RPM behind release

2020-09-26 Thread Jack Douglas
t I didn't get rc1 for a while after the release. Is the repository RPM updated on an automatic schedule? Ideally I'd like to get db<>fiddle updated on the day of the release, do I have to switch back to Debian from CentOS to achieve that? Jack

SPI Interface to Call Procedure with Transaction Control Statements

2019-01-03 Thread Jack LIU
Hi All, In PG-11, procedures were introduced. In the pg_partman tool, a procedure named run_maintenance_proc was developed to replace run_maintenance function. I was trying to call this procedure in pg_partman with SPI_execute() interface and this is the command being executed: CALL

Re: Duplicating data folder without tablespace, for read access

2018-08-28 Thread Jack Cushman
, Jack On Tue, Aug 14, 2018 at 11:57 AM Jack Cushman wrote: > Hi -- > > I'm wondering whether, in my specific situation, it would be safe to copy > a database cluster's data folder, and bring up the copy for read access, > without copying a tablespace linked from it. My situation (

Re: Duplicating data folder without tablespace, for read access

2018-08-14 Thread Jack Cushman
Thanks for such quick and helpful answers! My plan sounds probably better to avoid, but if it turns out to be necessary, you all gave me some helpful avenues and things to look out for. Best, Jack On Tue, Aug 14, 2018 at 1:06 PM, Stephen Frost wrote: > Greetings, > > * Jack Cushm

Duplicating data folder without tablespace, for read access

2018-08-14 Thread Jack Cushman
: - I could pg_dump and restore, but the 100GB table has lots of indexes and I'd rather not have to reindex on the release server each week. - I could replicate with pglogical and use some sort of blue-green setup on the release server to cut a release, but this adds a lot of moving parts, especially to deal with schema migrations. Thanks for any advice you might have! -Jack

RE: pg_dump to a remote server

2018-04-17 Thread Gao Jack
like gzip, -Fc, -Ft, -Fd -j 4(faster). -- Jack Gao jackg...@outlook.com > -Original Message- > From: Ron <ronljohnso...@gmail.com> > Sent: Tuesday, April 17, 2018 9:44 AM > To: Adrian Klaver <adrian.kla...@aklaver.com>; pgsql-general gene...@postgresql.org>

RE: Re:Postgresql with JDK

2018-04-17 Thread Gao Jack
en you will need to use a JDBC3 version of the driver, which will by necessity not be current, found in Other Versions. PostgreSQL JDBC 4.2 Driver, 42.2.2 -- Jack Gao jackg...@outlook.com > -Original Message- > From: vaibhav zaveri <vaibhavzave...@gmail.com> > Sent: Tuesday

RE: Which jdk version is supported by PostgreSQL

2018-04-17 Thread Gao Jack
ersion is supported by PostgreSQL? > > > Regards, > Vaibhav Zaveri Hi Do you mean jdbc? postgresql supports most versions of jdbc https://jdbc.postgresql.org/download.html -- Jack Gao jackg...@outlook.com

RE: pg_dump to a remote server

2018-04-16 Thread Gao Jack
gresql.org/docs/current/static/backup-dump.html#BACKUP-DUMP-RESTORE ... ... The ability of pg_dump and psql to write to or read from pipes makes it possible to dump a database directly from one server to another, for example: pg_dump -h host1 dbname | psql -h host2 dbname -- Jack Gao jackg...@outlook.com

Re: SQL statement in an error report for deferred constraint violation.

2018-04-16 Thread Jack Gao
t; $PGDATA/postgresql.conf sed -ir "s/#*log_directory.*/log_directory = 'pg_log'/" $PGDATA/postgresql.conf sed -ir "s/#*log_statement.*/log_statement= 'all'/" $PGDATA/postgresql.conf Execute this SQL and send error message in the log. regards Jack Gao -- Sent from: http://www.postgresql-archive.org/PostgreSQL-general-f1843780.html