Re: [GENERAL] Various intermittent bugs/instability - how to debug?

2008-09-25 Thread Frederik Ramm
Hi, just to give an update on this: Frederik Ramm wrote: Every other night, the process aborts with some strange error message, and never at the same position: [...] Turns out it *was* a RAM defect on one of the machines. memtest86 ran for a day and didn't detect it, but when I started

Re: [GENERAL] Various intermittent bugs/instability - how to debug?

2008-09-10 Thread Mark Cave-Ayland
Frederik Ramm wrote: Dear PostgreSQL community, I hope you can help me with a problem I'm having - I'm stuck and don't know how to debug this further. I have a rather large nightly process that imports a lot of data from the OpenStreetMap project into a PostGIS database, then proceeds

[GENERAL] Various intermittent bugs/instability - how to debug?

2008-09-09 Thread Frederik Ramm
Dear PostgreSQL community, I hope you can help me with a problem I'm having - I'm stuck and don't know how to debug this further. I have a rather large nightly process that imports a lot of data from the OpenStreetMap project into a PostGIS database, then proceeds doing all sorts of

Re: [GENERAL] Various intermittent bugs/instability - how to debug?

2008-09-09 Thread Joshua D. Drake
Frederik Ramm wrote: Dear PostgreSQL community, Every other night, the process aborts with some strange error message, and never at the same position: ERROR: invalid page header in block 166406 of relation node_tags ERROR: could not open segment 2 of relation 1663/24253056/24253895

Re: [GENERAL] Various intermittent bugs/instability - how to debug?

2008-09-09 Thread Frederik Ramm
Hi, Joshua D. Drake wrote: Hard drives. You said you replaced the machines and ran cpu burn etc... You didn't say you checked the hard drives (or replaced them). The new machine has new hard drives. On the old machine I had a hardware RAID5 array made up of 6x500 GB SATA with an Areca RAID

Re: [GENERAL] Various intermittent bugs/instability - how to debug?

2008-09-09 Thread Scott Marlowe
On Tue, Sep 9, 2008 at 8:50 AM, Frederik Ramm [EMAIL PROTECTED] wrote: Dear PostgreSQL community, I hope you can help me with a problem I'm having - I'm stuck and don't know how to debug this further. I have a rather large nightly process that imports a lot of data from the OpenStreetMap

Re: [GENERAL] Various intermittent bugs/instability - how to debug?

2008-09-09 Thread Scott Marlowe
Also, I'd try running a large, long running pgbench test to see if you get any errors. If such a simple schema / operation in large scale gets errors it's almost certainly a hardware failure. Have you had power removed while the system was running? With a lot of direct attached SATA drives you

Re: [GENERAL] Various intermittent bugs/instability - how to debug?

2008-09-09 Thread Martijn van Oosterhout
On Tue, Sep 09, 2008 at 04:50:53PM +0200, Frederik Ramm wrote: I have a rather large nightly process that imports a lot of data from the OpenStreetMap project into a PostGIS database, then proceeds doing all sorts of things - creating spatial indexes, computing bounding boxes, doing

Re: [GENERAL] Various intermittent bugs/instability - how to debug?

2008-09-09 Thread Tom Lane
Scott Marlowe [EMAIL PROTECTED] writes: On Tue, Sep 9, 2008 at 8:50 AM, Frederik Ramm I hope you can help me with a problem I'm having - I'm stuck and don't know how to debug this further. You definitely are suffering from db corruption, and given the number and differing type of errors, it