Re: [HACKERS] pg_restore [archiver] file offset in dump file

2005-11-01 Thread Kevin Grittner
I am sure I set binary mode. Even with that and an identical file length, I figured I should confirm a good transfer before posting; hence the md5sum on both sides. Both sides were built from the source. Here at home I don't have the info on what configure switches were used, but I did both the

Re: [HACKERS] Call for port reports

2005-11-01 Thread Adrian Maier
Hi, PostgreSql 8.1 RC1 ( --with-perl --with-python) passed all tests on Slackware Linux 10.2 (kernel 2.4.31, x86) Regards, Adrian Maier ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate s

Re: [HACKERS] pg_restore [archiver] file offset in dump file is too

2005-11-01 Thread Tom Lane
Andrew Dunstan <[EMAIL PROTECTED]> writes: > Hmm. Windows reports an offset size of 4 bytes on a dump I just made ... > is that relevant? What governs it? [ looks again... ] Hm, that is a 40Gb dump Kevin is complaining of, isn't it. Do our Windows builds have LARGEFILE support?

Re: slru.c race condition (was Re: [HACKERS] TRAP: FailedAssertion("!((itemid)->lp_flags

2005-11-01 Thread Tom Lane
Greg Stark <[EMAIL PROTECTED]> writes: > I happen to think that except for the rare assertion that has major > performance impact all the assertions should be on in production builds. The > goal of assertions is to catch corruption quickly and that's something that's > just as important in producti

Re: [HACKERS] 8.1-compatible xlogdump

2005-11-01 Thread Tom Lane
Alvaro Herrera <[EMAIL PROTECTED]> writes: > Jonah H. Harris wrote: >> Does anyone have a copy of xlogdump updated for 8.1? If so, please send me a >> copy. Otherwise I'll update it and forward the diffs. > We should definitely consider completing it and including it in contrib. There is already

Re: [HACKERS] pg_restore [archiver] file offset in dump file is too

2005-11-01 Thread Andrew Dunstan
Hmm. Windows reports an offset size of 4 bytes on a dump I just made ... is that relevant? What governs it? cheers andrew Kevin Grittner wrote: Posting here because it may be a 8.1 pre-release problem. I'll take it to the admin list if it looks like it's not. File dumped from 8.1beta3 us

Re: [HACKERS] pg_restore [archiver] file offset in dump file is too large

2005-11-01 Thread Tom Lane
"Kevin Grittner" <[EMAIL PROTECTED]> writes: > File dumped from 8.1beta3 using pg_dump -Fc on Linux box. > This dump restored successfully onto 8.1RC1 on Linux box. > File FTP'd to Windows box; attempt to restore onto 8.1RC1 fails with: > pg_restore [archiver] file offset in dump file is too large

Re: slru.c race condition (was Re: [HACKERS] TRAP: FailedAssertion("!((itemid)->lp_flags

2005-11-01 Thread Greg Stark
Bruce Momjian writes: > Jim C. Nasby wrote: > > > My assumption is that the asserts that are currently in place fall into > > one of two categories: either they check for something that if false > > could result in data corruption in the heap, or they check for something > > that shouldn't happe

Re: [HACKERS] 8.1-compatible xlogdump

2005-11-01 Thread Jonah H. Harris
I agree. On 11/1/05, Alvaro Herrera <[EMAIL PROTECTED]> wrote: Jonah H. Harris wrote:> Does anyone have a copy of xlogdump updated for 8.1? If so, please send me a > copy. Otherwise I'll update it and forward the diffs.We should definitely consider completing it and including it in contrib.--Alvaro

Re: [HACKERS] Reducing the overhead of NUMERIC data

2005-11-01 Thread J. Andrew Rogers
On 11/1/05 2:38 PM, "Jim C. Nasby" <[EMAIL PROTECTED]> wrote: > > FWIW, most databases I've used limit NUMERIC to 38 digits, presumably to > fit length info into 1 or 2 bytes. So there's something to be said for a > small numeric type that has less overhead and a large numeric (what we > have toda

Re: [HACKERS] 8.1-compatible xlogdump

2005-11-01 Thread Alvaro Herrera
Jonah H. Harris wrote: > Does anyone have a copy of xlogdump updated for 8.1? If so, please send me a > copy. Otherwise I'll update it and forward the diffs. We should definitely consider completing it and including it in contrib. -- Alvaro Herrera Valdivia, Chile ICBM: S 39º 49' 17.7",

Re: [HACKERS] Ideas for easier debugging of backend problems

2005-11-01 Thread Christopher Kings-Lynne
What about the Google Core Dumper? :) http://sourceforge.net/projects/goog-coredumper/ Chris Peter Eisentraut wrote: Martijn van Oosterhout wrote: 3. Add either a GUC or a command line switch or PGOPTION switch to automatically invoke and attach gdb on certain types of error. Obviously you

[HACKERS] 8.1-compatible xlogdump

2005-11-01 Thread Jonah H. Harris
Does anyone have a copy of xlogdump updated for 8.1?  If so, please send me a copy.  Otherwise I'll update it and forward the diffs.   -Jonah

[HACKERS] pg_restore [archiver] file offset in dump file is too large

2005-11-01 Thread Kevin Grittner
Posting here because it may be a 8.1 pre-release problem. I'll take it to the admin list if it looks like it's not. File dumped from 8.1beta3 using pg_dump -Fc on Linux box. This dump restored successfully onto 8.1RC1 on Linux box. File FTP'd to Windows box; attempt to restore onto 8.1RC1 fails w

Re: [HACKERS] Reducing the overhead of NUMERIC data

2005-11-01 Thread Tom Lane
Simon Riggs <[EMAIL PROTECTED]> writes: > Anybody like to work out a piece of SQL to perform data profiling and > derive the distribution of values with trailing zeroes? Don't forget leading zeroes. And all-zero (we omit digits entirely in that case). I don't think you can claim that zero isn't

Re: [HACKERS] slru.c race condition

2005-11-01 Thread Chris Browne
[EMAIL PROTECTED] (Alvaro Herrera) writes: > Chris Browne wrote: >> [EMAIL PROTECTED] ("Jim C. Nasby") writes: >> >> > On Tue, Nov 01, 2005 at 11:23:55AM -0300, Alvaro Herrera wrote: >> >> Tom Lane wrote: >> >> > "Jim C. Nasby" <[EMAIL PROTECTED]> writes: >> >> > > AFAIK they're not using subtran

Re: [HACKERS] Reducing the overhead of NUMERIC data

2005-11-01 Thread Tom Lane
"Jim C. Nasby" <[EMAIL PROTECTED]> writes: > On Tue, Nov 01, 2005 at 05:40:35PM -0500, Tom Lane wrote: >> Maybe if we had a few other datatypes that could also use the feature. >> [ thinks... ] inet/cidr comes to mind but I don't see any others. >> The case seems a bit weak :-( > Would varchar(25

Re: [HACKERS] Reducing the overhead of NUMERIC data

2005-11-01 Thread Simon Riggs
On Tue, 2005-11-01 at 23:16 +0100, Martijn van Oosterhout wrote: lots of useful things, thank you. > > So, assuming I have this all correct, means we could reduce the on disk > > storage for NUMERIC datatypes to the following struct. This gives an > > overhead of just 2.5 bytes, plus the loss of

Re: [HACKERS] Reducing the overhead of NUMERIC data

2005-11-01 Thread Tom Lane
"Jim C. Nasby" <[EMAIL PROTECTED]> writes: > FWIW, most databases I've used limit NUMERIC to 38 digits, presumably to > fit length info into 1 or 2 bytes. So there's something to be said for a > small numeric type that has less overhead and a large numeric (what we > have today). I don't think it'

Re: [HACKERS] Reducing the overhead of NUMERIC data

2005-11-01 Thread Jim C. Nasby
On Tue, Nov 01, 2005 at 05:40:35PM -0500, Tom Lane wrote: > Martijn van Oosterhout writes: > > You are proposing a fourth type, say VARLENA2 which looks a lot like a > > verlena but it's not. I think the shear volume of code that would need > > to be checked is huge. Also, things like pg_attribute

Re: [HACKERS] Reducing the overhead of NUMERIC data

2005-11-01 Thread Simon Riggs
On Tue, 2005-11-01 at 16:54 -0500, Tom Lane wrote: > Simon Riggs <[EMAIL PROTECTED]> writes: > > varlen is int32 to match the standard varlena header. However, the max > > number of digits of the datatype is less than the threshold at which > > values get toasted. So no NUMERIC values ever get toas

Re: [HACKERS] Reducing the overhead of NUMERIC data

2005-11-01 Thread Jim C. Nasby
On Tue, Nov 01, 2005 at 11:16:58PM +0100, Martijn van Oosterhout wrote: > Consider the algorithm: A number is stored as base + exponent. To > multiply two numbers you can multiply the bases and add the exponents. > OTOH, if you store the decimal inside the data, now you have to extract > it again b

Re: [HACKERS] Reducing the overhead of NUMERIC data

2005-11-01 Thread Tom Lane
Martijn van Oosterhout writes: > You are proposing a fourth type, say VARLENA2 which looks a lot like a > verlena but it's not. I think the shear volume of code that would need > to be checked is huge. Also, things like pg_attribute would need > changing because you have to represent this new stat

Re: [HACKERS] Reducing the overhead of NUMERIC data

2005-11-01 Thread Jim C. Nasby
On Tue, Nov 01, 2005 at 04:54:11PM -0500, Tom Lane wrote: > It might be reasonable to restrict the range of NUMERIC to the point > that we could fit the weight/sign/dscale into 2 bytes instead of 4, > thereby saving 2 bytes per NUMERIC. I'm not excited about the other > aspects of this, though. F

Re: [HACKERS] Reducing the overhead of NUMERIC data

2005-11-01 Thread Martijn van Oosterhout
On Tue, Nov 01, 2005 at 09:22:17PM +, Simon Riggs wrote: > varlen is int32 to match the standard varlena header. However, the max > number of digits of the datatype is less than the threshold at which > values get toasted. So no NUMERIC values ever get toasted - in which > case, why worry about

Re: [HACKERS] Reducing the overhead of NUMERIC data

2005-11-01 Thread Tom Lane
Simon Riggs <[EMAIL PROTECTED]> writes: > varlen is int32 to match the standard varlena header. However, the max > number of digits of the datatype is less than the threshold at which > values get toasted. So no NUMERIC values ever get toasted - in which > case, why worry about matching the size of

[HACKERS] Attn: Richard Huxton

2005-11-01 Thread Dave Page
Hi Richard, Dunno if you'll see this via the list, but your email address seems to be bouncing messages from me: dev@archonet.com on 01/11/2005 20:48 The message cannot be delivered due to a configuration error on the server. Please contact your Administrator. < s1.u

[HACKERS] Reducing the overhead of NUMERIC data

2005-11-01 Thread Simon Riggs
Currently, the overhead of NUMERIC datatype is 8 bytes. Each value is stored on disk as typedef struct NumericData { int32 varlen; /* Variable size (std varlena header) */ int16 n_weight; /* Weight of 1st digit */ uint16 n_sign_dscale; /* Sign + display

Re: [HACKERS] slru.c race condition

2005-11-01 Thread Alvaro Herrera
Chris Browne wrote: > [EMAIL PROTECTED] ("Jim C. Nasby") writes: > > > On Tue, Nov 01, 2005 at 11:23:55AM -0300, Alvaro Herrera wrote: > >> Tom Lane wrote: > >> > "Jim C. Nasby" <[EMAIL PROTECTED]> writes: > >> > > AFAIK they're not using subtransactions at all, but I'll check. > >> > > >> > Well

Re: [HACKERS] 8.1 Release Candidate 1 Bundled ...

2005-11-01 Thread Devrim GUNDUZ
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi Lamar, On Mon, 31 Oct 2005, Lamar Owen wrote: So thinking that: * Beta and RC RPMs are used only by testers * We use the beta and RC steps to build the new RPM sets, so that means that actually they are not production quality looking from th

Re: [HACKERS] slru.c race condition

2005-11-01 Thread Chris Browne
[EMAIL PROTECTED] ("Jim C. Nasby") writes: > AFAIK they're not using subtransactions at all, but I'll check. Are they perchance using pl/PerlNG? We discovered a problem with Slony-I's handling of subtransactions which was exposed by pl/PerlNG, which evidently wraps its SPI calls inside subtransac

Re: [HACKERS] slru.c race condition

2005-11-01 Thread Chris Browne
[EMAIL PROTECTED] ("Jim C. Nasby") writes: > On Tue, Nov 01, 2005 at 11:23:55AM -0300, Alvaro Herrera wrote: >> Tom Lane wrote: >> > "Jim C. Nasby" <[EMAIL PROTECTED]> writes: >> > > AFAIK they're not using subtransactions at all, but I'll check. >> > >> > Well, yeah, they are ... else you'd neve

Re: slru.c race condition (was Re: [HACKERS] TRAP: FailedAssertion("!((itemid)->lp_flags & 0x01)",)

2005-11-01 Thread Tom Lane
"Jim C. Nasby" <[EMAIL PROTECTED]> writes: > Doesn't clog use the same code? Yeah, but all three of your examples were referencing pg_subtrans, as proven by the stack traces and the contents of the shared control block. Even though the bug seems completely clog.c's fault, this is not a coincidenc

Re: slru.c race condition (was Re: [HACKERS] TRAP: FailedAssertion("!((itemid)->lp_flags & 0x01)",)

2005-11-01 Thread Tom Lane
I wrote: > Even though the bug seems completely clog.c's fault, s/clog.c/slru.c/ of course :-( regards, tom lane ---(end of broadcast)--- TIP 6: explain analyze is your friend

Re: slru.c race condition (was Re: [HACKERS] TRAP: FailedAssertion("!((itemid)->lp_flags & 0x01)",)

2005-11-01 Thread Jim C. Nasby
On Tue, Nov 01, 2005 at 11:23:55AM -0300, Alvaro Herrera wrote: > Tom Lane wrote: > > "Jim C. Nasby" <[EMAIL PROTECTED]> writes: > > > AFAIK they're not using subtransactions at all, but I'll check. > > > > Well, yeah, they are ... else you'd never have seen this failure. > > Maybe it's in plpgsq

Re: slru.c race condition (was Re: [HACKERS] TRAP: FailedAssertion("!((itemid)->lp_flags & 0x01)",)

2005-11-01 Thread Jim C. Nasby
On Tue, Nov 01, 2005 at 11:23:55AM -0300, Alvaro Herrera wrote: > Tom Lane wrote: > > "Jim C. Nasby" <[EMAIL PROTECTED]> writes: > > > AFAIK they're not using subtransactions at all, but I'll check. > > > > Well, yeah, they are ... else you'd never have seen this failure. > > Maybe it's in plpgsq

Re: [HACKERS] Ideas for easier debugging of backend problems

2005-11-01 Thread Jim C. Nasby
On Tue, Nov 01, 2005 at 12:33:39PM +0100, Peter Eisentraut wrote: > Martijn van Oosterhout wrote: > > 3. Add either a GUC or a command line switch or PGOPTION switch to > > automatically invoke and attach gdb on certain types of error. > > Obviously you can only do this where stdin, stdout and std

Re: [HACKERS] Debug in dest.h

2005-11-01 Thread Tom Lane
Alvaro Herrera <[EMAIL PROTECTED]> writes: > The "Debug" destreceiver has a pretty bad name. In fact for PL/php it > collides with a PHP symbol. Does anyone mind if I rename it to, say, > DestDebug? If you do that, you should rename all the values of the enum (DestNone, etc). For consistency, a

Re: [HACKERS] FreeBSD broke with autoconf-based build

2005-11-01 Thread Marc G. Fournier
On Tue, 1 Nov 2005, Peter Eisentraut wrote: Marc G. Fournier wrote: Also, which port of autoconf are you using? We're still stuck at 2.59, so if you are using the newer port available in FreeBSD, you may be being bitten by that as well ... If you're using something newer than 2.59, you're do

[HACKERS] Debug in dest.h

2005-11-01 Thread Alvaro Herrera
Hackers, The "Debug" destreceiver has a pretty bad name. In fact for PL/php it collides with a PHP symbol. Does anyone mind if I rename it to, say, DestDebug? -- Alvaro Herrerahttp://www.advogato.org/person/alvherre "El sabio habla porque tiene algo que decir; el tonto,

Re: [HACKERS] FreeBSD broke with autoconf-based build

2005-11-01 Thread Tom Lane
[EMAIL PROTECTED] writes: > We'll have to add a check for ELF_SYSTEM in our own configure script. > Wouldn't this be a problem for pgxs-compiled modules as well ? No, because they import the PG installation's Makefile.global. If you are importing Makefile.shlib and not Makefile.global, you are do

Re: [HACKERS] FreeBSD broke with autoconf-based build

2005-11-01 Thread Peter Eisentraut
Marc G. Fournier wrote: > Also, which port of autoconf are you using? We're still stuck at > 2.59, so if you are using the newer port available in FreeBSD, you > may be being bitten by that as well ... If you're using something newer than 2.59, you're doing something weird... ftp://ftp.gnu.org/

Re: [HACKERS] FreeBSD broke with autoconf-based build

2005-11-01 Thread strk
On Tue, Nov 01, 2005 at 09:10:24AM -0500, Tom Lane wrote: > [EMAIL PROTECTED] writes: > > I'm having troubles building postgis HEAD on freebsd > > using the new autoconf-based scripts. > > FreeBSD which, exactly? It makes a difference, because AFAICS from > configure newer versions of FreeBSD use

Re: [HACKERS] FreeBSD broke with autoconf-based build

2005-11-01 Thread Andrew Dunstan
Isn't the point about autoconf that the user should not have to run it, or even have it installed? Only the package creator should have to care about autoconf versions, surely, or else it is pointless. cheers andrew Marc G. Fournier wrote: Also, which port of autoconf are you using? We'r

Re: [HACKERS] FreeBSD broke with autoconf-based build

2005-11-01 Thread Marc G. Fournier
Also, which port of autoconf are you using? We're still stuck at 2.59, so if you are using the newer port available in FreeBSD, you may be being bitten by that as well ... On Tue, 1 Nov 2005, Tom Lane wrote: [EMAIL PROTECTED] writes: I'm having troubles building postgis HEAD on freebsd

Re: [HACKERS] [Fwd: Re: regression failures on WIndows in machines

2005-11-01 Thread Andrew Dunstan
Tom Lane wrote: bigtest: ! $(SHELL) ./pg_regress --schedule=$(srcdir)/serial_schedule --multibyte=$(MULTIBYTE) --load-language=plpgsql numeric_big $(NOLOCALE) bigcheck: ! $(SHELL) ./pg_regress --temp-install --top-builddir=$(top_builddir) --temp-port=$(TEMP_PORT

Re: [HACKERS] Call for port reports

2005-11-01 Thread Euler Taveira de Oliveira
--- Tom Lane <[EMAIL PROTECTED]> escreveu: > If you don't see your favorite platform already listed as tested > for 8.1 at > http://developer.postgresql.org/docs/postgres/supported-platforms.html > then please give it a try and send in your results. > [EMAIL PROTECTED]:~# uname -a Linux foobar 2

Re: slru.c race condition (was Re: [HACKERS] TRAP: FailedAssertion("!((itemid)->lp_flags & 0x01)",)

2005-11-01 Thread Alvaro Herrera
Tom Lane wrote: > "Jim C. Nasby" <[EMAIL PROTECTED]> writes: > > AFAIK they're not using subtransactions at all, but I'll check. > > Well, yeah, they are ... else you'd never have seen this failure. Maybe it's in plpgsql EXCEPTION clauses. -- Alvaro Herrera Valdivia, Chile ICBM: S 39º 4

Re: [HACKERS] FreeBSD broke with autoconf-based build

2005-11-01 Thread Tom Lane
[EMAIL PROTECTED] writes: > I'm having troubles building postgis HEAD on freebsd > using the new autoconf-based scripts. FreeBSD which, exactly? It makes a difference, because AFAICS from configure newer versions of FreeBSD use ELF, and the link switches are different then. > The Makefile.shlib

Re: [HACKERS] [Fwd: Re: regression failures on WIndows in machines with some non-English locales]

2005-11-01 Thread Tom Lane
Andrew Dunstan <[EMAIL PROTECTED]> writes: > This has refreshed my fading memory. The patch seems like the best > solution. Is there any objection to applying it? Putting the switch at the end seems certain to fail on some platforms (some versions of getopt are fussier than others). > bigtes

Re: [HACKERS] Adding a column in pg_proc for storing default values of arguments

2005-11-01 Thread Tom Lane
Salman Razzaq <[EMAIL PROTECTED]> writes: > I want to store default values of arguments in pg_proc catalog. i have to > add a column in the table. but what will be the type of column as to store > all the datatypes. do you think 'Datum' can be stored as it. Don't bother worrying about that until y

[HACKERS] [Fwd: Re: regression failures on WIndows in machines with some non-English locales]

2005-11-01 Thread Andrew Dunstan
This has refreshed my fading memory. The patch seems like the best solution. Is there any objection to applying it? (Petr, I assume you intended to send this to a mailing list also) cheers andrew Original Message Subject: Re: regression failures on WIndows in machines wit

Re: [HACKERS] Differences in UTF8 between 8.0 and 8.1

2005-11-01 Thread Paul Lindner
On Sun, Oct 30, 2005 at 11:49:41AM -0500, Gregory Maxwell wrote: > On 10/26/05, Christopher Kings-Lynne <[EMAIL PROTECTED]> wrote: > > > iconv -c -f UTF8 -t UTF8 > > recode UTF-8..UTF-8 < dump_in.sql > dump_out.sql > > I've got a file with characters that pg won't accept that recode does > not f

Re: [HACKERS] Ideas for easier debugging of backend problems

2005-11-01 Thread Peter Eisentraut
Martijn van Oosterhout wrote: > 3. Add either a GUC or a command line switch or PGOPTION switch to > automatically invoke and attach gdb on certain types of error. > Obviously you can only do this where stdin, stdout and stderr have > not been redirected. Samba has a configuration parameter that

[HACKERS] Adding a column in pg_proc for storing default values of arguments

2005-11-01 Thread Salman Razzaq
I want to store default values of arguments in pg_proc catalog. i have toadd a column in the table. but what will be the type of column as to storeall the datatypes. do you think 'Datum' can be stored as it.

[HACKERS] FreeBSD broke with autoconf-based build

2005-11-01 Thread strk
I'm having troubles building postgis HEAD on freebsd using the new autoconf-based scripts. The Makefile.shlib file copied by pgsql sources adds a -Bforcearchive flag to LINK.shared with arch is freebsd, but the flag seems to be unsupported (this is from 7.2.1 to 8.0.0) Weird enough PostgreSQL bui