Re: [HACKERS] Inefficient bytea escaping?
On 5/30/06, Bruce Momjian pgman@candle.pha.pa.us wrote: The crux of the matter was if its possible to use fwrite as easy string combining mechanism and the answer is no, because it's not lightweight enough. So your patch to src/backend/storage/file/fd.c should be discarded? OK. Yes. It was just for experimenting. As I understand Tom already rewrote the critical path. -- marko ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can get through to the mailing list cleanly
[HACKERS] plperl's ppport.h out of date?
ppport.h is throwing warnings when compiling on Fedora Core 5 (with perl-5.8.8-4). I gather from the comments in the head of that file that we ought to look for a newer version. regards, tom lane ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can get through to the mailing list cleanly
[HACKERS] 64bit build vs 32 bit build
Is it possible to use a binary copy of the cluster on a 64 bit build of pg 7.4.x that was created on a 32bit bild of 7.4.x assuming x is the same and integer-date-times are not enabled ? Dave ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can get through to the mailing list cleanly
Re: [HACKERS] 64bit build vs 32 bit build
On Tue, May 30, 2006 at 08:50:23AM -0400, Dave Cramer wrote: Is it possible to use a binary copy of the cluster on a 64 bit build of pg 7.4.x that was created on a 32bit bild of 7.4.x assuming x is the same and integer-date-times are not enabled ? I doubt it very much. Or put another way, no effort has been put into making it work... Have a nice day, -- Martijn van Oosterhout kleptog@svana.org http://svana.org/kleptog/ From each according to his ability. To each according to his ability to litigate. signature.asc Description: Digital signature
[HACKERS] session id and global storage
Hi, I cant find any function, which tells me something like session id. Is there something like that? I need it in my AM, because I need to know, if something which I wrote in file was written in this current session or previously. And second thing - it would be great if I could save pointer in some global storage, because I would like to access my dynamically created tree in more subsequent scans, which is impossible with void pointer stored just in opaque scan structure:( Thnaks, David Hoksza ---(end of broadcast)--- TIP 5: don't forget to increase your free space map settings
Re: [HACKERS] plperl's ppport.h out of date?
Tom Lane wrote: ppport.h is throwing warnings when compiling on Fedora Core 5 (with perl-5.8.8-4). I gather from the comments in the head of that file that we ought to look for a newer version. I don't currently have an FC5 box to test with. Here's what to try: move the ppport.h aside, and in the plperl directory run this command to generate a replacement: perl -MDevel::PPPort -e 'Devel::PPPort::WriteFile();' and then recompile. The last substantial change to ppport.h was when I mangled the old one a bit to get it to work with perl 5.05 - which we no longer support (see recent discussion). It does have some fairly horrible stuff (e.g. function bodies). cheers andrew ---(end of broadcast)--- TIP 2: Don't 'kill -9' the postmaster
Re: [HACKERS] [GENERAL] 8.1.4 - problem with PITR - .backup.done / backup.ready version of the same file at the same time.
Rafael Martinez, Guerrero [EMAIL PROTECTED] writes: The problem was that 000100080010.0006D5E8.backup was already archived, but under pg_xlog/archive_status/ there were two files: - 000100080010.0006D5E8.backup.done 000100080010.0006D5E8.backup.ready - This situation should not happen, anyone has seen this problem before? No, it shouldn't. What I suspect is that XLogArchiveIsDone() got confused and created a duplicate .ready file. It basically assumes that the only way its stat() calls can fail is ENOENT, ie, file not there ... but I wonder if they failed for some other reason instead. What sort of platform and filesystem is this on? Did you happen to make note of the mod times of the two files before deleting them? regards, tom lane ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq
Re: [HACKERS] plperl's ppport.h out of date?
Andrew Dunstan [EMAIL PROTECTED] writes: I don't currently have an FC5 box to test with. Here's what to try: move the ppport.h aside, and in the plperl directory run this command to generate a replacement: perl -MDevel::PPPort -e 'Devel::PPPort::WriteFile();' and then recompile. Hm. It compiles without warnings, but the new ppport.h is about 100K larger than the old one :-(. The change we seem to actually need is just to put #ifndef PERL_UNUSED_DECL around the attempted declaration of that macro, so I'm inclined to just commit that rather than buy into everything else that seems to have been done to PPPort lately. Thoughts? regards, tom lane ---(end of broadcast)--- TIP 5: don't forget to increase your free space map settings
Re: [HACKERS] 64bit build vs 32 bit build
Martijn van Oosterhout kleptog@svana.org writes: On Tue, May 30, 2006 at 08:50:23AM -0400, Dave Cramer wrote: Is it possible to use a binary copy of the cluster on a 64 bit build of pg 7.4.x that was created on a 32bit bild of 7.4.x I doubt it very much. Or put another way, no effort has been put into making it work... Even more to the point: the reason it won't work is that MAXALIGN is probably different in the two builds. Very recent PG releases check this via a pg_control field, but 7.4.x will probably just crash. regards, tom lane ---(end of broadcast)--- TIP 6: explain analyze is your friend
Re: [HACKERS] Compile libpq with vc8
When is this patch going to be applied? Is there a bug that I can follow along? thanks. jeff * From: Bruce Momjian pgman ( at ) candle ( dot ) pha ( dot ) pa ( dot ) us * To: Yannick ybgn ( at ) free ( dot ) fr * Subject: Re: Compile libpq with vc8 * Date: Mon, 29 May 2006 15:39:50 -0400 (EDT) Yes, I have a patch in the queue to fix it. Should be applied soon. --- Yannick wrote: Hi, I am trying to compile libpq with vc8. I got errors in wchar.c ..\..\backend\utils\mb\wchar.c(99) : error C2054: expected '(' to follow 'inline' ..\..\backend\utils\mb\wchar.c(100) : error C2085: 'pg_euc_mblen' : not in formal parameter list ..\..\backend\utils\mb\wchar.c(100) : error C2143: syntax error : missing ';' before '{' If I remove the inline, I got an error in: [...]postgresql-8.1.4\src\include\utils/elog.h(105) : error C2365: 'errcode' : redefinition; previous definition was 'typedef' Does anyone already compiled libpq with vc8? Yannick. ---(end of broadcast)--- TIP 6: explain analyze is your friend
Re: [HACKERS] plperl's ppport.h out of date?
Andrew Dunstan [EMAIL PROTECTED] writes: Tom Lane wrote: Hm. It compiles without warnings, but the new ppport.h is about 100K larger than the old one :-(. The change we seem to actually need is just to put #ifndef PERL_UNUSED_DECL around the attempted declaration of that macro, so I'm inclined to just commit that rather than buy into everything else that seems to have been done to PPPort lately. Well, if we start to use newer APIs at some stage, or if older APIs get replaced and moved into ppport.h, we will probably have to upgrade. That doesn't seem to be the case for now, so the minimal change seems reasonable - in fact Devrim asked me about this a week or so ago and in effect that's what I suggested to him, although I never heard back from him. A more radical solution is to remove ppport.h from our distribution entirely, and have the Makefile generate it at build time, using that same little bit of script you showed. Or is Devel::PPPort not part of the standard Perl distribution? regards, tom lane ---(end of broadcast)--- TIP 9: In versions below 8.0, the planner will ignore your desire to choose an index scan if your joining column's datatypes do not match
Re: [HACKERS] [ADMIN] Problem building initdb on sparc10
Averbukh Stella [EMAIL PROTECTED] writes: I'm building postgresQL on Sparc10 and the build goes fine unil initdb. /usr/local/bin/gcc -O2 -Wall -Wmissing-prototypes -Wpointer-arith -Winline -Wendif-labels -fno-strict-aliasing initdb.o -L../../../src/port -lpgport -L../../../src/interfaces/libpq -lpq -L../../../src/port -Wl,-R/postgres/lib -L/lib -L/usr/lib -L/usr/local/lib -L/usr/local/ssl/lib -L/platform/SUNW,Ultra-60/lib -L/usr/sfw/lib/sparcv9 -L/usr/sfw/lib/ -L/usr/local/lib/sparcv9 -lpgport -lz -lrt -lresolv -lgen -lsocket -lnsl -ldl -lm -o initdb Undefined first referenced symbol in file sigmask ../../../src/interfaces/libpq/libpq.so sigblock ../../../src/interfaces/libpq/libpq.so When did you last successfully build PG on this system? I'm guessing you must have been using 7.4 or older, because AFAICS this was broken by this 8.0 change: 2004-01-08 21:02 momjian * doc/src/sgml/libpq.sgml, src/backend/nodes/read.c, src/interfaces/libpq/fe-connect.c, src/interfaces/libpq/fe-print.c, src/interfaces/libpq/fe-secure.c, src/interfaces/libpq/libpq-fe.h, src/interfaces/libpq/libpq-int.h, src/interfaces/libpq/pqsignal.c, src/interfaces/libpq/pqsignal.h: Allow libpq to do thread-safe SIGPIPE handling. This allows it to ignore SIGPIPE from send() in libpq, but terminate on any other SIGPIPE, unless the user installs their own signal handler. This is a minor fix because the only time you get SIGPIPE from libpq's send() is when the backend dies. The code appears to unconditionally assume that sigmask() and sigblock() exist. Not a good assumption. AFAICS pqsignalinquire() isn't even used anywhere (at least not in HEAD), so the simplest answer may be to remove it rather than try to fix it. It's in src/interfaces/libpq/pqsignal.c. regards, tom lane ---(end of broadcast)--- TIP 2: Don't 'kill -9' the postmaster
Re: [HACKERS] [ADMIN] Problem building initdb on sparc10
Hi Tom, Actually I'm building it first time. The system didn't have prior versions of postgreSQL installed. I took postgresql-8.1.3.tar.gz code distribution. I'll try to remove it from the code. Thanks. Stella Averbukh _ Senior Software Lead, Arbitron Inc. Phone: (410) 312-8387 Fax: (410) 312-8614 e-mail: mailto:[EMAIL PROTECTED] -Original Message- From: Tom Lane [mailto:[EMAIL PROTECTED] Sent: Tuesday, May 30, 2006 11:29 AM To: Averbukh Stella Cc: pgsql-admin@postgresql.org; pgsql-hackers@postgresql.org; Bruce Momjian Subject: Re: [ADMIN] Problem building initdb on sparc10 Averbukh Stella [EMAIL PROTECTED] writes: I'm building postgresQL on Sparc10 and the build goes fine unil initdb. /usr/local/bin/gcc -O2 -Wall -Wmissing-prototypes -Wpointer-arith -Winline -Wendif-labels -fno-strict-aliasing initdb.o -L../../../src/port -lpgport -L../../../src/interfaces/libpq -lpq -L../../../src/port -Wl,-R/postgres/lib -L/lib -L/usr/lib -L/usr/local/lib -L/usr/local/ssl/lib -L/platform/SUNW,Ultra-60/lib -L/usr/sfw/lib/sparcv9 -L/usr/sfw/lib/ -L/usr/local/lib/sparcv9 -lpgport -lz -lrt -lresolv -lgen -lsocket -lnsl -ldl -lm -o initdb Undefined first referenced symbol in file sigmask ../../../src/interfaces/libpq/libpq.so sigblock ../../../src/interfaces/libpq/libpq.so When did you last successfully build PG on this system? I'm guessing you must have been using 7.4 or older, because AFAICS this was broken by this 8.0 change: 2004-01-08 21:02 momjian * doc/src/sgml/libpq.sgml, src/backend/nodes/read.c, src/interfaces/libpq/fe-connect.c, src/interfaces/libpq/fe-print.c, src/interfaces/libpq/fe-secure.c, src/interfaces/libpq/libpq-fe.h, src/interfaces/libpq/libpq-int.h, src/interfaces/libpq/pqsignal.c, src/interfaces/libpq/pqsignal.h: Allow libpq to do thread-safe SIGPIPE handling. This allows it to ignore SIGPIPE from send() in libpq, but terminate on any other SIGPIPE, unless the user installs their own signal handler. This is a minor fix because the only time you get SIGPIPE from libpq's send() is when the backend dies. The code appears to unconditionally assume that sigmask() and sigblock() exist. Not a good assumption. AFAICS pqsignalinquire() isn't even used anywhere (at least not in HEAD), so the simplest answer may be to remove it rather than try to fix it. It's in src/interfaces/libpq/pqsignal.c. regards, tom lane __ This e-mail has been scanned by Arbitron's Email Content Service. __ ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can get through to the mailing list cleanly
Re: [HACKERS] plperl's ppport.h out of date?
Andrew Dunstan [EMAIL PROTECTED] writes: It is, but this misses the point. You want to use the latest ppport.h even when building with earlier perls. Doh, of course. Well, for the moment I'll just put in the #ifndef. FWIW, it looks like a large part of the bloat in the newer file is in-line documentation, which we hardly need to include in our distribution. I'll leave it to someone more familiar with Perl to determine whether we want to try to use a slimmed-down copy of the up-to-date output. regards, tom lane ---(end of broadcast)--- TIP 6: explain analyze is your friend
Re: [HACKERS] anoncvs still slow
On Mon, May 29, 2006 at 02:14:42PM -0300, Marc G. Fournier wrote: On Sun, 28 May 2006, Magnus Hagander wrote: AFAICS, this is caused by the machine attempting to relay thousands and thousands of spam emails (some quick checked showed a rate of about 1 spam / 5 seconds enytering the queue - and I know I deleted almost 20,000 from the queue) And how exactly would you like me to fix *that*? The reason those were in the queue is because svr4 is a legit MX record for the mailing lists ... the messages are being delivered into svr4's mail queue, and mail.postgresql.org subsequently refusing htem because they are for invalid addresses ... If I remove svr4 as an MX record, its just going to move to a different machine ... So, how exactly would you like me to fix that problem? Postfix allows you to specify a list of valid email addresses. It should be a simple matter of specifying what all the valid mailing list email addresses are. -- Jim C. Nasby, Sr. Engineering Consultant [EMAIL PROTECTED] Pervasive Software http://pervasive.comwork: 512-231-6117 vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461 ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can get through to the mailing list cleanly
Re: [HACKERS] anoncvs still slow
Jim C. Nasby wrote: Postfix allows you to specify a list of valid email addresses. It should be a simple matter of specifying what all the valid mailing list email addresses are. umm ... we allow non-subscribers to post, the posts just have to be approved. How would we still do that? cheers andrew ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org
Re: [HACKERS] anoncvs still slow
Andrew Dunstan wrote: Jim C. Nasby wrote: Postfix allows you to specify a list of valid email addresses. It should be a simple matter of specifying what all the valid mailing list email addresses are. umm ... we allow non-subscribers to post, the posts just have to be approved. How would we still do that? What's checked is the recipient, not the sender. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 9: In versions below 8.0, the planner will ignore your desire to choose an index scan if your joining column's datatypes do not match
Re: [HACKERS] anoncvs still slow
Alvaro Herrera wrote: Andrew Dunstan wrote: Jim C. Nasby wrote: Postfix allows you to specify a list of valid email addresses. It should be a simple matter of specifying what all the valid mailing list email addresses are. umm ... we allow non-subscribers to post, the posts just have to be approved. How would we still do that? What's checked is the recipient, not the sender. ah, ok. sorry for the noise. cheers andrew ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org
Re: [HACKERS] [GENERAL] 8.1.4 - problem with PITR - .backup.done /
On Tue, 2006-05-30 at 09:45 -0400, Tom Lane wrote: Rafael Martinez, Guerrero [EMAIL PROTECTED] writes: The problem was that 000100080010.0006D5E8.backup was already archived, but under pg_xlog/archive_status/ there were two files: - 000100080010.0006D5E8.backup.done 000100080010.0006D5E8.backup.ready - This situation should not happen, anyone has seen this problem before? No, it shouldn't. What I suspect is that XLogArchiveIsDone() got confused and created a duplicate .ready file. It basically assumes that the only way its stat() calls can fail is ENOENT, ie, file not there ... but I wonder if they failed for some other reason instead. What sort of platform and filesystem is this on? This is on a AMD64 Opteron server with RHELAS4 / 2.6.9-34.ELsmp and ext3 filesystem. This is the first time this happens. I cannot the postgres internals but after a quick look to the source code .. XLogArchiveIsDone() has this code in the final of the function: - /* Race condition --- maybe archiver just finished, so recheck */ StatusFilePath(archiveStatusPath, xlog, .done); if (stat(archiveStatusPath, stat_buf) == 0) return true; /* Retry creation of the .ready file */ XLogArchiveNotify(xlog); return false; } - What happens if we have a race condition and the archiver creates a .done file between the last check for the .done file and the creation of the .ready file by XLogArchiveNotify? Did you happen to make note of the mod times of the two files before deleting them? No, I did not :( If it happens again, I will do. regards, -- Rafael Martinez, [EMAIL PROTECTED] Center for Information Technology Services University of Oslo, Norway PGP Public Key: http://folk.uio.no/rafael/ ---(end of broadcast)--- TIP 6: explain analyze is your friend
Re: [HACKERS] anoncvs still slow
On Tue, 30 May 2006, Jim C. Nasby wrote: On Mon, May 29, 2006 at 02:14:42PM -0300, Marc G. Fournier wrote: On Sun, 28 May 2006, Magnus Hagander wrote: AFAICS, this is caused by the machine attempting to relay thousands and thousands of spam emails (some quick checked showed a rate of about 1 spam / 5 seconds enytering the queue - and I know I deleted almost 20,000 from the queue) And how exactly would you like me to fix *that*? The reason those were in the queue is because svr4 is a legit MX record for the mailing lists ... the messages are being delivered into svr4's mail queue, and mail.postgresql.org subsequently refusing htem because they are for invalid addresses ... If I remove svr4 as an MX record, its just going to move to a different machine ... So, how exactly would you like me to fix that problem? Postfix allows you to specify a list of valid email addresses. It should be a simple matter of specifying what all the valid mailing list email addresses are. The list of email addresses changes over time ... so whomever creates a new mailbox would need to remember to add it on the MX servers as well ... Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email . [EMAIL PROTECTED] MSN . [EMAIL PROTECTED] Yahoo . yscrappy Skype: hub.orgICQ . 7615664 ---(end of broadcast)--- TIP 5: don't forget to increase your free space map settings
Re: [HACKERS] timezones to own config file
Martijn, On Fri, May 26, 2006 at 03:03:15PM +0200, Martijn van Oosterhout wrote: I think you may be thinking of yet a separate TODO item, which is to be able to use the zic timezone names in timestamptz input, viz '2006-05-24 21:11 Americas/New_York'::timestamptz But names like 'IST' or 'CDT' are not zic timezone names, they just represent specific offsets from UTC. Well, the zic database does contain information about the abbreviations, so we would be able to build a list of them. That's what i've done already :-) I think the right solution is probably fix the above first (allow full zic timezones in timestamps) and then setup the CST/CEST/etc as a list of aliases users can customise... Why do you think that full zic timezone in timestamps should be done first? For me, both features are independent, but maybe I've missed something. As I understand it, the time zone abbreviations are not aliases for full zic names but only for offsets. So if you set Region/City as the timezone, the offset depends on the year (because countries have changed their timezones in the past) and whether or not DST is or was active at that time. On the other hand, a timezone abbreviation only means GMT + x hours and nothing more. The relation between both now is that a Region/City timezone changes its timezone abbreviation over the years (to reflect changes to timezones done in the past) and during the year (to reflect changes due to daylight saving time). And this is actually what the zic database is all about. Joachim ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org
Re: [HACKERS] [GENERAL] 8.1.4 - problem with PITR - .backup.done / backup.ready version of the same file at the same time.
Rafael Martinez [EMAIL PROTECTED] writes: What happens if we have a race condition and the archiver creates a .done file between the last check for the .done file and the creation of the .ready file by XLogArchiveNotify? That can't happen; the archiver creates the .done file by rename()ing the previous .ready file, which is (supposed to be) an atomic action. If the .ready file isn't there, and then after that we see that the .done file isn't there, then either neither of them are there or the filesystem is seriously broken. My thought is that the stat()s on the .done file failed for some obscure reason, perhaps insufficient kernel resources, even though the file was actually there. If you have postmaster log output for the interval in which this happened, it would be interesting to look for occurrences of this warning message from pgarch_archiveDone: if (rename(rlogready, rlogdone) 0) ereport(WARNING, (errcode_for_file_access(), errmsg(could not rename file \%s\ to \%s\: %m, rlogready, rlogdone))); If you find any then we might need a different theory ... regards, tom lane ---(end of broadcast)--- TIP 6: explain analyze is your friend
[HACKERS] Looking for Postgres Developers to fix problem
Hi, Perhaps one of you can help me. I am a IT Executive Recruiter from a Search firm in Toronto looking for a Postgres Developer/ Administrator to work on a Two week(80 hours) contract to fix my clients Postgres Problem. My client in situated in Toronto, Canada and needs someone to start Mid/Late June. If you are interested in hearing more, or know someone who may be interested in working on a short contract with a great company, please can you reply to this email or call 416-928-1212 ext 228. I look forward to your response. Thanking you kindly, -- Mandy Abrahams Executive IT Recruiter OFFICE: (416) 928-1212 ext 228 FAX:(416) 928-0555 EMAIL: [EMAIL PROTECTED] WEBSITE: www.fernstevens.com FERN STEVENS ASSOCIATES 4950 Yonge Street, Suite 1102 North York, Ontario M2N 6K1 PROVIDING RECRUITMENT SELECTION SERVICES THROUGHOUT NORTH AMERICA, USA EUROPE SINCE 1986. ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org
Re: [HACKERS] Looking for Postgres Developers to fix problem
One of the first things an IT Executive Recruiter needs to learn is where to post job info - in this case it would be the pgsql-jobs list ;-) cheers andrew Mandy Abrahams wrote: Hi, Perhaps one of you can help me. I am a IT Executive Recruiter from a Search firm in Toronto looking for a Postgres Developer/ Administrator to work on a Two week(80 hours) contract to fix my clients Postgres Problem. My client in situated in Toronto, Canada and needs someone to start Mid/Late June. If you are interested in hearing more, or know someone who may be interested in working on a short contract with a great company, please can you reply to this email or call 416-928-1212 ext 228. I look forward to your response. Thanking you kindly, ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq
Re: [HACKERS] [GENERAL] 8.1.4 - problem with PITR - .backup.done /
On Tue, 2006-05-30 at 15:38 -0400, Tom Lane wrote: [...] My thought is that the stat()s on the .done file failed for some obscure reason, perhaps insufficient kernel resources, even though the file was actually there. If you have postmaster log output for the interval in which this happened, it would be interesting to look for occurrences of this warning message from pgarch_archiveDone: if (rename(rlogready, rlogdone) 0) ereport(WARNING, (errcode_for_file_access(), errmsg(could not rename file \%s\ to \%s\: %m, rlogready, rlogdone))); If you find any then we might need a different theory ... I do not find any warning message could not rename file These are the relevant entries in the log file: [2006-05-29 17:31:55.212 CEST] 12022 LOG: archived transaction log file 00010008000F PITR_basebackup script started around 17:32 [2006-05-29 17:40:27.735 CEST] 12022 LOG: archived transaction log file 000100080010 [2006-05-29 17:49:32.075 CEST] 12022 LOG: archived transaction log file 000100080011 [2006-05-29 17:59:40.575 CEST] 12022 LOG: archived transaction log file 000100080012 [2006-05-29 18:08:27.229 CEST] 12022 LOG: archived transaction log file 000100080013 [2006-05-29 18:11:36.434 CEST] 12022 LOG: archived transaction log file 000100080010.0006D5E8.backup [2006-05-29 18:11:36.467 CEST] 12022 LOG: archive command archive_wal.sh -P pg_xlog/000100080010.0006D5E8.backup -F 000100080010.0006D5E8.backup failed: return code 256 [2006-05-29 18:11:37.479 CEST] 12022 LOG: archive command archive_wal.sh -P pg_xlog/000100080010.0006D5E8.backup -F 000100080010.0006D5E8.backup failed: return code 256 [2006-05-29 18:11:38.492 CEST] 12022 LOG: archive command archive_wal.sh -P pg_xlog/000100080010.0006D5E8.backup -F 000100080010.0006D5E8.backup failed: return code 256 [2006-05-29 18:11:38.492 CEST] 12022 WARNING: transaction log file 000100080010.0006D5E8.backup could not be archived: too many failures PITR_basebackup script finnished 18:12:16 ... Same error several times until we deleted the .backup.ready file at 18:15 [2006-05-29 18:19:14.546 CEST] 12022 LOG: archived transaction log file 000100080014 [2006-05-29 18:30:10.939 CEST] 12022 LOG: archived transaction log file 000100080015 ... Our PITR_basebackup script does this: * Checks if Backup label file exists * Starts Backup process with pg_start_backup() * Creates a LVM2 Snapshot of data partition * Mounts the Snapshot partition * Creates a tar.bz2 file of data * Umounts Snapshot partition * Removes Snapshot LV * Backup last WAL file not yet archived * Stops Backup process with pg_stop_backup() * Waits for *.backup file to appear under the archivedir * Removes old WAL archived files * Removes old tar.bz2 data file To create the tar.bz file and to delete old WAL files can take some time. The total running time of the PITR_basebackup script was 2412 sec. If we get the same problem again, I will try to get more information from the system. As I said in my last e-mail, this has been a one time problem. regards, -- Rafael Martinez, [EMAIL PROTECTED] Center for Information Technology Services University of Oslo, Norway PGP Public Key: http://folk.uio.no/rafael/ ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq
Re: [HACKERS] anoncvs still slow
On Tue, May 30, 2006 at 02:01:07PM -0400, Andrew Dunstan wrote: Jim C. Nasby wrote: Postfix allows you to specify a list of valid email addresses. It should be a simple matter of specifying what all the valid mailing list email addresses are. umm ... we allow non-subscribers to post, the posts just have to be approved. How would we still do that? I'm assuming we're talking about a list of valid To: addresses, not From: addresses. That list should be fairly short... Have a nice day, -- Martijn van Oosterhout kleptog@svana.org http://svana.org/kleptog/ From each according to his ability. To each according to his ability to litigate. signature.asc Description: Digital signature
Re: [HACKERS] [PATCHES] Magic block for modules
Martijn van Oosterhout kleptog@svana.org writes: On Sun, May 07, 2006 at 08:21:43PM -0400, Tom Lane wrote: I'm pretty sure we had agreed that magic blocks should be required; otherwise this check will accomplish little. Sure, I just didn't want to break every module in one weekend. I was thinking of adding it with LOG level now, send a message on -announce saying that at the beginning of the 8.2 freeze it will be an ERROR. Give people time to react. Now that the magic-block patch is in, we need to revisit this bit of the discussion. I'm for making lack of a magic block an ERROR immediately. I don't see the point of waiting; in fact, if we wait till freeze we'll just make the breakage more concentrated. At the very least it ought to be a WARNING immediately, because a LOG message is just not visible enough. Comments? regards, tom lane ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq
Re: [HACKERS] error-free disabling of individual child partition
Tom Lane: ALTER TABLE childN DROP INHERITS old_parent; ALTER TABLE childN ADD INHERITS new_parent; I think you would have to make INHERITS a reserved word to make that happen: stark= create table integer (i integer); CREATE TABLE stark= alter table test add inherits integer; ALTER TABLE -- greg ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq
Re: [HACKERS] anoncvs still slow
On Tue, May 30, 2006 at 04:21:46PM -0300, Marc G. Fournier wrote: On Tue, 30 May 2006, Jim C. Nasby wrote: On Mon, May 29, 2006 at 02:14:42PM -0300, Marc G. Fournier wrote: On Sun, 28 May 2006, Magnus Hagander wrote: AFAICS, this is caused by the machine attempting to relay thousands and thousands of spam emails (some quick checked showed a rate of about 1 spam / 5 seconds enytering the queue - and I know I deleted almost 20,000 from the queue) And how exactly would you like me to fix *that*? The reason those were in the queue is because svr4 is a legit MX record for the mailing lists ... the messages are being delivered into svr4's mail queue, and mail.postgresql.org subsequently refusing htem because they are for invalid addresses ... If I remove svr4 as an MX record, its just going to move to a different machine ... So, how exactly would you like me to fix that problem? Postfix allows you to specify a list of valid email addresses. It should be a simple matter of specifying what all the valid mailing list email addresses are. The list of email addresses changes over time ... so whomever creates a new mailbox would need to remember to add it on the MX servers as well ... Depending on what the exact setup is, a friend has a script that should help: http://slacker.com/~nugget/projects/postfixrelaymaps/ In a nutshell, it pulls from things like /etc/passwd on the master MX and then pushes that info out to the slaves. It's written in perl, so it should be easy to modify to pull from whatever source is necessary. -- Jim C. Nasby, Sr. Engineering Consultant [EMAIL PROTECTED] Pervasive Software http://pervasive.comwork: 512-231-6117 vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461 ---(end of broadcast)--- TIP 2: Don't 'kill -9' the postmaster
Re: [HACKERS] anoncvs still slow
On Tue, 30 May 2006, Jim C. Nasby wrote: Depending on what the exact setup is, a friend has a script that should help: http://slacker.com/~nugget/projects/postfixrelaymaps/ Thanks, but the script would involve a fair amount of work, since our mail system isn't based on the pasword file :) But, I have setup a cron job that runs every 30 minutes to generate a relay_users map for the MX server that contains all valid mailboxes on the system ... if someone does notice an email bouncing to somewhere that *should* work, please do let me know ... Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email . [EMAIL PROTECTED] MSN . [EMAIL PROTECTED] Yahoo . yscrappy Skype: hub.orgICQ . 7615664 ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can get through to the mailing list cleanly
Re: [HACKERS] Looking for Postgres Developers to fix problem
On Tue, May 30, 2006 at 16:52:09 -0400, Andrew Dunstan [EMAIL PROTECTED] wrote: One of the first things an IT Executive Recruiter needs to learn is where to post job info - in this case it would be the pgsql-jobs list ;-) But his timing is pretty good, there will shortly be a bunch of Postgres experts in Toronto. ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can get through to the mailing list cleanly
Re: [HACKERS] Looking for Postgres Developers to fix problem
In an attempt to throw the authorities off his trail, [EMAIL PROTECTED] (Bruno Wolff III) transmitted: On Tue, May 30, 2006 at 16:52:09 -0400, Andrew Dunstan [EMAIL PROTECTED] wrote: One of the first things an IT Executive Recruiter needs to learn is where to post job info - in this case it would be the pgsql-jobs list ;-) But his timing is pretty good, there will shortly be a bunch of Postgres experts in Toronto. Possibly, possibly not... A reasonable set of obvious people have talked with them, and the contract hasn't yet been filled. -- If this was helpful, http://svcs.affero.net/rm.php?r=cbbrowne rate me http://linuxfinances.info/info/slony.html Academics denigrating Popularizers During the rise of the merchant class, the landed aristocracy understood the value of creating food, but didn't appreciate that food isn't valuable unless it reaches hungry mouths. New ideas aren't valuable unless they reach hungry minds. -- Mark Miller ---(end of broadcast)--- TIP 6: explain analyze is your friend
[HACKERS] PQescapeIdentifier
Here's a question. I wish to add a function to libpq to escape PostgreSQL identifiers. Will this function be subject to the same security/encoding issues as PQescapeString? Chris -- Christopher Kings-Lynne Technical Manager CalorieKing Tel: +618.9389.8777 Fax: +618.9389.8444 [EMAIL PROTECTED] www.calorieking.com ---(end of broadcast)--- TIP 9: In versions below 8.0, the planner will ignore your desire to choose an index scan if your joining column's datatypes do not match
Re: [HACKERS] PQescapeIdentifier
Christopher Kings-Lynne [EMAIL PROTECTED] writes: Here's a question. I wish to add a function to libpq to escape PostgreSQL identifiers. Will this function be subject to the same security/encoding issues as PQescapeString? Is this of any general-purpose use? How many apps are really prepared to let an untrusted user dictate which columns are selected/compared? But to answer your question, yes, I can certainly imagine encoding-related risks... regards, tom lane ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can get through to the mailing list cleanly
Re: [HACKERS] PQescapeIdentifier
Christopher Kings-Lynne [EMAIL PROTECTED] writes: Here's a question. I wish to add a function to libpq to escape PostgreSQL identifiers. Will this function be subject to the same security/encoding issues as PQescapeString? Is this of any general-purpose use? How many apps are really prepared to let an untrusted user dictate which columns are selected/compared? phpPgAdmin has use for it, I assume pgAdmin would as well. As does PHP's PostgreSQL interface, etc. The PHP sites I work on in my job have some functions to automatically build queries (eg. insert queries), which technically need to escape column names. It seems nice from my point of view as completeness, and will help in the case when we ever change identifier escaping, etc. It might also encourage app writers to escape fields properly...I've seen too many places where they escape strings, but not fields... However, I guess it's still a small minority of apps. But to answer your question, yes, I can certainly imagine encoding-related risks... It's probably out of my league to code safely then I guess, unless it's basically the same coding as for PQescapeStringInternal...? Chris ---(end of broadcast)--- TIP 2: Don't 'kill -9' the postmaster
[HACKERS] LinkedIn
Hi hackers, I sent this to the hackers list, as this is the people I wish to contact. Do any of you guys use linkedin.com and want to add me to your contacts network? I'm keen to get into a network of PostgreSQL-related people - for future jobs/contracts purposes. My linkedin.com email is [EMAIL PROTECTED] Sorry for bothering anyone with this who doesn't care... Cheers, Chris ---(end of broadcast)--- TIP 9: In versions below 8.0, the planner will ignore your desire to choose an index scan if your joining column's datatypes do not match
Re: [HACKERS] LinkedIn
KL, Do any of you guys use linkedin.com and want to add me to your contacts network? Ironically, I don't use LinkedIn, even though they use PostgreSQL (not exclusively, though). -- Josh Berkus PostgreSQL @ Sun San Francisco ---(end of broadcast)--- TIP 9: In versions below 8.0, the planner will ignore your desire to choose an index scan if your joining column's datatypes do not match