Re: [GENERAL] 10.5 OS X ppc64 problem

2008-07-18 Thread Tom Lane
Shane Ambler <[EMAIL PROTECTED]> writes: > There has been some talk about getting postgres to build as a universal > binary. The current makefiles don't support the option but a couple of > people have come up with work arounds. I do believe that there are plans > to add this to future releases.

Re: [GENERAL] UPDATE runs slow in a transaction

2008-07-18 Thread Tom Lane
Viktor Rosenfeld <[EMAIL PROTECTED]> writes: > Postgres is indeed selecting a bad plan. Turns out that the index I > created to speed up the UPDATE isn't used inside a transaction block. That doesn't make any sense to me, and in fact I cannot replicate any such behavior here. What PG version a

[GENERAL] using regexp_matches and array manipulation

2008-07-18 Thread Bret Schuhmacher
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Can anyone give me an example of how to use regexp_matches and use the captured values? For instance, if I have a delimited string "a,b,c" and I want to put each letter into a variable so I can subsequently use those variables in an insert statem

Re: [GENERAL] Backup/Restore of single table in multi TB database

2008-07-18 Thread Francisco Reyes
Simon Riggs wrote: Have a look at pg_snapclone. It's specifically designed to significantly improve dump times for very large objects. http://pgfoundry.org/projects/snapclone/ Also, in case the original poster is not aware, by default pg_dump allows to backup single tables. Just add -t .

Re: [GENERAL] tsearch dictionary list?

2008-07-18 Thread Oleg Bartunov
On Fri, 18 Jul 2008, Daniel Chiaramello wrote: Hi all. I'm new to postgresql world, and I have to extend an existing product for Thailand - that product has some features based on tsearch, and I was wondering if there is an existing dictionary for that language... I failed to find any refere

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Francisco Reyes
On 4:55 pm 07/18/08 Tom Lane <[EMAIL PROTECTED]> wrote: > The only thing I can think of is that you had a huge number of rows > with all the same hash value, so that there wasn't any way to split > the batch into smaller sections. What are the join keys exactly in > this query, and what can you te

Re: [GENERAL] Calling Python functions with parameters

2008-07-18 Thread Adrian Klaver
-- Original message -- From: "user" <[EMAIL PROTECTED]> > I am having a problem with the simplest of Python functions, so I must be > doing something wrong. After hours of searching and trying many options, I > need the key that my puny brain is missing here. > >

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Tom Lane
"Francisco Reyes" <[EMAIL PROTECTED]> writes: > What is the overhead for each AfterTriggerEvent? On a 64-bit machine it looks like they'd cost you about 80 bytes each :-(. A good deal of that is palloc overhead --- I wonder if we should get rid of the separate-palloc-for-each-event design? > Whe

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Tom Lane
"Francisco Reyes" <[EMAIL PROTECTED]> writes: > On 3:55 pm 07/18/08 Tom Lane <[EMAIL PROTECTED]> wrote: >>> AfterTriggerEvents: 10553909248 total in 1268 blocks; 20432 free (6 >>> chunks); 1055316 used >> >> Well, that's definitely your problem ... > So I need to remove the foreign constraint

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Francisco Reyes
On 3:55 pm 07/18/08 Tom Lane <[EMAIL PROTECTED]> wrote: > > AfterTriggerEvents: 10553909248 total in 1268 blocks; 20432 free (6 > > chunks); 1055316 used > > Well, that's definitely your problem ... What is the overhead for each AfterTriggerEvent? I guess I can write a program to process so

[GENERAL] Calling Python functions with parameters

2008-07-18 Thread user
I am having a problem with the simplest of Python functions, so I must be doing something wrong. After hours of searching and trying many options, I need the key that my puny brain is missing here. I cannot pass parameters to a plpythonu function. I have tried within psql and with pgAdmin III (w

Re: [GENERAL] Writing a user defined function

2008-07-18 Thread Raymond O'Donnell
On 18/07/2008 17:07, Suresh_ wrote: CREATE OR REPLACE FUNCTION udf() RETURNS integer AS $$ BEGIN for i in 1..2000 loop for j in 1...1 loop end loop; begin work; ^^- Here's your problem! You can't have a transaction inside a function - the function is already executed in

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Francisco Reyes
On 3:55 pm 07/18/08 Tom Lane <[EMAIL PROTECTED]> wrote: > > AfterTriggerEvents: 10553909248 total in 1268 blocks; 20432 free (6 > > chunks); 1055316 used > > Well, that's definitely your problem ... So I need to remove the foreign constraints? > >HashBatchContext: 415227952 tota

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Tom Lane
"Francisco Reyes" <[EMAIL PROTECTED]> writes: > On 1:00 pm 07/18/08 Tom Lane <[EMAIL PROTECTED]> wrote: >> If you can get Postgres to report an actual out-of-memory error (as >> opposed to crashing from OOM kill) >> then it should dump a memory usage >> map into the postmaster log. Looking at that

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Francisco Reyes
On 1:00 pm 07/18/08 Tom Lane <[EMAIL PROTECTED]> wrote: > Are there any AFTER triggers (including foreign key constraints) I have two foreign key constraints. > the table being inserted into? If so the list of pending trigger > events might be your problem. I guess I can try disablign the forei

Re: [GENERAL] Initdb problem on debian mips cobalt: Bus error

2008-07-18 Thread Lennin Caro
--- On Fri, 7/18/08, Glyn Astill <[EMAIL PROTECTED]> wrote: > From: Glyn Astill <[EMAIL PROTECTED]> > Subject: [GENERAL] Initdb problem on debian mips cobalt: Bus error > To: pgsql-general@postgresql.org > Date: Friday, July 18, 2008, 10:26 AM > Hi Chaps, > > I'm attempting to run 8.3.3 on an

Re: [GENERAL] Initdb problem on debian mips cobalt: Bus error

2008-07-18 Thread Tom Lane
Glyn Astill <[EMAIL PROTECTED]> writes: > No. Will recompile with debug info and post back when done. FWIW, the most likely issue here is the MIPS-specific assembly code in src/include/storage/s_lock.h --- I'm not sure how many MIPS platforms that's really been exercised on, but it may not work on

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Tom Lane
"Francisco Reyes" <[EMAIL PROTECTED]> writes: > Given that memory grows over time I am beggining to wonder if it is some > type of memory leak. Are there any AFTER triggers (including foreign key constraints) on the table being inserted into? If so the list of pending trigger events might be your

Re: [GENERAL] Initdb problem on debian mips cobalt: Bus error

2008-07-18 Thread Glyn Astill
No. Will recompile with debug info and post back when done. - Original Message > From: Tom Lane <[EMAIL PROTECTED]> > To: Glyn Astill <[EMAIL PROTECTED]> > Cc: pgsql-general@postgresql.org > Sent: Friday, 18 July, 2008 5:50:05 PM > Subject: Re: [GENERAL] Initdb problem on debian mips c

Re: [GENERAL] Initdb problem on debian mips cobalt: Bus error

2008-07-18 Thread Tom Lane
Glyn Astill <[EMAIL PROTECTED]> writes: > Could this be any less informative? > Core was generated by > `/usr/pgsql_src/postgresql-8.3.3/src/test/regress/tmp_check/install/usr/local/pg'. > Program terminated with signal 10, Bus error. > #0 0x007572d0 in ?? () Probably not :-(. Did you build wit

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Francisco Reyes
On 12:23 pm 07/18/08 Alvaro Herrera <[EMAIL PROTECTED]> wrote: > Do you have long-running transactions? (For example transactions that > have been idle for a long time). No. The two inserts I was running were the only processes. I even did a restart to make sure there was absolutely nothing else

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Francisco Reyes
On 12:03 pm 07/18/08 Martijn van Oosterhout <[EMAIL PROTECTED]> wrote: > Perhaps you can try reducing the shared_buffers, to see if that helps > more? Will try. > 8MB is quite small for workmem. More shared_buffers is not > necessarily better. Ok, but from everything I had read shared_buffers o

[GENERAL] Returns cursor?

2008-07-18 Thread dfx
Hi Guru, can a function returns a cursor? Thank you! Domenico -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] autovacuum logging 8.1

2008-07-18 Thread Alvaro Herrera
[EMAIL PROTECTED] escribió: > Is there a way to disable some of the autovacuum logging? Yes -- upgrade to a newer version. Autovacuum was primitive in 8.1. It was the first version. Bear with us. -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replica

Re: [GENERAL] Initdb problem on debian mips cobalt: Bus error

2008-07-18 Thread Glyn Astill
Could this be any less informative? Core was generated by `/usr/pgsql_src/postgresql-8.3.3/src/test/regress/tmp_check/install/usr/local/pg'. Program terminated with signal 10, Bus error. #0 0x007572d0 in ?? () - Original Message > From: Tom Lane <[EMAIL PROTECTED]> > To: Glyn Astill

Re: [GENERAL] Writing a user defined function

2008-07-18 Thread Douglas McNaught
On Fri, Jul 18, 2008 at 12:07 PM, Suresh_ <[EMAIL PROTECTED]> wrote: > > Hello, > I am trying to code a simple udf in postgres. How do I write sql commands > into pl/sql ? The foll. code doesnt work. > > CREATE OR REPLACE FUNCTION udf() > RETURNS integer AS $$ > BEGIN > for i in 1..2000 loop > fo

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Alvaro Herrera
Francisco Reyes wrote: > On 11:25 am 07/18/08 Richard Huxton <[EMAIL PROTECTED]> wrote: > > Strace of the single/large process. > Again, all the query is doing is > insert into select > > The strace is pretty much a repetition of the lines below. Do you have long-running transactions? (For ex

Re: [GENERAL] TODO list and "hyphen"

2008-07-18 Thread Scara Maccai
> You are the first person to ever ask, and searching for ' -' is pretty > basic. If it is a problem, I think some other symbol should be used. using opera it doesn't work... and with Firefox you still get a lot of not-wanted matches... Of course, this is not a "problem", I was just thinking th

[GENERAL] Writing a user defined function

2008-07-18 Thread Suresh_
Hello, I am trying to code a simple udf in postgres. How do I write sql commands into pl/sql ? The foll. code doesnt work. CREATE OR REPLACE FUNCTION udf() RETURNS integer AS $$ BEGIN for i in 1..2000 loop for j in 1...1 loop end loop; begin work; declare cust scroll cursor for sele

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Francisco Reyes
On 11:25 am 07/18/08 Richard Huxton <[EMAIL PROTECTED]> wrote: Strace of the single/large process. Again, all the query is doing is insert into select The strace is pretty much a repetition of the lines below. semop(557057, 0x7fbfffdfb0, 1) = 0 lseek(100, 0, SEEK_END)

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Martijn van Oosterhout
On Fri, Jul 18, 2008 at 10:40:02AM -0400, Francisco Reyes wrote: > Found that yesterday (vm.overcommit_memory=2). > Agree that this is better than OOM. I still ran out of memory last night > and postgres just failed on the malloc(), which as you mentioned is better. > > Reduced work_mem to 8MB and

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Francisco Reyes
On 11:25 am 07/18/08 Richard Huxton <[EMAIL PROTECTED]> wrote: > I'm wondering whether it's memory usage either for the trigger > itself, or for the function (pl/pgsql?). Good point. > If you're doing something > like:INSERT INTO partitioned_table SELECT * FROM big_table > then that's not onl

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Richard Huxton
Francisco Reyes wrote: On 8:13 am 07/18/08 Richard Huxton <[EMAIL PROTECTED]> wrote: Is the partition split done with triggers or rules? I have a single trigger+function combo that dynamically computes which partition the data has to go to. I'm wondering whether it's memory usage either for

Re: [GENERAL] Initdb problem on debian mips cobalt: Bus error

2008-07-18 Thread Tom Lane
Glyn Astill <[EMAIL PROTECTED]> writes: > I'm attempting to run 8.3.3 on an old cobalt qube, with debian etch. It > appeared to compile ok (however I didn't stick around to watch, that'd be > painfull) and said "PostgreSQL compiled successfully and ready to install" or > whatever, but when I run

Re: [GENERAL] C-procedure crashed in Postgres 8.3.3 when using 'text' variable (WinXP) - additional

2008-07-18 Thread Tom Lane
el dorado <[EMAIL PROTECTED]> writes: > (By the way, I can't compile it as C++ Code (/TP) No, you can't. > 1>d:\pgsql83\getstring\c_getstring.c(75) : warning C4311: 'type cast' : > pointer truncation from 'char [8]' to 'Datum' > 1>d:\pgsql83\getstring\c_getstring.c(75) : warning C4312: 'type cas

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Francisco Reyes
On 8:13 am 07/18/08 Richard Huxton <[EMAIL PROTECTED]> wrote: > Is the partition split done with triggers or rules? I have a single trigger+function combo that dynamically computes which partition the data has to go to. -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To ma

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Francisco Reyes
On 9:53 am 07/18/08 "Douglas McNaught" <[EMAIL PROTECTED]> wrote: > dedicated database server you really don't ever want to have the OOM > killer triggered. Found that yesterday (vm.overcommit_memory=2). Agree that this is better than OOM. I still ran out of memory last night and postgres just fai

Re: [GENERAL] query optimization

2008-07-18 Thread Kevin Duffy
I sent this follow up in yesterday, but it did not show up. Must be doing something wrong. Here is the second try. kd select * from security sec where getsectypekey('OP') = sec.securitytypekey returns 690 rows in 1625ms EXPLAIN "Seq Scan on "security" sec (cost=0.00..507.54 rows=602 wid

[GENERAL] SSPI/Kerberos support for ODBC on Windows 2008 Server

2008-07-18 Thread Blake Duffey
I have my Windows 2008 stand-alone server configured so I can log on using my MIT Kerberos credentials. I have an SSPI enabled PUTTY which will allow single-sign-on with Kerberos. This much is working correctly. My question - does the current ODBC driver support this type of 'native' configurati

Re: [GENERAL] Initdb problem on debian mips cobalt: Bus error

2008-07-18 Thread Glyn Astill
I thought similar, I assumed it was sort sort of generic maximum. The qube is very old so there's only 196Mb ram in it. Nope, never tried postgres on this qube before. I've not tried debians package, it was 8.1 as I recall. I'll give the package ago purely as a test unless anyone can see any ot

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Douglas McNaught
On Fri, Jul 18, 2008 at 12:18 AM, Francisco Reyes <[EMAIL PROTECTED]> wrote: > Douglas McNaught writes: > > >> It does seem that reducing work_mem might help you, but others on this > > I reduced it from 256MB to 64MB. It seems it is helping. You should also look at your memory overcommit settings

Re: [GENERAL] TODO list and "hyphen"

2008-07-18 Thread Bruce Momjian
Russ Brown wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > Bruce Momjian wrote: > > Scara Maccai wrote: > >> Hi, > >> > >> I was looking at the TODO: > >> > >> http://www.postgresql.org/docs/faqs.TODO.html > >> > >> > >> "A hyphen, "-", marks changes that will appear in the upcoming 8

Re: [GENERAL] TODO list and "hyphen"

2008-07-18 Thread Russ Brown
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Bruce Momjian wrote: > Scara Maccai wrote: >> Hi, >> >> I was looking at the TODO: >> >> http://www.postgresql.org/docs/faqs.TODO.html >> >> >> "A hyphen, "-", marks changes that will appear in the upcoming 8.4 release." >> >> Well, making a search for

Re: [GENERAL] Initdb problem on debian mips cobalt: Bus error

2008-07-18 Thread Richard Huxton
Glyn Astill wrote: Yes I think it does? deb:/home/glyn# cat /proc/sys/kernel/shmall 2097152 deb:/home/glyn# getconf PAGE_SIZE 4096 Well, if it's using PAGE_SIZE then that's 8GB which sounds optimistic for a qube. Presumably it represents some theoretical maximum. Did a previous version of

Re: [GENERAL] Initdb problem on debian mips cobalt: Bus error

2008-07-18 Thread Glyn Astill
Yes I think it does? deb:/home/glyn# cat /proc/sys/kernel/shmall 2097152 deb:/home/glyn# getconf PAGE_SIZE 4096 - Original Message > From: Richard Huxton <[EMAIL PROTECTED]> > To: Glyn Astill <[EMAIL PROTECTED]> > Cc: pgsql-general@postgresql.org > Sent: Friday, 18 July, 2008 12:36:3

Re: [GENERAL] Reducing memory usage of insert into select operations?

2008-07-18 Thread Richard Huxton
Francisco Reyes wrote: The OS triggered the out of memory killer (oom-killer). The table I am selecting from has a few hundred million rows. The table I am inserting into has partitions. I am benchmarking breaking up a large table into smaller partitions. Is the partition split done with tr

Re: [GENERAL] Initdb problem on debian mips cobalt: Bus error

2008-07-18 Thread Richard Huxton
Glyn Astill wrote: I assume it's doing it correctly deb:/home/glyn# cat /proc/sys/kernel/shmmax 33554432 That's right isn't it? 4096*8192= 33554432 Does shmall allow for any more? Other processes may be preventing you from allocating all that. Of course, ideally you'd get an error message

Re: [GENERAL] Initdb problem on debian mips cobalt: Bus error

2008-07-18 Thread Glyn Astill
I assume it's doing it correctly deb:/home/glyn# cat /proc/sys/kernel/shmmax 33554432 That's right isn't it? 4096*8192= 33554432 - Original Message > From: Richard Huxton <[EMAIL PROTECTED]> > To: Glyn Astill <[EMAIL PROTECTED]> > Cc: pgsql-general@postgresql.org > Sent: Friday, 18

Re: [GENERAL] Initdb problem on debian mips cobalt: Bus error

2008-07-18 Thread Richard Huxton
Glyn Astill wrote: Hi Chaps, I'm attempting to run 8.3.3 on an old cobalt qube, with debian etch. It appeared to compile ok (however I didn't stick around to watch, that'd be painfull) and said "PostgreSQL compiled successfully and ready to install" or whatever, but when I run make check, fails

[GENERAL] Initdb problem on debian mips cobalt: Bus error

2008-07-18 Thread Glyn Astill
Hi Chaps, I'm attempting to run 8.3.3 on an old cobalt qube, with debian etch. It appeared to compile ok (however I didn't stick around to watch, that'd be painfull) and said "PostgreSQL compiled successfully and ready to install" or whatever, but when I run make check, fails in initdb. Here i

[GENERAL] tsearch dictionary list?

2008-07-18 Thread Daniel Chiaramello
Hi all. I'm new to postgresql world, and I have to extend an existing product for Thailand - that product has some features based on tsearch, and I was wondering if there is an existing dictionary for that language... I failed to find any reference of such dictionary on the web, and of course

[GENERAL] C-procedure crashed in Postgres 8.3.3 when using 'text' variable (WinXP) - additional

2008-07-18 Thread el dorado
Hello. I'm trying to create a C-procedure returning text variable - again :). Postgres 8.3.3 (standard binaries - so built by means of MSVC), WinXP SP2. I also use MSVC 2005 for compilation my library. Configuration type - Dynamic Library (.dll) Additional include directories - D:\pgsql83\include;