Re: [GENERAL] How to restore a SQL-ASCII encoded database to a new UTF-8 db?

2009-05-21 Thread Albe Laurenz
> I have a database that was created with SQL-ASCII encoding > (unfortunately). I ran pg_restore to load the struct and data into a > new database with UTF-8 encoding but no surprise- I'm seeing this > error for a number of tables: > > pg_restore: [archiver (db)] COPY failed: ERROR: invalid byte

Re: [GENERAL] referring to calculated column in sub select

2009-05-21 Thread Scott Bailey
Hi, why column "acoltest" is not found by the subselect in this select: SELECT acol + 100 as acoltest, (select max(t) from mytab where anothercol=acoltest) as col2 FROM mytab2 group by somet ??? Only columns belonging to a table can be used in a subselect??? What about "calculated

Re: [GENERAL] Tuning resource parameters for a logging database.

2009-05-21 Thread Alex Thurlow
I was hoping to not have to change all my code to automate the partitioning table creation stuff, but if that's really the best way, I'll check it out. Thanks for the advice. Alex Thurlow Blastro Networks http://www.blastro.com http://www.roxwel.com http://www.yallwire.com On 5/21/2009 2:2

[GENERAL] How to restore a SQL-ASCII encoded database to a new UTF-8 db?

2009-05-21 Thread Postgres User
Hi, I have a database that was created with SQL-ASCII encoding (unfortunately). I ran pg_restore to load the struct and data into a new database with UTF-8 encoding but no surprise- I'm seeing this error for a number of tables: pg_restore: [archiver (db)] COPY failed: ERROR: invalid byte sequen

[GENERAL] cascade deleting

2009-05-21 Thread Duan Ligong
Hi. I am wondering whether the following problem can be avoided by using Cascade Deleting while the DB is in Read Committed Isolation Level: In the following scenario, The "DEL item1 from tb_pk" command fails because of involating foreign key constraints. (The tb_fk1, tb_fk2, and tb_fk3 tab

[GENERAL] Re: Re: Re: [GENERAL] Can not decompress a compressed string under plpy!

2009-05-21 Thread Adrian Klaver
On Thursday 21 May 2009 3:26:22 pm Timmy wrote: > > Yes, most of your guess is correct. > I'm using postgresql 8.3.x and ms windows 2000. > The compressed string is saved to the table in binary > format using the psycopg. I had set the table field to bytea data type. > I want to use the plpythonu

Re: [GENERAL] running postgresql on a private machine accessing it from public web pages

2009-05-21 Thread Reid Thompson
Keith D. Evans wrote: We usually run postgresql on a private machine (gravity) but due to space, we have moved the database to a different machine through afs (a local network at the university). We do not want the private machine to be accessible to outside users, so our web pages are on the u

Re: Re: [GENERAL] Can not decompress a compressed string under plpy!

2009-05-21 Thread Timmy
> > Hi, > >I have stored a compressed string in a table field. > > The compressed string is created by zlib using python. > > I want to decompress this string by zlib under plpy but plpy fails to do > > so. Is plpy not support decompression? Why? > > > > Thanks! > > A bit more information is r

Re: [GENERAL] Postgres, DB design, and object IDs (of any ilk)

2009-05-21 Thread Chris Browne
kentil...@gmail.com (Kenneth Tilton) writes: > Just looking for postgres "best practices" input from the veterans: OIDs are decidedly a bad idea; the difference between "natural" IDs and "surrogate" IDs is a general database issue that is fairly well documented in the literature and is not notably

Re: [GENERAL] After each row trigger NOT seeing data changes?

2009-05-21 Thread Karl Nack
The reason is that you've declared the function STABLE Yes, that did it! I'm not sure if the cited portions of the manual ought to contain notes about this or not. It seems a bit off-topic for them, but if other people have been bit by this, then maybe ... comments anyone? Perhaps this shou

Re: [GENERAL] After each row trigger NOT seeing data changes?

2009-05-21 Thread Raymond O'Donnell
On 21/05/2009 21:36, Tom Lane wrote: > Karl Nack writes: >> http://www.postgresql.org/docs/8.3/interactive/trigger-datachanges.html >> http://www.postgresql.org/docs/8.3/interactive/trigger-example.html > I'm not sure if the cited portions of the manual ought to contain notes > about this or not

Re: [GENERAL] After each row trigger NOT seeing data changes?

2009-05-21 Thread Rodrigo Gonzalez
you have to change RETURN NULL; with RETURN NEW; On 05/21/2009 04:57 PM, Karl Nack wrote: I'm attempting to create an inventory of trees. Here's a simplified, sample table: CREATE TABLE tree ( tree_id SERIAL PRIMARY KEY, tree_species_id INT NOT NULL REFERENCES tree_species, tree_location POIN

Re: [GENERAL] After each row trigger NOT seeing data changes?

2009-05-21 Thread Tom Lane
Karl Nack writes: > I notice the row count does not reflect the newly-inserted row, which > suggests that the trigger is not seeing changes made to the table. This > seems to be exactly opposite of what's in the manual: > http://www.postgresql.org/docs/8.3/interactive/trigger-datachanges.html >

[GENERAL] After each row trigger NOT seeing data changes?

2009-05-21 Thread Karl Nack
I'm attempting to create an inventory of trees. Here's a simplified, sample table: CREATE TABLE tree ( tree_id SERIAL PRIMARY KEY, tree_species_id INT NOT NULL REFERENCES tree_species, tree_location POINT NOT NULL, tree_install_date DATE NOT NULL, tree

Re: [GENERAL] Tuning resource parameters for a logging database.

2009-05-21 Thread Scott Marlowe
On Thu, May 21, 2009 at 1:39 PM, Alex Thurlow wrote: > I should also specify how my inserts are happening I guess.  I'm actually > doing the logs to flat files and then inserting them into the database on an > hourly basis using COPY, so I don't need to worry as much about the log > insert speed a

Re: [GENERAL] Tuning resource parameters for a logging database.

2009-05-21 Thread Scott Marlowe
On Thu, May 21, 2009 at 1:36 PM, Scott Marlowe wrote: > Below, I meant with a logging / reporting database... > With a logging database you're optimizing two often opposing actions. > Lots of small inserts in a stream that HAVE to get processed and put > in efficiently.  This is often accomplish

Re: [GENERAL] Tuning resource parameters for a logging database.

2009-05-21 Thread Alex Thurlow
I should also specify how my inserts are happening I guess. I'm actually doing the logs to flat files and then inserting them into the database on an hourly basis using COPY, so I don't need to worry as much about the log insert speed as I do the reporting. On 5/21/2009 2:36 PM, Scott Marlowe

Re: [GENERAL] Tuning resource parameters for a logging database.

2009-05-21 Thread Scott Marlowe
On Thu, May 21, 2009 at 1:13 PM, Alex Thurlow wrote: > I have a postgresql database that I'm using for logging of data. There's > basically one table where each row is a line from my log files.  It's > getting to a size where it's running very slow though.  There are about 10 > million log lines p

[GENERAL] Tuning resource parameters for a logging database.

2009-05-21 Thread Alex Thurlow
I have a postgresql database that I'm using for logging of data. There's basically one table where each row is a line from my log files. It's getting to a size where it's running very slow though. There are about 10 million log lines per day and I keep 30 days of data in it. All the columns

Re: [GENERAL] Tuning resource parameters for a logging database.

2009-05-21 Thread Vick Khera
On Thu, May 21, 2009 at 3:13 PM, Alex Thurlow wrote: > I have a postgresql database that I'm using for logging of data. There's > basically one table where each row is a line from my log files.  It's > getting to a size where it's running very slow though.  There are about 10 > million log lines p

[GENERAL] Tuning resource parameters for a logging database.

2009-05-21 Thread Alex Thurlow
I have a postgresql database that I'm using for logging of data. There's basically one table where each row is a line from my log files. It's getting to a size where it's running very slow though. There are about 10 million log lines per day and I keep 30 days of data in it. All the columns I

Re: [GENERAL] running postgresql on a private machine accessing it from public web pages

2009-05-21 Thread Scott Marlowe
On Thu, May 21, 2009 at 1:04 PM, Scott Marlowe wrote: > On Thu, May 21, 2009 at 12:23 PM, Keith D. Evans wrote: >> We usually run postgresql on a private machine (gravity) but due to space, >> we have moved the database to a different machine through afs (a local > > Wait, the whole database, inc

Re: [GENERAL] running postgresql on a private machine accessing it from public web pages

2009-05-21 Thread Scott Marlowe
On Thu, May 21, 2009 at 12:23 PM, Keith D. Evans wrote: > We usually run postgresql on a private machine (gravity) but due to space, > we have moved the database to a different machine through afs (a local Wait, the whole database, including a postmaster running on the other machine? Or just tha

Re: [GENERAL] running postgresql on a private machine accessing it from public web pages

2009-05-21 Thread Scott Mead
In your application, the connection string should have the ip address of the postgres server. The postgres server (solaris box) should allow port 5432 through the firewall. If you cannot access port 5432 on your solaris box from the linux box, then make sure that you don't have a firewall in th

Re: [GENERAL] running postgresql on a private machine accessing it from public web pages

2009-05-21 Thread Keith D. Evans
We usually run postgresql on a private machine (gravity) but due to space, we have moved the database to a different machine through afs (a local network at the university). We do not want the private machine to be accessible to outside users, so our web pages are on the university's public web

Re: [GENERAL] running postgresql on a private machine accessing it from public web pages

2009-05-21 Thread Raymond O'Donnell
On 21/05/2009 18:49, Keith D. Evans wrote: > The database is on a public machine (Linux), but the postgresql > postmaster runs on a private machine (Solaris 10). That doesn't make a lot of sense, unless you've got *two* postmasters running, one on each machine, or maybe you've created a tablespac

Re: [GENERAL] Postgres, DB design, and object IDs (of any ilk)

2009-05-21 Thread Kenneth Tilton
Merlin Moncure wrote: On Thu, May 21, 2009 at 12:35 PM, Kenneth Tilton wrote: If the primary key of the customer table is cust_short_name and my DB reflects also customer departments, I can link a customer to its departments one of three ways: 1. The department table has a cust_short_name co

Re: [GENERAL] running postgresql on a private machine accessing it from public web pages

2009-05-21 Thread Joshua D. Drake
On Thu, 2009-05-21 at 13:49 -0400, Keith D. Evans wrote: > Joshua, > > Let me rephrase what I wrote. The database is on a public machine > (Linux), but the postgresql postmaster runs on a private machine > (Solaris 10). Can we access the postgresql database through the public > machine, even t

Re: [GENERAL] running postgresql on a private machine accessing it from public web pages

2009-05-21 Thread Keith D. Evans
Joshua, Let me rephrase what I wrote. The database is on a public machine (Linux), but the postgresql postmaster runs on a private machine (Solaris 10). Can we access the postgresql database through the public machine, even though the postmaster is running from a (different) private machine?

Re: [GENERAL] Postgres, DB design, and object IDs (of any ilk)

2009-05-21 Thread Grzegorz Jaśkiewicz
I wouldn't trust OIDs, because they are 32bits for once. Secondly, Watch for index size. That's the main reason why (big)int as a key reference is a win over other types - at least in my general practice. And third advice, try different approaches, and queries - to figureout what would suit the so

Re: [GENERAL] Postgres, DB design, and object IDs (of any ilk)

2009-05-21 Thread Merlin Moncure
On Thu, May 21, 2009 at 12:35 PM, Kenneth Tilton wrote: > If the primary key of the customer table is cust_short_name and my DB > reflects also customer departments, I can link a customer to its departments > one of three ways: > > 1. The department table has a cust_short_name column and makes tha

[GENERAL] Postgres, DB design, and object IDs (of any ilk)

2009-05-21 Thread Kenneth Tilton
Just looking for postgres "best practices" input from the veterans: If the primary key of the customer table is cust_short_name and my DB reflects also customer departments, I can link a customer to its departments one of three ways: 1. The department table has a cust_short_name column and ma

Re: [GENERAL] running postgresql on a private machine accessing it from public web pages

2009-05-21 Thread Joshua D. Drake
> So, the question is, can someone go through these (public) web pages and > access the postgresql database if the postgresql server is running on > the private machine? > > We have other data in the postgresql and would like to only have to use > one database types, i.e., postgresql. If you

[GENERAL] running postgresql on a private machine accessing it from public web pages

2009-05-21 Thread Keith D. Evans
We have a private machine that runs postgresql and have created a database. We want to access that database from the web for plotting using php. The web server and pages are on a public (different) machine that does not have postgresql. Nor will they install it for is. The postgresql database i

Re: [GENERAL] compilation test fails

2009-05-21 Thread Tom Lane
"Sofer, Yuval" writes: > I have compiled 8.3.7 on HP-Itanium > After the build I have continued to the tests (gmake check) > One of the tests failed (division by zero error test) Hm, what compiler and what optimization level? We have seen a report or two about this before, all from people using

Re: [GENERAL] fsm on 8.1

2009-05-21 Thread Grzegorz Jaśkiewicz
2009/5/21 Tom Lane : > =?UTF-8?Q?Grzegorz_Ja=C5=9Bkiewicz?= writes: >> on 8.1, is vacuum analyze actually updating fsm too ? > > Yup. Thanks, also to make sure that I got it. Whatever's in FSM, will be actually reused by postgreqsl during normal operation, instead of creating new files to store t

Re: [GENERAL] fsm on 8.1

2009-05-21 Thread Tom Lane
=?UTF-8?Q?Grzegorz_Ja=C5=9Bkiewicz?= writes: > on 8.1, is vacuum analyze actually updating fsm too ? Yup. regards, tom lane -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgs

Re: [GENERAL] Inserts hang in DB and error messages in log

2009-05-21 Thread Bill Moran
In response to "Moshe Ben-Shoham" : > > We're working with version 8.3.5-1. > > Lately we started seeing insert statements hang in the DB. The > statements come from two different clients. > > When it happens, I see the following messages in the log every second or > so: > > 2009-05-21 08:56:49

Re: [GENERAL] Help with join syntax sought supplemental

2009-05-21 Thread James B. Byrne
On Thu, May 21, 2009 06:02, Alban Hertroys wrote: > > But as people often say here, premature optimisation is a waste of > time, so don't go that route unless you have a reason to expect > problems in that area. > That was my very thought when I sent that message. On the other hand, in case I w

Re: [GENERAL] Inserts hang in DB and error messages in log

2009-05-21 Thread Adrian Klaver
On Wednesday 20 May 2009 11:36:38 pm Moshe Ben-Shoham wrote: > Hi, > > > > We're working with version 8.3.5-1. > > > > Lately we started seeing insert statements hang in the DB. The > statements come from two different clients. > > > > When it happens, I see the following messages in the log every

Re: [GENERAL] [Windows] Feedback on PG?

2009-05-21 Thread Jasen Betts
On 2009-05-20, Gilles wrote: > At 10:58 20/05/2009, Craig Ringer wrote: >>I suspect a lot of that comes down to user/admin knowledge as much >>as anything. [...] That said, there are also a few bugs lurking that >>only affect the Windows version. [...] I've used Pg on my laptop at >>various poi

[GENERAL] Re: corruption on data table disconnects other clients silently when page is read

2009-05-21 Thread Jasen Betts
On 2009-05-20, Vick Khera wrote: > Does psql silently reconnect to the DB? I have noticed that behaviour recently. -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Can not decompress a compressed string under plpy!

2009-05-21 Thread Jasen Betts
On 2009-05-20, Timmy wrote: > Hi, >I have stored a compressed string in a table field. > The compressed string is created by zlib using python. > I want to decompress this string by zlib under plpy but plpy fails to do so. > Is plpy not support decompression? Why? are you storing it in a byt

Re: [GENERAL] Can I pause the pg_dump or pg_restore

2009-05-21 Thread Jasen Betts
On 2009-05-20, Sam Mason wrote: > On Wed, May 20, 2009 at 03:39:39PM +0100, Howard Cole wrote: >> Sam Mason wrote: >> >Note that when used on the pg_dump process all you're doing is stopping >> >it from writing out the backup. The server process will still be >> >running and waiting for the backu

Re: [GENERAL] Can I pause the pg_dump or pg_restore

2009-05-21 Thread Jasen Betts
On 2009-05-20, Chen, Dongdong (GE Healthcare) wrote: > This is a multi-part message in MIME format. > > In my application, when press button "Backup" in UI, it invokes pg_dump > to backup the database. It may take few minutes for the whole process. > If I want to pause the process, what should I d

Re: [GENERAL] package for debugger/wizard was: Feedback on PG?

2009-05-21 Thread Dave Page
On Wed, May 20, 2009 at 8:50 AM, Ivan Sergio Borgonovo wrote: > On Wed, 20 May 2009 07:46:02 -0400 > Dave Page wrote: > >> > Beside the fact I can only thank for all the great work around >> > postgresql, is there a reason we can't have something similar on >> > eg. Debian that will let us have a

Re: [GENERAL] HOT question - insert/delete

2009-05-21 Thread Gerhard Wiesinger
The data isn't really historical, but some data have to be for e.g. some regulations after a period of time. But all the available data should be available for e.g. reporting. So partitioning doesn't make any sense in this case, right? Ciao, Gerhard -- http://www.wiesinger.com/ On Thu, 21 M

Re: [GENERAL] Help with join syntax sought supplemental

2009-05-21 Thread Alban Hertroys
On May 20, 2009, at 7:17 PM, James B. Byrne wrote: Looking at this I have to wonder what will be the effect of having tens of thousands of rate-pairs on file. Would this query be improved by first doing a sub-query on base/quote pairs that returned DISTINCT pairs and then do the IN condition usi

Re: [GENERAL] origins/destinations

2009-05-21 Thread Carson Farmer
Thanks Andy, That was exactly what I needed! Now I just have to deal with this huge matrix I've generated ;-) Cheers, Carson -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

[GENERAL] fsm on 8.1

2009-05-21 Thread Grzegorz Jaśkiewicz
Question here, on 8.1, is vacuum analyze actually updating fsm too ? -- GJ -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

[GENERAL] Problem in Postgresql DB backup setup

2009-05-21 Thread Ujjawal Misra
Hi, We are facing a problem in setting up a database backup for our production server using pg-standby. We are using Postgres 8.3.5 in our production environment. We have an active user-base of 2 million and need to support 5000 TPS. The service needs to be up and running 24x7. The production dat

Re: [GENERAL] changing the locale of the DB cluster

2009-05-21 Thread Raymond O'Donnell
On 21/05/2009 07:39, Kent Tong wrote: > I know that it is impossible to change the locale. But can I pg_dump all the > databases, run initdb again using the desired locale, and then pg_restore? Absolutely - this is no different from an upgrade scenario. Ray. ---

[GENERAL] compilation test fails

2009-05-21 Thread Sofer, Yuval
Hi, I have compiled 8.3.7 on HP-Itanium After the build I have continued to the tests (gmake check) One of the tests failed (division by zero error test) The regression.diffs file shows the diff regarding of the expected result and the actual result: *** ./expected/errors.out Sat Nov 10 16

Re: [GENERAL] HOT question - insert/delete

2009-05-21 Thread Gerhard Wiesinger
Are there any plans to support this kind of scenario? Ciao, Gerhard -- http://www.wiesinger.com/ On Wed, 20 May 2009, Merlin Moncure wrote: On Wed, May 20, 2009 at 3:11 PM, Gerhard Wiesinger wrote: Hello! Is HOT in 8.3 used in the following scenario: INSERT ... DELETE ... at the same ra

[GENERAL] compilation test fails

2009-05-21 Thread Sofer, Yuval
Hi, I have compiled 8.3.7 on HP-Itanium After the build I have continued to the tests (gmake check) One of the tests failed (division by zero error test) The regression.diffs file shows the diff regarding of the expected result and the actual result: *** ./expected/errors.out Sat Nov 10 1

Re: [GENERAL] HOT question - insert/delete

2009-05-21 Thread Simon Riggs
On Wed, 2009-05-20 at 16:01 -0400, Merlin Moncure wrote: > On Wed, May 20, 2009 at 3:11 PM, Gerhard Wiesinger > wrote: > > Hello! > > > > Is HOT in 8.3 used in the following scenario: > > INSERT ... > > DELETE ... > > at the same ratio. > > > > So for example current data is added every minute a

Re: [GENERAL] HOT question - insert/delete

2009-05-21 Thread Grzegorz Jaśkiewicz
On Wed, May 20, 2009 at 9:01 PM, Merlin Moncure wrote: > On Wed, May 20, 2009 at 3:11 PM, Gerhard Wiesinger > wrote: >> Hello! >> >> Is HOT in 8.3 used in the following scenario: >> INSERT ... >> DELETE ... >> at the same ratio. >> >> So for example current data is added every minute and all old

Re: [GENERAL] Regarding visual studio 2008 build

2009-05-21 Thread Venkat Rao Tammineni
Hi You should use npgsql.dll to play with pgsql.which stores in postgresql install folder.please check or let me your are getting any problem with that. Thanks, Venkat From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Vikram Patil Se