Re: [GENERAL] Unhandled exception in PGAdmin when opening 16-million-record table

2010-10-30 Thread Guillaume Lelarge
Le 29/10/2010 14:46, Guillaume Lelarge a écrit : > Le 29/10/2010 13:52, Rob Richardson a écrit : >> A customer was reviewing the database that supports the application we >> have provided. One of the tables is very simple, but has over 16 >> million records. Here is the table's definition: >> >

Re: [GENERAL] Can Postgres Not Do This Safely ?!?

2010-10-30 Thread Merlin Moncure
On Fri, Oct 29, 2010 at 7:59 PM, Jeff Davis wrote: > On Fri, 2010-10-29 at 16:57 -0500, Andy Colson wrote: >> begin >> insert into logged select * from events where processed = false; >> update events set processed = true where processed = false; >> commit; > > There's a race condition there. The

Re: [GENERAL] Can Postgres Not Do This Safely ?!?

2010-10-30 Thread bricklen
On Fri, Oct 29, 2010 at 4:59 PM, Jeff Davis wrote: > On Fri, 2010-10-29 at 16:57 -0500, Andy Colson wrote: >> begin >> insert into logged select * from events where processed = false; >> update events set processed = true where processed = false; >> commit; > > There's a race condition there. The

Re: [GENERAL] large xml database

2010-10-30 Thread Mike Christensen
Gz. Maybe you can lease a bunch of Amazon EC2 high computing slices and parallelize it? I think throwing ridiculous amounts of hardware at things is always the best approach. On Sat, Oct 30, 2010 at 2:48 PM, Viktor Bojović wrote: > Hi, > i have very big XML documment which is larger tha

[GENERAL] large xml database

2010-10-30 Thread Viktor Bojović
Hi, i have very big XML documment which is larger than 50GB and want to import it into databse, and transform it to relational schema. When splitting this documment to smaller independent xml documments i get ~11.1mil XML documents. I have spent lots of time trying to get fastest way to transform a

Re: [GENERAL] gitweb error?

2010-10-30 Thread Jeff Davis
On Sat, 2010-10-30 at 16:35 +0200, Martijn van Oosterhout wrote: > When I go to the following link: > > http://git.postgresql.org/gitweb?p=postgresql.git;a=commitdiff;h=e6721c6e1617a0fc8b4bce8eacba8b5a381f1f21 > > I get the following error: > > XML Parsing Error: undefined entity > Location: > h

Re: [GENERAL] Unhandled exception in PGAdmin when opening 16-million-record table

2010-10-30 Thread Dmitriy Igrishin
Ahh, yes. In this case it is possibly only with holdable cursors by declaring them and committing before reading any rows from it to force materialization of entire result set to the temporary storage. Although, this approach can be used to avoid std::bad_alloc in case of millions tuples in the res

Re: [GENERAL] Unhandled exception in PGAdmin when opening 16-million-record table

2010-10-30 Thread Dave Page
On Sat, Oct 30, 2010 at 4:14 PM, Dmitriy Igrishin wrote: > Do you mean that cursors (regular, not holdable) live only inside a > transactions? > But it is possible to check transaction status from another part of pgAdmin > or > even make the window with result set modal ? No, I mean that the tool

Re: [GENERAL] Unhandled exception in PGAdmin when opening 16-million-record table

2010-10-30 Thread Dmitriy Igrishin
Hey Peter, Dave > I've seen that behaviour before in similar applications, but it had a > > major downside: the number of rows returned was not known in advance > > of scrolling down to the last one. So you couldn't visualise the size > > of the record set based on the size and relative position o

Re: [GENERAL] Which variant to choose?

2010-10-30 Thread Merlin Moncure
On Sat, Oct 30, 2010 at 2:56 AM, RP Khare wrote: > I want to use PostgreSQL for my standalone .NET Windows application. I > downloaded PostgreSQL Advanced Server from EnterpriseDB's website and it is > very smooth. The GUI also very good. But I suspect how along EnterpriseDB > will support it. > T

[GENERAL] gitweb error?

2010-10-30 Thread Martijn van Oosterhout
When I go to the following link: http://git.postgresql.org/gitweb?p=postgresql.git;a=commitdiff;h=e6721c6e1617a0fc8b4bce8eacba8b5a381f1f21 I get the following error: XML Parsing Error: undefined entity Location: http://git.postgresql.org/gitweb?p=postgresql.git;a=commitdiff;h=e6721c6e1617a0fc8b

Re: [GENERAL] Unhandled exception in PGAdmin when opening 16-million-record table

2010-10-30 Thread Dave Page
On Sat, Oct 30, 2010 at 2:45 PM, Peter Geoghegan wrote: > On 30 October 2010 11:26, Dmitriy Igrishin wrote: >> Hey all, >> >> Why not to use MVC approach by implementing a model, which uses, e.g. >> scrollable cursors? I believe that wxWidgets supports MVC. > > I've seen that behaviour before in

Re: [GENERAL] Which variant to choose?

2010-10-30 Thread Richard Huxton
On 30/10/10 07:56, RP Khare wrote: I want to use PostgreSQL for my standalone .NET Windows application. I downloaded PostgreSQL Advanced Server from EnterpriseDB's website and it is very smooth. The GUI also very good. But I suspect how along EnterpriseDB will support it. > The second option i

Re: [GENERAL] Unhandled exception in PGAdmin when opening 16-million-record table

2010-10-30 Thread Peter Geoghegan
On 30 October 2010 11:26, Dmitriy Igrishin wrote: > Hey all, > > Why not to use MVC approach by implementing a model, which uses, e.g. > scrollable cursors? I believe that wxWidgets supports MVC. I've seen that behaviour before in similar applications, but it had a major downside: the number of r

Re: [GENERAL] Max tables in a union

2010-10-30 Thread Fred Miller
Thanks all -- I made my first post under an unregistered account. It was stalled. Then I posted under my registered account - to which Tom Lane replied (thanks Tom) Then later my first post punched through making it seem like I didn't see Tom Lane's reply. We have some dynamic-schema generat

Re: [GENERAL] pgAdmin on Mac connecting to Postgres 9 on Linux - SSL/timeout issue

2010-10-30 Thread Mike Christensen
Maybe that's it.. It's definitely some sort of SSL thing since it didn't start happening until I enabled SSL. I guess I'll just have to close pgAdmin when I'm not using it.. On Sat, Oct 30, 2010 at 12:57 AM, Basil Bourque wrote: > > On Oct 29, 2010, at 15:36, Mike Christensen wrote: > >> I have

Re: [GENERAL] Enable automatic scheduled backups

2010-10-30 Thread Raymond O'Donnell
On 30/10/2010 09:52, RP Khare wrote: I want pgsql to take automatic scheduled backup of the database every 30 minutes. How to do this? There isn't a scheduler built into PostgreSQL; you use cron or similar. Have a read here too: http://www.postgresql.org/docs/9.0/static/backup.html Ray.

Re: [GENERAL] Unhandled exception in PGAdmin when opening 16-million-record table

2010-10-30 Thread Dmitriy Igrishin
Hey all, Why not to use MVC approach by implementing a model, which uses, e.g. scrollable cursors? I believe that wxWidgets supports MVC. 2010/10/30 Peter Geoghegan > On 29 October 2010 21:52, Rob Richardson > wrote: > > A customer was reviewing the database that supports the application we >

Re: [GENERAL] Enable automatic scheduled backups

2010-10-30 Thread John R Pierce
On 10/30/10 2:00 AM, Gabriele Bartolini wrote: Il 30/10/10 10:52, RP Khare ha scritto: I want pgsql to take automatic scheduled backup of the database every 30 minutes. How to do this? On Unix like systems, you can set a crontab that executes pg_dump every 30 minutes. if the database become

Re: [GENERAL] Enable automatic scheduled backups

2010-10-30 Thread Gabriele Bartolini
Il 30/10/10 10:52, RP Khare ha scritto: I want pgsql to take automatic scheduled backup of the database every 30 minutes. How to do this? On Unix like systems, you can set a crontab that executes pg_dump every 30 minutes. -- Gabriele Bartolini - 2ndQuadrant Italia PostgreSQL Training, Servic

[GENERAL] Enable automatic scheduled backups

2010-10-30 Thread RP Khare
I want pgsql to take automatic scheduled backup of the database every 30 minutes. How to do this?

Re: [GENERAL] pgAdmin on Mac connecting to Postgres 9 on Linux - SSL/timeout issue

2010-10-30 Thread Basil Bourque
On Oct 29, 2010, at 15:36, Mike Christensen wrote: > I have a Postgres 9 server running on a server out on the Internet and > I connect to it with pgAdmin on OS/X over an SSL connection. > > I notice if I keep the connection open and idle for maybe an hour or > so, when I try to run a query it e

Re: [GENERAL] Max tables in a union

2010-10-30 Thread Scott Marlowe
On Fri, Oct 29, 2010 at 3:11 PM, Fred Miller wrote: > What is the maximum number of tables allowed in a union in 8.4 and 9.0? I'm not aware of any preset limit. I'd guess you'd run into performance problems before you hit a limit. -- To understand recursion, one must first understand recursion.