Re: [GENERAL] view row-level locks

2008-07-11 Thread Vivek Khera
On Jul 11, 2008, at 4:24 AM, Richard Huxton wrote: If you just want to see if a lock has been taken (e.g. SELECT FOR UPDATE) then that shows in pg_locks. If you want details on the actual rows involved, then you probably want pgrowlocks mentioned in Appendix F. Additional Supplied

Re: [GENERAL] Stripping out slony after / before / during pg_restore?

2008-05-13 Thread Vivek Khera
Here's how you do it on restore step from a pg_dump in -Fc format. pg_restore -l dumpfile list edit the file list to remove references to slony objects pg_restore -L list other options you want dumpfile -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to

Re: [GENERAL] close database, nomount state

2008-04-28 Thread Vivek Khera
On Apr 28, 2008, at 6:50 PM, [EMAIL PROTECTED] wrote: I want to ask if there is something like nomount state or close database state in which I can acces postgresql to drop database or to do some other stuff. change the permissions on the DB so nobody can log in. you really should find

Re: [GENERAL] Master-master replication with PostgreSQL

2008-04-16 Thread Vivek Khera
On Apr 16, 2008, at 8:47 AM, Julio Cesar Sánchez González wrote: From what I've read, Slony-I does only master-slave replication and Slony-II is not being actively developed. Is this right? Are there any viable master-master replication tools for PostgreSQL. (They could be commercial/paid

Re: [GENERAL] PostgreSQL Replication with read-only access to standby DB

2008-03-31 Thread Vivek Khera
On Mar 25, 2008, at 4:28 PM, Jeff Davis wrote: This obviously does not work in real time, but it may be useful. It does not require a lot of additional space to do this because of the ZFS copy-on-write implementation. But what benefit does it give you if you're pounding on the same set of

Re: [GENERAL] Problem with async notifications of table updates

2008-03-18 Thread Vivek Khera
On Mar 17, 2008, at 10:58 PM, Tyler, Mark wrote: I suggest rethinking your dislike of NOTIFY. I have thought very hard about using NOTIFY for this but it has two large problems (from my point of view). The first is that it forces me Wait a while and you will learn to detest Spread, too.

Re: [GENERAL] Recomendations on raid controllers raid 1+0

2008-03-13 Thread Vivek Khera
On Mar 13, 2008, at 7:50 AM, Glyn Astill wrote: I'm looking at switching out the perc5i (lsi megaraid) cards from our Dell 2950s for something else as they're crap at raid 10. Use an actual LSI branded card instead of the Dell improved version. -- Sent via pgsql-general mailing list

Re: [GENERAL] pain of postgres upgrade with extensions

2008-03-12 Thread Vivek Khera
On Mar 12, 2008, at 3:19 PM, Tom Lane wrote: - restore dump, ignoring object already exists errors Couldn't one use the dump listing feature of pg_restore and comment out the extensions when restoring? Not likely to be a big improvement over ignore errors :-) -- Sent via

Re: [GENERAL] How to convert postgres timestamp to date: yyyy-mm-dd

2008-03-11 Thread Vivek Khera
On Mar 11, 2008, at 2:50 PM, A. Kretschmer wrote: i.e ... WHERE pt.created_date = '2008-01-21' You can't compare a date or timestamp to a varchar or text. For your example, cast the date-string to a real date like: Since which version of Pg? Queries like the above have worked for me from

Re: [GENERAL] Vacuous errors in pg_dump ... | pg_restore pipeline

2008-02-21 Thread Vivek Khera
On Feb 20, 2008, at 2:12 PM, Douglas McNaught wrote: Alternatively, is there a better way to streamline the duplication of a database? How about: CREATE DATABASE newdb TEMPLATE olddb; The template DB has to have no open connections during the entire copy process, so it is not always

Re: [GENERAL] Is PG a moving target?

2008-02-11 Thread Vivek Khera
On Feb 9, 2008, at 12:20 PM, Ken Johanson wrote: But given the recent and dramatic example of 8.3's on-by-default stricter typing in functions (now not-autocasting), I worry that kind of change could happen in every minor version (8.4 etc). You need to *know* your software if you're using

Re: [GENERAL] Working with huge amount of data.

2008-02-11 Thread Vivek Khera
On Feb 11, 2008, at 10:37 AM, Mario Lopez wrote: The problem arises with the second type of queries, where there are no possible partitions and that the search keywords are not known, I have tried making indexes on the letter it ends with, or indexes that specify that it contains the

Re: [GENERAL] [pgsql-advocacy] PostgreSQL Certification

2008-02-09 Thread Vivek Khera
On Feb 4, 2008, at 11:31 AM, Joshua D. Drake wrote: I don't agree in the least, I was actually going to suggest we add a new one for relational design questions. I like many lists that are contextually specific. IMO, general should be removed for example. I think this makes sense for a

Re: [GENERAL] Lets get the 8.3 Announcement on the front page of Digg

2008-02-05 Thread Vivek Khera
On Feb 5, 2008, at 12:29 PM, Tony Caduto wrote: So this Stonebraker guy is the Postgres Architect? That doesn't imply Postgres == PostgreSQL :-) The original Postgres wasn't even SQL, was it? ---(end of broadcast)--- TIP 9: In versions below

Re: [GENERAL] REINDEX on large DB vs. DROP INDEX/CREATE INDEX

2008-02-04 Thread Vivek Khera
On Feb 4, 2008, at 10:00 AM, Wes wrote: Just a follow-up on this... The REINDEX took about 2 1/2 days. I didn't gain much disk space back - a full backup takes just as long as before, but the vacuum time dropped from 30 hours to 3 hours. what you need to do is compare the relpages from

Re: [GENERAL] How can I avoid PGPool as a single point of failure?

2008-01-31 Thread Vivek Khera
On Jan 31, 2008, at 4:28 AM, Aaron Glenn wrote: CARP *and* pfsync. this late at night off the top of my head I can't see any blatantly obvious reason this wouldn't work (with at least pgpool that is, dunno about your data) we use CARP to balance and failover some webserver pairs. We also

Re: [GENERAL] Log file permissions?

2008-01-31 Thread Vivek Khera
On Jan 31, 2008, at 10:21 AM, Alvaro Herrera wrote: Glyn Astill wrote: I'm not piping it to a file, postgres is managing the logs. Is there any way to manage the permissions, or do I just need to create a script to change the permissions? I think you should be able to chmod the files after

Re: [GENERAL] postgresql book - practical or something newer?

2008-01-31 Thread Vivek Khera
On Jan 31, 2008, at 10:14 AM, Erik Jones wrote: That's an interesting idea. Is there a general audience/ participation wiki for Postgres? I know the developers have one, but a user-oriented sister wiki would probably be a good way to get lots of different people involved. I'm of the

Re: [GENERAL] OT - pg perl DBI question

2008-01-29 Thread Vivek Khera
On Jan 29, 2008, at 7:24 AM, Glyn Astill wrote: I'm trying yo run a perl script that uses DBI (Slonys psql_replication_check.pl to be precise) and I'm getting the error: Can't locate Pg.pm in @INC It doesn't use DBI, it uses Pg. At some point I posted patches to convert it to DBI and

Re: [GENERAL] Tips for upgrading from 7.4

2008-01-23 Thread Vivek Khera
On Jan 23, 2008, at 10:26 AM, Tom Lane wrote: Reading the release notes is good, but you really really should test the application(s) against a test 8.1 installation before you go live ... be sure to run *every* query your system uses through 8.1. the most common problems you will run

Re: [GENERAL] Restoring 8.0 db to 8.1

2007-12-21 Thread Vivek Khera
On Dec 21, 2007, at 11:09 AM, Martijn van Oosterhout wrote: The usual answer is use slony. You can use it to replicate the 8.0 server onto an 8.1 server. This may take weeks/months/years/whatever to synchronise. When the slave is up to date, you pull the plug on the 8.0 server and get

Re: [GENERAL] partitioned table query question

2007-12-11 Thread Vivek Khera
On Dec 11, 2007, at 10:08 AM, Erik Jones wrote: b.) precomputing the bin and directly accessing the child table will be the only options we have for now. This is where I'm headed I have only one or two queries that don't specify the partitioned ID, and those need a full table scan

Re: [GENERAL] partitioned table query question

2007-12-11 Thread Vivek Khera
On Dec 11, 2007, at 10:44 AM, Gregory Stark wrote: The problem Tom's tried to explain is that the function may or may not preserve the bin. So for example if you wanted to bin based on the final digit of a numeric number, so you had a constraint like I, along with at least Erik, was

Re: [GENERAL] Slony replication

2007-12-10 Thread Vivek Khera
On Dec 8, 2007, at 9:21 AM, Geoffrey wrote: I am quite new to Slony as well, but one of the first requirements the docs state is: Thus, examples of cases where Slony-I probably won't work out well would include: * Sites where connectivity is really flakey * Replication to nodes

Re: [GENERAL] SQL design pattern for a delta trigger?

2007-12-10 Thread Vivek Khera
On Dec 7, 2007, at 11:42 AM, Colin Wetherbee wrote: You can do this with a conditional. Something like the following should work. IF NOT (a query matching your data returns rows) THEN INSERT (your new data) There exists a race condition here unless you've locked your tables.

Re: [GENERAL] partitioned table query question

2007-12-10 Thread Vivek Khera
On Dec 10, 2007, at 1:21 PM, Erik Jones wrote: You beat me to the punch on this one. I was wanting to use modulo operations for bin style partitioning as well, but this makes things pretty awkward as well as unintuitive. So, to the postgres gurus: What are the limitations of check

Re: [GENERAL] Script to reset all sequence values in the a given DB?

2007-12-10 Thread Vivek Khera
please don't hijack old threads (partitioned table query question in this case) and change the subject line to start your new question. it messes up threaded mail readers. thanks. On Dec 10, 2007, at 3:00 PM, Nathan Wilhelmi wrote: Hello - Does anyone happen to have a SQL script or

Re: [GENERAL] SQL design pattern for a delta trigger?

2007-12-10 Thread Vivek Khera
On Dec 10, 2007, at 5:04 PM, Colin Wetherbee wrote: For what it's worth, the real algorithm would be as follows. I hadn't had enough coffee yet, and I forgot the UPDATE bit. IF (a query matching your old data returns rows) THEN UPDATE with your new data ELSE INSERT your new data Still

Re: [GENERAL] Error compiling Slony I

2007-11-29 Thread Vivek Khera
On Nov 28, 2007, at 11:17 AM, Glyn Astill wrote: I've already tried removing and re-installing bison, but I shall try again as you suggest. I recommended uninstalling bison, not re-installing it. ---(end of broadcast)--- TIP 6: explain

Re: [GENERAL] Config settings for large restore

2007-11-28 Thread Vivek Khera
. =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Vivek Khera, Ph.D.MailerMailer, LLC Rockville, MD http://www.MailerMailer.com/ +1-301-869-4449 x806 ---(end of broadcast)--- TIP 2: Don't 'kill -9' the postmaster

Re: [GENERAL] PostgreSQL DB split

2007-11-28 Thread Vivek Khera
On Nov 28, 2007, at 8:18 AM, Richard Huxton wrote: I can read that I can create a PostgreSQL DB on the RAMDisk partion, but I'm wondering if is it possible to create one DB with two schemas in two different memory location (RAM and flash)? See the manuals for tablespaces. but postgres

Re: [GENERAL] Error compiling Slony I

2007-11-28 Thread Vivek Khera
On Nov 28, 2007, at 8:50 AM, Glyn Astill wrote: Hi people, When I try to compile Slony 1.2 I get the following error:P parser.y:1090:18: error: scan.c: No such file or directory make[2]: *** [parser.o] Error 1 make[2]: Leaving directory `/tmp/slony1-1.2.12/src/slony_logshipper' make[1]: ***

Re: [GENERAL] Select all fields except one

2007-11-28 Thread Vivek Khera
On Nov 28, 2007, at 11:06 AM, Matt Doughty wrote: Is there a way of selecting all fields except for one in particular? I'd like to create a query that says something like: select * except fieldx For best practices, you should never use select * in your queries. You will inevitably

Re: [GENERAL] Migrating from 32 to 64 bit

2007-11-26 Thread Vivek Khera
On Nov 24, 2007, at 6:18 PM, Laurent CARON wrote: Question: I'd like to know if it is possible (and wise) to just keep the /var/lib/postgres.. directories from the old 32Bit server to use on the 64Bit version. This is just as a personal interest since I can also just dump and restore

Re: [GENERAL] replication in Postgres

2007-11-26 Thread Vivek Khera
On Nov 26, 2007, at 10:14 AM, Jeff Larsen wrote: Yes, but I'd like something better than near real time as the above page describes. Or maybe someone could clarify that Besides, EnterpriseDB does not save me enough money. In my current commercial DB, if a transaction is committed on the

Re: [GENERAL] postgresql storage and performance questions

2007-11-20 Thread Vivek Khera
On Nov 20, 2007, at 1:04 PM, Josh Harrison wrote: I ran vacuum full on this table already. I haven't re-indexed it. But this will not affect the table size...right...since indexes are stored separately? Yes, but your indexes are probably bloated at this point, so to reduce the space they

Re: [GENERAL] FreeBSD portupgrade of 8.1 - 8.2

2007-11-13 Thread Vivek Khera
On Nov 12, 2007, at 8:55 PM, Steve Manes wrote: Steve Manes wrote: What's the portupgrade process in FreeBSD?? (Fixed. The answer is to use pg_delete -f on the old package to force the delete) more elegantly, portupgrade -Rrv -f -o databases/postgresql82-client postgresql-client but

Re: [GENERAL] Sharing database handles across forked child processes

2007-11-13 Thread Vivek Khera
On Nov 13, 2007, at 1:18 PM, [EMAIL PROTECTED] wrote: Yep, this is a fork without exec. And the child processes often aren't even doing any database access -- the database connection's opened and held, then a child is forked off, and the child 'helpfully' closes the handle during the child's

Re: [GENERAL] Linux v.s. Mac OS-X Performance

2007-11-12 Thread Vivek Khera
On Nov 12, 2007, at 12:29 PM, Sam Mason wrote: You only need a 64bit address space when each process wants to see more than ~3GB of RAM. And how exactly do you get that on a 32-bit CPU? Even with PAE (shudders from memories of expanded/extended RAM in the DOS days), you still have a

Re: [GENERAL] Linux v.s. Mac OS-X Performance

2007-11-12 Thread Vivek Khera
On Nov 12, 2007, at 12:01 PM, Greg Smith wrote: Not the Mac OS BSD. Last time I looked into this OS X was still dramatically slower than Linux on things like process creation. On MacOS X, that's the Mach kernel doing process creation, not anything BSD-ish at all. The BSD flavor of MacOS

Re: [GENERAL] Calculation for Max_FSM_pages : Any rules of thumb?

2007-11-08 Thread Vivek Khera
On Nov 1, 2007, at 8:51 PM, Ow Mun Heng wrote: Another question is, based on what I've read in the archives (in my laptop.. No-Inet conn @ work) Since I've overran my max_FSM, I'm basically screwed and will have to do a vacuum verbose FULL on the entire DB. Crap.. I've seen this repeated

Re: [GENERAL] time penalties on triggers?

2007-10-10 Thread Vivek Khera
On Oct 5, 2007, at 9:10 AM, Kenneth Downs wrote: I also found it very hard to pin down the penalty of the trigger, but came up with rough figures of 30-50% overhead. The complexity of the trigger did not matter. in which language did you write your triggers?

Re: [GENERAL] Debian problem...

2007-09-28 Thread Vivek Khera
On Sep 28, 2007, at 5:09 AM, Tom Allison wrote: I know reiserfs does better performance wise, but there's no point in going fast if you can't steer. I recently had to replace 16 Western Digital 10kRPM SATA drives with Hitachi 7.2kRPM drives because the WD drives kept randomly (and

Re: [GENERAL] question about pg_dump -a

2007-09-28 Thread Vivek Khera
On Sep 28, 2007, at 9:07 AM, Ottavio Campana wrote: But why does pg_dump does not already exports data such that previous tables do not depend on successive ones? Because you can't always sort your tables that way. The restore procedure is responsible for either sorting or disabling the

Re: [GENERAL] For index bloat: VACUUM ANALYZE vs REINDEX/CLUSTER

2007-09-24 Thread Vivek Khera
On Sep 18, 2007, at 1:14 AM, Joshua D. Drake wrote: Q: To get rid of index bloat, is a VACUUM ANALYZE enough? Or must I reindex/cluster indexes? If you overrun your max_fsm_pages, no: else yes; my algorithm is: if (true) then yes; my FSM is way bigger than I ever use (vacuum never

Re: [GENERAL] For index bloat: VACUUM ANALYZE vs REINDEX/CLUSTER

2007-09-24 Thread Vivek Khera
On Sep 24, 2007, at 12:00 PM, Phoenix Kiula wrote: I feel your pain. But I seem to have (mostly) solved my problem in three ways: My particular usage pattern (add data continuously, purge *some* of the data once per week or every other week. The purge is what seems to kill it. Last

Re: [GENERAL] importing pgsql schema into visio (for diagramming)

2007-09-14 Thread Vivek Khera
On Sep 12, 2007, at 7:32 PM, Andrew Hammond wrote: Does anyone know where I could find a tool which allows importing schema information from a postgres database into visio? The boss guys want some pretty pictures... See SQLFairy. it can generate pretty pictures directly from the

Re: [GENERAL] accessing PG using Perl:DBI

2007-08-30 Thread Vivek Khera
On Aug 30, 2007, at 4:03 AM, Ow Mun Heng wrote: 2. how do I perform a list of SQL using transactions. eg: like above, but wrap it into a transaction. assuming $dbh is your open handle to the database via DBI, then you do something like this: $dbh-begin_work() or die; $sth =

Re: [GENERAL] [PERFORM] Partioning tsearch2 a table into chunks and accessing via views

2007-08-27 Thread Vivek Khera
On Aug 25, 2007, at 1:34 AM, Benjamin Arai wrote: There has to be another way to do incremental indexing without loosing that much performance. This is the killer feature that prevents us from using the tsearch2 full text indexer on postgres. we're investigating making a foreign table

Re: [GENERAL] Bigtime scaling of Postgresql (cluster and stuff I suppose)

2007-08-27 Thread Vivek Khera
On Aug 25, 2007, at 8:12 AM, Phoenix Kiula wrote: The sentence that caught my attention is Nokia, Alcatel and Nortel are all building real-time network nodes on top of MySQL Cluster. My experiences with MySQL so far have been less than exhilerating (only tried it for our web stuff, which is

Re: [GENERAL] Bigtime scaling of Postgresql (cluster and stuff I suppose)

2007-08-27 Thread Vivek Khera
On Aug 27, 2007, at 11:04 AM, Andrew Sullivan wrote: It was a way to scale many small systems for certain kinds of workloads. My impression is that in most cases, it's a SQL-ish solution to a problem where someone decided to use the SQL nail because that's the hammer they had. I can think of

Re: [GENERAL] PostgreSQL vs Firebird feature comparison finished

2007-08-24 Thread Vivek Khera
On Aug 24, 2007, at 4:09 AM, Alban Hertroys wrote: I'm not entirely sure what makes multi-threading be advantageous on a specific operating system, but I think FreeBSD should be added to that list as well... They've been bench marking their threading support using multi-threading in MySQL

Re: [GENERAL] Best practice for: ERROR: invalid byte sequence for encoding UTF8

2007-08-15 Thread Vivek Khera
On Aug 15, 2007, at 7:41 AM, Ivan Zolotukhin wrote: What is the best practice to process such a broken strings before passing them to PostgreSQL? Iconv from utf-8 to utf-8 dropping bad characters? This rings of GIGO... if your user enters garbage, how do you know what they wanted? You

Re: [GENERAL] Time for Vacuum vs. Vacuum Full

2007-08-09 Thread Vivek Khera
On Aug 9, 2007, at 9:38 AM, Brad Nicholson wrote: I have the times that it takes to to do a regular vacuum on the clusters, will vacuum full take longer? almost certainly it will, since it has to move data to compact pages rather than just tagging the rows as reusable. you can speed

Re: [GENERAL] How do I connect postgres table structures and view structures to an existing svn repository?

2007-08-07 Thread Vivek Khera
On Aug 1, 2007, at 10:56 AM, Richard Huxton wrote: You could write a small cron-script that dumped the schema once every 5 minutes so it could be picked up by svn. I think most people have a separate collection of schema-creation/ update scripts that they keep under version control. All

Re: [GENERAL] upgrade to 8.2.? or implement Slony, which first?

2007-07-31 Thread Vivek Khera
On Jul 27, 2007, at 8:29 PM, Jim Nasby wrote: Double-check with the Slony guys, but ISTR that there's an issue going all the way from 7.4 to 8.2 in a single shot. I don't think that's a slony-specific issue. Moving from 7.4 to 8.0 introduces a fair number of incompatibilities one must

Re: [GENERAL] pg_dump without blobs

2007-07-16 Thread Vivek Khera
On Jul 16, 2007, at 9:26 AM, Francisco Reyes wrote: I guess the next question is 'what does postgresql considers a blob'? bytea fields? How about a large text with megabytes worth of data? bytea and text fields are NOT blobs. they are what you access via the 'large object' functions.

Re: [GENERAL] growing disk usage problem: alternative solution?

2007-06-26 Thread Vivek Khera
On Jun 26, 2007, at 3:31 PM, Bill Moran wrote: VACUUM FULL and REINDEX are not required to maintain disk usage. Good old- fashoned VACUUM will do this as long as your FSM settings are high enough. I find this true for the data but not necessarily for indexes. The other week I

Re: [GENERAL] pg_restore out of memory

2007-06-25 Thread Vivek Khera
On Jun 25, 2007, at 9:33 PM, Francisco Reyes wrote: Therefore, the problem is only with the i386 version. Should I report this as a bug or is this nornal and expected? i wouldn't call it a bug to need more resources than you've got available :-) obviously the limits on the i386 version

Re: [GENERAL] pg_restore out of memory

2007-06-25 Thread Vivek Khera
On Jun 25, 2007, at 10:32 PM, Francisco Reyes wrote: Hm... now I am really confused. The same settings on AMD64 work. So how are more resources available when I have the same amount of memory and the same settings? you set your maxdsize to the same as on i386? on even my smallest

Re: [GENERAL] pg_restore out of memory

2007-06-18 Thread Vivek Khera
On Jun 15, 2007, at 8:24 AM, Francisco Reyes wrote: Understood. But at least it shows that the program was already above the default of 512MB limit of the operating system. But that is a false assertion that the limit is 512Mb. On a random system of mine running FreeBSD/i386 it shows the

Re: [GENERAL] pg_restore out of memory

2007-06-18 Thread Vivek Khera
On Jun 18, 2007, at 2:10 PM, Francisco Reyes wrote: Also the error is about running out of memory when trying to allocate 84MB. The default FreeBSD limit is 512MB so 84MB is well below that. Try being less stingy than 128Mb for your stack. The default stack is 512Mb.

Re: [GENERAL] Using the power of the GPU

2007-06-08 Thread Vivek Khera
On Jun 8, 2007, at 3:33 PM, Guy Rouillier wrote: Well, I'm not one of the developers, and one of them may have this particular scratch, but in my opinion just about any available fish has to be bigger than this one. Until someone comes out with a standardized approach for utilizing

Re: [GENERAL] Performance

2007-05-31 Thread Vivek Khera
On May 23, 2007, at 1:12 PM, Donald Laurine wrote: Now my question. The performance of each of these databases is decreasing. I measure the average insert time to the database. This metric has decreased by about 300 percent over the last year. I run vacuum analyze and vacuum analyze full

Re: [GENERAL] why postgresql over other RDBMS

2007-05-31 Thread Vivek Khera
On May 25, 2007, at 5:28 PM, Tom Lane wrote: That's true at the level of DDL operations, but AFAIK we could parallelize table-loading and index-creation steps pretty effectively --- and that's where all the time goes. I would be happy with parallel builds of the indexes of a given table.

Re: [GENERAL] Postgres Printed Manuals

2007-05-16 Thread Vivek Khera
On May 13, 2007, at 10:43 PM, Tom Lane wrote: It's hard to make any money that way :-(. Rich Morin used to run a business called Prime Time Freeware that published hardcopy versions of our manuals along with much other open-source documentation. He gave up on it some years ago, though, and I

Re: [GENERAL] Performance issues of one vs. two split tables.

2007-05-16 Thread Vivek Khera
On May 14, 2007, at 4:37 PM, Bill Moseley wrote: Say that there's also about 10 columns of settings or preferences for each user. Are there any cases or reasons to have a separate user_preferences table vs. just placing all the columns together in one table? when you have, say 65 million

Re: [GENERAL] Performance issues of one vs. two split tables.

2007-05-16 Thread Vivek Khera
On May 15, 2007, at 10:35 AM, Bill Moseley wrote: For some value of large, is there a time when one might consider using a single column in the user or user_prefs table to represent their color choices instead of a link table? We use bitfields on our large user table. It is becoming

Re: [GENERAL] Is there a shortage of postgresql skilled ops people

2007-04-09 Thread Vivek Khera
On Mar 27, 2007, at 4:09 PM, Tony Caduto wrote: Another thing is this, how hard could it possibly be for a MS SQL DBA or Oracle DBA to pick up using PostgreSQL? I don't think it would take a decent admin of any database to come up to speed in a very short time as long as they were

Re: [GENERAL] Is there a shortage of postgresql skilled ops people

2007-04-09 Thread Vivek Khera
On Apr 9, 2007, at 10:09 AM, [EMAIL PROTECTED] wrote: It would be a really great service to this community if you would capture those issues and publish documentation (but feel free to change or omit the names to protect the incompetent^w innocent!). There's no incompetence involved...

Re: [GENERAL] best way to kill long running query?

2007-03-21 Thread Vivek Khera
On Mar 21, 2007, at 3:09 PM, Bill Eaton wrote: I want to allow some queries for my users to run for a prescribed period of time and kill them if they go over time. Is there a good way to do this? set statement_timeout perhaps? Ooh. I like that. It would be absolutely brilliant if I

Re: [GENERAL] cache - timing

2007-03-20 Thread Vivek Khera
On Mar 19, 2007, at 1:58 AM, ab wrote: I am trying to measure the time taken for a number of queries using \timing . All queries on my table other than the first one are pretty fast. This is likely due to caching. Is there any way to clear the internal cache of Postgres. Should I be worried

[GENERAL] anyone heard of/use SurfRAID Triton product with postgres?

2007-03-19 Thread Vivek Khera
! =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Vivek Khera, Ph.D.Khera Communications, Inc. Internet: khera@kciLink.com Rockville, MD +1-301-869-4449 x806 ---(end of broadcast)--- TIP 2: Don't 'kill -9

Re: [GENERAL] Lifecycle of PostgreSQL releases

2007-03-16 Thread Vivek Khera
On Mar 15, 2007, at 10:22 AM, Alvaro Herrera wrote: He could wait for 8.4 as well, as it will be probably faster and have more features than 8.3. Following your reasoning, one could wait essentially forever. H... precisely the reason my cell phone hasn't been replaced in a long

[GENERAL] grant permissions to set variable?

2007-03-14 Thread Vivek Khera
I want to do some debugging on an app, and I'd like to set on a per- connection basis set log_min_duration_statement = 10; Obviously since I'm not super user I get permission denied. Is there some GRANT I can grant to the user in question to allow this? I don't really want to do it

Re: [GENERAL] grant permissions to set variable?

2007-03-14 Thread Vivek Khera
On Mar 14, 2007, at 11:36 AM, Richard Huxton wrote: Vivek Khera wrote: I want to do some debugging on an app, and I'd like to set on a per-connection basis set log_min_duration_statement = 10; Obviously since I'm not super user I get permission denied. Is there some GRANT I can grant

Re: [GENERAL] daylight savings patches needed?

2007-03-14 Thread Vivek Khera
On Mar 12, 2007, at 6:08 PM, Martijn van Oosterhout wrote: On Mon, Mar 12, 2007 at 01:13:42PM -0600, Ed L. wrote: Would I be correct in understanding that every pre-8.0 cluster must be restarted in order for the OS changes to take affect?!? Possibly, I imagine many C libraries would cache

Re: [GENERAL] DST failing on 8.1.3

2007-03-14 Thread Vivek Khera
On Mar 14, 2007, at 2:00 PM, Tom Lane wrote: Should work to just copy over the timezone directory tree from a correct installation on the same machine architecture (I can't recall right now if the file format is machine-dependent or not). You might have to restart the postmaster too,

Re: [GENERAL] FreeBSD kernel configuration

2007-03-06 Thread Vivek Khera
On Mar 6, 2007, at 3:42 AM, veejar wrote: Hi! I have server such configuration: 2 x Xeon LV DualCore 1.66GHz MEM 4Gb DDR2-400 2 x 250Gb SATA HDD how are you using the drives? software mirror? I have 20 databases on PostgreSQL 8. 2 of them are more than 1GB. I have ~50 requests per

Re: [GENERAL] How often do I need to reindex tables?

2007-03-01 Thread Vivek Khera
On Feb 28, 2007, at 5:35 PM, Bill Moran wrote: Just an FYI ... I remembered what prompted the cron job. We were seeing significant performance degradation. I never did actual measurements, but it was on the order of Bill, why is restoring taking such a long time? from other systems

Re: [GENERAL] open source - content management system - that uses PostGreSQL

2007-02-19 Thread Vivek Khera
On Feb 16, 2007, at 4:13 PM, Andrew Kirkness wrote: I am currently setting up a website and have PostGreSQL database I'm using for the backend. I'm researching an open source Content Management System that uses PostGreSQL. Do you have any recommendations? You need to define what you

Re: [GENERAL] Have anyone this man e-mail ?

2007-02-16 Thread Vivek Khera
On Feb 16, 2007, at 12:46 PM, Ezequias Rodrigues da Rocha wrote: Hi list, I am looking for this guy for some help with Slony-I. Then why don't you send Robert a direct email? He's not that hard to find with google. Or perhaps ask your question here; there are lots of smart folks

Re: [GENERAL] Converting 7.x to 8.x

2007-01-29 Thread Vivek Khera
On Jan 27, 2007, at 10:45 AM, Ron Johnson wrote: Using slony or piped pg_dump requires that you have *double* the amount of disk space. Having a *very large* database and double capacity of SCSI disks (including storage controllers, shelves, etc, etc) is expensive, and might not be available.

Re: [GENERAL] Index bloat of 4x

2007-01-17 Thread Vivek Khera
On Jan 17, 2007, at 11:56 AM, Tom Lane wrote: So the above doesn't sound too unlikely. Perhaps we should recommend vac full + reindex as standard cleanup procedure. Longer term, maybe teach vac full to do an automatic reindex if it's moved more than X % of a vac full + reindex is a waste

Re: [GENERAL] queueing via database table?

2007-01-03 Thread Vivek Khera
On Jan 3, 2007, at 2:00 AM, Steve Atkins wrote: Holding a lock while generating the thumbnail doesn't sound like a great idea, and I think that the select for update will end up serialising the requests. I'd add a rendering field, text, defaulting to an empty string. Then do a select for

Re: [GENERAL] FreeBSD 6.0 PostgreSQL upgrade

2006-12-19 Thread Vivek Khera
On Dec 19, 2006, at 3:17 AM, Jeff Amiel wrote: We have a production FreeBSD 6.0 system with Postgresql 8.1 where we have avoided upgrading/updating the ports to avoid compatability and other unknown issues. We have our supfile default date set on our production, test and development

Re: [GENERAL] HELP: Urgent, Vacuum problem

2006-12-06 Thread Vivek Khera
On Dec 5, 2006, at 4:09 PM, Scott Marlowe wrote: I recently tossed 8.1 on my workstation which runs a little reporting application here. I pointed the app from 7.4 to 8.1 and got a visit within about an hour from a user, asking if I'd done anything to my database. Worrying that I'd made some

Re: [GENERAL] [ANNOUNCE] PostgreSQL 8.2 Now Available

2006-12-06 Thread Vivek Khera
On Dec 5, 2006, at 5:07 PM, Josh Berkus wrote: Ragnar, Now that this has been announced, should not http://www.postgresql.org/docs/current/ and co be redirected to http://www.postgresql.org/docs/8.1/ instead of http://www.postgresql.org/docs/8.2/ in particular, the press release's link to

Re: [GENERAL] Stripping kernel FreeBSD - postgres

2006-11-30 Thread Vivek Khera
On Nov 30, 2006, at 8:50 AM, Enrico wrote: I already read your link and it is not specific for Postgres, I'm searching for a more specific document. Just remove any devices you don't have on your machine, and remove any extras like linux compat, older version compat, etc. You probably

Re: [GENERAL] Postgresql data integrity during RAID10 drive rebuild

2006-11-29 Thread Vivek Khera
On Nov 29, 2006, at 11:56 AM, Steve Poe wrote: I've never had to replace a disc in an array with Postgresql running on it. LSI says I can replace the disc and do a rebuild while everything is running. I am of course concerned about data integrity/corruption. This is the whole entire

Re: [GENERAL] Postgresql data integrity during RAID10 drive rebuild

2006-11-29 Thread Vivek Khera
On Nov 29, 2006, at 2:39 PM, Scott Marlowe wrote: Sounds good. According to LSI, the drive will take 8 hrs to rebuild a 146GB disc (at a 30% rebuild rate), so doing this in the middle of the day is not ideal. The rebuild time also tends to depend on how full the array is. If you're only

Re: [GENERAL] vacuum: out of memory error

2006-11-28 Thread Vivek Khera
On Nov 28, 2006, at 8:40 AM, Jakub Ouhrabka wrote: There are 4G of RAM and 4G swap. and what is the per-process resource limit imposed by your OS? Just because your box has that much RAM doesn't mean your process is allowed to use it. smime.p7s Description: S/MIME cryptographic

Re: [GENERAL] How to increace nightly backup speed

2006-11-28 Thread Vivek Khera
On Nov 28, 2006, at 11:11 AM, Andrus wrote: 1. My database size seems to be appox 1 GB and download speed is approx 600 kb/s. Your solution requires 4.5 hours download time since 1 GB of data must be downloaded. If you're running pg_dump on a remote host, you're transferring the data

Re: [GENERAL] Fast backup/restore

2006-10-17 Thread Vivek Khera
On Oct 17, 2006, at 10:43 AM, [EMAIL PROTECTED] wrote:We just tar/gzip the entire data directory.  It takes all of 20 sec.  We've successfully restored from that also.  The machine you are restoring to *must* be running the save version of postgresql you backed up from. If you successfully backed

Re: [GENERAL] Fast backup/restore

2006-10-17 Thread Vivek Khera
On Oct 17, 2006, at 2:35 PM, Steve Poe wrote: Vivek, What methods of backup do you recommend for medium to large databases? In our example, we have a 20GB database and it takes 2 hrs to load from a pg_dump file. my largest db is about 60Gb with indexes. reloading the data (about

Re: [GENERAL] RES: Dates rejected

2006-10-16 Thread Vivek Khera
On Oct 16, 2006, at 1:08 PM, Carlos H. Reimer wrote: How can we explain the 01:00:00 hour that the to_date function returns for date 15/10/2006? does your timezone change from summer time to winter time (daylight savings, etc.) on that date? smime.p7s Description: S/MIME

Re: [GENERAL] old Pg interface

2006-10-16 Thread Vivek Khera
On Oct 16, 2006, at 1:15 PM, Brandon Metcalf wrote: Does anyone know of any issues with continuing to use the old Pg interface with newer versions of PostgreSQL? it is just a rather thin glue layer on top of the libpq interface, so it should continue to work just as any libpq app would

Re: [GENERAL] [Slony1-general] Using slony with many schema's

2006-10-11 Thread Vivek Khera
On Oct 11, 2006, at 2:55 PM, snacktime wrote: So by putting all the data into one schema, every report query now gets run against a million or more rows instead of just a few hundred or thousand. So all clients will see a drop in query performance instead of just the clients with large

Re: [GENERAL] Backup Large Tables

2006-09-22 Thread Vivek Khera
On Sep 21, 2006, at 10:54 PM, Charles Ambrose wrote:I have a fairly large database tables (say an average of  3Million to 4Million records).  Using the pg_dump utility takes forever to dump the Sounds like your either woefully mis-configured or woefully underpowered or have a short definition of

Re: [GENERAL] Backup / export DB

2006-09-22 Thread Vivek Khera
On Sep 22, 2006, at 3:04 AM, [EMAIL PROTECTED] wrote:If you're database contains foreign keys or similar, make sure to include OIDs into the database dump.on what basis did you make up this advice?i have no OID's anywhere and FK's work just fine.when you set up the new server, be sure to re-create

  1   2   3   >