Re: [PERFORM] Partitions and work_mem?

2014-11-16 Thread Magnus Hagander
On Oct 16, 2014 12:58 AM, "Tom Lane" wrote: > > Igor Neyman writes: > > From: Dave Johansen [mailto:davejohan...@gmail.com] > > This conversation has probably become a bit off topic, but my understanding is that what you're paying RedHat for is a stable platform for a long period of time. That me

Re: [PERFORM] pg_dump vs pg_basebackup

2014-03-25 Thread Magnus Hagander
ally works. Probably such sort of > knowledge is so essential for a DBA, that it is better to learn both > methods, at least to be able to choose correctly? But maybe it is a > rhetorical question. > > On Tue, Mar 25, 2014 at 4:21 PM, Magnus Hagander > wrote: > > I would say that

Re: [PERFORM] pg_dump vs pg_basebackup

2014-03-25 Thread Magnus Hagander
> To make changes to your subscription: > > http://www.postgresql.org/mailpref/pgsql-performance > > > > -- > Ilya Kosmodemiansky, > > PostgreSQL-Consulting.com > tel. +14084142500 > cell. +4915144336040 > i...@postgresql-consulting.com > > > -- > Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-performance > -- Magnus Hagander Me: http://www.hagander.net/ Work: http://www.redpill-linpro.com/

Re: [PERFORM] Hot Standby performance issue

2013-10-21 Thread Magnus Hagander
On Oct 22, 2013 1:14 AM, "Tomas Vondra" wrote: > > On 22.10.2013 00:59, sparikh wrote: > > Yes, Expalin without Analyze is taking long. It is weird. In the > > pg_stat_activity Explain was the only query running. So server was > > almost idle. Using New relic interface I checked CPU was almost idl

Re: [PERFORM] Best practice when reindexing in production

2013-05-29 Thread Magnus Hagander
ement ? You can use something like SELECT pg_get_indexdef(indexrelid) FROM pg_index. You will need to filter it not to include system indexes, toast, etc, and then insert the CONCURRENCY part, but it should give you a good startingpoint. -- Magnus Hagander Me: http://www.hagander.net/ Work

Re: [PERFORM] Best practice when reindexing in production

2013-05-29 Thread Magnus Hagander
NCURRENTLY, and then rename the new one into place (typically in a transaction). (If your app, documentation or dba doesn't mind the index changing names, you don't need to rename of course, you can just drop the old one). -- Magnus Hagander Me: http://www.hagander.net/ Work: ht

Re: [PERFORM] Why is my pg_xlog directory so huge?

2013-03-18 Thread Magnus Hagander
re about your archive you could set your archive_command to e.g. /bin/true, and that will make it pretend it has archived the files, and should clean it up quicker. But that will mean you have no valid archive and thus no valid backups, until you start over froma new base. -- Magnus Hagander Me

Re: [PERFORM] Why is my pg_xlog directory so huge?

2013-03-18 Thread Magnus Hagander
e > database - this seems wrong to me, however I have no clue why this would > happen. My first guess would be that your archive_command is failing - so check your logs for that. If that command fails, no xlog files will ever be rotated (since it would invalidate your backups). --

Re: [PERFORM] Thousands databases or schemas

2012-11-08 Thread Magnus Hagander
y to deal with the "we lost data sometime between and but don't know when" when tracking it down. I've yet to find a case where that's not easier than repeatedly restoring even a fairly small pg_dump based backup to find it. Plus, it give you a much better granularity,

Re: [PERFORM] Connection Options -- SSL already uses compression?

2012-10-21 Thread Magnus Hagander
rprise me if it's not possible. -- Magnus Hagander Me: http://www.hagander.net/ Work: http://www.redpill-linpro.com/ -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] Postgres 9.1.4 - high stats collector IO usage

2012-08-06 Thread Magnus Hagander
On Mon, Aug 6, 2012 at 4:16 PM, Pavel Stehule wrote: > 2012/8/6 Magnus Hagander : >> That's not a good way of doing it, since you loose persistent storage. >> >> Instead, you should set the stats_temp_dir paramter to a filesystem >> somewhere else that is tmpfs. Th

Re: [PERFORM] Postgres 9.1.4 - high stats collector IO usage

2012-08-06 Thread Magnus Hagander
ther server with similar problems >> on 9.1. >> >> Any help would be sincerely appreciated. >> >> >> David Barton d...@oneit.com.au > > -- > Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-performance -- Magnus Hagander Me: http://www.hagander.net/ Work: http://www.redpill-linpro.com/ -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] Performance of pg_basebackup

2012-06-12 Thread Magnus Hagander
u have a single tablespace you can have pg_basebackup write the output to stdout and then pipe that through pigz. --  Magnus Hagander  Me: http://www.hagander.net/  Work: http://www.redpill-linpro.com/ -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes

Re: [PERFORM] Intel 710 pgbench write latencies

2011-11-02 Thread Magnus Hagander
e raid controller does > 'write-throughs' on the attached disks, and the SSD's don't lie about when > they've written to RAM. Doesn't most SSDs without supercaps lie about the writes, though? --  Magnus Hagander  Me: http://www.hagander.net/  Work: http://www

Re: [PERFORM] Infinite Cache

2011-07-08 Thread Magnus Hagander
han as an extra module or app that you have to patch your kernel with. Unless you can get it all the way into the baseline kernel of course, but that's not going to be easy... --  Magnus Hagander  Me: http://www.hagander.net/  Work: http://www.redpill-linpro.com/ -- Sent via pgs

Re: [PERFORM] Infinite Cache

2011-07-03 Thread Magnus Hagander
certainly hope it didn't take years to clean up ;) So I wouldn't hold my breath for that one. --  Magnus Hagander  Me: http://www.hagander.net/  Work: http://www.redpill-linpro.com/ -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] seq scan in the case of max() on the primary key column

2011-06-16 Thread Magnus Hagander
what can I do to make the first query use its index > on the primary key. Looks like the first table is not partitioned, but the second one is? PostgreSQL 9.0 is unable to use an index scan to find min/max on a partitioned table. 9.1, however, can do that. --  Magnus Hagander  Me: http:

Re: [PERFORM] pgpoolAdmin handling several pgpool-II clusters

2011-05-03 Thread Magnus Hagander
idea to choose your clustering technology based on the web interfaces... Running 3 pgpooladmin doesn't seem like a huge thing. And you should note that PostgresXC is nowhere near production ready. It'll get there, but it's pretty far away. --  Magnus Hagander  Me: http://www.haga

Re: [PERFORM] Time to put theory to the test?

2011-04-26 Thread Magnus Hagander
dn't want to make themselves dependant on an Oracle controlled technology. That argument certainly went away when Oracle bought them - and I think that was the main reason. Not the "oracle mindset" or anything like that... --  Magnus Hagander  Me: http://www.hagander.net/  Work: htt

Re: [PERFORM] Which RAID Controllers to pick/avoid?

2011-02-02 Thread Magnus Hagander
tested? Yes. > - Is the linux support of the LSI and Adaptec cards comparable? Can't comment on that one, sorry. --  Magnus Hagander  Me: http://www.hagander.net/  Work: http://www.redpill-linpro.com/ -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To

Re: [PERFORM] PostgreSQL 9.0 x64 bit pgbench TPC very low question?

2010-12-21 Thread Magnus Hagander
you'll get weird errors about failed transactions til > rollback etc. Yeah, AFAIK pgbouncer works fine on Windows, and is a very good pooler for PostgreSQL. I haven't run it on Windows myself, but it should support it fine... --  Magnus Hagander  Me: http://www.hagander.net/  Work:

Re: [PERFORM] [Fwd: postgres 8.4.1 number of connections]

2010-08-27 Thread Magnus Hagander
a bit of downtime. Just sticking a 1-1 mapping pgbouncer in between with support for SUSPEND makes a lot of difference if you switch master/slave on your replication /ha. It'll still break the connections for jboss, but it'll recover from that a *lot* faster than a reconfig. --  Magnus

Re: [PERFORM] Pooling in Core WAS: Need help in performance tuning.

2010-07-13 Thread Magnus Hagander
n't want to push the extensibility of PostgreSQL there? +1 on this idea in general, if we can think up a good API - this seems very useful to me, and you have some good examples there of cases where it'd definitely be a help. --  Magnus Hagander  Me: http://www.hagander.net/  Wor

Re: [PERFORM] Analysis Function

2010-06-15 Thread Magnus Hagander
On Mon, Jun 14, 2010 at 15:59, Tom Lane wrote: > Magnus Hagander writes: >> On Sun, Jun 13, 2010 at 21:19, David Jarvis wrote: >>> I prefer to_timestamp and to_date over the more verbose construct_timestamp. > >> Yeah, I agree with that. > > Those names

Re: [PERFORM] Analysis Function

2010-06-14 Thread Magnus Hagander
requires both year and month etc? > I prefer to_timestamp and to_date over the more verbose construct_timestamp. Yeah, I agree with that. -- Magnus Hagander Me: http://www.hagander.net/ Work: http://www.redpill-linpro.com/ -- Sent via pgsql-performance mailing list (pgsql-performance@

Re: [PERFORM] Analysis Function

2010-06-14 Thread Magnus Hagander
On Sun, Jun 13, 2010 at 17:58, Tom Lane wrote: > Magnus Hagander writes: >> On Sun, Jun 13, 2010 at 17:42, Tom Lane wrote: >>> ... (We presumably want >>> timezone to default to the system timezone setting, but I wonder how >>> we should make that work ---

Re: [PERFORM] Analysis Function

2010-06-13 Thread Magnus Hagander
On Sun, Jun 13, 2010 at 17:42, Tom Lane wrote: > Magnus Hagander writes: >> On Sun, Jun 13, 2010 at 09:38, David Jarvis wrote: >>> Does it makes sense to use named parameter notation for the first value (the >>> year)? This could be potentially confusing: &g

Re: [PERFORM] Analysis Function

2010-06-13 Thread Magnus Hagander
the others are so arbitrary there is no way to explain such a choice. > Similarly, to_timestamp() ...? Seems meaningless without at least a full > date and an hour. Agreed. -- Magnus Hagander Me: http://www.hagander.net/ Work: http://www.redpill-linpro.com/ -- Sent via pgsql-pe

Re: [PERFORM] mysql to postgresql, performance questions

2010-03-18 Thread Magnus Hagander
n will by default to SSL on your connection which obviously adds a *lot* of overhead. If you're not actively using it (in which case you will control this from pg_hba.conf), just edit postgresql.conf and disable SSL, then restart the server. -- Magnus Hagander Me: http://www.hag

Re: [PERFORM] Inserting 8MB bytea: just 25% of disk perf used?

2010-01-14 Thread Magnus Hagander
; >        I've no idea of the other needed NTFS tweaks, like if there is a > noatime/nodiratime ?... It does. See http://www.hagander.net/talks/Advanced%20PostgreSQL%20on%20Windows.pdf -- Magnus Hagander Me: http://www.hagander.net/ Work: http://www.redpill-linpro.com/ -- S

Re: [PERFORM] statement stats extra load?

2009-09-23 Thread Magnus Hagander
On Tue, Sep 22, 2009 at 15:19, Alan McKay wrote: > On Tue, Sep 22, 2009 at 2:42 AM, Magnus Hagander wrote: >> That's not true at all. >> >> If you have many relations in your cluster that have at some point been >> touched, the starts collector can create

Re: [PERFORM] statement stats extra load?

2009-09-21 Thread Magnus Hagander
On 21 sep 2009, at 23.41, Bruce Momjian wrote: Alan McKay wrote: And if so, where does that extra load go? ? ?Disk? ?CPU? ?RAM? As of 8.4.X the load isn't measurable. Thanks Bruce. What about 8.3 since that is our current production DB? Same. All statsistics settings that are enabled

Re: [PERFORM] Seeking performance advice and explanation for high I/O on 8.3

2009-09-04 Thread Magnus Hagander
that you don't have to struggle with tuning the FSM in 8.4 is another thing that makes life a *lot* easier in this kind of installations. -- Magnus Hagander Me: http://www.hagander.net/ Work: http://www.redpill-linpro.com/ -- Sent via pgsql-performance mailing list (pgsql-performance

Re: [PERFORM] Help: how to speed up query after db server reboot

2009-09-03 Thread Magnus Hagander
Schedule a run of a couple of representative queries right as the database has started? That should pre-populate the cache before your users get there, hopefully. -- Magnus Hagander Me: http://www.hagander.net/ Work: http://www.redpill-linpro.com/ -- Sent via pgsql-performance mailing li

Re: [PERFORM] [BUGS] Postgres user authentification or LDAP authentification

2009-07-24 Thread Magnus Hagander
onnection pooling. Is there > some more variants to use connection pooling without using postgres users? Not that I know of. -- Magnus Hagander Self: http://www.hagander.net/ Work: http://www.redpill-linpro.com/ -- Sent via pgsql-performance mailing list (pgsql-performance@postgre

Re: [PERFORM] TCP network cost

2009-03-01 Thread Magnus Hagander
Tom Lane wrote: > Linos writes: >> Tom Lane escribió: >>> That's just weird --- ssl off should be ssl off no matter which knob you >>> use to turn it off. Are you sure it's really off in the slow connections? > >> Maybe i am missing something, i use the same command to connect to it >> from loca

Re: [PERFORM] select on 22 GB table causes "An I/O error occured while sending to the backend." exception

2008-08-29 Thread Magnus Hagander
[EMAIL PROTECTED] wrote: > On Thu, 28 Aug 2008, Scott Marlowe wrote: >>> wait a min here, postgres is supposed to be able to survive a >>> complete box >>> failure without corrupting the database, if killing a process can >>> corrupt >>> the database it sounds like a major problem. >> >> Yes it is

Re: [PERFORM] 2GB or not 2GB

2008-05-29 Thread Magnus Hagander
Joshua D. Drake wrote: > > > On Wed, 2008-05-28 at 16:59 -0700, Josh Berkus wrote: > > Folks, > > > shared_buffers: according to witnesses, Greg Smith presented at > > East that based on PostgreSQL's buffer algorithms, buffers above > > 2GB would not really receive significant use. However, Ji

Re: [PERFORM] index performance on large tables with update and insert

2008-05-23 Thread Magnus Hagander
Jessica Richard wrote: > I have a large table with about 2 million rows and it will keep > growing... > > I need to do update/inserts, and select as well. > > An index will speed up the select, but it will slow down the updates. > > Are all Postgres indexes ordered? i.e., with every update, the

Re: [PERFORM] bulk data loading

2008-04-08 Thread Magnus Hagander
Potluri Srikanth wrote: > Hi all, > > I need to do a bulk data loading around 704GB (log file size) at > present in 8 hrs (1 am - 9am). The data file size may increase 3 to > 5 times in future. > > Using COPY it takes 96 hrs to finish the task. > What is the best way to do it ? > > HARDWARE: S

Re: [PERFORM] Small DB Server Advice

2008-02-13 Thread Magnus Hagander
Matthew wrote: On Wed, 13 Feb 2008, Rory Campbell-Lange wrote: 4 x 147GB 15000 rpm SCSI in RAID 10 with 320-1 RAID CARD + 64MB cache BBU 2x Intel Xeon E5405 / 4x 2.00GHz / 1333MHz FSB / 12MB cache 6GB RAM Cost around 2320 GBP -- it would be great to get it under 2000 Needs to be

Re: [PERFORM] 8.3rc1 Out of memory when performing update

2008-01-25 Thread Magnus Hagander
Roberts, Jon wrote: Subject: Re: [PERFORM] 8.3rc1 Out of memory when performing update A simple update query, over roughly 17 million rows, populating a newly added column in a table, resulted in an out of memory error when the process memory usage reached 2GB. Could this be due to a poor choic

Re: [PERFORM] More shared buffers causes lower performances

2007-12-27 Thread Magnus Hagander
On Thu, Dec 27, 2007 at 01:10:29AM -0500, Tom Lane wrote: > Greg Smith <[EMAIL PROTECTED]> writes: > > On Wed, 26 Dec 2007, Guillaume Smet wrote: > >> beta RPMs are by default compiled with --enable-debug and > >> --enable-cassert which doesn't help them to fly fast... > > > Got that right. Last

Re: [PERFORM] libgcc double-free, backend won't die

2007-12-11 Thread Magnus Hagander
On Tue, Dec 11, 2007 at 07:50:17AM -0800, Craig James wrote: > Alvaro Herrera wrote: > >>>...Since you've now shown that OpenBabel is > >>>multithreaded, then that's a much more likely cause. > >>Can you elaborate? Are multithreaded libraries not allowed to be > >>linked to Postgres? > > > >Absolu

Re: [PERFORM] clear pg_stats

2007-11-29 Thread Magnus Hagander
Campbell, Lance wrote: > How can I clear the pg_stats views without restarting PostgreSQL? I > thought there was a function. pg_stat_reset() //Magnus ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archi

Re: [PERFORM] Hardware for PostgreSQL

2007-10-31 Thread Magnus Hagander
Ow Mun Heng wrote: >> You're likely better off (performance-wise) putting it on the same disk >> as the database itself if that one has better RAID, for example. > > I'm thinking along the lines of since nothing much writes to the OS > Disk, I should(keyword) be safe. Unless it's *always* in the

Re: [PERFORM] hardware and For PostgreSQL

2007-10-31 Thread Magnus Hagander
Ron St-Pierre wrote: > Joe Uhl wrote: >> I realize there are people who discourage looking at Dell, but i've been >> very happy with a larger ball of equipment we ordered recently from >> them. Our database servers consist of a PowerEdge 2950 connected to a >> PowerVault MD1000 with a 1 meter SAS

Re: [PERFORM] Hardware for PostgreSQL

2007-10-31 Thread Magnus Hagander
Ow Mun Heng wrote: > On Wed, 2007-10-31 at 22:58 +0100, Tomas Vondra wrote: > >> 2) separate the transaction log from the database >> >> It's mostly written, and it's the most valuable data you have. And in >> case you use PITR, this is the only thing that really needs to be >> backed

Re: [PERFORM] Hardware for PostgreSQL

2007-10-31 Thread Magnus Hagander
Tomas Vondra wrote: >> How does pg utilize multiple processors? The more the better? > > Linux version uses processes, so it's able to use multiple processors. > (Not sure about Windows version, but I guess it uses threads.) No, the Windows version also uses processes. //Magnus -

Re: [PERFORM] Hardware for PostgreSQL

2007-10-31 Thread Magnus Hagander
Ketema wrote: > I am trying to build a very Robust DB server that will support 1000+ > concurrent users (all ready have seen max of 237 no pooling being > used). I have read so many articles now that I am just saturated. I > have a general idea but would like feedback from others. > > I understa

Re: [PERFORM] Apache2 PostgreSQL http authentication

2007-10-08 Thread Magnus Hagander
Tino Wildenhain wrote: > Magnus Hagander schrieb: >> I'd consider having a small daemon LISTENing for NOTIFYs that you send >> by triggers whenever the table has changed. That'll make sure it only >> dumps if something actually changed. And you can also implement

Re: [PERFORM] Apache2 PostgreSQL http authentication

2007-10-07 Thread Magnus Hagander
I'd consider having a small daemon LISTENing for NOTIFYs that you send by triggers whenever the table has changed. That'll make sure it only dumps if something actually changed. And you can also implement some ratelimiting if needed. /Magnus > --- Original Message --- > From: "Jeffrey

Re: [PERFORM] PostgreSQL publishes first real benchmark

2007-07-09 Thread Magnus Hagander
Joshua D. Drake wrote: > Steinar H. Gunderson wrote: >> On Mon, Jul 09, 2007 at 11:57:13AM -0400, Jignesh K. Shah wrote: >>> I think this result will be useful for performance discussions of >>> postgresql against other databases. >>> >>> http://www.spec.org/jAppServer2004/results/res2007q3/ >> >>

Re: [PERFORM] PostgreSQL Configuration Tool for Dummies

2007-07-05 Thread Magnus Hagander
Tom Lane wrote: > PFC <[EMAIL PROTECTED]> writes: >>> What version of PostgreSQL are you using? > >> I think newbies should be pushed a bit to use the latest versions, > > How about pushed *hard* ? I'm constantly amazed at the number of people > who show up in the lists saying they installe

Re: [PERFORM] How to install Postgresql 8.2.x on windows XP silently

2007-06-28 Thread Magnus Hagander
Sachchida Ojha wrote: > Hi, > > I am new to PostgreSQL database. Can anybody help me (or point me the > related post) to install PostgreSQL on windows XP from command line. > (From .bat file) http://pginstaller.projects.postgresql.org/silent.html //Magnus ---(end of broa

Re: [PERFORM] LIKE search and performance

2007-05-24 Thread Magnus Hagander
James Mansion wrote: > Alexander Staubo wrote: >> On 5/23/07, Andy <[EMAIL PROTECTED]> wrote: >>> An example would be: >>> SELECT * FROM table >>> WHERE name like '%john%' or street like >>> '%srt%' >>> >>> Anyway, the query planner always does seq scan on the whole tab

Re: [PERFORM] Kernel cache vs shared_buffers

2007-05-13 Thread Magnus Hagander
Harald Armin Massa wrote: > Heikki, > > >> > PostgreSQL on Windows. My current rule of thumb on Windows: set >> > shared_buffers to minimum * 2 >> > Adjust effective_cache_size to the number given as "system cache" >> > within the task manager. >> >> Why? > > I tried with shared_buffers = 50% of

Re: [PERFORM] Throttling PostgreSQL's CPU usage

2007-05-08 Thread Magnus Hagander
> Thanks for all the feedback. Unfortunately I didn't specify that this > is running on a WinXP machine (the 3D renderer is an ActiveX plugin), > and I don't even think "nice" is available. I've tried using the > Windows Task Manager to set every postgres.exe process to a low > priority, but th

Re: [PERFORM] pg_stat_* collection

2007-05-03 Thread Magnus Hagander
On Thu, May 03, 2007 at 10:45:48AM -0400, Greg Smith wrote: > Today's survey is: just what are *you* doing to collect up the > information about your system made available by the various pg_stat views? > I have this hacked together script that dumps them into a file, imports > them into another

Re: [PERFORM] Usage up to 50% CPU

2007-04-27 Thread Magnus Hagander
On Fri, Apr 27, 2007 at 08:10:48AM +, Andres Retzlaff wrote: > Hi Magnus, > > in this case each CPU goes up to 50%, giveing me 50% total usage. I was > specting as you say 1 query 100% cpu. > > Any ideas? No. 1 query will only use 100% of *one* CPU, which means 50% total usage. You need at

Re: [PERFORM] Usage up to 50% CPU

2007-04-27 Thread Magnus Hagander
On Fri, Apr 27, 2007 at 04:43:06AM +, Andres Retzlaff wrote: > Hi, > > I have pg 8.1.4 running in > Windows XP Pro > wirh a Pentium D > > and I notice that I can not use more than 50% of the cpus (Pentium D has 2 > cpus), how can I change the settings to use the 100% of it. A single query w

Re: [PERFORM] SATA RAID: Promise vs. 3ware

2007-03-20 Thread Magnus Hagander
On Tue, Mar 20, 2007 at 10:18:45AM -0400, Merlin Moncure wrote: > On 3/20/07, Ireneusz Pluta <[EMAIL PROTECTED]> wrote: > >Hello all, > > > >I sent a similar post to a FreeBSD group, but thought I'd might try here > >too. > > > >I am completing a box for PostgreSQL server on FreeBSD. Selecting a R

Re: [PERFORM] compact flash disks?

2007-03-08 Thread Magnus Hagander
On Thu, Mar 08, 2007 at 06:24:35AM -, James Mansion wrote: > > In the long run, we are going to have to seriously rethink pg's use > of WAL as the way we implement MVCC as it becomes more and more of a > performance bottleneck. > We have WAL because Stonebreaker made an assumption about the fu

Re: [PERFORM] stats collector process high CPU utilization

2007-03-02 Thread Magnus Hagander
Tom Lane wrote: > "Merlin Moncure" <[EMAIL PROTECTED]> writes: >> On 3/2/07, Tom Lane <[EMAIL PROTECTED]> wrote: >>> "Merlin Moncure" <[EMAIL PROTECTED]> writes: I think this explains the trigger that was blowing up my FC4 box. >>> I dug in the archives a bit and couldn't find the report you'r

Re: [PERFORM] increasing database connections

2007-03-01 Thread Magnus Hagander
On Thu, Mar 01, 2007 at 12:49:14AM -0500, Jonah H. Harris wrote: > On 3/1/07, Shiva Sarna <[EMAIL PROTECTED]> wrote: > >I am sorry if it is a repeat question but I want to know if database > >performance will decrease if I increase the max-connections to 2000. At > >present it is 100. > > Most cer

Re: [PERFORM] Writting a "search engine" for a pgsql DB

2007-02-27 Thread Magnus Hagander
On Tue, Feb 27, 2007 at 06:36:11PM -0500, Charles Sprickman wrote: > On Tue, 27 Feb 2007, Dave Page wrote: > > >Magnus Hagander wrote: > >> > >>Just as a datapoint, we did try to use mnogosearch for the > >>postgresql.org website+archives search, and it fell

Re: [PERFORM] Writting a "search engine" for a pgsql DB

2007-02-27 Thread Magnus Hagander
On Mon, Feb 26, 2007 at 04:24:12PM -0500, Charles Sprickman wrote: > On Mon, 26 Feb 2007, Madison Kelly wrote: > > >Hi all, > > > >I'd really like to come up with a more intelligent search engine that > >doesn't take two minutes to return results. :) I know, in the end good > >indexes and underl

Re: [PERFORM] Writting a "search engine" for a pgsql DB

2007-02-26 Thread Magnus Hagander
> Joshua, I've been digging around the CVS (web) looking for the search > engine code but so far have only found the reference (www.search) in > 'general.php' but can't locate the file. You wouldn't happen to have a > direct link would you? It's all in module "portal". You will find the indexing

Re: [PERFORM] which Xeon processors don't have the context switching problem

2007-02-23 Thread Magnus Hagander
Alvaro Herrera wrote: > Steinar H. Gunderson wrote: >> On Fri, Feb 23, 2007 at 02:05:57PM -0500, Geoffrey wrote: >>> In searching the archives, I can't find any specific info indentifying >>> which Xeon processors don't have this problem. >> AFAIK the cut-off point is at the Woodcrests. They are o

Re: [PERFORM] Performance of PostgreSQL on Windows vs Linux

2007-01-03 Thread Magnus Hagander
Jeremy Haile wrote: > I am sure that this has been discussed before, but I can't seem to find > any recent posts. (I am running PostgreSQL 8.2) > > I have always ran PostgreSQL on Linux in the past, but the company I am > currently working for uses Windows on all of their servers. I don't > have

Re: [PERFORM] commit so slow program looks frozen

2006-10-26 Thread Magnus Hagander
> > > You may try to figure out what's the process doing (the backend > > > obviously, not the frontend (Tcl) process) by attaching > to it with > > > strace. > > > > It's so sad when us poor Windows guys get helpful hints from people > > assume that we're smart enough to run *NIX... ;-) > >

Re: [PERFORM] pgBench on Windows

2006-10-21 Thread Magnus Hagander
> Hello Performancers, > > has anyone a pgBench tool running on Windows? Does the one that ships in the installer not work? //Magnus ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs

Re: [PERFORM] measuring shared memory usage on Windows

2006-10-16 Thread Magnus Hagander
> > > "anonymous mapped memory" site:microsoft.com turns out 0 (zero) > > > results. And even splitting it up there seems to be nearly no > > > information ... is the same thing by any chance also known by > > > different names? > > > > Hmm. Yeah, most likely :) I may have grabbed that name fro

Re: [PERFORM] measuring shared memory usage on Windows

2006-10-16 Thread Magnus Hagander
> > So: has anybody a hint how I can check how much shared_memory > > is really used by PostgreSQL on Windows, to fine tune > this parameter? > > > > I learned the hard way that just rising it can lead to a hard > > performance loss :) > > Not really sur

Re: [PERFORM] measuring shared memory usage on Windows

2006-10-16 Thread Magnus Hagander
> Hello, > > Shridhar Daithankar and Josh Berkus write on > http://www.varlena.com/varlena/GeneralBits/Tidbits/perf.html > > shared_memory > > """ > There is one way to decide what is best for you. Set a high > value of this parameter and run the database for typical > usage. Watch usage of

Re: [PERFORM] [BUGS] Hanging queries on Windows 2003 SP1

2006-09-04 Thread Magnus Hagander
> Hi, > > We are seeing hanging queries on Windows 2003 Server SP1 with dual > CPU, looks like one of the process is blocked. In a lot of cases, > the whole DB is blocked if this process is holding important locks. > > Looks like this issue was discussed in the following thread a few > month ago,

Re: [PERFORM] Postgresql Performance on an HP DL385 and

2006-08-18 Thread Magnus Hagander
> There is 64MB on the 6i and 192MB on the 642 controller. I wish the > controllers had a "wrieback" enable option like the LSI MegaRAID > adapters have. I have tried splitting the cache accelerator 25/75 > 75/25 0/100 100/0 but the results really did not improve. They have a writeback option, but

Re: [PERFORM] Hardware upgraded but performance still ain't good

2006-08-18 Thread Magnus Hagander
> > First off - very few third party tools support debian. Debian is > a > > sure fire way to have an unsupported system. Use RedHat or SuSe > > (flame me all you want, it doesn't make it less true). > > *cough* BS *cough* > > Linux is Linux. It doesn't matter what trademark you put on top of >

Re: [PERFORM] PostgreSQL runs a query much slower than BDE and

2006-08-17 Thread Magnus Hagander
> MSSQL can give either a graphical query plan or a text-based > one similar to PG. There's no way that I've found to get the > equivalent of an EXPLAIN ANALYZE, but I'm by no means an MSSQL guru. SET STATISTICS IO ON SET STATISTICS PROFILE ON SET STATISTICS TIME ON //Magnus

Re: [PERFORM] Kill a session

2006-07-12 Thread Magnus Hagander
> > I beleive the function to kill a backend is actually in the > codebase, > > it's just commented out because it's considered dangerous. > There are > > some possible issues (see -hackers archives) about sending SIGTERM > > without actually shutting down the whole cluster. > > > > Doing the

Re: [PERFORM] Kill a session

2006-07-11 Thread Magnus Hagander
> There have been dozens, perhaps hundreds, of entries in the > pg-admin, pg-general, and pg-performance lists regarding > killing a session, but as far as I can tell, there is no > Postgres solution. Did I miss something? > > This raises the question: Why doesn't Postgres have a "kill > sess

Re: [PERFORM] Speeding up query, Joining 55mil and 43mil records.

2006-06-22 Thread Magnus Hagander
> PostgreSQL elects not to use them. I assume, because it most > likely needs to traverse the entire table anyway. > > if i change: / substr(t0.code,1,2) not in > ('14','15','16','17')/ > to (removing the NOT): /substr(t0.code,1,2) in > ('14','15','16','17')/ > > it uses the i

Re: [PERFORM] Performance Issues on Opteron Dual Core

2006-05-05 Thread Magnus Hagander
> > > > > FWIW, I've found problems running PostgreSQL on Windows in a > > > > > multi-CPU environment on w2k3. It runs fine for some > period, and > > > > > then CPU and throughput drop to zero. So far I've > been unable to > > > > > track down any more information than that, other than the >

Re: [PERFORM] Performance Issues on Opteron Dual Core

2006-05-03 Thread Magnus Hagander
> > > FWIW, I've found problems running PostgreSQL on Windows in a > > > multi-CPU environment on w2k3. It runs fine for some period, and > > > then CPU and throughput drop to zero. So far I've been unable to > > > track down any more information than that, other than the > fact that > > > I h

Re: [PERFORM] Inserts optimization?

2006-04-19 Thread Magnus Hagander
> > Bacula already serializes access to the database (they have > to support > > mysql/myisam), so this shouldn't help. > > Ouch, that hurts. > > To support mysql, they break performance for _every other_ > database system? Actually, it probably helps on SQLite as well. And considering they o

Re: [PERFORM] Inserts optimization?

2006-04-18 Thread Magnus Hagander
> > For now, I only could get good performance with bacula and > postgresql > > when disabling fsync... > > > Isn't that less safe? Most definitly. FWIW, I'm getting pretty good speeds with Bacula and PostgreSQL on a reasonably small db (file table about 40 million rows, filename about 5.2 mi

Re: [PERFORM] [Solved] Slow performance on Windows .NET and OleDb

2006-03-31 Thread Magnus Hagander
> This is a blatant thread steal... but here we go... > Do people have any opinions on the pgsql driver? It's very nice. > How does it compare with the odbc in terms of performance? I haven't measured specifically, but if you're tlaking .net it should be better. It's all in managed code, so you

Re: [PERFORM] Hanging queries on dual CPU windows

2006-03-10 Thread Magnus Hagander
> > > Could it be they broke it when they did that > > > > In theory, yes, but it still seems a bit far fetched :-( > > Well, I rolled back SP1 and am running my test again. Looking > much better, hasn't locked up in 45mins now, whereas before > it would lock up within 5mins. > > So I think

Re: [PERFORM] Hanging queries on dual CPU windows

2006-03-10 Thread Magnus Hagander
> > > >  I dunno > > > > > > > > > if you've got anything gdb-equivalent under Windows, > but that's > > > > > the first thing I'd be interested in ... > > > > > > > > Here ya go: > > > > > > > > http://www.devisser-siderius.com/stack1.jpg > > > > http://www.devisser-siderius.com/stack2.jpg > > >

Re: [PERFORM] Hanging queries on dual CPU windows

2006-03-10 Thread Magnus Hagander
> > Is it possible to get a stack trace from the stuck process? >  I dunno > > if you've got anything gdb-equivalent under Windows, but that's the > > first thing I'd be interested in ... > > Here ya go: > > http://www.devisser-siderius.com/stack1.jpg > http://www.devisser-siderius.com/stack2.

Re: [PERFORM] Hanging queries on dual CPU windows

2006-03-09 Thread Magnus Hagander
> Is it possible to get a stack trace from the stuck process? > I dunno if you've got anything gdb-equivalent under Windows, > but that's the first thing I'd be interested in ... Try Process Explorer from www.sysinternals.com. //Magnus ---(end of broadcast)

Re: [pgsql-www] [PERFORM] Help speeding up delete

2005-11-17 Thread Magnus Hagander
> >>That way if someone wanted to upgrade from 7.2 to 8.1, they > can just > >>grab the latest dumper from the website, dump their old > database, then > >>upgrade easily. > > > > But if they're upgrading to 8.1, don't they already have the new > > pg_dump? How else are they going to dump the

Re: [pgsql-www] [PERFORM] Help speeding up delete

2005-11-17 Thread Magnus Hagander
> > Perhaps we should put a link on the home page underneath LATEST > > RELEASEs saying > > 7.2: de-supported > > > > with a link to a scary note along the lines of the above. > > > > ISTM that there are still too many people on older releases. > > > > We probably need an explanation of why

Re: [PERFORM] Help speeding up delete

2005-11-15 Thread Magnus Hagander
> Because I think we need to. The above would only delete rows > that have name = 'obsid' and value = 'oid080505'. We need to > delete all rows that have the same ids as those rows. > However, from what you note, I bet we could do: > >DELETE FROM "tmp_table2" WHERE id IN > (SELECT

Re: [HACKERS] [PERFORM] insert performance for win32

2005-11-04 Thread Magnus Hagander
> >> AFAICS it is appropriate to move the sigsetjmp and > >> setup_cancel_handler calls in front of the per-line loop inside > >> MainLoop --- can anyone see a reason not to? > > > hm. mainloop is re-entrant, right? That means each \i > would reset the > > handler...what is downside to keepin

Re: [PERFORM] insert performance for win32

2005-11-04 Thread Magnus Hagander
> > I'm inclined to treat this as an outright bug, not just a minor > certainly... > > > performance issue, because it implies that a sufficiently long psql > > script would probably crash a Windows machine. > > actually, it's worse than that, it's more of a dos on the > whole system, as window

Re: [PERFORM] insert performance for win32

2005-11-03 Thread Magnus Hagander
> > > I'd like to use the win32 provided recv(), send() > functions instead > > > of redirect them to pgwin32_recv()/pgwin32_send(), just > like libpq > > > does. If we do this, we will lose some functionalities, > but I'd like > > > to see the performance difference first. -- do you think >

Re: [PERFORM] insert performance for win32

2005-11-03 Thread Magnus Hagander
> > Sorry, I don't follow you here - what do you mean to do? Remove the > > event completely so we can't wait on it? > > > > I'd like to use the win32 provided recv(), send() functions > instead of redirect them to pgwin32_recv()/pgwin32_send(), > just like libpq does. If we do this, we will lo

Re: [PERFORM] insert performance for win32

2005-11-03 Thread Magnus Hagander
> > > Both win32 send/recv have pgwin32_poll_signals() in them. > > > This is glorified WaitForSingleObjectEx on global > > > pgwin32_signal_event. This is probably part of the problem. > > > Can we work some of the same magic you put into check interrupts > > > macro? > > > > > > > Uh, we alrea

Re: [PERFORM] insert performance for win32

2005-11-03 Thread Magnus Hagander
> Both win32 send/recv have pgwin32_poll_signals() in them. > This is glorified WaitForSingleObjectEx on global > pgwin32_signal_event. This is probably part of the problem. > Can we work some of the same magic you put into check > interrupts macro? > > ISTM everything also in win32 functio

  1   2   >