Re: [PERFORM] Anyone using a SAN?

2008-02-20 Thread Matthew
is specialist, and expensive. Matthew -- Nog: Look! They've made me into an ensign! O'Brien: I didn't know things were going so badly. Nog: Frightening, isn't it? ---(end of broadcast)--- TIP 4: Have you searche

Re: [PERFORM] Disable WAL completely

2008-02-19 Thread Matthew
a bigger flash device? The "too many writes wear it out" argument is mostly not true nowadays anyway. Matthew -- Don't worry! The world can't end today because it's already tomorrow in Australia. ---(end of broadcast)-

Re: [PERFORM] Query slows after offset of 100K

2008-02-15 Thread Matthew
orrectly will help the planner in this case. Setting work_mem higher will improve the performance of the sort in the second case. Of course, what others have said about trying to avoid large offsets is good advice. You don't actually need a unique index, but it makes it simpler if you do. M

Re: [PERFORM] Small DB Server Advice

2008-02-13 Thread Matthew
dates. And it'll also pick up other write activity onthe system... Of course. My point was that 64MB should be quite sufficient if most accesses are reads. We have a few machines here with 2GB BBU caches as we do LOTS of writes - that sort of thing probably isn't necessary here.

Re: [PERFORM] Small DB Server Advice

2008-02-13 Thread Matthew
vely over-providing or it may be woefully inadequate, but this machine looks like a fairly good buy for the price. Matthew -- No trees were killed in the sending of this message. However a large number of electrons were terribly inconvenienced. ---(end of broadcast)--

Re: [PERFORM] Benchmark Data requested --- pgloader CE design ideas

2008-02-07 Thread Matthew
be able to use the same algorithm to work out where the boundary is, therefore they'll get the same result. No need to pass back information. Matthew -- There is something in the lecture course which may not have been visible so far, which is reality --

Re: [PERFORM] Benchmark Data requested

2008-02-05 Thread Matthew
change to the backend, but it would only work for dump restores, and would require the client to be clever. I'm all for allowing this kind of optimisation while writing normally to the database, and for not requiring the client to think too hard. Matthew -- All of this sounds mildly turg

Re: [PERFORM] Benchmark Data requested

2008-02-05 Thread Matthew
riting the data to the WAL, just without the data bit. Matthew -- Failure is not an option. It comes bundled with your Microsoft product. -- Ferenc Mantfeld ---(end of broadcast)--- TIP 5: don&

Re: [PERFORM] Benchmark Data requested

2008-02-05 Thread Matthew
y the first few rows optimized and all the rest not. Why would you need to lock the table? Matthew -- Picard: I was just paid a visit from Q. Riker: Q! Any idea what he's up to? Picard: No. He said he wanted to be "nice" to me. Riker: I'll alert the crew.

Re: [PERFORM] Benchmark Data requested

2008-02-05 Thread Matthew
On Tue, 5 Feb 2008, Richard Huxton wrote: In the case of a bulk upload to an empty table (or partition?) could you not optimise the WAL away? Argh. If I hadn't had to retype my email, I would have suggested that before you. ;) Matthew -- Unfortunately, university regulations pro

Re: [PERFORM] Benchmark Data requested

2008-02-05 Thread Matthew
ckpointed, no work would be required. This would improve the performance of database restores and large writes which expand the table's data file. So, would it work? Matthew -- If pro is the opposite of con, what is the opposite of progress? --

Re: [PERFORM] Benchmark Data requested

2008-02-05 Thread Matthew
---(end of broadcast)--- TIP 2: Don't 'kill -9' the postmaster

Re: [PERFORM] Performance problems inside a stored procedure.

2008-02-05 Thread Matthew Lunnon
very much for your time. Regards Matthew Андрей Репко wrote: Hello Matthew, Monday, January 28, 2008, 2:02:26 PM, Вы писали: ML> I have a query which runs pretty quick ( 0.82ms) but when I put it ML> inside a stored procedure it takes 10 times as long (11.229ms). Is ML> this what

Re: [PERFORM] Performance problems inside a stored procedure.

2008-01-29 Thread Matthew Lunnon
this to access the index and so was returning too many rows and then filtering them. It looks like I still have to take a hit of 2ms or so to call the function but I guess that is not unreasonable. Thanks for your help and to everyone who answered this thread. Regards Matthew. Euler Tavei

Re: [PERFORM] RAID arrays and performance

2008-01-29 Thread Matthew
ce mailing list. Matthew ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org

Re: [PERFORM] JDBC/Stored procedure performance issue

2008-01-29 Thread Matthew Lunnon
Hi Tom, Is there any way to work out what plan the query is using in side the function? I think I have a similar problem with a query taking much longer from inside a function than it does as a select statement. Regards Matthew Tom Lane wrote: Claire McLister <[EMAIL PROTECTED]>

Re: [PERFORM] Performance issues migrating from 743 to 826

2008-01-28 Thread Matthew Lunnon
your time. I'm using Thunderbird, maybe I need to upgrade. On Jan 28, 2008 9:27 AM, Matthew Lunnon <[EMAIL PROTECTED]> wrote: Scott Marlowe wrote: On Jan 28, 2008 5:41 AM, Matthew Lunnon <[EMAIL PROTECTED]> wrote: default_statistics_target = 1000 That's very high

Re: [PERFORM] Performance issues migrating from 743 to 826

2008-01-28 Thread Matthew Lunnon
t=0.00..0.27 rows=1 width=81) (actual time=0.003..0.004 rows=1 loops=189)" " Index Cond: (mgpr.market_group_id = mg.market_group_id)" " Filter: (live <> 'X'::bpchar)" " -> Seq Scan on market_group_relation mgr (cost=0.00.

Re: [PERFORM] Performance issues migrating from 743 to 826

2008-01-28 Thread Matthew Lunnon
Hi Scott, Thanks for your time Regards Matthew Scott Marlowe wrote: On Jan 28, 2008 5:41 AM, Matthew Lunnon <[EMAIL PROTECTED]> wrote: Hi I am investigating migrating from postgres 743 to postgres 826 but although the performance in postgres 826 seems to be generally better there ar

Re: [PERFORM] Linux/PostgreSQL scalability issue - problem with 8 cores

2008-01-28 Thread Matthew
current cut-off of signalling everyone when the queue really is full. The hope would be that that would never happen. Matthew ---(end of broadcast)--- TIP 6: explain analyze is your friend

Re: [PERFORM] Performance problems inside a stored procedure.

2008-01-28 Thread Matthew Lunnon
Ahh, sorry, I have been too aggressive with my cutting, I am running 8.2.6 and the function is below. Thanks. Matthew CREATE OR REPLACE FUNCTION sp_get_price_panel_id(int4, "varchar", "varchar", "varchar", bpchar) RETURNS SETOF t_market_price_panel AS $BOD

[PERFORM] Performance problems inside a stored procedure.

2008-01-28 Thread Matthew Lunnon
maintenance_work_mem = 100MB effective_cache_size = 2048MB default_statistics_target = 1000 Thanks for any help. Regards Matthew. ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org

[PERFORM] Performance issues migrating from 743 to 826

2008-01-28 Thread Matthew Lunnon
ms to run on 862 and 2.332 to run on 743. Thanks in advance for any help. Regards Matthew 8.2.6 shared_buffers = 500MB work_mem = 10MB maintenance_work_mem = 100MB effective_cache_size = 2048MB default_statistics_target = 1000 7.4.3 shared_buffers = 51200 sort_mem = 10240 vacuum_mem = 81920

Re: [PERFORM] 1 or 2 servers for large DB scenario.

2008-01-25 Thread Matthew
, but Greg is correct - you only need to put the WAL on a cached disc system. That'd be quite a bit cheaper, I'd imagine. Another case of that small SSD drive being useful, I think. Matthew ---(end of broadcast)--- TIP 1: if posting/

Re: [PERFORM] 1 or 2 servers for large DB scenario.

2008-01-25 Thread Matthew
that helps, Matthew ---(end of broadcast)--- TIP 6: explain analyze is your friend

Re: [PERFORM] Making the most of memory?

2008-01-24 Thread Matthew
e write performance of normal RAM, without wasting space, and could (theoretically) be pretty cheap, and would improve the transaction speed of Postgres significantly. If someone doesn't already make one, they should! Matthew ---(end of broadcast)--

Re: [PERFORM] Heavy write activity on first vacuum of fresh TOASTa

2007-12-14 Thread Matthew
On Fri, 14 Dec 2007, Tom Lane wrote: > Matthew <[EMAIL PROTECTED]> writes: > > Interesting thread. Now, I know absolutely nothing about how the data is > > stored, but it strikes me as being non-optimal that every single block on > > the disc needs to be written again ju

Re: [PERFORM] Heavy write activity on first vacuum of fresh TOASTa

2007-12-14 Thread Matthew
ut into a separate bitmap stored somewhere else? That would mean the (relatively small) amount of data being written could be written in a small sequential write to the disc, rather than very sparsely over the whole table. Matthew -- If you let your happiness depend upon how somebody else feels about

Re: [PERFORM] Limited performance on multi core server

2007-12-12 Thread Matthew Lunnon
Hi Sven, Does this mean that one option I have is to use a multi core Intel based server instead of an AMD based server? Matthew Sven Geisler wrote: Hi Matthew, I remember that I also an issue with AMD Opterons before Pg 8.1 There is a specific Opteron behaviour on shared memory locks

Re: [PERFORM] Limited performance on multi core server

2007-12-12 Thread Matthew Lunnon
some overflow here. But some kind of limiting of connections is probably required. Thanks Matthew Sven Geisler wrote: Hi Matthew, The context switching isn't the issue. This is an indicator which is useful to identify your problem. What kind of application do you running? Can you limi

Re: [PERFORM] Limited performance on multi core server

2007-12-12 Thread Matthew Lunnon
Hi Sven, yes the patch would be great if you could send it to me, we have already had to compile postgres to up the number of function parameters from 32 to 64. Meanwhile I will try and persuade my colleagues to consider the upgrade option. Thanks Matthew Sven Geisler wrote: Hi Matthew

Re: [PERFORM] Limited performance on multi core server

2007-12-12 Thread Matthew Lunnon
that number. Thanks Matthew. Claus Guttesen wrote: I have a 4 * dual core 64bit AMD OPTERON server with 16G of RAM, running postgres 7.4.3. This has been recompiled on the server for 64 stored procedure parameters, (I assume this makes postgres 64 bit but are not sure). When the server gets under

Re: [PERFORM] Limited performance on multi core server

2007-12-12 Thread Matthew Lunnon
Ah I was afraid of that. Maybe I'll have to come out of the dark ages. Matthew Steinar H. Gunderson wrote: On Wed, Dec 12, 2007 at 10:16:43AM +0000, Matthew Lunnon wrote: Does anyone have any ideas what my bottle neck might be and what I can do about it? Your bottleneck is tha

Re: [PERFORM] Limited performance on multi core server

2007-12-12 Thread Matthew Lunnon
e a closer look at the this Thanks Matthew Sven Geisler wrote: Hi Matthew, I know exactly what you experience. We had a 4-way DC Opteron and Pg 7.4 too. You should monitor context switches. First suggest upgrade to 8.2.5 because the scale up is much better with 8.2. You need to limi

[PERFORM] Limited performance on multi core server

2007-12-12 Thread Matthew Lunnon
nyone have any ideas what my bottle neck might be and what I can do about it? Thanks for any help. Matthew. ---(end of broadcast)--- TIP 6: explain analyze is your friend

Re: [PERFORM] TB-sized databases

2007-12-06 Thread Matthew
On Thu, 6 Dec 2007, Tom Lane wrote: > Matthew <[EMAIL PROTECTED]> writes: > > ... For this query, Postgres would perform a nested loop, > > iterating over all rows in the small table, and doing a hundred index > > lookups in the big table. This completed very quickly. Ho

Re: [PERFORM] TB-sized databases

2007-12-06 Thread Matthew
ontinue to the last possible hit. This query completed quickly, as the min and max could be answered quickly by the indexes. Still, it's a pity Postgres couldn't work that out for itself, having all the information present in its statistics and indexes. AIUI the planner doesn't peek i

Re: [PERFORM] RAID arrays and performance

2007-12-04 Thread Matthew
l implementation. I didn't have reiserfs, jfs, or xfs available at that time, but it would have been really interesting to compare. This is the system I would have based my indexing thing on. Matthew -- Anyone who goes to a psychiatrist ought to have his head examined. -

Re: [PERFORM] RAID arrays and performance

2007-12-04 Thread Matthew
that particular job very fast, so I have done a reasonable amount of research into the topic. In Java, that is. It would add a little bit more performance for our system. That wouldn't cover us - we still need to do complex queries with the same problem, and that'll have to stay in Postgres.

Re: [PERFORM] RAID arrays and performance

2007-12-04 Thread Matthew
rows with a column containing integer values ranging from zero to ten thousand. Create an index on that column, analyse it. Then pick a number between zero and ten thousand, and "SELECT * FROM table WHERE that_column = the_number_you_picked" Matthew -- Experience is

Re: [PERFORM] RAID arrays and performance

2007-12-04 Thread Matthew
r of requests, the longest reasonably-expected queue length for a particular disc gets closer to the number of requests divided by the number of discs, as the requests get spread more and more evenly among the discs. The larger the set of requests, the closer the performance will scale to the num

Re: [PERFORM] RAID arrays and performance

2007-12-04 Thread Matthew
On Tue, 4 Dec 2007, Mark Mielke wrote: > The disk head has less theoretical distance to travel if always moving > in a single direction instead of randomly seeking back and forth. True... and false. The head can move pretty quickly, and it also has rotational latency and settling time to deal with

Re: [PERFORM] RAID arrays and performance

2007-12-04 Thread Matthew
t of the cache instead of from the disc. Of course, this is from a simple Java programmer who doesn't know the OS interfaces for this sort of thing. Matthew -- Here we go - the Fairy Godmother redundancy proof. -- Computer Science Lecturer ---(end of broadcast)--- TIP 6: explain analyze is your friend

Re: [PERFORM] Utilizing multiple cores for one query

2007-12-04 Thread Matthew
e bigger than fit in memory. This would benefit a lot of multi-table joins, because being able to sort a table faster would enable merge joins to be used at lower cost. That's particularly valuable when you're doing a large summary multi-table join that uses most of the database contents. Matt

Re: [PERFORM] RAID arrays and performance

2007-12-04 Thread Matthew
On Tue, 4 Dec 2007, Gregory Stark wrote: > "Matthew" <[EMAIL PROTECTED]> writes: > > > Does Postgres issue requests to each random access in turn, waiting for > > each one to complete before issuing the next request (in which case the > > performance will no

[PERFORM] RAID arrays and performance

2007-12-04 Thread Matthew
ingle disc), or does it use some clever asynchronous access method to send a queue of random access requests to the OS that can be distributed among the available discs? Any knowledgable answers or benchmark proof would be appreciated, Matthew -- "To err is human; to really louse things u

Re: [PERFORM] Dealing with big tables

2007-12-03 Thread Matthew
rted by different columns. Just remember to select from the correct table to get the performance, and to write all changes to all the tables! Kind of messes up transactions and locking a little though. Matthew -- No, C++ isn't equal to D. 'C' is undeclared, so we assume it

Re: [PERFORM] GiST indexing tuples

2007-11-30 Thread Matthew
On Thu, 29 Nov 2007, Matthew T. O'Connor wrote: > Matthew wrote: > > For instance, the normal B-tree index on (a, b) is able to answer queries > > like "a = 5 AND b > 1" or "a > 5". An R-tree would be able to index these, > > plus queries like

Re: [PERFORM] Appending "LIMIT" to query drastically decreases performance

2007-11-30 Thread Matthew
iving the database the option to > stop the evaluation earlier (when it reaches the output 500 rows)? The planner doesn't always get it right. Simple. Have you done a "VACUUM FULL ANALYSE" recently? Matthew -- It is better to keep your mouth closed and let people think you are a f

Re: [PERFORM] GiST indexing tuples

2007-11-29 Thread Matthew T. O'Connor
Matthew wrote: For instance, the normal B-tree index on (a, b) is able to answer queries like "a = 5 AND b > 1" or "a > 5". An R-tree would be able to index these, plus queries like "a > 5 AND b < 1". Sorry in advance if this is a stupid question, but

Re: [PERFORM] TB-sized databases

2007-11-28 Thread Matthew
moment on my work's system, we call EXPLAIN before queries to find out if it will take too long. This would improve performance by stopping us having to pass the query into the query planner twice. Matthew -- An ant doesn't have a lot of processing power available to it. I'm not trying

Re: [PERFORM] GiST indexing tuples

2007-11-28 Thread Matthew
ies like "a > 5 AND b < 1". As far as I can see, it is not possible at the moment to write such an index system for GiST, which is a shame because the actual R-tree algorithm is very simple. It's just a matter of communicating both values from the query to the index code. Matthew

Re: [PERFORM] TB-sized databases

2007-11-28 Thread Matthew
x27;t necessarily mean a full table scan (for instance if there is a LIMIT), and where an index scan *does* mean a full table scan (for instance, selecting the whole table and ordering by an indexed field). Matthew -- Existence is a convenient concept to designate all of the f

Re: [PERFORM] GiST indexing tuples

2007-11-28 Thread Matthew
On Tue, 27 Nov 2007, Steinar H. Gunderson wrote: > On Tue, Nov 27, 2007 at 06:28:23PM +0000, Matthew wrote: > > SELECT * FROM table WHERE a > 1 AND b < 4; > > This sounds like something an R-tree can do. I *know* that. However, Postgres (as far as I can see) doesn't pro

Re: [PERFORM] TB-sized databases

2007-11-28 Thread Matthew
able. It's silly. I would rather the query failed than have to wait for a sequential scan of the entire table." Yes, that would be really useful, if you have huge tables in your database. Matthew -- Trying to write a program that can't be written is... well, i

[PERFORM] GiST indexing tuples

2007-11-27 Thread Matthew
b) &[EMAIL PROTECTED] fancy_type(1, 4); which I don't want to do. So, has this problem been solved before? Is there an already-existing index that will speed up my query? Is there a way to get more than one value into a GiST index? Thanks, Matthew -- If you let your happiness depen

[PERFORM] Postgres ignoring index when using left outer join.

2007-11-20 Thread Matthew Schumacher
Anyone know what is up with this? I have two queries here which return the same results, one uses a left outer join to get some data from a table which may not match a constraint, and one that uses a union to get the data from each constraint and put them together. The second one isn't nearly as

Re: [PERFORM] SAN vs Internal Disks

2007-09-07 Thread Matthew Schumacher
I'm getting a san together to consolidate my disk space usage for my servers. It's iscsi based and I'll be pxe booting my servers from it. The idea is to keep spares on hand for one system (the san) and not have to worry about spares for each specific storage system on each server. This also makes

Re: [PERFORM] Auto-Vacuum in 8.1 was ineffective for me. 8.2 may work better?

2007-02-21 Thread Matthew T. O'Connor
Mark Stosberg wrote: Let me ask the question a different way: Is simply setting the two values plus enabling autovacuuming generally enough, or is further tweaking common place? No, most people in addition to setting those two GUC settings also lower the threshold values (there is a fair amoun

Re: [PERFORM] Autoanalyze settings with zero scale factor

2007-01-18 Thread Matthew T. O'Connor
Jeremy Haile wrote: Also, are other auto-vacuums and auto-analyzes showing up in the pg_stats table? Maybe it's a stats system issue. No tables have been vacuumed or analyzed today. I had thought that this problem was due to my pg_autovacuum changes, but perhaps not. I restarted Postgre

Re: [PERFORM] Autoanalyze settings with zero scale factor

2007-01-18 Thread Matthew T. O'Connor
Jeremy Haile wrote: I changed the table-specific settings so that the ANALYZE base threshold was 5000 and the ANALYZE scale factor is 0. According to the documented formula: analyze threshold = analyze base threshold + analyze scale factor * number of tuples, I assumed that this would cause the

Re: [PERFORM] PostgreSQL to host e-mail?

2007-01-04 Thread Matthew Schumacher
Frank Wiles wrote: > On Thu, 4 Jan 2007 15:00:05 -0300 > "Charles A. Landemaine" <[EMAIL PROTECTED]> wrote: > >> I'm building an e-mail service that has two requirements: It should >> index messages on the fly to have lightening search results, and it >> should be able to handle large amounts of s

Re: [PERFORM] New to PostgreSQL, performance considerations

2006-12-14 Thread Matthew O'Connor
Tom Lane wrote: "Joshua D. Drake" <[EMAIL PROTECTED]> writes: On Wed, 2006-12-13 at 18:36 -0800, Josh Berkus wrote: Mostly, though, pgbench just gives the I/O system a workout. It's not a really good general workload. It also will not utilize all cpus on a many cpu machine. We recently foun

[PERFORM] Disk storage and san questions (was File Systems Compared)

2006-12-06 Thread Matthew Schumacher
Joshua D. Drake wrote: > I agree. I have many people that want to purchase a SAN because someone > told them that is what they need... Yet they can spend 20% of the cost > on two external arrays and get incredible performance... > > We are seeing great numbers from the following config: > > (2) HP

Re: [PERFORM] Is Vacuum/analyze destroying my performance?

2006-12-04 Thread Matthew T. O'Connor
Carlo Stonebanks wrote: Just a wild guess, but the performance problem sounds like maybe as your data changes, eventually the planner moves some query from an index scan to a sequential scan, do you have any details on what queries are taking so long when things are running slow? You can turn

Re: [PERFORM] Is Vacuum/analyze destroying my performance?

2006-12-04 Thread Matthew O'Connor
Just a wild guess, but the performance problem sounds like maybe as your data changes, eventually the planner moves some query from an index scan to a sequential scan, do you have any details on what queries are taking so long when things are running slow? You can turn on the GUC var "log_min_

Re: [PERFORM] Database-wide vacuum can take a long time, during which

2006-11-01 Thread Matthew O'Connor
Steven Flatt wrote: Here is a potential problem with the auto-vacuum daemon, and I'm wondering if anyone has considered this. To avoid transaction ID wraparound, the auto-vacuum daemon will periodically determine that it needs to do a DB-wide vacuum, which takes a long time. On our system, i

Re: [PERFORM] Stored procedure slower than sql?

2006-10-26 Thread Matthew Peters
partition_constraint_column = $2; $$ LANGUAGE SQL; Matthew A. Peters Sr. Software Engineer, Haydrian Corp. [EMAIL PROTECTED] (mobile) 425-941-6566 Haydrian Corp. -Original Message- From: Tom Lane [mailto:[EMAIL PROTECTED] Sent: Thursday, October 26, 2006 9:15 AM To: Matthew Peters Cc: pgsql-performance

[PERFORM] Stored procedure slower than sql?

2006-10-26 Thread Matthew Peters
:text, 2, 1) = '5'::text) AND (table_key = 10265512) AND (date_part('year'::text, (event_date)::timestamp without time zone) = 2005::double precision))   ->  Seq Scan on table5_p12 table5  (cost=0.00..2089.95 rows=1 width=

Re: [ADMIN] [PERFORM] autovacuum on a -mostly- r/o table

2006-10-15 Thread Matthew T. O'Connor
Tobias Brox wrote: [Matthew T. O'Connor - Wed at 02:33:10PM -0400] In addition autovacuum respects the work of manual or cron based vacuums, so if you issue a vacuum right after a daily batch insert / update, autovacuum won't repeat the work of that manual vacuum. I was exp

Re: [PERFORM] Performace Optimization for Dummies

2006-09-28 Thread Matthew Nuzum
into RAM then they are in-memory as long as they're actively being used. Hashtables and GDBM, as far as I know, are only useful for key->value lookups. However, for this they are *fast*. If you can figure out a way to make them work I'll bet things speed up. -- Matthew Nuzum new

Re: [PERFORM] Performace Optimization for Dummies

2006-09-28 Thread Matthew Nuzum
45 min to a little over an hour but decreased the memory usage to something like 45MB (vs dozens or hundreds of MB per hashtable) -- Matthew Nuzum newz2000 on freenode ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq

Re: [PERFORM] Problems with inconsistant query performance.

2006-09-28 Thread Matthew Schumacher
Marcin Mank wrote: >> So the question is why on a relatively simple proc and I getting a query >> performance delta between 3549ms and 7ms? > > What version of PG is it? > > I had such problems in a pseudo-realtime app I use here with Postgres, and > they went away when I moved to 8.1 (from 7.4).

Re: [PERFORM] Problems with inconsistant query performance.

2006-09-27 Thread Matthew Schumacher
Jim C. Nasby wrote: > > It can cause a race if another process could be performing those same > inserts or updates at the same time. There are inserts and updates running all of the time, but never the same data. I'm not sure how I can get around this since the queries are coming from my radius

Re: [PERFORM] Problems with inconsistant query performance.

2006-09-27 Thread Matthew Schumacher
Jim, Thanks for the help. I went and looked at that example and I don't see how it's different than the "INSERT into radutmp_tab" I'm already doing. Both raise an exception, the only difference is that I'm not doing anything with it. Perhaps you are talking about the "IF (NOT FOUND)" I put afte

[PERFORM] Problems with inconsistant query performance.

2006-09-27 Thread Matthew Schumacher
List, I posted a little about this a while back to the general list, but never really got any where with it so I'll try again, this time with a little more detail and hopefully someone can send me in the right direction. Here is the problem, I have a procedure that is called 100k times a day. Mo

Re: [ADMIN] [PERFORM] autovacuum on a -mostly- r/o table

2006-09-27 Thread Matthew T. O'Connor
Csaba Nagy wrote: On Wed, 2006-09-27 at 18:08, Edoardo Ceccarelli wrote: How can I configure the vacuum to run after the daily batch insert/update? Check out this: http://www.postgresql.org/docs/8.1/static/catalog-pg-autovacuum.html By inserting the right row you can disable autovacuu

Re: [PERFORM] performance problems.

2006-08-30 Thread Matthew Sullivan
Vivek Khera wrote: On Aug 30, 2006, at 5:29 AM, Matthew Sullivan wrote: The hardware is a Compaq 6400r with 4G of EDO RAM, 4x500MHz Xeons and a Compaq RAID 3200 in RAID 5 configuration running across 3 spindles (34G total space). The OS is FreeBSD 5.4-RELEASE-p14 The PG Version is 8.1.3

[PERFORM] performance problems.

2006-08-30 Thread Matthew Sullivan
All, Got a little bit of a performance problem I hope that can be resolved. All the files/info I believe you are going to ask for are here: http://www.au.sorbs.net/~matthew/postgres/30.8.06/ The odd thing was it originally was fast (1-2 seconds) which is all I need - the query is a

Re: [PERFORM] Sun Fire T2000 and PostgreSQL 8.1.3

2006-04-06 Thread Matthew Nuzum
ing that can grow over time as our needs change. I don't want to > buy a server only to find out later that it cannot meet our needs with > future database projects. I have to balance a limited budget, room for > future performance growth, and current system requirements.

Re: [PERFORM] count(*) performance

2006-03-27 Thread Matthew T. O'Connor
Mikael Carneholm wrote: This is where a "last_vacuumed" (and "last_analyzed") column in pg_statistic(?) would come in handy. Each time vacuum or analyze has finished, update the row for the specific table that was vacuumed/analyzed with a timestamp in the last_vacuumed/last_analyzed column. No mo

Re: [PERFORM] count(*) performance

2006-03-27 Thread Matthew T. O'Connor
Gábriel Ákos wrote: Luke Lonergan wrote: Gabriel, On 3/27/06 10:05 AM, "Gábriel Ákos" <[EMAIL PROTECTED]> wrote: That gave me an idea. I thought that autovacuum is doing it right, but I issued a vacuum full analyze verbose , and it worked all the day. After that I've tweaked memory settings a

Re: [PERFORM] n00b autovacuum question

2006-03-18 Thread Matthew T. O'Connor
More detail please. It sounds like you running 8.1 and talking about the integrated autovacuum is that correct? Also, what is the message specifically from pgadmin? Matt Antoine wrote: Hi, I have enabled the autovacuum daemon, but occasionally still get a message telling me I need to run vac

Re: [PERFORM] 1 TB of memory

2006-03-16 Thread Matthew Nuzum
) Pricing is tight-lipped, but searching shows $1.85 /GB. That's close to $500,000 for 250GB. One report says a person paid $219,000 for 32GB and 1TB costs "well over $1,000,000." But they "guarantee the performance." Too rich for me. -- Matthew Nuzum www.bearfrui

Re: [PERFORM] help needed asap....

2006-03-12 Thread Matthew Nuzum
varlena/GeneralBits/Tidbits/index.php Notice there's a section on performance tips. Also, this list works because volunteers who have knowledge and free time choose to help when they can. If you really need answers ASAP, there are a few organizations who provide paid support.

Re: [PERFORM] Process Time X200

2006-03-10 Thread Matthew Nuzum
at the explain analyze output of the query from pg 7.3, figure out why the plan is bad and tweak your query to get optimum performance. Yes, I agree with the other statements that say, "upgrade to 7.4 or 8.x if you can" but if you can't, then you can still work on it. -- Matthew

Re: [PERFORM] Postgres on VPS - how much is enough?

2006-03-07 Thread Matthew Nuzum
of linux, kernel and all. > > No, linux vserver is equivalent to a jail - and they work superbly imho. > developer.pgadmin.org is just one such VM that I run. > > http://www.linux-vserver.org/ > > Regards, Dave. I can confirm this. I've been using linux-vserver for years. It

Re: [PERFORM] Postgres on VPS - how much is enough?

2006-03-06 Thread Matthew Nuzum
On 3/6/06, Marc G. Fournier <[EMAIL PROTECTED]> wrote: > On Mon, 6 Mar 2006, Matthew Nuzum wrote: > > My problem with running PG inside of a VPS was that the VPS used a > > virtual filesystem... basically, a single file that had been formatted > > and loop mounted so th

Re: [PERFORM] Postgres on VPS - how much is enough?

2006-03-06 Thread Matthew Nuzum
at works on pretty much any linux OS. Try it out, tinker with the values and that way you won't have to guess when making your purchase decission. [1] http://www.colinux.org/ Coperative Linux [2] http://linux-vserver.org/ Linux-vserver project -- Matthew Nuzum www.bearfruit.org ---

Re: [PERFORM] 10+hrs vs 15min because of just one index

2006-02-10 Thread Matthew T. O'Connor
Aaron Turner wrote: So I'm trying to figure out how to optimize my PG install (8.0.3) to get better performance without dropping one of my indexes. What about something like this: begin; drop slow_index_name; update; create index slow_index_name; commit; vacuum; Matt

Re: [PERFORM] Large Database Design Help

2006-02-09 Thread Matthew Nuzum
d probably want to start with the GDB technique unless you have a ton of available ram. You might interpret this as being a knock against PostgreSQL since I pulled the data out of the db, but it's not; You'd be hard pressed to find anything as fast as the in-memory hashtable or th

Re: [PERFORM] Default autovacuum settings too conservative

2006-02-01 Thread Matthew T. O'Connor
Jim C. Nasby wrote: Small tables are most likely to have either very few updates (ie: a 'lookup table') or very frequent updates (ie: a table implementing a queue). In the former, even with vacuum_threshold = 0 vacuum will be a very rare occurance. In the later case, a high threshold is likely to

Re: [PERFORM] Autovacuum / full vacuum

2006-01-17 Thread Matthew T. O'Connor
Michael Riess wrote: did you read my post? In the first part I explained why I don't want to increase the FSM that much. I'm sure he did, but just because you don't have enough FSM space to capture all everything from your "burst", that doesn't mean that space can't be reclaimed. The next ti

Re: [PERFORM] SAN/NAS options

2005-12-19 Thread Matthew Schumacher
Jim C. Nasby wrote: > On Wed, Dec 14, 2005 at 01:56:10AM -0500, Charles Sprickman wrote: > You'll note that I'm being somewhat driven by my OS of choice, FreeBSD. > >>Unlike Solaris or other commercial offerings, there is no nice volume >>management available. While I'd love to keep managing a

Re: [PERFORM] Hardware/OS recommendations for large databases (

2005-11-16 Thread Matthew Nuzum
oss *twice* this year by using SMART hard drive monitoring software. I can't tell you how good it feels to replace a drive that is about to die, as compared to restoring data because a drive died. -- Matthew Nuzum www.bearfruit.org ---(end of broadcast)

Re: [PERFORM] Hardware/OS recommendations for large databases (

2005-11-16 Thread Matthew Nuzum
ideology so that a server should be replaced after 3 years, where before I aimed for 5. It seems to me that the least reliable components in servers these days are the fans. -- Matthew Nuzum www.bearfruit.org ---(end of broadcast)--- TIP 9: In

Re: [PERFORM] Help tuning postgres

2005-10-13 Thread Matthew Nuzum
ng like this would definately peg your disk i/o. Throwing more hardware at your problem will definately help, but I'm a performance freak and I like to optimize everything to the max. *Sometimes* you can get drastic improvements without adding any hardware. I have seen some truly miraculu

Re: [PERFORM] Help tuning postgres

2005-10-12 Thread Matthew Nuzum
ow. I would suggest posting the explain analyze output for one of your slow updates. I'll bet it is much more revealing and takes out a lot of the guesswork. -- Matthew Nuzum www.bearfruit.org ---(end of broadcast)--- TIP 5: don't forget to increase your free space map settings

[PERFORM] Logarithmic change (decrease) in performance

2005-09-28 Thread Matthew Nuzum
essage is being sent to the list to serve as a warning to other data warehouse admins that when you reach your capacity, the downward spiral happens rather quickly. Crud... Outlook just froze while composing the PHB memo. I've been working on that for an hour. What a bad day. -- Matthew Nuzum ww

Re: [PERFORM] Monitoring Postgresql performance

2005-09-28 Thread Matthew Nuzum
> /tmp/warn.txt echo >> /tmp/warn.txt top -bn 1 >> /tmp/warn.txt echo >> /tmp/warn.txt fi NOW=`date` CPU_LOAD=`cat /proc/loadavg | cut --delimiter=" " -f 1,2,3 --output-delimiter=\|` echo -e $NOW\|$CPU_LOAD\|$DB_LOAD >> ~/LOAD_MONITOR.LOG -- Matthew Nuzum www.bearfruit.org ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq

<    1   2   3   4   5   6   7   >