Re: [HACKERS] Proposal: Multiversion page api (inplace upgrade)

2008-06-11 Thread Stephen Denne
information together with text data, however it is referring to keeping it together when processing it, not when storing the text. Regards, Stephen Denne. -- At the Datamail Group we value teamwork, respect, achievement, client focus, and courage. This email with any attachments is confidential

Re: [HACKERS] Core team statement on replication in PostgreSQL

2008-06-03 Thread Stephen Denne
variations on this kind of daemon can be used to perform testing, configuring it to work well, go slow, pause, not respond, disconnect, or fail in particular ways, emulating disk full, etc. Regards, Stephen Denne. -- At the Datamail Group we value teamwork, respect, achievement, client focus

Re: [HACKERS] triggers on prepare, commit, rollback... ?

2008-05-20 Thread Stephen Denne
. Regards, Stephen Denne. At the Datamail Group we value teamwork, respect, achievement, client focus, and courage. This email with any attachments is confidential and may be subject to legal privilege. If it is not intended for you please advise by replying immediately, destroy it and do

Re: [HACKERS] count(*) performance improvement ideas

2008-04-17 Thread Stephen Denne
: if you rollback, GD and SD stay the same, and when you issue a query, you can assume the state of SD and GD is random (due to previous queries) unless you initialize them to a known value. Using txid_current() as a key should alleviate that. Regards, Stephen Denne. Disclaimer

Re: [HACKERS] count(*) performance improvement ideas

2008-04-17 Thread Stephen Denne
when to clear it. Regards, Stephen Denne. Disclaimer: At the Datamail Group we value team commitment, respect, achievement, customer focus, and courage. This email with any attachments is confidential and may be subject to legal privilege. If it is not intended for you please advise by reply

Re: [HACKERS] count(*) performance improvement ideas

2008-04-16 Thread Stephen Denne
Tom Lane wrote Stephen Denne [EMAIL PROTECTED] writes: From: Tom Lane [mailto:[EMAIL PROTECTED] As for 2) and 3), can't you look into the pg_settings view? pg_settings view doesn't contain custom variables created on the fly, Really? [ pokes around ... ] Hm, you're right, because

Re: [HACKERS] count(*) performance improvement ideas

2008-04-16 Thread Stephen Denne
Tom Lane wrote Transaction commit is an exceedingly subtle and carefully structured thing. Throwing random user-defined code into it ain't gonna happen. Deferred constraint triggers currently run random user-defined code. This'll do me. Regards, Stephen Denne. Disclaimer: At the Datamail

Re: [HACKERS] count(*) performance improvement ideas

2008-04-16 Thread Stephen Denne
is private static data. The global dictionary GD is public data, available to all Python functions within a session. Use with care. Does session == transaction or connection? I don't understand the difference between SD and GD, private and public. Where are the context boundaries? Regards, Stephen

Re: [HACKERS] count(*) performance improvement ideas

2008-04-15 Thread Stephen Denne
(There is a possible performance bug mentioned at the end of the email, the rest is further discussion regarding materialised views) I wrote Pavan Deolasee wrote On Thu, Mar 20, 2008 at 3:24 AM, Stephen Denne [EMAIL PROTECTED] wrote: Pavan also refers to deferred triggers, which

Re: [HACKERS] count(*) performance improvement ideas

2008-04-15 Thread Stephen Denne
presume would appear in pg_settings. Updating existing variables is much quicker, over 10 updates per second. Regards, Stephen Denne. From: Tom Lane [mailto:[EMAIL PROTECTED] Sent: Wed 16/04/2008 1:55 p.m. Stephen Denne [EMAIL PROTECTED] writes: The custom

Re: [HACKERS] Allow COPY from STDIN to absorb all input before throwing an error

2008-04-08 Thread Stephen Denne
would have solved my problem. Regards, Stephen Denne. Disclaimer: At the Datamail Group we value team commitment, respect, achievement, customer focus, and courage. This email with any attachments is confidential and may be subject to legal privilege. If it is not intended for you please advise

Re: [HACKERS] count(*) performance improvement ideas

2008-03-24 Thread Stephen Denne
Pavan Deolasee wrote On Thu, Mar 20, 2008 at 3:24 AM, Stephen Denne [EMAIL PROTECTED] wrote: Pavan also refers to deferred triggers, which has got me thinking about another possible solution: Instead of inserting a delta row, that will be updated a lot of times, create

Re: [HACKERS] count(*) performance improvement ideas

2008-03-19 Thread Stephen Denne
for some reason? Regards, Stephen Denne. Disclaimer: At the Datamail Group we value team commitment, respect, achievement, customer focus, and courage. This email with any attachments is confidential and may be subject to legal privilege. If it is not intended for you please advise by reply

Re: [HACKERS] count(*) performance improvement ideas

2008-03-18 Thread Stephen Denne
(Sorry for the repeat email Tom, I forgot the cc's) Tom Lane wrote: Stephen Denne [EMAIL PROTECTED] writes: I initially thought that what you meant by having transactions enter delta entries was that I have a trigger that would create a row each time it was called, writing how many

Re: [HACKERS] count(*) performance improvement ideas

2008-03-18 Thread Stephen Denne
Tom Lane wrote Stephen Denne [EMAIL PROTECTED] writes: What I was asking about with those questions, is if a single row is inserted in transaction A, and updated 1000 times still within transaction A, then transaction A commits... does a single row version get written, or 1001, 1000

Re: [HACKERS] count(*) performance improvement ideas

2008-03-17 Thread Stephen Denne
as the lock would not be required till late in the game, and not held for long? Regards, Stephen Denne. Disclaimer: At the Datamail Group we value team commitment, respect, achievement, customer focus, and courage. This email with any attachments is confidential and may be subject to legal

Re: [HACKERS] Estimating geometric distributions

2008-03-11 Thread Stephen Denne
arithmetic mean is equal to what I calculated the geometric mean to be. Stephen Denne. Disclaimer: At the Datamail Group we value team commitment, respect, achievement, customer focus, and courage. This email with any attachments is confidential and may be subject to legal privilege

Re: [HACKERS] Maximum statistics target

2008-03-10 Thread Stephen Denne
changing the algorithm that determines how many, and which pages to analyze, perhaps so that it is adaptive to the results of the analysis as it progresses? That doesn't sound easy. Regards, Stephen Denne. Disclaimer: At the Datamail Group we value team commitment, respect, achievement, customer

Re: [HACKERS] Maximum statistics target

2008-03-09 Thread Stephen Denne
for the planner. It wouldn't solve my problem though, which is frequent over-estimation of rows when restricting by this field with values not known at plan time. Regards, Stephen Denne. Disclaimer: At the Datamail Group we value team commitment, respect, achievement, customer focus, and courage

[HACKERS] Estimating geometric distributions

2008-03-09 Thread Stephen Denne
of the arithmetic mean. Regards, Stephen Denne. Disclaimer: At the Datamail Group we value team commitment, respect, achievement, customer focus, and courage. This email with any attachments is confidential and may be subject to legal privilege. If it is not intended for you please advise

Re: [HACKERS] Ad Hoc Indexes

2008-02-18 Thread Stephen Denne
),'No Operation Completed') as LastFinshedOp regards, Stephen Denne. Disclaimer: At the Datamail Group we value team commitment, respect, achievement, customer focus, and courage. This email with any attachments is confidential and may be subject to legal privilege. If it is not intended for you please

Re: [HACKERS] Ad Hoc Indexes

2008-02-18 Thread Stephen Denne
creating any indexes on wooper. Regards, Stephen Denne. Disclaimer: At the Datamail Group we value team commitment, respect, achievement, customer focus, and courage. This email with any attachments is confidential and may be subject to legal privilege. If it is not intended for you please advise

[HACKERS] Locale vs LIKE

2008-02-12 Thread Stephen Denne
include predicates of the form [indexed text expression] like ABC%) Stephen Denne Disclaimer: At the Datamail Group we value team commitment, respect, achievement, customer focus, and courage. This email with any attachments is confidential and may be subject to legal privilege

Re: [HACKERS] [PATCHES] Proposed patch: synchronized_scanningGUCvariable

2008-01-29 Thread Stephen Denne
of any old 1000 returned in order) If A is a circular structure, you would have to know where it started, and include this info in the dump/restore (or lose A's correlation). Stephen Denne. Disclaimer: At the Datamail Group we value team commitment, respect, achievement, customer focus, and courage

Re: [HACKERS] 8.3RC1 on windows missing descriptive Event handle names

2008-01-29 Thread Stephen Denne
both v8.2 and v8.3rc1 at once, and I think it is the second started that is missing the process descriptions. Regards, Stephen Denne. Disclaimer: At the Datamail Group we value team commitment, respect, achievement, customer focus, and courage. This email with any attachments is confidential

Re: [HACKERS] Possible future performance improvement: sort updates/deletes by ctid

2008-01-29 Thread Stephen Denne
document_file AS df SET document_type_id = d.document_type_id FROM document AS d WHERE d.id = document_id; to UPDATE ONLY document_file AS df SET document_type_id = (SELECT d.document_type_id FROM document AS d WHERE d.id = document_id); Which is several orders of magnitude faster for me. Stephen

Re: [HACKERS] Possible future performance improvement: sort updates/deletes by ctid

2008-01-29 Thread Stephen Denne
estimate larger than the first estimate? Stephen Denne. Disclaimer: At the Datamail Group we value team commitment, respect, achievement, customer focus, and courage. This email with any attachments is confidential and may be subject to legal privilege. If it is not intended for you please

[HACKERS] 8.3RC1 on windows missing descriptive Event handle names

2008-01-14 Thread Stephen Denne
. PostgreSQL is started as a service. Stephen Denne Disclaimer: At the Datamail Group we value team commitment, respect, achievement, customer focus, and courage. This email with any attachments is confidential and may be subject to legal privilege. If it is not intended for you please advise by reply