Re: [HACKERS] list rewrite committed

2004-05-27 Thread Neil Conway
Jeff wrote: Do we have any numbers as to how much this will help things? No, I haven't done any benchmarking yet (I might do some before I leave for the summer, but it's not a priority...) FWIW, the performance improvement from this patch won't be as large as it might be, since Tom already

[HACKERS] list rewrite committed

2004-05-25 Thread Neil Conway
I've applied the list rewrite patch to CVS HEAD. I've also sent a copy of the patch I applied to the -patches list. Notes: - the tree compiles without warnings and passes the regression tests. I'm not aware of any bugs, regression failures, or compiler warnings caused by the list rewrite patch

[HACKERS] zero-column table behavior

2004-05-23 Thread Neil Conway
Does the following zero-column behavior strike anyone else as being a little strange? I can take a look at fixing this, I'm just curious if there's a consensus that the status quo isn't optimal. (1) neilc=# create table zero_col (); CREATE TABLE neilc=# select * from zero_col; -- (0 rows) --

[HACKERS] CVS HEAD: make install broken for vpath

2004-05-22 Thread Neil Conway
With current sources, it appears that vpath builds (i.e. separate source and build trees) are broken. make succeeds, but make install produces: [neilc:/Users/neilc/build-pgsql]% make install make -C doc install make[1]: Nothing to be done for `install'. make -C src install make -C port install

Re: [HACKERS] commit messages from gforge - pgsql-committers

2004-05-20 Thread Neil Conway
Tom Lane wrote: BTW, while you're messing with it, can you fix the random one-character lossage that so frequently happens in the list of file names? While we're asking for improvements to pgsql-committers, would it be possible for you to make it easier to view the diff for a particular CVS

Re: [HACKERS] commit messages from gforge - pgsql-committers

2004-05-20 Thread Neil Conway
Marc G. Fournier wrote: I can't see this really being possible ... have you seen this on another project? Sure, it's quite common. There's a list of scripts that support this kind of functionality at the bottom of this page: http://www.badgers-in-foil.co.uk/projects/cvsspam/ So there are plenty

Re: [HACKERS] commit messages from gforge - pgsql-committers

2004-05-20 Thread Neil Conway
Bruce Momjian wrote: Agreed, even if the URL is only valid for a week or so. Why would the URL only be temporarily valid? -Neil ---(end of broadcast)--- TIP 8: explain analyze is your friend

Re: [HACKERS] commit messages from gforge - pgsql-committers

2004-05-20 Thread Neil Conway
Marc G. Fournier wrote: k, hasn't come through yet, but looked in the archives and the message looks good ... missed a / for cvsweb, so fixed that ... Looks good, but one minor quibble: the URL is to the cvsweb page for the file in question, not the diff for the change to the file described by

Re: [HACKERS] [COMMITTERS] attempt at a multi file commit, to seee

2004-05-20 Thread Neil Conway
Sander Steffann wrote: All those links look messy IMHO. Maybe it's possible to give one link for every directory instead one for every file? The commit message ought to (and how does) contain a link directly to the relevant diff, rather than to the cvsweb entry for the modified file. Emitting

Re: [HACKERS] commit messages from gforge - pgsql-committers

2004-05-20 Thread Neil Conway
Marc G. Fournier wrote: Tom appears to be against, everyone else seems to be for ... should we try it and see how it works out? Sure, although I personally think Andrew's suggestion of creating a separate (non-archived) list that includes the full diff is the best solution. That satisfies both

Re: [HACKERS] bitwise and/or aggregate functions?

2004-05-18 Thread Neil Conway
[ Sorry for the latency of my response, Chris -- this got buried in my inbox... ] Fabien COELHO wrote: I don't know where these standards are available online... It seems they are not available:-( A copy that claims to represent an almost indistinuishable delta on the actual SQL 2003 database

Re: [HACKERS] Why new features only in magior releases ?

2004-05-18 Thread Neil Conway
Gaetano Mendola wrote: I well understand the reason to wait a 7.5 in order to delivery BIG changes that are requiring a initdb, but I don't understand why little enhancement can not be delivered in a 7.4.3 ( may be with a short period with a 7.4.3beta ) like the vacuum delayed. I don't think this

Re: [HACKERS] bitwise and/or aggregate functions?

2004-05-18 Thread Neil Conway
Alvaro Herrera Munoz wrote: Those are PDFs AFAIR, not easily greppable Not greppable, but any half-decent PDF viewer should have a search feature that should allow much the same thing. Checking the index is another way to go, although it is somewhat time-consuming. I don't have access to an

[HACKERS] FYI: away for the summer

2004-05-17 Thread Neil Conway
I'll be away from PostgreSQL development from approximately the end of May until August 20th. I won't be subscribed to any PG-related mailing lists for that period. However, I'll still be accessible via email to this address. Have a great summer, everyone. -Neil ---(end

Re: [HACKERS] email built in type

2004-05-10 Thread Neil Conway
On Sat, 2004-05-08 at 13:10, Gaetano Mendola wrote: However an *add on* is an *add on* with not the same eligibility of the main project I'd suggest implementing the custom datatype first and packaging it separately (say, via pgFoundry) -- it can always be moved into the core distribution at

Re: [HACKERS] Resource allocation?

2004-05-05 Thread Neil Conway
On 4-May-04, at 2:18 PM, David Fetter wrote: I'd like to be able to run large batch-process jobs for caching, but limit the total resource utilization on them, something like nice(1). Better still would be some way to put a max on total resources be able to allocate from that. Does PostgreSQL

Re: [HACKERS] Plan for feature freeze?

2004-05-01 Thread Neil Conway
On 30-Apr-04, at 8:53 PM, Tatsuo Ishii wrote: For me even September 1st does not seem too late. Major version up bring users pains including backup/restore application imcompatibilty... IMO to justify those pains we need to give users major enhancements. Honestly I don't understand why we should

Re: [HACKERS] linked list rewrite

2004-04-28 Thread Neil Conway
On 28-Apr-04, at 12:12 AM, Bruce Momjian wrote: I never liked cell myself. It is too vague to me. But I see your point that list_head you would think returns the head of the list, not the first element in the list. I'm not sure what you mean: list_head() returns the head of the list, which is

Re: [HACKERS] linked list rewrite

2004-04-28 Thread Neil Conway
On 27-Apr-04, at 10:07 PM, Tom Lane wrote: [ ... on the topic of list_union(), list_union_int() and friends ] I guess the real question in my mind is whether there is any true gain in symmetry or readability by doing it this way. I think there's a small gain: everything else being equal, an API

Re: [HACKERS] linked list rewrite

2004-04-25 Thread Neil Conway
(To resurrect an old thread, I've finally got some time to devote to this; I'll post a patch once I've got something ready for public consumption.) On 23-Mar-04, at 4:59 PM, Tom Lane wrote: Let's see ... fleshing out this idea a bit, here's a rundown of all the symbols in pg_list.h and

Re: [HACKERS] Multiple statements in one prepare

2004-04-24 Thread Neil Conway
On 15-Apr-04, at 9:26 AM, Robert Turnbull wrote: How can multiple SQL statements be included in one prepare command? The goal is to reduce chatter between the client and server by submitting an atomic tranasaction set. You can submit multiple PREPARE commands in one query string (separated by

Re: [HACKERS] License question

2004-04-22 Thread Neil Conway
On Thu, 2004-04-22 at 09:19, Shachar Shemesh wrote: The license given in the web link you mention seems to mandate all related work to be under the same license, which is nowhere near what BSD means. What license text do you think implies this? -Neil ---(end of

[HACKERS] valgrind errors

2004-04-21 Thread Neil Conway
Valgrind'ing the postmaster yields a fair number of errors. A lot of them are similar, such as the following: ==29929== Use of uninitialised value of size 4 ==29929==at 0x80AFB80: XLogInsert (xlog.c:570) ==29929==by 0x808B0A6: heap_insert (heapam.c:1189) ==29929==by 0x808B19D:

Re: [HACKERS] ON COMMIT DROP

2004-04-19 Thread Neil Conway
On Mon, 2004-04-19 at 02:16, Tom Lane wrote: (Offhand I can't even find CREATE TABLE AS in SQL99...) This is semi-OT, but CREATE TABLE AS is (new) in SQL2003. At few glance, the spec's notion of the command is about the same as ours, except for a few minor syntactic differences (e.g. the [ WITH

Re: [HACKERS] Information/schema hiding...

2004-04-11 Thread Neil Conway
On Sun, 2004-04-11 at 17:10, Sean Chittenden wrote: Should information hiding be done in psql(1) or should this be managed by the backend and all logic kept out of psql(1)? If the intent of this feature is security, it seems totally pointless to implement it in psql (leaving aside whether it's

[HACKERS] FYI: MIT Innovation Lab 2004

2004-04-09 Thread Neil Conway
I'll be attending the MIT Sloan Innovation Lab Meeting at MIT on April 15 and 16. The topic of the meeting is Exploring the Inner Workings of User Innovation Communities. Some other folks from the open-source community will be there, including individuals from Apache, Red Hat, and Ximian. If

Re: [HACKERS] Function to kill backend

2004-04-03 Thread Neil Conway
On 2-Apr-04, at 5:16 PM, Andrew Dunstan wrote: If' we're going to have this shouldn't it be a proper command? Why? What benefit would this offer over implementing this feature as a function? -Neil ---(end of broadcast)--- TIP 1: subscribe and

Re: [HACKERS] Fuzzy cost comparison to eliminate redundant planning

2004-03-28 Thread Neil Conway
On 28-Mar-04, at 8:32 PM, Joe Conway wrote: It looks like a great idea to me... + * XXX does this percentage need to be user-configurable? ...but I think the answer to the above is yes. Is this really a parameter that we can expect administrators to be able to understand and tune very

Re: subversion vs cvs (Was: Re: [HACKERS] linked list rewrite)

2004-03-25 Thread Neil Conway
On 25-Mar-04, at 12:25 AM, Dustin Sallings wrote: It's definitely not a magic tool that makes bad code good and conflicting patches happy. It solves other problems, though. I don't think anything mentioned in this thread so far would be an enormous improvement over what we have now. However, I

Re: subversion vs cvs (Was: Re: [HACKERS] linked list rewrite)

2004-03-25 Thread Neil Conway
On 25-Mar-04, at 3:03 PM, Dustin Sallings wrote: I don't do Windows, but my understanding is that tla is as well supported on Windows as postgres is. David Wheeler disagrees: A serious weakness of arch is that it doesn't work well on Windows-based systems, and it's not clear if that will ever

Re: [HACKERS] Per database users/admins, handy for database virtual hosting...

2004-03-25 Thread Neil Conway
On 25-Mar-04, at 8:18 PM, Sean Chittenden wrote: I haven't read much in the last few months, but archives from 2002 suggested there wasn't much on the table in terms of making this happen beyond adding a function that runs as a DBA to create users (which I've done). Well, the db_user_namespace

Re: [HACKERS] [COMMITTERS] pgsql-server/ oc/src/sgml/ref/alter_table.sgml ...

2004-03-24 Thread Neil Conway
On 23-Mar-04, at 3:03 PM, Bruce Momjian wrote: Does removing SET WITHOUT OIDS cause compatibility problems? ALTER TABLE ... SET WITHOUT OIDS has not been removed. -Neil ---(end of broadcast)--- TIP 2: you can get off all lists at once with the

[HACKERS] linked list rewrite

2004-03-23 Thread Neil Conway
I'd like to wrap up the linked list rewrite, and get the code into CVS reasonably soon. If you're unfamiliar with the motivations for redesigning the linked list code, check the archives for previous discussions, such as: http://www.mail-archive.com/[EMAIL PROTECTED]/msg02204.html

Re: [HACKERS] linked list rewrite

2004-03-23 Thread Neil Conway
On 23-Mar-04, at 10:31 PM, Tom Lane wrote: How do you mean it's no longer the case? ListCell looks exactly like a cons cell to me. Sorry, thinko on my part. I meant to say that lcons() is a Lispy name, which suggests a Lispy implementation. This is no longer the case. While lcons() isn't that

Re: [HACKERS] float8 regression test failure in head

2004-03-22 Thread Neil Conway
Christopher Kings-Lynne wrote: This has not yet been fixed... Attached is a patch for this issue. I've checked with Chris, and this patch allows the regression tests to pass on his machine. I also updated float8-exp-three-digits expected file, but I wasn't able to test these changes (I don't

Re: [HACKERS] execute command tag including affected rows count

2004-03-21 Thread Neil Conway
On 21-Mar-04, at 11:39 AM, Kris Jurka wrote: Would it be possible to have the command completion tag for EXECUTE return the affected row count? Yes, this has been suggested before -- for example: http://www.mail-archive.com/[EMAIL PROTECTED]/msg26787.html I agree it would be a good idea,

[HACKERS] compile warning in CVS HEAD

2004-03-18 Thread Neil Conway
I get the following warning compiling CVS HEAD: [neilc:/Users/neilc/pgsql]% make -C src/backend/utils/error all [ ... ] gcc -no-cpp-precomp -O0 -Winline -fno-strict-aliasing -g -Wall -Wmissing-prototypes -Wmissing-declarations -I../../../../src/include -I/sw/include -c -o elog.o elog.c -MMD

Re: [HACKERS] Regression failure for floats

2004-03-13 Thread Neil Conway
Bruce Momjian [EMAIL PROTECTED] writes: I am seeing the following regression failure for current CVS. On my OS, BSD/OS 4.3, it seems once you hit Infinity, you can't negate it. Actually, I suspect the problem is that isinf() on your platform returns 1 for any infinity (rather than -1 for

Re: [HACKERS] unsafe floats

2004-03-11 Thread Neil Conway
Dennis Bjorklund [EMAIL PROTECTED] writes: In C one can set a signal handler to catch floating point exceptions (SIGFPE). Without a handler you can get NaN and Infinity as the result of mathematical operations. Okay, I think this would be a reasonable set of behavior: - define a new GUC

Re: [HACKERS] unsafe floats

2004-03-11 Thread Neil Conway
Tom Lane [EMAIL PROTECTED] writes: That sounds okay. Also we might want to distinguish NaN from Infinity --- I would expect most people to want zero-divide to continue to get reported, for instance, even if they want to get Infinity for overflow. Yeah, good point. This I disagree with. It

Re: [HACKERS] unsafe floats

2004-03-10 Thread Neil Conway
Dennis Bjorklund [EMAIL PROTECTED] writes: When UNSAFE_FLOATS is defined there is a check that float results are within the min and max limits, which excludes values like 'Infinity', '-Infinity' and 'Nan'. No, 'NaN' is legal float4/float8/numeric input whether UNSAFE_FLOATS is defined or not.

Re: [HACKERS] unsafe floats

2004-03-10 Thread Neil Conway
Tom Lane [EMAIL PROTECTED] writes: Nowadays, IEEE float math is nearly universal, and we would be offering better functionality if we allowed access to Infinity and Nan by default. This is faulty reasoning: we *do* allow NaN by default (although you're correct that we reject Infinity in float8

[HACKERS] raising the default default_statistics_target

2004-03-07 Thread Neil Conway
From time to time, people on IRC ask for help with performance problems, and the cause of the difficulty is ultimately traced to a poor query plan that is chosen because default_statistics_target is too low. While there will always need to be *some* tuning of the statistics target by advanced

Re: [HACKERS] raising the default default_statistics_target

2004-03-07 Thread Neil Conway
Tom Lane wrote: This is something we need to consider, but we'll need more evidence before making a choice. One thing that we have very little data about is how much difference it makes in the quality of planner choices. Right, but is there a practical way to actually get this data? If the

[HACKERS] avg() for timestamp

2004-03-06 Thread Neil Conway
It seems to me the following should Just Work: nconway=# create table t1 (a timestamp); CREATE TABLE nconway=# insert into t1 values (now()); INSERT 17164 1 nconway=# insert into t1 values (now()); INSERT 17165 1 nconway=# insert into t1 values (now()); INSERT 17166 1 nconway=# insert into t1

Re: [HACKERS] [PERFORM] WAL Optimisation - configuration and usage

2004-03-03 Thread Neil Conway
Simon Riggs wrote: On the other hand, I was just about to change the wal_debug behaviour to allow better debugging of PITR features as they're added. That's a development activity. Enabling the WAL_DEBUG #ifdef by default during the 7.5 development cycle would be uncontroversial, I think. I

Re: [HACKERS] Avoid MVCC using exclusive lock possible?

2004-02-29 Thread Neil Conway
Jon Jensen wrote: How would you do a rollback if an error occurred mid-query? How would you keep your table from being a big pile of junk if a power failure happened during the query? As most non-MVCC database do: by writing WAL records. In theory, it seems to me that we could implement an

Re: [HACKERS] Collaboration Tool Proposal -- Summary to date

2004-02-29 Thread Neil Conway
Josh Berkus wrote: D. One possible reservation may be integrating RT with GForge. I'm confused. Are we considering moving core backend development over to GForge as well, or just GBorg? (Personally the former doesn't strike me as a good idea, at least initially.) I think that the PostgreSQL

Re: [HACKERS] [pgsql-www] Collaboration Tool Proposal

2004-02-26 Thread Neil Conway
Peter Eisentraut [EMAIL PROTECTED] writes: I think we had previously decided that we will not allow a random user off the street to file bug reports into whatever system we end up using. Uh, why not? (And more to the point, why raise the barrier to entry on reporting bugs?) Individuals can

[HACKERS] CVS HEAD compile warning

2004-02-25 Thread Neil Conway
$ cd src/interfaces/ecpg $ make [ ... ] bison -y -d preproc.y mv -f y.tab.c ./preproc.c mv -f y.tab.h ./preproc.h /usr/bin/flex -o'pgc.c' pgc.l pgc.l:979: warning, -s option given but default rule can be matched -Neil ---(end of broadcast)---

Re: [HACKERS] CVS HEAD compile warning

2004-02-25 Thread Neil Conway
Tom Lane [EMAIL PROTECTED] writes: That's interesting, because I get no such warning here. What version of flex are you using? (Mine is 2.5.4) [EMAIL PROTECTED]:/home/nconway]% flex --version flex 2.5.31 (The flex 2.5.31-22 debian package) -Neil ---(end of

Re: [HACKERS] bgwriter never dies

2004-02-24 Thread Neil Conway
Jan Wieck [EMAIL PROTECTED] writes: In the case of a postmaster crash, I think something in the system is so wrong that I'd prefer an immediate shutdown. I agree. Allowing existing backends to commit transactions after the postmaster has died doesn't strike me as being that useful, and is

Re: [HACKERS] Transaction aborts on syntax error.

2004-02-23 Thread Neil Conway
Bruce Momjian [EMAIL PROTECTED] writes: Josh Berkus wrote: Hmmm I'm not sure how you arrived at this wording for the TODO. How are we defining a syntax error? Parser error, I would say. Misspelling a table name, perhaps. FWIW, a misspelled table name is plainly a semantic error, not

Re: [HACKERS] [PATCHES] update i386 spinlock for hyperthreading

2004-02-20 Thread Neil Conway
Simon Riggs [EMAIL PROTECTED] writes: Kenneth Marshall would like me to post this: I agree that in order to manage today's large memory machines, we need to have less contention in our buffer management strategies. The two main main choke points are in the buffer hash table routines and in the

Re: [HACKERS] Design Documentation Help !!

2004-02-19 Thread Neil Conway
Ramanujam H S Iyengar [EMAIL PROTECTED] writes: Can i get any design documentation apart from the readme files and the comments those are available with the source code . Not really. There's some information in the Internals section of the main docs:

Re: [HACKERS] casting zero-length strings

2004-02-19 Thread Neil Conway
Christopher Kings-Lynne [EMAIL PROTECTED] writes: Either way, we should make them a WARNING for 7.5, then error in 7.6. Ok, I'll make this change soon. If we end up marking more 7.5 changes using this mechanism (i.e. deprecate for 7.5, disallow for 7.6), we could use an #ifdef symbol to mark

[HACKERS] DROP TABLE and concurrent modifications

2004-02-17 Thread Neil Conway
I can reproduce the following behavior with CVS HEAD. 1. Have a process do INSERTs into a table in a tight loop (I've attached a trivial libpq app that does this) 2. In another session, repeatedly drop and re-create the table that is being modified You should see a

Re: [HACKERS] DROP TABLE and concurrent modifications

2004-02-17 Thread Neil Conway
Neil Conway [EMAIL PROTECTED] writes: 1. Have a process do INSERTs into a table in a tight loop (I've attached a trivial libpq app that does this) Sorry, I was evidently a little too quick off the draw. A simple test app is /really/ attached this time. -Neil #include stdio.h

[HACKERS] casting zero-length strings

2004-02-16 Thread Neil Conway
Chris KL recently pointed out to me that we currently don't raise an error when attempting to cast a zero-length string to a float: nconway=# select ''::float8; float8 0 (1 row) nconway=# select ''::float4; float4 0 (1 row) Similarly for oid: nconway=# select

Re: [HACKERS] psql variables

2004-02-09 Thread Neil Conway
Tom Lane [EMAIL PROTECTED] writes: [ blinks... ] This is historical revisionism. Psql variables were invented to provide user-defined variables; it is the predefined ones that are a wart added to the mechanism, not vice versa. The historical origins of the feature are no excuse for its

Re: [HACKERS] psql tab completion USERSET vars

2004-02-09 Thread Neil Conway
Tom Lane [EMAIL PROTECTED] writes: I'm not by any means wedded to the USERSET and possibly SUSET policy, but I would like to stop somewhere short of include everything. Any thoughts? Perhaps we could have two sets of variables: all the GUC vars (that can be displayed via SHOW), and a subset

[HACKERS] psql tab completion USERSET vars

2004-02-08 Thread Neil Conway
While reviewing Andrew Dunstan's patch that implements the log_disconnections GUC var, I noticed that tab-complete.c in psql claims that only USERSET and possibly SUSET GUC variables should be included in the list of variables that can be auto-completed. That policy is clearly not followed:

[HACKERS] psql variables

2004-02-08 Thread Neil Conway
Recently, I was surprised to learn that psql variables are case sensitive. Furthermore, there is no error when one attempts to '\set' a non-existent variable (arguably for good reason: I suppose it's too late now to get rid of user-defined psql variables). That leads to confusing situations like

Re: [HACKERS] implemented missing bitSetBit() and bitGetBit()

2004-02-04 Thread Neil Conway
David Helgason [EMAIL PROTECTED] writes: I needed these, so I went and implemented them myself. I didn't see any followup to this: do we want to include this in the main tree, contrib/, or not at all? -Neil (who has no opinion on the matter, but just wants to make sure this doesn't fall through

Re: [HACKERS] pg_stat_activity

2004-02-02 Thread Neil Conway
Christopher Kings-Lynne [EMAIL PROTECTED] writes: In what version of Postgres did the pg_stat_activity view appear? 7.2 -Neil ---(end of broadcast)--- TIP 1: subscribe and unsubscribe commands go to [EMAIL PROTECTED]

Re: [HACKERS] Problem with pgtcl on HP

2004-01-31 Thread Neil Conway
Michael Brusser [EMAIL PROTECTED] writes: We tracked problem to this line in pgtcl.c: putenv (PGCLIENTENCODING=UNICODE); Changing this to Tcl_PutEnv (PGCLIENTENCODING=UNICODE); seems to be a good fix, so far we are not seeing any problems. Looks good to me. Unless anyone else objects,

Re: [HACKERS] compile failure on xmalloc()

2004-01-25 Thread Neil Conway
Bruce Momjian [EMAIL PROTECTED] writes: I am seeing the following compile failure in currrent CVS. Seems there is a conflict between readline and psql's use of the xmalloc function name. This should be fixed in the latest CVS HEAD code (i.e. r1.82 of common.c) -- can you make sure your

Re: [HACKERS] Named arguments in function calls

2004-01-25 Thread Neil Conway
Greg Stark [EMAIL PROTECTED] writes: But the compatibility with Oracle would be awfully nice. Perhaps I'm missing something here: why is compatibility with Oracle here particularly worth worrying about? Supporting the same functionality as Oracle is good, but ISTM supporting the exact same

Re: [HACKERS] 7.5 change documentation

2004-01-23 Thread Neil Conway
Tom Lane [EMAIL PROTECTED] writes: In theory there should be a section at the head of release.sgml mentioning the major changes done-so-far, but for various reasons this hasn't gotten installed in the 7.5 branch yet. (Look at the CVS versions during 7.4 development to see how we did it last

Re: [HACKERS] Bunch o' dead code in GEQO

2004-01-22 Thread Neil Conway
Tom Lane [EMAIL PROTECTED] writes: I'm assuming that the original author of the GEQO code already did that testing ... Removing the code without bothering to verify this assumption is a little unwise, IMHO: given the low quality of the rest of the GEQO code, I wouldn't be surprised to learn

Re: [HACKERS] Bunch o' dead code in GEQO

2004-01-22 Thread Neil Conway
Tom Lane [EMAIL PROTECTED] writes: Where are we going to find a representative test set of dozen-or-more- way SQL join queries? Interesting that you should mention that. I've been thinking for a while that we need a much more extensive test suite for the query optimizer. This would allow us to

Re: [HACKERS] cache control?

2004-01-16 Thread Neil Conway
Michael Brusser [EMAIL PROTECTED] writes: Is there a way to force database to load a frequently-accessed table into cache and keep it there? No. BTW, this idea has been suggested in the past, so check the archives for the prior discussions on this topic. The usual response is that the

Re: [HACKERS] nomenclature

2004-01-16 Thread Neil Conway
Marc G. Fournier [EMAIL PROTECTED] writes: if you think about it, the postmaster is actually aptly named, since it is the process that sorts out the incoming connections and assigns them to backend processes ... just like the postmaster does with your mail ... Right, hence the witty pun :-)

Re: [HACKERS] DBT-2 pulls PostgreSQL from CVS for STP

2004-01-14 Thread Neil Conway
Tom Lane [EMAIL PROTECTED] writes: This is a bug Jan introduced recently --- he forgot to modify the shared memory setup code to allow space for the new data structures used by ARC. Jan, would you mind fixing that soon? It's getting in people's way. Jan had asked that I include the fix for

Re: [HACKERS] Bug in new buffer freelist code

2004-01-07 Thread Neil Conway
Tom Lane [EMAIL PROTECTED] writes: It might also be worthwhile to add another BM_FLAG bit that specifically indicates a buffer is on the freelist, and set/clear/test that at appropriate spots. ISTM that BM_FREE should indicate this, or am I misunderstanding you? -Neil

Re: [HACKERS] Bug in new buffer freelist code

2004-01-07 Thread Neil Conway
Tom Lane [EMAIL PROTECTED] writes: It might be a good idea to rename BM_FREE to something else, perhaps BM_UNPINNED, since I can recall being confused about what it meant too. If all it indicates is refcount == 0, ISTM we can just get rid of it altogether, and just check the shared refcount

[HACKERS] RFC: bufmgr locking changes

2004-01-07 Thread Neil Conway
I've attached a (gzip'ed) patch that makes the following changes to the buffer manager: (1) Overhaul locking; whenever the code needs to modify the state of an individual buffer, do synchronization via a per-buffer meta data lock rather than the global BufMgrLock. For more

Re: [HACKERS] One regression failure with 7.4.1 on Debian 3.0r2

2004-01-05 Thread Neil Conway
Adam Witney [EMAIL PROTECTED] writes: I have one regression failure on 7.4.1, which does not occur with 7.4 [EMAIL PROTECTED] more src/test/regress/regression.diffs *** ./expected/random.out Thu Feb 13 05:24:04 2003 --- ./results/random.outTue Dec 23 20:19:40 2003

Re: [HACKERS] Need a good .

2004-01-04 Thread Neil Conway
Thomas Hallgren [EMAIL PROTECTED] writes: I'm working on a pljava module. In it, I'd like to cache some allocated structures (allocated using TopMemoryContext) using a string as the key. I need a hash or binary-search table with dynamic size where I can store arbitrary structures and then find

Re: [HACKERS] *sigh*

2004-01-04 Thread Neil Conway
Simon Riggs [EMAIL PROTECTED] writes: Select count(*) could be evaluated against any available index sub-tables, since all that is required is to count the rows. That would be significantly faster than a full file scan and accurate too. PostgreSQL stores MVCC information in heap tuples only,

Re: [pgsql-hackers-win32] [HACKERS] [PATCHES] fork/exec patch

2003-12-16 Thread Neil Conway
Andrew Dunstan [EMAIL PROTECTED] writes: In normal operation the only thing that should be signalling a backend is the postmaster. Oh? What about LISTEN/NOTIFY? -Neil ---(end of broadcast)--- TIP 9: the planner will ignore your desire to choose

Re: [HACKERS] ORDER BY and DISTINCT ON

2003-12-14 Thread Neil Conway
Tom Lane [EMAIL PROTECTED] writes: This was discussed before --- see the archives. I believe the conclusion was that the results would actually be nondeterministic if we used two sort steps (that's what the code comment means by rather unpredictable). Does the non-determinism you're

Re: [HACKERS] ORDER BY and DISTINCT ON

2003-12-13 Thread Neil Conway
Greg Stark [EMAIL PROTECTED] writes: Do you really want: select distinct on (b,c,a) a,b,c from abc order by b,c,a; or is that you want select * from (select distinct on (a) a,b,c order by a) order by b,c,a; If I understand you correctly, I don't think I would expect either. - ORDER BY

[HACKERS] ORDER BY and DISTINCT ON

2003-12-12 Thread Neil Conway
We reject the following query: nconway=# create table abc (a int, b int, c int); CREATE TABLE nconway=# select distinct on (a) a, b, c from abc order by b, c, a; ERROR: SELECT DISTINCT ON expressions must match initial ORDER BY expressions This works fine, of course: nconway=# select distinct

Re: [HACKERS] PostgreSQL port to pure Java?

2003-12-09 Thread Neil Conway
Andrew Dunstan [EMAIL PROTECTED] writes: Frank Wiles wrote: Not to mention it would kill PostgreSQL's current speedy performance! Maybe, maybe not. Modern JVMs have much better performance characteristics than was once the case. Also, some of the things that Java buys you (memory

Re: [HACKERS] 73.5 and uw 713

2003-12-08 Thread Neil Conway
[EMAIL PROTECTED] writes: Is there ay way I can help with this debugging? Can you speculate on what might have caused the crash? Is the crash reproducible? When the backend crashed, it should have produced a core file (assuming your system is configured to do so). Can you post the stacktrace

Re: [HACKERS] 7.4.1 ... slight change of scheduale ...

2003-12-06 Thread Neil Conway
Marc G. Fournier [EMAIL PROTECTED] writes: To accomodate ppls travel scheduales, we are going to move the 7.4.1 release up to Monday, *unless* there is a report before then about something that needs to be fixed first The libpq SSL memory leak reported on -bugs would be good to fix. BTW, is

[HACKERS] DBMS course notes

2003-12-06 Thread Neil Conway
I recently had the opportunity to take an upper-year/graduate-level course on DBMS internals at my university. While taking that course, I wrote some notes on course material as a study aid. I thought that perhaps some of the people on -hackers might find the notes somewhat useful, so Bruce was

Re: [HACKERS] initdb should create a warning message [was Re:

2003-11-30 Thread Neil Conway
Oliver Elphick [EMAIL PROTECTED] writes: The use of the word log in the directory name does tend to invite this error, and some have acted on it without asking first. I think initdb should put a README.IMPORTANT file in $PGDATA to say [...] If someone deletes something from $PGDATA without

Re: [HACKERS] cvs head configure broken for --with-krb5 on RH9

2003-11-29 Thread Neil Conway
Tom Lane [EMAIL PROTECTED] writes: I believe the idea is that instead of --with-krb5=/usr/kerberos you now need --with-krb5 --with-includes=/usr/kerberos/include \ --with-libs=/usr/kerberos/lib Rather than silenty accepting but ignoring the old syntax, could we have configure bail out

Re: [HACKERS] Materialized views proposal

2003-11-29 Thread Neil Conway
Jonathan Gardner [EMAIL PROTECTED] writes: 3) We would implement some sort of differential view update scheme based on the paper Efficiently Updating Materialized Views[1]. One resource on this topic that appears to be quite authoritative is Materialized Views: Techniques, Implementations,

Re: [HACKERS] gettimeofday() goes backwards on FreeBSD 4.9

2003-11-28 Thread Neil Conway
Tom Lane [EMAIL PROTECTED] writes: Whoa. Try the following test program. I tried this on two uniprocessor x86 machines: (1) $ uname -a Linux tokyo 2.6.0-test10 #3 Mon Nov 24 13:43:54 EST 2003 i686 GNU/Linux This machine produces this output, after running the test app for about 30 minutes:

Re: [HACKERS] gettimeofday() goes backwards on FreeBSD 4.9

2003-11-28 Thread Neil Conway
Marc G. Fournier [EMAIL PROTECTED] writes: On Fri, 28 Nov 2003, Neil Conway wrote: $ uname -a FreeBSD home.samurai.com 4.9-RELEASE [...] what is kern.timecounter.method set to? $ sysctl kern.timecounter.method kern.timecounter.method: 0 FYI, I ran the test program for another 30 minutes

Re: [HACKERS] gettimeofday() goes backwards on FreeBSD 4.9

2003-11-28 Thread Neil Conway
Marc G. Fournier [EMAIL PROTECTED] writes: What kinda processor are you running? From dmesg: Timecounter i8254 frequency 1193182 Hz CPU: Intel Celeron (631.29-MHz 686-class CPU) Origin = GenuineIntel Id = 0x686 Stepping = 6

Re: [HACKERS] detecting poor query plans

2003-11-26 Thread Neil Conway
Tom Lane [EMAIL PROTECTED] writes: I think such a thing would have such a low signal-to-noise ratio as to be useless :-(. As you note, there are many places where the planner's estimate is routinely off by more than 3x (or any other threshold you might pick instead). I wonder, perhaps we

[HACKERS] building outside source tree

2003-11-26 Thread Neil Conway
Building PostgreSQL outside the source tree is slightly broken: (Using the current CVS HEAD code) $ mkdir ~/test-pg-build $ cd ~/test-pg-build $ ../pgsql/configure [ output omitted] $ make [ output omitted; make succeeds ] $ touch ../pgsql/configure # i.e. cvs up $ make The final make

Re: [HACKERS] detecting poor query plans

2003-11-26 Thread Neil Conway
Greg Stark [EMAIL PROTECTED] writes: There's a dual to this as well. If the results were very close but the actual time taken to run the node doesn't match the cost calculated then some optimizer parameter needs to be adjusted. I was thinking about this, but I couldn't think of how to get it

Re: [HACKERS] detecting poor query plans

2003-11-26 Thread Neil Conway
Greg Stark [EMAIL PROTECTED] writes: At least for all the possible plans of a given query at a specific point in time the intention is that the cost be proportional to the execution time. Why is this relevant? Given a cost X at a given point in time, the system needs to derive an expected

Re: [HACKERS] Function parameter names

2003-11-25 Thread Neil Conway
Dennis Bjorklund [EMAIL PROTECTED] writes: It's strange to allow identifiers to be of any length in the system table when there is no way to create it using normal syntax. I agree with Tom -- that doesn't seem strange to me at all. -Neil ---(end of

Re: [HACKERS] ALTER SEQUENCE enchancement

2003-11-24 Thread Neil Conway
Christopher Kings-Lynne [EMAIL PROTECTED] writes: Is there demand for this syntax: ALTER SEQUENCE ON table(col) CYCLE 100; What if the values in a column are generated via a sequence that was created independently -- i.e. it's not a SERIAL column? I'm not very enthusiastic about features that

<    2   3   4   5   6   7   8   9   10   11   >