Re: [HACKERS] Rewriting Free Space Map

2008-03-18 Thread tomas
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Mon, Mar 17, 2008 at 01:23:46PM -0400, Tom Lane wrote: Simon Riggs [EMAIL PROTECTED] writes: Tom Lane wrote: The idea that's becoming attractive to me while contemplating the multiple-maps problem is that we should adopt something similar to

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Peter Eisentraut
Am Dienstag, 18. März 2008 schrieb Dave Page: On Mon, Mar 17, 2008 at 7:44 PM, Peter Eisentraut [EMAIL PROTECTED] wrote: Log Message: --- Enable probes to work with Mac OS X Leopard and other OSes that will support DTrace in the future. Switch from using DTRACE_PROBEn

Re: [HACKERS] count(*) performance improvement ideas

2008-03-18 Thread Gregory Stark
Tom Lane [EMAIL PROTECTED] writes: Stephen Denne [EMAIL PROTECTED] writes: However I'm not after a fast count(*) from table, but more like a fast select grouping_id, count(*) from my_table group by grouping_id You could apply the same technique across each group id, though this

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Dave Page
On Tue, Mar 18, 2008 at 9:40 AM, Peter Eisentraut [EMAIL PROTECTED] wrote: Do we need some support in the buildfarm to create the header file? The Windows/MSVC build system needs some adjustments. I have no idea how it works, but I'd be glad to explain the details to someone who does.

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Dave Page
On Mon, Mar 17, 2008 at 7:44 PM, Peter Eisentraut [EMAIL PROTECTED] wrote: Log Message: --- Enable probes to work with Mac OS X Leopard and other OSes that will support DTrace in the future. Switch from using DTRACE_PROBEn macros to the dynamically generated macros. Use dtrace

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Dave Page
On Tue, Mar 18, 2008 at 11:48 AM, Peter Eisentraut [EMAIL PROTECTED] wrote: Am Dienstag, 18. März 2008 schrieb Dave Page: I was actually thinking of the OS X buildfarm member I setup to exercise this. From your description it sounded like we need to generate the probe header manually if

[HACKERS] CVS problems

2008-03-18 Thread Manolo SupaMA
Hi. Yesterday I downloaded source code from CVS following developer.postgresql.org/docs/postgres/cvs.html First of all it had problems downloading files, INSTALL text file has not been downloaded, for example. Today that web page isn't even available... That's probably causing the problems I'm

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Peter Eisentraut
Am Dienstag, 18. März 2008 schrieb Dave Page: I was actually thinking of the OS X buildfarm member I setup to exercise this. From your description it sounded like we need to generate the probe header manually if we enable dtrace. Nope. -- Sent via pgsql-hackers mailing list

Re: [HACKERS] Remove hacks for old bad qsort() implementations?

2008-03-18 Thread Zeugswetter Andreas OSB SD
How about always adding the TID as last key when using qsort for create index ? I think you misunderstood: that's what we do now. I'm proposing removing it because I think it's probably useless. Ah, sorry, I did not look at the code, and interpreted your comment as some exceptional

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Alvaro Herrera
Dave Page wrote: Shouldn't there have been a doc patch with this as well? Last time I read the docs they said only Solaris supports dtrace. Well, it won't support anything else until somebody tries debugs it ;-) -- Alvaro Herrerahttp://www.CommandPrompt.com/

Re: [HACKERS] CVS problems

2008-03-18 Thread Alvaro Herrera
Manolo SupaMA escribió: Hi. Yesterday I downloaded source code from CVS following developer.postgresql.org/docs/postgres/cvs.html First of all it had problems downloading files, INSTALL text file has not been downloaded, for example. Today that web page isn't even available... That

Re: [HACKERS] minimal update

2008-03-18 Thread Gurjeet Singh
On Fri, Mar 7, 2008 at 9:40 PM, Bruce Momjian [EMAIL PROTECTED] wrote: I assume don't want a TODO for this? (Suppress UPDATE no changed columns) I am starting to implement this. Do we want to have this trigger function in the server, or in an external module? Best regards,

[HACKERS] Collating records based on a custom group by (aggregate like) function

2008-03-18 Thread Dan Searle
Hi, I want to create a custom function/query (using the C API?) that collates records from a record set (takes multiple records as input) and produces a set of records (returns multiple records). The Postgres docs only give examples of how to create a custom function that returns multiple

Re: [HACKERS] minimal update

2008-03-18 Thread Andrew Dunstan
Gurjeet Singh wrote: On Fri, Mar 7, 2008 at 9:40 PM, Bruce Momjian [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: I assume don't want a TODO for this? (Suppress UPDATE no changed columns) I am starting to implement this. Do we want to have this trigger function in the

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Tom Lane
Alvaro Herrera [EMAIL PROTECTED] writes: Dave Page wrote: Shouldn't there have been a doc patch with this as well? Last time I read the docs they said only Solaris supports dtrace. Well, it won't support anything else until somebody tries debugs it ;-) Well, I've got Leopard here, I'd be

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Peter Eisentraut
Am Dienstag, 18. März 2008 schrieb Tom Lane: Well, I've got Leopard here, I'd be happy to test it ... but the patch has rendered http://developer.postgresql.org/pgdocs/postgres/dynamic-trace.html into a pack of lies quite independently of which OSes are supported, so I'm not very sure what to

Re: [HACKERS] minimal update

2008-03-18 Thread Gurjeet Singh
On Tue, Mar 18, 2008 at 7:46 PM, Andrew Dunstan [EMAIL PROTECTED] wrote: Gurjeet Singh wrote: On Fri, Mar 7, 2008 at 9:40 PM, Bruce Momjian [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: I assume don't want a TODO for this? (Suppress UPDATE no changed columns)

[HACKERS] whaddya know, a build with no flex noise at all

2008-03-18 Thread Tom Lane
I am pleased to report that the recently released flex 2.5.35 generates code for our .l files that produces no gcc warnings whatsoever. This is a first :-(, at least for versions of flex without any downstream patches. regards, tom lane -- Sent via pgsql-hackers mailing

Re: [HACKERS] CVS problems

2008-03-18 Thread Greg Smith
On Tue, 18 Mar 2008, Manolo SupaMA wrote: Yesterday I downloaded source code from CVS following developer.postgresql.org/docs/postgres/cvs.html There is another tutorial that's got a lot more detail than this one at http://wiki.postgresql.org/wiki/Working_with_CVS which uses rsync to make

Re: [HACKERS] [0/4] Proposal of SE-PostgreSQL patches

2008-03-18 Thread Josh Berkus
KaiGai, NSA and SUN announces a new project launched which tries to port FLASK security architecture, it is named as FMAC. It can be a good candidate to host multilevel database security. (SELinux is also based on FLASK security architecture.) SEBSD project is also known. It is a poring of

Re: [HACKERS] Need Mentors for Google Summer of Code!

2008-03-18 Thread Oleg Bartunov
Josh, I'm interested in selectivity functions for FTS, proposed by Jan Urbaski. In case there will be no available mentors for him, I'd work with him. Oleg On Thu, 28 Feb 2008, Josh Berkus wrote: Hackers, Over the last 2 years, Google Summer of Code has been responsible for=20 several new

Re: [HACKERS] Need Mentors for Google Summer of Code!

2008-03-18 Thread Jan Urbański
Oleg Bartunov wrote: Josh, I'm interested in selectivity functions for FTS, proposed by Jan Urbaski. In case there will be no available mentors for him, I'd work with him. Oleg Thanks! Today I'll post a more detailed plan on -hackers explaining how I think I could approach the problem.

Re: [HACKERS] Need Mentors for Google Summer of Code!

2008-03-18 Thread Jan Urbański
Oleg Bartunov wrote: Josh, I'm interested in selectivity functions for FTS, proposed by Jan Urbaski. In case there will be no available mentors for him, I'd work with him. Oleg Thanks! Today I'll post a more detailed plan on -hackers explaining how I think I could approach the problem.

Re: [HACKERS] Need Mentors for Google Summer of Code!

2008-03-18 Thread Oleg Bartunov
On Tue, 18 Mar 2008, Jan Urbaski wrote: Oleg Bartunov wrote: Josh, I'm interested in selectivity functions for FTS, proposed by Jan Urbaski. In case there will be no available mentors for him, I'd work with him. Oleg Thanks! Today I'll post a more detailed plan on -hackers explaining how I

Re: [HACKERS] Need Mentors for Google Summer of Code!

2008-03-18 Thread Jan Urbański
Oleg Bartunov wrote: On Tue, 18 Mar 2008, Jan Urbaski wrote: Oleg Bartunov wrote: Josh, I'm interested in selectivity functions for FTS, proposed by Jan Urbaski. In case there will be no available mentors for him, I'd work with him. Oleg Thanks! Today I'll post a more detailed plan on

Re: [HACKERS] Need Mentors for Google Summer of Code!

2008-03-18 Thread Josh Berkus
Jan, Oleg, should I contact you personally to consult the application that I'm going to submit through the Google web app, or should I just send it to Google when the gates open and wait for the results? Submit it to Google. We have the ability to update submissions if they need to be

[HACKERS] Re: [COMMITTERS] pgsql: Don't need -Wno-error anymore, because flex is no longer

2008-03-18 Thread Bruce Momjian
Peter Eisentraut wrote: Log Message: --- Don't need -Wno-error anymore, because flex is no longer producing warnings. I see this patch only affects ecpg? Is this related to Tom's report from trying the new flex? Are we assuming that all CVS build people also have the new flex? Is

Re: [HACKERS] whaddya know, a build with no flex noise at all

2008-03-18 Thread Peter Eisentraut
Am Dienstag, 18. März 2008 schrieb Tom Lane: I am pleased to report that the recently released flex 2.5.35 generates code for our .l files that produces no gcc warnings whatsoever. This is a first :-(, at least for versions of flex without any downstream patches. Oh excellent! Now we can

Re: [HACKERS] Re: [COMMITTERS] pgsql: Don't need -Wno-error anymore, because flex is no longer

2008-03-18 Thread Peter Eisentraut
Am Dienstag, 18. März 2008 schrieb Bruce Momjian: Peter Eisentraut wrote: Log Message: --- Don't need -Wno-error anymore, because flex is no longer producing warnings. I see this patch only affects ecpg? Is this related to Tom's report from trying the new flex? Yes. There

Re: [HACKERS] Proposal for Null Bitmap Optimization(for Trailing NULLs)

2008-03-18 Thread Bruce Momjian
Added to TODO: * Consider not storing a NULL bitmap on disk if all the NULLs are trailing http://archives.postgresql.org/pgsql-hackers/2007-12/msg00624.php http://archives.postgresql.org/pgsql-patches/2007-12/msg00109.php Tom's comments are:

Re: [HACKERS] Better error message for select_common_type()

2008-03-18 Thread Peter Eisentraut
Am Dienstag, 18. März 2008 schrieb Tom Lane: Or we could apply Peter's patch more or less as-is, but I don't like that.  I don't think it solves the stated problem: if you know that CASE branches 3 and 5 don't match, that still doesn't help you in a monster query with lots of CASEs.  I think

[HACKERS] Problems with compilation of user-defined C functions for PostgreSQL 8.3.0

2008-03-18 Thread Denis Vnukov @ Nabble
Hi, I am trying to create a kind of simple procedural language for PostgreSQL. The first version was compiled with MinGW/gcc for PostgreSQL 8.2.6 and it worked OK. When PostgreSQL 8.3.0 was shipped, I tried to recompile all my code for this version, but it didn't work (almost every

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Robert Lor
Peter Eisentraut wrote: Well, yes. I meant to say, a build system that can supply the functionality of Gen_fmgrtab can surely implement this new thing. I see there is Perl being used, so it should be simple. I was thinking of using a Perl script to generate the dummy header file but

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Robert Lor
Peter Eisentraut wrote: Am Dienstag, 18. März 2008 schrieb Tom Lane: Well, I've got Leopard here, I'd be happy to test it ... but the patch has rendered http://developer.postgresql.org/pgdocs/postgres/dynamic-trace.html into a pack of lies quite independently of which OSes are supported, so

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Andrew Dunstan
Robert Lor wrote: Peter Eisentraut wrote: Well, yes. I meant to say, a build system that can supply the functionality of Gen_fmgrtab can surely implement this new thing. I see there is Perl being used, so it should be simple. I was thinking of using a Perl script to generate the dummy

Re: [HACKERS] How large file is really large - pathconf results

2008-03-18 Thread Reini Urban
Zdenek Kotala schrieb: Regarding to discussion about large segment size of table files a test pathconf function (see http://www.opengroup.org/onlinepubs/009695399/functions/pathconf.html). You can see output there: _PC_FILESIZEBITS - 3rd column _PC_LINK_MAX - 4th column _PC_NAME_MAX - 5th

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Tom Lane
Andrew Dunstan [EMAIL PROTECTED] writes: Robert Lor wrote: I was thinking of using a Perl script to generate the dummy header file but decided against it to avoid disrupting the build on other platforms. If sed doesn't work on Windows for some reason, we can use a Perl script instead.

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Joshua D. Drake
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Tue, 18 Mar 2008 18:14:32 -0400 Tom Lane [EMAIL PROTECTED] wrote: Perl is required for all MSVC builds, and for all builds from CVS on any platform too, IIRC, so it's a fairly safe bet for any tool you provide. The key phrase in that is

Re: [HACKERS] Re: [COMMITTERS] pgsql: Don't need -Wno-error anymore, because flex is no longer

2008-03-18 Thread Tom Lane
Peter Eisentraut [EMAIL PROTECTED] writes: I think it is reasonable to assume that those wanting to use -Werror should use the new flex, because if they don't the build will fail anyway, at any of the other lexers. It's been true for quite a long time that only ecpg's lexer generated any

Re: [HACKERS] timestamp datatype cleanup

2008-03-18 Thread Warren Turkal
Give the discussion on this. Is this small patch being considered for inclusion? If not, what do I need to change to make it acceptable? Thanks, wt On Sun, Mar 9, 2008 at 1:32 AM, Warren Turkal [EMAIL PROTECTED] wrote: PosgreSQL hackers, Here's an initial bit of my attempt at cleaning up the

[HACKERS] broken head?

2008-03-18 Thread Pavel Stehule
I did checking of current head. There is some problems test boolean ... ok test char ... FAILED test name ... ok test varchar ... FAILED test text ... ok test int2 ... ok test int4 ... ok

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Peter Eisentraut
Joshua D. Drake wrote: At some point, do we recognize that Perl is installed on every reasonable platform in existence or can be easily? I mean, we already require autoconf/make etc... What is adding Perl in practice? For one thing, a moving target. If we rely on standard Unix tools, we have

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Joshua D. Drake
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Wed, 19 Mar 2008 00:07:09 +0100 Peter Eisentraut [EMAIL PROTECTED] wrote: Joshua D. Drake wrote: At some point, do we recognize that Perl is installed on every reasonable platform in existence or can be easily? I mean, we already require

Re: [HACKERS] pgindent issue with EXEC_BACKEND-only typedefs

2008-03-18 Thread Bruce Momjian
I have commited a change to src/tools/find_typedef that should allow it to run under Linux. The only difference I see is that some unused typedefs do not appear in the Linux version. --- Alvaro Herrera wrote: Bruce

Re: [HACKERS] pgindent issue with EXEC_BACKEND-only typedefs

2008-03-18 Thread Bruce Momjian
Bruce Momjian wrote: I have commited a change to src/tools/find_typedef that should allow it to run under Linux. The only difference I see is that some unused typedefs do not appear in the Linux version. However, I think pgindent only cares about the typedef references, not the definitions,

Re: [HACKERS] count(*) performance improvement ideas

2008-03-18 Thread Stephen Denne
(Sorry for the repeat email Tom, I forgot the cc's) Tom Lane wrote: Stephen Denne [EMAIL PROTECTED] writes: I initially thought that what you meant by having transactions enter delta entries was that I have a trigger that would create a row each time it was called, writing how many

Re: [HACKERS] broken head?

2008-03-18 Thread Bruce Momjian
I am not seeing a problem here. Can you show use regression.diff? --- Pavel Stehule wrote: I did checking of current head. There is some problems test boolean ... ok test char ... FAILED

Re: [HACKERS] Proposal: new large object API

2008-03-18 Thread Tatsuo Ishii
lo_import_with_oid added. Note that actually committed function signature is: Oid lo_import_with_oid(PGconn *conn, const char *filename, Oid lobjId); -- Tatsuo Ishii SRA OSS, Inc. Japan I have posted proposed patches to pgsql-patches. -- Tatsuo Ishii SRA OSS, Inc. Japan I would like to

Re: [HACKERS] [COMMITTERS] pgsql: Enable probes to work with Mac OS X Leopard and other OSes that

2008-03-18 Thread Tom Lane
Peter Eisentraut [EMAIL PROTECTED] writes: Joshua D. Drake wrote: What is adding Perl in practice? For one thing, a moving target. Well, if we were that afraid of Perl version discrepancies, we shouldn't be using it at all anywhere. My point was just that we should not add a new build tool

Text search selectivity improvements (was Re: [HACKERS] Google Summer of Code 2008)

2008-03-18 Thread Jan Urbański
OK, here's a more detailed description of the FTS selectivity improvement idea: === Write a typanalyze function for column type tsvector The function would go through the tuples returned by the BlockSampler and compute the number of times each distinct lexeme appears inside the

[HACKERS] fast count(*) through statistics collector

2008-03-18 Thread Artem Yazkov
Hi hackers, I'm novice in PostgreSQL codebase (and in English too :-)), but I'd be glad to make a modest contribution to this great project. By viewing this list, I see a lot of discussions on the problem of fast count (*), but acceptable decision have not been formulated. Well, I make

Re: [HACKERS] timestamp datatype cleanup

2008-03-18 Thread Warren Turkal
Is there anything I can do to help? wt On Tue, Mar 18, 2008 at 7:49 PM, Tom Lane [EMAIL PROTECTED] wrote: Warren Turkal [EMAIL PROTECTED] writes: Give the discussion on this. Is this small patch being considered for inclusion? If not, what do I need to change to make it acceptable?

Re: [HACKERS] count(*) performance improvement ideas

2008-03-18 Thread Stephen Denne
Tom Lane wrote Stephen Denne [EMAIL PROTECTED] writes: What I was asking about with those questions, is if a single row is inserted in transaction A, and updated 1000 times still within transaction A, then transaction A commits... does a single row version get written, or 1001, 1000

Re: [HACKERS] count(*) performance improvement ideas

2008-03-18 Thread Tom Lane
Stephen Denne [EMAIL PROTECTED] writes: Tom Lane wrote Umm ... AFAICS there is no need for an UPDATE to touch the count table at all. You'd only need ON INSERT and ON DELETE triggers. I'm not referring to updates of my base table... the single row inserted was referring to the delta row...

Re: [HACKERS] count(*) performance improvement ideas

2008-03-18 Thread Tom Lane
Stephen Denne [EMAIL PROTECTED] writes: What I was asking about with those questions, is if a single row is inserted in transaction A, and updated 1000 times still within transaction A, then transaction A commits... does a single row version get written, or 1001, 1000 of which are

Re: [HACKERS] timestamp datatype cleanup

2008-03-18 Thread Tom Lane
Warren Turkal [EMAIL PROTECTED] writes: Give the discussion on this. Is this small patch being considered for inclusion? If not, what do I need to change to make it acceptable? It's in the to-do queue for the current commit fest. The queue is kinda long however :-(

Re: [HACKERS] [COMMITTERS] Re: pgsql: Add URLs for : * Speed WAL recovery by allowing more than one

2008-03-18 Thread Tom Lane
Simon Riggs [EMAIL PROTECTED] writes: It may surprise you but I didn't read Tom's words as being against Simon's approach. Personally I read them as a generic warning, which I agreed with. Maybe Tom can straighten that out. AFAIR, I just said that I'd find it hard to trust any complex

Re: [HACKERS] count(*) performance improvement ideas

2008-03-18 Thread Mark Mielke
Tom Lane wrote: Stephen Denne [EMAIL PROTECTED] writes: What I was asking about with those questions, is if a single row is inserted in transaction A, and updated 1000 times still within transaction A, then transaction A commits... does a single row version get written, or 1001, 1000 of

Re: [PATCHES] [HACKERS] [0/4] Proposal of SE-PostgreSQL patches

2008-03-18 Thread KaiGai Kohei
For easier reviewing, the most fundamental patch to implement PGACE (PostgreSQL Access Control Extension) was separated into thress parts. I want to start discussion about PGACE security framework at first. Any comments are welcome. [1/3] PGACE core features