Re: [HACKERS] EXPLAIN ANALYZE printing logical and hardware I/O per-node

2007-12-17 Thread Trevor Talbot
On 12/17/07, Decibel! <[EMAIL PROTECTED]> wrote: > Also, has anyone looked into adding a class of system calls that > would actually tell us if the kernel issued physical IO? I find it > hard to believe that other RDBMSes wouldn't like to have that info... Non-blocking style interfaces can help h

Re: [HACKERS] EXPLAIN ANALYZE printing logical and hardware I/O per-node

2007-12-17 Thread Greg Smith
On Mon, 17 Dec 2007, Decibel! wrote: Someone want to throw together some code that actually measures this? Maybe something that keeps a histogram of how many instructions take place per I/O request? If it turns out that counters do vary too much between CPUs, there might be ways that we can ac

Re: [HACKERS] EXPLAIN ANALYZE printing logical and hardware I/O per-node

2007-12-17 Thread Decibel!
On Dec 14, 2007, at 11:10 PM, Neil Conway wrote: But it occurred to me just now that the hardware instruction counter available on just about every platform would be good enough for a heuristic guess at whether the read(2) was cached. I'm skeptical that this would be reliable enough to be v

Re: [HACKERS] Board for developers

2007-12-17 Thread Merlin Moncure
On Dec 17, 2007 3:23 PM, Heikki Linnakangas <[EMAIL PROTECTED]> wrote: > Oleg Bartunov wrote: > > On Mon, 17 Dec 2007, Magnus Hagander wrote: > >>> just interested do we have a place where developers could post > >>> their availability for contract work ? > >>> > >>> For example, I and Teodor will

Re: [HACKERS] Sorting Improvements for 8.4

2007-12-17 Thread Ron Mayer
Has anyone looked into sorting algorithms that could use more than one CPU or core at a time? Benchmarks I see[1][2] suggest that sorting is an area that improves greatly with multiple processors and even with multi-threading on a single core processor. "For 1-processor and 2-threads (1p2t), t

Re: [HACKERS] Board for developers

2007-12-17 Thread Heikki Linnakangas
Oleg Bartunov wrote: On Mon, 17 Dec 2007, Magnus Hagander wrote: Hi there, just interested do we have a place where developers could post their availability for contract work ? For example, I and Teodor will be available soon for contract work and we prefer to work on postgres-related projec

Re: [HACKERS] Proposal for Null Bitmap Optimization(for TrailingNULLs)

2007-12-17 Thread Gokulakannan Somasundaram
Hi, I made the fix and tested it today. It involved some 10-15 lines of code change. I will mail it tomorrow. Feel free to give suggestions on making the fix more maintainable. I have followed Gregory's advice in the fix - Instead of changing the slot_deform_tuple, i have reduced the number

Re: [HACKERS] Board for developers

2007-12-17 Thread Joshua D. Drake
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Mon, 17 Dec 2007 20:24:15 +0300 (MSK) Oleg Bartunov <[EMAIL PROTECTED]> wrote: > On Mon, 17 Dec 2007, Magnus Hagander wrote: > > >> Hi there, > >> > >> just interested do we have a place where developers could post > >> their availability for cont

Re: [HACKERS] Board for developers

2007-12-17 Thread Oleg Bartunov
On Mon, 17 Dec 2007, Magnus Hagander wrote: Hi there, just interested do we have a place where developers could post their availability for contract work ? For example, I and Teodor will be available soon for contract work and we prefer to work on postgres-related projects, mostly from our to

Re: [HACKERS] Board for developers

2007-12-17 Thread Magnus Hagander
> Hi there, > > just interested do we have a place where developers could post > their availability for contract work ? > > For example, I and Teodor will be available soon > for contract work and we prefer to work on postgres-related projects, > mostly from our todo list. I'd like to post this

Re: [HACKERS] pgindent issue with EXEC_BACKEND-only typedefs

2007-12-17 Thread Alvaro Herrera
Tom Lane wrote: > Alvaro Herrera <[EMAIL PROTECTED]> writes: > > I don't know how to make it output the symbol names like it seems to do > > for you. > > I dislike the object-file-based approach altogether, not least because > it appears to depend on unportable aspects of someBSD's objdump. > > S

[HACKERS] Board for developers

2007-12-17 Thread Oleg Bartunov
Hi there, just interested do we have a place where developers could post their availability for contract work ? For example, I and Teodor will be available soon for contract work and we prefer to work on postgres-related projects, mostly from our todo list. I'd like to post this list somewhere,

Re: [HACKERS] ecxt_scantuple has wrong TupleDesc

2007-12-17 Thread Tom Lane
[EMAIL PROTECTED] writes: > I wonder why my ecxt_scantuple has a TupleDesc matching the subplan's > tlist, not my plan's tlist. That's the way it's supposed to be --- the scantuple slot is for scanning your subplan's output. > I have written a new executor node Foo, with corresponding ExecFoo and

Re: [HACKERS] pgindent issue with EXEC_BACKEND-only typedefs

2007-12-17 Thread Tom Lane
Alvaro Herrera <[EMAIL PROTECTED]> writes: > I don't know how to make it output the symbol names like it seems to do > for you. I dislike the object-file-based approach altogether, not least because it appears to depend on unportable aspects of someBSD's objdump. Surely there's some code out ther

Re: [HACKERS] pgindent issue with EXEC_BACKEND-only typedefs

2007-12-17 Thread Alvaro Herrera
Bruce Momjian wrote: > Does someone want to generate that typedef list in the future? I would love to do that, but objdump --stabs does not work for me like find_typedefs says it should. I only get something like: $ objdump --stabs ../backend/postgres ../backend/postgres: file format elf6

Re: [HACKERS] Proposal for Null Bitmap Optimization(for TrailingNULLs)

2007-12-17 Thread Gregory Stark
"Simon Riggs" <[EMAIL PROTECTED]> writes: > On Mon, 2007-12-17 at 08:47 -0500, Andrew Dunstan wrote: > >> This strikes me as such a corner case that it's likely not to be worth it. >> >> If you really want to save space along these lines, one better place to >> start might be mutable with colu

Re: [HACKERS] Negative LIMIT and OFFSET?

2007-12-17 Thread Andrew Sullivan
On Sun, Dec 16, 2007 at 12:31:11PM -0500, Tom Lane wrote: > > Well, I wouldn't advocate making it in a minor release, but it's not > clear how that translates into saying it can't go into 8.3. Just because we're well past feature freeze, in beta. I realise this seems like a corner case, but the

Re: [HACKERS] Proposal for Null Bitmap Optimization(for Trailing NULLs)

2007-12-17 Thread Simon Riggs
On Mon, 2007-12-17 at 08:47 -0500, Andrew Dunstan wrote: > This strikes me as such a corner case that it's likely not to be worth it. > > If you really want to save space along these lines, one better place to > start might be mutable with column ordering - see > http://archives.postgresql.org

Re: [HACKERS] Proposal for Null Bitmap Optimization(for Trailing NULLs)

2007-12-17 Thread Andrew Dunstan
Gregory Stark wrote: "Gokulakannan Somasundaram" <[EMAIL PROTECTED]> writes: a) By modifying the functions, heap_form_tuple and heap_fill_tuple, we can check whether all the nulls are trailing nulls. If all the nulls are trailing nulls, then we will not set the has_null flag and we will no

Re: [HACKERS] Requesting clarification on Vacuuming/Freezing behaviour

2007-12-17 Thread Gokulakannan Somasundaram
Thanks Heikki. I misunderstood things. Especially the comment in log_heap_freeze misled me. On Dec 17, 2007 1:39 PM, Heikki Linnakangas <[EMAIL PROTECTED]> wrote: > Gokulakannan Somasundaram wrote: > > a) When i was looking at the code for freezing heap tuples, i found out > the > > following. Wh

Re: [HACKERS] Proposal for Null Bitmap Optimization(for Trailing NULLs)

2007-12-17 Thread Gokulakannan Somasundaram
Thanks. I agree with you. -- Thanks, Gokul. CertoSQL Project, Allied Solution Group. (www.alliedgroups.com)

Re: [HACKERS] Proposal for Null Bitmap Optimization(for Trailing NULLs)

2007-12-17 Thread Gokulakannan Somasundaram
On Dec 17, 2007 3:28 PM, Simon Riggs <[EMAIL PROTECTED]> wrote: > On Mon, 2007-12-17 at 13:10 +0530, Gokulakannan Somasundaram wrote: > > > Currently we check for the existence of NULL values in the tuple > > and we set the has_null flag. If the has_null flag is present, the > > tuple will be

[HACKERS] ecxt_scantuple has wrong TupleDesc

2007-12-17 Thread peter . trautmeier
Hi all, I wonder why my ecxt_scantuple has a TupleDesc matching the subplan's tlist, not my plan's tlist. Basically, my question is what is x in econtext->ecxt_scantuple = x ? I have written a new executor node Foo, with corresponding ExecFoo and make_foo functions. I have also written a new E

Re: [HACKERS] Proposal for Null Bitmap Optimization(for Trailing NULLs)

2007-12-17 Thread Simon Riggs
On Mon, 2007-12-17 at 13:10 +0530, Gokulakannan Somasundaram wrote: > Currently we check for the existence of NULL values in the tuple > and we set the has_null flag. If the has_null flag is present, the > tuple will be storing a null bitmap. What i propose is Will this work for ALTER TABLE w

Re: [HACKERS] Proposal for Null Bitmap Optimization(for Trailing NULLs)

2007-12-17 Thread Gregory Stark
"Gokulakannan Somasundaram" <[EMAIL PROTECTED]> writes: > a) By modifying the functions, heap_form_tuple and heap_fill_tuple, we can > check whether all the nulls are trailing nulls. If all the nulls are > trailing nulls, then we will not set the has_null flag and we will not have > the null bitma

Re: [HACKERS] WORM and Read Only Tables (v0.1)

2007-12-17 Thread Simon Riggs
On Sat, 2007-12-15 at 13:32 +0100, Albert Cervera i Areny wrote: > > Read-Only Tables > > > > Postgres supports the concept of freezing tuples, so they can live > > forever within the database without needing further writes. Currently > > there is no command that will guarantee tha

Re: [HACKERS] standalone hot backup docs

2007-12-17 Thread Bruce Momjian
Andrew Dunstan wrote: > > The docs contain the following example of an archive_command for use > with standalone hot backup: > > test -f /var/lib/pgsql/backup_in_progress && cp -i %p > /var/lib/pgsql/archive/%f > Unfortunately, as I found out when I tried it, this command returns a > non

Re: [HACKERS] Requesting clarification on Vacuuming/Freezing behaviour

2007-12-17 Thread Heikki Linnakangas
Gokulakannan Somasundaram wrote: a) When i was looking at the code for freezing heap tuples, i found out the following. While freezing we log the complete block(not just the tuples we froze). b) Again after removing the dead tuples and fragmentation, we log the complete block. Umm, no we don't.

Re: [HACKERS] Proposal for Null Bitmap Optimization(for Trailing NULLs)

2007-12-17 Thread Gokulakannan Somasundaram
We can also implement the same for index tuples. On Dec 17, 2007 1:10 PM, Gokulakannan Somasundaram <[EMAIL PROTECTED]> wrote: > Hi, > Currently we check for the existence of NULL values in the tuple and > we set the has_null flag. If the has_null flag is present, the tuple will be > sto