[PATCHES] SPI function to investigate query semantics

2004-12-01 Thread Thomas Hallgren
Here's a patch containing the function SPI_iterate_query_roots(...). I'm 
optimistic so it's complete with documentation :-)

I think that this function is needed so that PL/lang authors like 
myself have a way to investigate the semantics of a prepared query. For 
me this is essential since I want to prevent that savepoint related 
statements are executed using normal SQL so that I can enforce the use 
of the methods stipulated by the connection interface.

I forsee that this might be of interest for other PL/lang authors as 
well. With this patch in place, it will be possible to do things like 
this (returning false is rejecting in this case since false terminates 
the iteration):

static bool rejectTransactionCommand(Query* query, void* clientData)
{
   return !(query-commandType == CMD_UTILITY 
   IsA(query-utilityStmt, TransactionStmt));
}
and then use that like:
   result = !SPI_iterate_query_roots(ePlan, rejectTransactionCommand, 
NULL);

The patch has no side effects since it's a pure addon.
Kind regards,
Thomas Hallgren
Index: doc/src/sgml/spi.sgml
===
RCS file: /projects/cvsroot/pgsql/doc/src/sgml/spi.sgml,v
retrieving revision 1.35
diff -u -r1.35 spi.sgml
--- doc/src/sgml/spi.sgml   13 Sep 2004 20:05:25 -  1.35
+++ doc/src/sgml/spi.sgml   1 Dec 2004 19:05:28 -
@@ -1305,6 +1305,82 @@
 
 !-- *** --
 
+refentry id=spi-spi-iterate-query-roots
+ refmeta
+  refentrytitleSPI_iterate_query_roots/refentrytitle
+ /refmeta
+
+ refnamediv
+  refnameSPI_iterate_query_roots/refname
+  refpurposeinvestigate the semantics of a query/refpurpose
+ /refnamediv
+
+ indextermprimarySPI_iterate_query_roots/primary/indexterm
+
+ refsynopsisdiv
+synopsis
+bool SPI_iterate_query_roots(void * parameterplan/parameter, QueryVisitor 
parametercallback/parameter, void * parameterclientData/parameter)
+/synopsis
+ /refsynopsisdiv
+
+ refsect1
+  titleDescription/title
+
+  para
+The functionSPI_iterate_query_roots/function will invoke the
+symbolqueryVisitor/symbol callback once for each top level
+symbolQuery/symbol found in the supplied execution plan.
+The iteration is cancelled when a callback returns symbolfalse/symbol.
+If no callback returns symbolfalse/symbol, or if the plan is
+symbolNULL/symbol, the function returns symboltrue/symbol.
+  /para
+ /refsect1
+
+ refsect1
+  titleArguments/title
+
+  variablelist
+   varlistentry
+termliteralvoid * parameterplan/parameter/literal/term
+listitem
+ para
+  execution plan (returned by functionSPI_prepare/function)
+ /para
+/listitem
+   /varlistentry
+
+   varlistentry
+termliteralQueryVisitor 
parametercallback/parameter/literal/term
+listitem
+ para
+  the callback to invoke for each query found
+ /para
+/listitem
+   /varlistentry
+
+   varlistentry
+termliteralvoid * parameterclientData/parameter/literal/term
+listitem
+ para
+  user defined data that will be passed on to the callback
+ /para
+/listitem
+   /varlistentry
+  /variablelist
+ /refsect1
+
+ refsect1
+  titleReturn Value/title
+  para
+symboltrue/symbol when all callbacks returned symboltrue/symbol or
+symbolfalse/symbol when a callback returned symbolfalse/symbol and
+thus terminated the iteration.
+  /para
+ /refsect1
+/refentry
+
+!-- *** --
+
 refentry id=spi-spi-cursor-find
  refmeta
   refentrytitleSPI_cursor_find/refentrytitle
Index: src/backend/executor/spi.c
===
RCS file: /projects/cvsroot/pgsql/src/backend/executor/spi.c,v
retrieving revision 1.132
diff -u -r1.132 spi.c
--- src/backend/executor/spi.c  16 Nov 2004 18:10:13 -  1.132
+++ src/backend/executor/spi.c  1 Dec 2004 19:05:29 -
@@ -1064,6 +1064,42 @@
return false;
 }
 
+/**
+ * Invokes the queryVisitor callback for each top level Query found in an
+ * execution plan. The iteration is cancelled when a callback returns
+ * false. If no callbacks returns false, or if the plan is NULL, this
+ * function returns true.
+ *
+ * Arguments:
+ * plan  An ExecutionPlan created by SPI_prepare
+ * queryVisitor  The callback function
+ * clientDataUser defined data that will be passed on to the callback
+ * Returns: true if the plan is NULL or if all callback invocation returns true
+ */
+bool
+SPI_iterate_query_roots(void *plan, QueryVisitor queryVisitor, void 
*clientData)
+{
+   _SPI_plan *spiplan = (_SPI_plan *) plan;
+
+   if (spiplan != NULL)
+   {
+   ListCell *query_list_list_item;
+   List *query_list_list = spiplan-qtlist;
+   foreach(query_list_list_item, query_list_list)
+   {
+   List *query_list = lfirst(query_list_list_item);
+   ListCell 

Re: [PATCHES] SPI function to investigate query semantics

2004-12-01 Thread Thomas Hallgren
Tom Lane wrote:
We haven't got one that will work from inside arbitrary functions ---
DefineSavepoint and friends don't get it done by themselves, but
expect you to call CommitTransactionCommand/StartTransactionCommand,
and those functions tend to pull the rug out from under the executor.
(I seem to recall trying to do it that way in the first attempt on
plpgsql, and running into all kinds of memory management issues.)
The existing PLs use BeginInternalSubTransaction,
ReleaseCurrentSubTransaction, RollbackAndReleaseCurrentSubTransaction,
but these are subset implementations only suited for
exception-block-structured code.
 

Thanks. I'll check that out and try to figure out how to use it.
What are the future plans? For me it would work really well with 
something like

Savepoint SPI_savepoint(const char* name);
void SPI_releaseSavepoint(Savepoint sp);
void SPI_rollbackSavepoint(Savepoint sp);
The Savepoint structure could then hold information about call level 
etc. needed to ensure proper behaviour when nesting.

Regards,
Thomas Hallgren
---(end of broadcast)---
TIP 7: don't forget to increase your free space map settings


Re: [PATCHES] SPI function to investigate query semantics

2004-12-01 Thread Tom Lane
Thomas Hallgren [EMAIL PROTECTED] writes:
 What are the future plans?

I haven't got any at the moment ;-).  It would make sense to think about
extending the SPI API along the lines you suggest, but I really am not
clear on the implications.  Right at the moment I'm focused on trying to
push 8.0 out the door ...

regards, tom lane

---(end of broadcast)---
TIP 9: the planner will ignore your desire to choose an index scan if your
  joining column's datatypes do not match


Re: [PATCHES] SPI function to investigate query semantics

2004-12-01 Thread Tom Lane
Thomas Hallgren [EMAIL PROTECTED] writes:
 I think that this function is needed so that PL/lang authors like 
 myself have a way to investigate the semantics of a prepared query.

Which you will do what with?  I'm not sure I see the point of treating
_SPI_plan as an opaque type while assuming you know what to do with a
Query.

 For me this is essential since I want to prevent that savepoint related 
 statements are executed using normal SQL so that I can enforce the use 
 of the methods stipulated by the connection interface.

You do realize that SPI_execute will reject TransactionStmt anyway?
The example is therefore not very compelling ...

regards, tom lane

---(end of broadcast)---
TIP 5: Have you checked our extensive FAQ?

   http://www.postgresql.org/docs/faqs/FAQ.html


Re: [PATCHES] SPI function to investigate query semantics

2004-12-01 Thread Thomas Hallgren
Tom Lane wrote:
Looks pretty rejectish to me...
			regards, tom lane
 

Arrghh.
Forget my patch. It's not possible to set savepoints at all using SPI! 
Here I was, thinking that only begin/commit/rollback was rejected (I 
trusted the documentation and did not dive into the code).

A patch is needed for the documentation to clarify this :-)
So what *is* the appropriate way of  starting, releasing, and rolling 
back savepoints then?

Regards,
Thomas Hallgren

---(end of broadcast)---
TIP 6: Have you searched our list archives?
  http://archives.postgresql.org


Re: [PATCHES] SPI function to investigate query semantics

2004-12-01 Thread Thomas Hallgren
Tom Lane wrote:
You do realize that SPI_execute will reject TransactionStmt anyway?
The example is therefore not very compelling ...
 

It won't reject savepoint related statements and that's what the example 
is for.

I want savepoints rejected unless they go through a specific method 
found on my connection object. From current discussions it seems similar 
functionality might be needed for other PL's.

Regards,
Thomas Hallgren
---(end of broadcast)---
TIP 6: Have you searched our list archives?
  http://archives.postgresql.org


Re: [PATCHES] SPI function to investigate query semantics

2004-12-01 Thread Tom Lane
Thomas Hallgren [EMAIL PROTECTED] writes:
 Tom Lane wrote:
 You do realize that SPI_execute will reject TransactionStmt anyway?
 The example is therefore not very compelling ...
 
 It won't reject savepoint related statements and that's what the example 
 is for.

Really?

if (queryTree-commandType == CMD_UTILITY)
{
...
else if (IsA(queryTree-utilityStmt, TransactionStmt))
{
res = SPI_ERROR_TRANSACTION;
goto fail;
}
}

Looks pretty rejectish to me...

regards, tom lane

---(end of broadcast)---
TIP 4: Don't 'kill -9' the postmaster


Re: [PATCHES] SPI function to investigate query semantics

2004-12-01 Thread Thomas Hallgren
Tom Lane wrote:
Which you will do what with?  I'm not sure I see the point of treating
_SPI_plan as an opaque type while assuming you know what to do with a
Query.
 

What's different in that compared to the methods that use a Snapshot? 
The fact that I provided documentation? If so, ok remove the docs.

Regards,
Thomas Hallgren
---(end of broadcast)---
TIP 4: Don't 'kill -9' the postmaster


Re: [PATCHES] SPI function to investigate query semantics

2004-12-01 Thread Tom Lane
Thomas Hallgren [EMAIL PROTECTED] writes:
 So what *is* the appropriate way of  starting, releasing, and rolling 
 back savepoints then?

We haven't got one that will work from inside arbitrary functions ---
DefineSavepoint and friends don't get it done by themselves, but
expect you to call CommitTransactionCommand/StartTransactionCommand,
and those functions tend to pull the rug out from under the executor.
(I seem to recall trying to do it that way in the first attempt on
plpgsql, and running into all kinds of memory management issues.)

The existing PLs use BeginInternalSubTransaction,
ReleaseCurrentSubTransaction, RollbackAndReleaseCurrentSubTransaction,
but these are subset implementations only suited for
exception-block-structured code.

regards, tom lane

---(end of broadcast)---
TIP 3: if posting/reading through Usenet, please send an appropriate
  subscribe-nomail command to [EMAIL PROTECTED] so that your
  message can get through to the mailing list cleanly