Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-14 Thread Radosław Smogura

On Thu, 14 Jul 2011 15:15:33 +0300, Peter Eisentraut wrote:

On sön, 2011-07-10 at 11:40 -0700, Josh Berkus wrote:

Hackers,

 B. 6. Current behaviour _is intended_ (there is if  to check 
node type) and _natural_. In this particular case user ask for text 
content of some node, and this content is actually .


 I don't buy that. The check for the node type is there because
 two different libxml functions are used to convert nodes to
 strings. The if has absolutely *zero* to do with escaping, expect
 for that missing escape_xml() call in the else case.

 Secondly, there is little point in having an type XML if we
 don't actually ensure that values of that type can only contain
 well-formed XML.

Can anyone else weigh in on this? Peter?


Looks like a good change to me.
I'll bump it in few hours, as I can't recall password from keyring. Now 
I have hands clean and it's not my business to care about this.


Best regards.
Radek.


--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-14 Thread Peter Eisentraut
On ons, 2011-07-13 at 11:58 +0200, Nicolas Barbier wrote:
 2011/6/29, Florian Pflug f...@phlo.org:
 
  Secondly, there is little point in having an type XML if we
  don't actually ensure that values of that type can only contain
  well-formed XML.
 
 +1. The fact that XPATH() must return a type that cannot depend on the
 given expression (even if it is a constant string) may be unfortunate,
 but returning XML-that-is-not-quite-XML sounds way worse to me.

The example given was

XPATH('/*/text()', 'rootlt;/root')

This XPath expression returns a node set, and XML is a serialization
format of a node, so returning xml[] in this particular case seems
entirely reasonable to me.


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-14 Thread Peter Eisentraut
On sön, 2011-07-10 at 11:40 -0700, Josh Berkus wrote:
 Hackers,
 
  B. 6. Current behaviour _is intended_ (there is if  to check node type) 
  and _natural_. In this particular case user ask for text content of some 
  node, and this content is actually .
  
  I don't buy that. The check for the node type is there because
  two different libxml functions are used to convert nodes to
  strings. The if has absolutely *zero* to do with escaping, expect
  for that missing escape_xml() call in the else case.
  
  Secondly, there is little point in having an type XML if we
  don't actually ensure that values of that type can only contain
  well-formed XML.
 
 Can anyone else weigh in on this? Peter?

Looks like a good change to me.


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-13 Thread Radosław Smogura

On Tue, 12 Jul 2011 11:11:40 -0700, Josh Berkus wrote:

Radoslaw,

For me this discussion is over. I putted my objections and 
suggestions. Full
review is available in archives, and why to not escape is putted in 
review

of your 2nd patch, about scalar values.


Did you install and test the functionality of the patch?  I can't 
tell

from your review whether you got that far.


Yas, patch was tested, and applied. I think in both reviews I marked 
that patch does this what Florain said. Examples of double escaping were 
taken from one of patch (I think from this about scalar values).


If I should I will bump this patches up.

Regards,
Radosław Smogura

--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-13 Thread Nicolas Barbier
2011/6/29, Florian Pflug f...@phlo.org:

 Secondly, there is little point in having an type XML if we
 don't actually ensure that values of that type can only contain
 well-formed XML.

+1. The fact that XPATH() must return a type that cannot depend on the
given expression (even if it is a constant string) may be unfortunate,
but returning XML-that-is-not-quite-XML sounds way worse to me.

Nicolas

-- 
A. Because it breaks the logical sequence of discussion.
Q. Why is top posting bad?

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-12 Thread Radosław Smogura

On Sun, 10 Jul 2011 17:06:22 -0500, Robert Haas wrote:

On Jul 10, 2011, at 1:40 PM, Josh Berkus j...@agliodbs.com wrote:


Hackers,

B. 6. Current behaviour _is intended_ (there is if  to check 
node type) and _natural_. In this particular case user ask for 
text content of some node, and this content is actually .


I don't buy that. The check for the node type is there because
two different libxml functions are used to convert nodes to
strings. The if has absolutely *zero* to do with escaping, expect
for that missing escape_xml() call in the else case.

Secondly, there is little point in having an type XML if we
don't actually ensure that values of that type can only contain
well-formed XML.


Can anyone else weigh in on this? Peter?


Unless I am missing something, Florian  is clearly correct here.

...Robert
For me not, because this should be fixed internally by making xml type 
sefe, currently xml type may be used to keep proper XMLs and any kind of 
data, as well.


If I ask, by any means select xpath(/text(...)). I want to get 
text.
1) How I should descape node in client application (if it's part of xml 
I don't have header), bear in mind XML must give support for streaming 
processing too.
2) Why I should differntly treat text() then select from varchar in 
both I ask for xml, driver can't make this, because it doesn't know if 
it gets scalar, text, comment, element, or maybe document.
3) What about current applications, folks probably uses this and are 
happy they get text, and will not see, that next release of PostgreSQL 
will break their applications.


There is of course disadvantage of current behaviour as it may lead to 
inserting badly xmls (in one case), but I created example when auto 
escaping will create double escaped xmls, and may lead to insert 
inproper data (this is about 2nd patch where Florian add escaping, too).


SELECT XMLELEMENT(name root, XMLATTRIBUTES(foo.namespace AS sth)) FROM 
(SELECT
(XPATH('namespace-uri(/*)', x))[1] AS namespace FROM (VALUES 
(XMLELEMENT(name
root, XMLATTRIBUTES('n' AS xmlns, 'v' AS value),'t'))) v(x)) as 
foo;


   xmlelement
-
 root sth=amp;lt;n/

It can't be resolved without storing type in xml or adding xmltext or 
adding pseudo xmlany element, which will be returned by xpath.


Regards,
Radek

--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-12 Thread Florian Pflug
On Jul12, 2011, at 11:00 , Radosław Smogura wrote:
 On Sun, 10 Jul 2011 17:06:22 -0500, Robert Haas wrote:
 Unless I am missing something, Florian  is clearly correct here.
 For me not, because this should be fixed internally by making xml type sefe

Huh??. Making the xml type safe is *exactly* what I'm trying to do here...

 currently xml type may be used to keep proper XMLs and any kind of data, as 
 well.

As I pointed out before, that simply isn't true. Try storing
non-well-formed data into an XML column (there *are* ways to do
that, i.e. there are bugs, one if which I'm trying to fix here!)
and then dump and (try to) reload your database. Ka-wom!

 If I ask, by any means select xpath(/text(...)). I want to get text.

And I want '3' || '4' to return the integer 34. Though luck! The fact that
XPATH() is declared to return XML, *not* TEXT means you don't get what you
want. Period. Feel free to provide a patch that adds a function XPATH_TEXT
if you feel this is an issue.

XML *is* *not* simply an alias for TEXT! It's a distinct type, which its
down distinct rules about what constitutes a valid value and what doesn't.

 1) How I should descape node in client application (if it's part of xml I 
 don't have header), bear in mind XML must give support for streaming 
 processing too.

Huh?

 2) Why I should differntly treat text() then select from varchar in both I 
 ask for xml, driver can't make this, because it doesn't know if it gets 
 scalar, text, comment, element, or maybe document.

 3) What about current applications, folks probably uses this and are happy 
 they get text, and will not see, that next release of PostgreSQL will break 
 their applications.

That, and *only* that, I recognize as a valid concern. However, and *again*
as I have pointer out before a *multiple* of times, backwards compatibility
is no excuse not to fix bugs. Plus, there might just as well be applications
which feed the contents of XML columns directly into a XML parser (as they
have every right to!) and don't expect that parser to throw an error. Which,
as it stands, we cannot guarantee. Having to deal with an error there is akin
to having to deal with integer columns containing 'foobar'!

 There is of course disadvantage of current behaviour as it may lead to 
 inserting badly xmls (in one case), but I created example when auto escaping 
 will create double escaped xmls, and may lead to insert inproper data (this 
 is about 2nd patch where Florian add escaping, too).
 
 SELECT XMLELEMENT(name root, XMLATTRIBUTES(foo.namespace AS sth)) FROM (SELECT
 (XPATH('namespace-uri(/*)', x))[1] AS namespace FROM (VALUES (XMLELEMENT(name
 root, XMLATTRIBUTES('n' AS xmlns, 'v' AS value),'t'))) v(x)) as foo;
 
   xmlelement
 -
 root sth=amp;lt;n/

Radosław, you've raised that point before, and I refuted it. The crucial
difference is that double-escaped values are well-formed, where as un-escaped
ones are not.

Again, as I said before, the double-escaping done by XMLATTRIBUTES there is
not pretty. But its *not* XPATH()'s fault!. To see that, simply replace your
XPATH() expression with 'lt;n'::xml to see that.

And in fact

 It can't be resolved without storing type in xml or adding xmltext or adding 
 pseudo xmlany element, which will be returned by xpath.

Huh?

Frankly, Radosław, I get the feeling that you're not trying to understand my
answers to your objections, but instead keep repeating the same assertions
over and over again. Even though at least some of them, like XML being able to
store arbitrary values, are simply wrong! And I'm getting pretty tired of 
this...
So far, you also don't seem to have taken a single look at the actual
implementation of the patch, even though code review is an supposed to be an
integral part of the patch review process. I therefore don't believe that we're
getting anywhere here.

So please either start reviewing the actual implementation, and leave
the considerations about whether we want this or not to the eventual committer.
Or, if you don't want to do that for one reason or another, pleaser consider
letting somebody else take over this review, i.e. consider removing your name
from the Reviewer field.

best regards,
Florian Pflug


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-12 Thread Radosław Smogura

On Tue, 12 Jul 2011 11:45:59 +0200, Florian Pflug wrote:

On Jul12, 2011, at 11:00 , Radosław Smogura wrote:

On Sun, 10 Jul 2011 17:06:22 -0500, Robert Haas wrote:

Unless I am missing something, Florian  is clearly correct here.
For me not, because this should be fixed internally by making xml 
type sefe


Huh??. Making the xml type safe is *exactly* what I'm trying to do 
here...


currently xml type may be used to keep proper XMLs and any kind of 
data, as well.


As I pointed out before, that simply isn't true. Try storing
non-well-formed data into an XML column (there *are* ways to do
that, i.e. there are bugs, one if which I'm trying to fix here!)
and then dump and (try to) reload your database. Ka-wom!

If I ask, by any means select xpath(/text(...)). I want to get 
text.


And I want '3' || '4' to return the integer 34. Though luck! The fact 
that
XPATH() is declared to return XML, *not* TEXT means you don't get 
what you
want. Period. Feel free to provide a patch that adds a function 
XPATH_TEXT

if you feel this is an issue.

XML *is* *not* simply an alias for TEXT! It's a distinct type, which 
its
down distinct rules about what constitutes a valid value and what 
doesn't.


1) How I should descape node in client application (if it's part of 
xml I don't have header), bear in mind XML must give support for 
streaming processing too.


Huh?

2) Why I should differntly treat text() then select from varchar in 
both I ask for xml, driver can't make this, because it doesn't know if 
it gets scalar, text, comment, element, or maybe document.


3) What about current applications, folks probably uses this and are 
happy they get text, and will not see, that next release of PostgreSQL 
will break their applications.


That, and *only* that, I recognize as a valid concern. However, and 
*again*
as I have pointer out before a *multiple* of times, backwards 
compatibility
is no excuse not to fix bugs. Plus, there might just as well be 
applications
which feed the contents of XML columns directly into a XML parser (as 
they
have every right to!) and don't expect that parser to throw an error. 
Which,
as it stands, we cannot guarantee. Having to deal with an error there 
is akin

to having to deal with integer columns containing 'foobar'!


Bugs must be resolved in smart way, especially if they changes 
behaviour, with consideration of impact change will produce, removing 
support for xml resolves this bug as well. I've said problem should be 
resolved in different way.


There is of course disadvantage of current behaviour as it may lead 
to inserting badly xmls (in one case), but I created example when auto 
escaping will create double escaped xmls, and may lead to insert 
inproper data (this is about 2nd patch where Florian add escaping, 
too).


SELECT XMLELEMENT(name root, XMLATTRIBUTES(foo.namespace AS sth)) 
FROM (SELECT
(XPATH('namespace-uri(/*)', x))[1] AS namespace FROM (VALUES 
(XMLELEMENT(name
root, XMLATTRIBUTES('n' AS xmlns, 'v' AS value),'t'))) v(x)) as 
foo;


  xmlelement
-
root sth=amp;lt;n/


Radosław, you've raised that point before, and I refuted it. The 
crucial
difference is that double-escaped values are well-formed, where as 
un-escaped

ones are not.

Again, as I said before, the double-escaping done by XMLATTRIBUTES 
there is
not pretty. But its *not* XPATH()'s fault!. To see that, simply 
replace your

XPATH() expression with 'lt;n'::xml to see that.

And in fact

It can't be resolved without storing type in xml or adding xmltext 
or adding pseudo xmlany element, which will be returned by xpath.


Huh?

Frankly, Radosław, I get the feeling that you're not trying to 
understand my
answers to your objections, but instead keep repeating the same 
assertions

over and over again. Even though at least some of them, like XML
being able to
store arbitrary values, are simply wrong! And I'm getting pretty
tired of this...
So far, you also don't seem to have taken a single look at the actual
implementation of the patch, even though code review is an supposed 
to be an

integral part of the patch review process. I therefore don't believe
that we're
getting anywhere here.
So far, you don't know if I taken a single look, your suspicious are 
wrong, and You try to blame me. All of your sentences about do not 
understanding I may sent to you, and blame you with your words.



So please either start reviewing the actual implementation, and leave
the considerations about whether we want this or not to the eventual
committer.
Or, if you don't want to do that for one reason or another, pleaser 
consider
letting somebody else take over this review, i.e. consider removing 
your name

from the Reviewer field.


If I do review I may put my comments, but I get the feeling that 
you're not trying to understand my
answers to your objections, but instead keep repeating the same 
assertions over and over again. - and in patch there is review of code.
So please either 

Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-12 Thread Florian Pflug
On Jul12, 2011, at 12:57 , Radosław Smogura wrote:
 On Tue, 12 Jul 2011 11:45:59 +0200, Florian Pflug wrote:
 On Jul12, 2011, at 11:00 , Radosław Smogura wrote:
 On Sun, 10 Jul 2011 17:06:22 -0500, Robert Haas wrote:
 Unless I am missing something, Florian  is clearly correct here.
 For me not, because this should be fixed internally by making xml type sefe
 
 Huh??. Making the xml type safe is *exactly* what I'm trying to do here...
 
 currently xml type may be used to keep proper XMLs and any kind of data, as 
 well.
 
 As I pointed out before, that simply isn't true. Try storing
 non-well-formed data into an XML column (there *are* ways to do
 that, i.e. there are bugs, one if which I'm trying to fix here!)
 and then dump and (try to) reload your database. Ka-wom!

You again very conveniently ignored me here, and thus the *fact*
that XML *doesn't* allow arbitrary textual values to be stored.
If it did, there would not be a Ka-wom! here.

I beg you to actually try this out. Put the result of an XPATH()
expression that returns a literal '' into a column of type XML,
and dump and reload.

 If I ask, by any means select xpath(/text(...)). I want to get text.
 
 And I want '3' || '4' to return the integer 34. Though luck! The fact that
 XPATH() is declared to return XML, *not* TEXT means you don't get what you
 want. Period. Feel free to provide a patch that adds a function XPATH_TEXT
 if you feel this is an issue.
 
 XML *is* *not* simply an alias for TEXT! It's a distinct type, which its
 down distinct rules about what constitutes a valid value and what doesn't.

Again, you ignored my answer.

 3) What about current applications, folks probably uses this and are happy
 they get text, and will not see, that next release of PostgreSQL will break
 their applications.
 
 That, and *only* that, I recognize as a valid concern. However, and *again*
 as I have pointer out before a *multiple* of times, backwards compatibility
 is no excuse not to fix bugs. Plus, there might just as well be applications
 which feed the contents of XML columns directly into a XML parser (as they
 have every right to!) and don't expect that parser to throw an error. Which,
 as it stands, we cannot guarantee. Having to deal with an error there is akin
 to having to deal with integer columns containing 'foobar'!
 
 Bugs must be resolved in smart way, especially if they changes behaviour, with
 consideration of impact change will produce, removing support for xml resolves
 this bug as well. I've said problem should be resolved in different way.

Fine. So what does that different way look like? Keeping things as they are
is certainly not an option, since it failed as soon as you dump and reload
(Or simply cast the value to TEXT and back to XML).

 There is of course disadvantage of current behaviour as it may lead to
 inserting badly xmls (in one case), but I created example when auto escaping
 will create double escaped xmls, and may lead to insert inproper data (this
 is about 2nd patch where Florian add escaping, too).
 
 SELECT XMLELEMENT(name root, XMLATTRIBUTES(foo.namespace AS sth)) FROM 
 (SELECT
 (XPATH('namespace-uri(/*)', x))[1] AS namespace FROM (VALUES 
 (XMLELEMENT(name
 root, XMLATTRIBUTES('n' AS xmlns, 'v' AS value),'t'))) v(x)) as foo;
 
  xmlelement
 -
 root sth=amp;lt;n/
 
 Radosław, you've raised that point before, and I refuted it. The crucial
 difference is that double-escaped values are well-formed, where as un-escaped
 ones are not.
 
 Again, as I said before, the double-escaping done by XMLATTRIBUTES there is
 not pretty. But its *not* XPATH()'s fault!. To see that, simply replace your
 XPATH() expression with 'lt;n'::xml to see that.

And here too I see no response from you...

 Frankly, Radosław, I get the feeling that you're not trying to understand my
 answers to your objections, but instead keep repeating the same assertions
 over and over again. Even though at least some of them, like XML
 being able to
 store arbitrary values, are simply wrong! And I'm getting pretty
 tired of this...
 So far, you also don't seem to have taken a single look at the actual
 implementation of the patch, even though code review is an supposed to be an
 integral part of the patch review process. I therefore don't believe
 that we're
 getting anywhere here.
 So far, you don't know if I taken a single look, your suspicious are wrong, 
 and
 You try to blame me.

Well, you haven't commented on the code, so assumed that you haven't
look at it. May I instead assume that you did look at it, and found the
patch to be in good shape, implementation-wise?

 All of your sentences about do not understanding I may
 sent to you, and blame you with your words.

I think I have so far provided quite detailed responses to all of your
concerns. If no, please point me to one of your concerns where I haven't
either acknowledged that there is a problem, or have explained quite detailed
why there is none.

 So 

Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-12 Thread Josh Berkus
Radoslaw,

 For me this discussion is over. I putted my objections and suggestions. Full
 review is available in archives, and why to not escape is putted in review
 of your 2nd patch, about scalar values.

Did you install and test the functionality of the patch?  I can't tell
from your review whether you got that far.

-- 
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-12 Thread Josh Berkus
Florian, Radoslaw,

Please both of you calm down.  Florian is trying to improve our XML
type.  Radoslaw is trying to help out by reviewing it.  It's not a
benefit to anyone for you two to get into an argument about who said
what ... especially if the argument is based on (as far as I can see)
not understanding what the other person was saying.

Answering What did you mean by X?  Did you mean Y, or something else?
is much more friendly than saying You couldn't possibly mean X or You
don't understand X.  Consider that *both* of you are exchanging emails
in a language which is native to neither of you.

This goes for all discussions on -hackers, but your recent conversation
is a good example of unnecessary argument.

-- 
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-10 Thread Josh Berkus
Hackers,

 B. 6. Current behaviour _is intended_ (there is if  to check node type) 
 and _natural_. In this particular case user ask for text content of some 
 node, and this content is actually .
 
 I don't buy that. The check for the node type is there because
 two different libxml functions are used to convert nodes to
 strings. The if has absolutely *zero* to do with escaping, expect
 for that missing escape_xml() call in the else case.
 
 Secondly, there is little point in having an type XML if we
 don't actually ensure that values of that type can only contain
 well-formed XML.

Can anyone else weigh in on this? Peter?


-- 
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-10 Thread Robert Haas
On Jul 10, 2011, at 1:40 PM, Josh Berkus j...@agliodbs.com wrote:

 Hackers,
 
 B. 6. Current behaviour _is intended_ (there is if  to check node type) 
 and _natural_. In this particular case user ask for text content of some 
 node, and this content is actually .
 
 I don't buy that. The check for the node type is there because
 two different libxml functions are used to convert nodes to
 strings. The if has absolutely *zero* to do with escaping, expect
 for that missing escape_xml() call in the else case.
 
 Secondly, there is little point in having an type XML if we
 don't actually ensure that values of that type can only contain
 well-formed XML.
 
 Can anyone else weigh in on this? Peter?

Unless I am missing something, Florian  is clearly correct here.

...Robert
-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


[HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-06-29 Thread Radosław Smogura
Review of patch 
https://commitfest.postgresql.org/action/patch_view?id=580


=== Patch description ===
SUMMARY: When text() based XPATH expression is invoked output is not XML 
escaped


DESCRIPTION: Submitter invokes following statement:
SELECT (XPATH('/*/text()', 'rootlt;/root'))[1].
He expect (escaped) result lt;, but gets 

AFFECTS: Possible this may affects situations when user wants to insert output 
from above expression to XML column.


PATCH CONTENT:
A. 1. Patch fixes above problem (I don't treat this like problem, but like 
enhancement).

A. 2. In addition patch contains test cases for above.
A. 3. Patch changes behaviour of method xml_xmlnodetoxmltype invoked by 
xpath_internal, by adding escape_xml() call.

A. 4. I don't see any stability issues with this.
A. 5. Performance may be reduced and memory consumption may 
increase due to internals of method escape_xml


=== Review ===
B. 1. Patch applies cleanly.

B. 2. Source compiles, and patch works as Submitter wants.

B. 3. Personally I missed some notes in documentation that such 
expression will be escaped (those should be clearly exposed, as the live 
functionality is changed).


B. 4. Submitter, possible, revealed some missed, minor functionality of 
PostgreSQL XML. As he expects XML escaped output.


B. 5. Currently XPATH produces escaped output for Element nodes, and 
not escaped output for all other types of nodes (including text, 
comment, etc.)


B. 6. Current behaviour _is intended_ (there is if  to check node type) 
and _natural_. In this particular case user ask for text content of some 
node, and this content is actually .


B. 7. Similar behaviour may be observer e. g. in SQL Server(tm)
SELECT x.value('(//text())[1]', 'varchar(256)') FROM #xml_t;
Produced 

B. 8. Even if current behaviour may be treated as wrong it was exposed 
and other may depends on not escaped content.


B. 9. I think, correct approach should go to create new function 
(basing on one existing) that will be able to escape above. In this 
situation

call should look like (for example only!):
SELECT xml_escape((XPATH('/*/text()', 'rootlt;/root')))[1]
or
SELECT xml_escape((XPATH('/*/text()', 'rootlt;/root'))[1])
One method to operate on array one to operate on single XML datum.
Or to think about something like xmltext(). (Compare current status of xml.c)

B. 10. If such function (B.9.) is needed and if it will be included is out of 
scope of this review.


Basing mainly on A.1, B.6., B.8., bearing in mind B.10., in my opinion this is 
subject to reject as need more work, or as invalid.


The detailed explanation why such behaviour should not be implemented I will 
send in review of https://commitfest.postgresql.org/action/patch_view?id=565.


Regards,

Radosław Smogura

P. S.
I would like to say sorry, for such late answaer, but I sent this from other 
mail address, which was not attached to mailing list. Blame KDE KMail not me 
:)


--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-06-29 Thread Florian Pflug
On Jun29, 2011, at 19:34 , Radosław Smogura wrote:
 B. 6. Current behaviour _is intended_ (there is if  to check node type) and 
 _natural_. In this particular case user ask for text content of some node, 
 and this content is actually .

I don't buy that. The check for the node type is there because
two different libxml functions are used to convert nodes to
strings. The if has absolutely *zero* to do with escaping, expect
for that missing escape_xml() call in the else case.

Secondly, there is little point in having an type XML if we
don't actually ensure that values of that type can only contain
well-formed XML.

 B. 7. Similar behaviour may be observer e. g. in SQL Server(tm)
 SELECT x.value('(//text())[1]', 'varchar(256)') FROM #xml_t;
 Produced 

Whats the *type* of that value? I'm not familiar with the XPATH
support in SQL Server, but since you pass 'varchar(256)' as
the second parameter, I assume that this is how you tell it
the return type you want. Since you chose a textual type, not
quoting the value is perfectly fine. I suggest that you try
this again, but this time evaluate the XPATH expression so
that you get a value of type XML (Assuming such a type exists
in SQL Server)

 B. 8. Even if current behaviour may be treated as wrong it was exposed and 
 other may depends on not escaped content.

Granted, there's the possibility of breaking existing applications
here. But the same argument could have been applied when we made
check against invalid characters (e.g. invalid UTF-8 byte sequences)
tighter for textual types.

When it comes to data integrity (and non-well-formed values in
XML columns are a data integrity issue), I believe that the advantages
of tighter checks out-weight potential compatibility problems.

 B. 9. I think, correct approach should go to create new function (basing on 
 one existing) that will be able to escape above. In this situation
 call should look like (for example only!):
 SELECT xml_escape((XPATH('/*/text()', 'rootlt;/root')))[1]
 or
 SELECT xml_escape((XPATH('/*/text()', 'rootlt;/root'))[1])
 One method to operate on array one to operate on single XML datum.
 Or to think about something like xmltext(). (Compare current status of xml.c)

-1. Again, value of type XML should always be well-formed XML.
Requiring every future user of posgres XML support to remember
to surround XPATH() calls with XML_ESCAPE() will undoubtedly lead
to bugs.

I'm all for having escaping and un-escaping functions though,
but these *need* to have the signatures

  XML_ESCAPE(text) RETURNS xml
  XML_UNESCAPE(XML) RETURNS text

best regards,
Florian Pflug

PS: Next time, please post your Review as a follow-up of the mail
that contains the patch. That makes sure that people who already
weighted in on the issue don't overlook your review. Or, the
patch author, for that matter - I nearly missed your Review between
the larger number of mail in my postgres folder.


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers