Re: mod_python 3.2.3b available for testing

2005-10-25 Thread Jim Gallacher

Nick wrote:

More info:

python 2.4.2 on Linux:
  import tempfile
  t = tempfile.TemporaryFile()
  t
open file 'fdopen', mode 'w+b' at 0xb7df07b8
  type(t)
type 'file'
  dir(t)
['__class__', '__delattr__', '__doc__', '__getattribute__', '__hash__', 
'__init__', '__iter__', '__new__', '__reduce__', '__reduce_ex__', 
'__repr__', '__setattr__', '__str__', 'close', 'closed', 'encoding', 
'fileno', 'flush', 'isatty', 'mode', 'name', 'newlines', 'next', 'read', 
'readinto', 'readline', 'readlines', 'seek', 'softspace', 'tell', 
'truncate', 'write', 'writelines', 'xreadlines']


python 2.4.1 on windows:
  import tempfile
  t = tempfile.TemporaryFile()
  t
open file 'fdopen', mode 'w+b' at 0x0099FBA8
  type(t)
type 'instance'
  dir(t)
['__doc__', '__getattr__', '__init__', '__module__', '__repr__', 
'close_called', 'file', 'name']


So this is an inconsistency within Python.  Should mod_python attempt to 
correct it, or just claim a Python bug?


I think we should correct it. I'm sure users don't care that we 
implement this with TemporaryFile. That being said, I wonder how many 
applications on Windows we may break by fixing this? Version 3.1.4 also 
used TemporaryFile, so this is not a new bug.


Jim


Nick wrote:


This may be a Python Windows thing, but it shows up in mod_python:

When using util.FieldStorage on multipart/form-data encoded POST data 
containing a file, in Linux a field.file will yield a file object 
(actually a subclass of file), but in Windows you have to get the file 
object through field.file.file.  This probably has something to do 
with the fact that Windows' implementation of tempfile.TemporaryFile 
is different from Linux, but it should be made consistent in the 
mod_python interface.


Nick


Re: mod_python 3.2.3b available for testing

2005-10-25 Thread Nick

Jim Gallacher wrote:
So this is an inconsistency within Python.  Should mod_python attempt 
to correct it, or just claim a Python bug?


I think we should correct it. I'm sure users don't care that we 
implement this with TemporaryFile. That being said, I wonder how many 
applications on Windows we may break by fixing this? Version 3.1.4 also 
used TemporaryFile, so this is not a new bug.


Yeah, I never noticed it either until someone pointed it out to me.  I 
appreciated the change to TemporaryFile, but being primarily a Linux user I 
never noticed that this broke my code in Windows.


In any case, I'm still gonna have to implement a workaround in my own code 
to catch people using the different versions of mod_python out there, so I 
can live with whatever decision you guys make.  But here's +1 for making the 
interface consistent at least for mod_python users.  As for code breakage, I 
would consider this a bug introduced in 3.1.4, which was the last official 
release of mod_python, which will be corrected in release 3.3.


Nick


Re: mod_python 3.2.3b available for testing

2005-10-25 Thread Jorey Bump

Jim Gallacher wrote:

Nick wrote:


More info:

python 2.4.2 on Linux:
  import tempfile
  t = tempfile.TemporaryFile()
  t
open file 'fdopen', mode 'w+b' at 0xb7df07b8
  type(t)
type 'file'
  dir(t)
['__class__', '__delattr__', '__doc__', '__getattribute__', 
'__hash__', '__init__', '__iter__', '__new__', '__reduce__', 
'__reduce_ex__', '__repr__', '__setattr__', '__str__', 'close', 
'closed', 'encoding', 'fileno', 'flush', 'isatty', 'mode', 'name', 
'newlines', 'next', 'read', 'readinto', 'readline', 'readlines', 
'seek', 'softspace', 'tell', 'truncate', 'write', 'writelines', 
'xreadlines']


python 2.4.1 on windows:
  import tempfile
  t = tempfile.TemporaryFile()
  t
open file 'fdopen', mode 'w+b' at 0x0099FBA8
  type(t)
type 'instance'
  dir(t)
['__doc__', '__getattr__', '__init__', '__module__', '__repr__', 
'close_called', 'file', 'name']


So this is an inconsistency within Python.  Should mod_python attempt 
to correct it, or just claim a Python bug?



I think we should correct it. I'm sure users don't care that we 
implement this with TemporaryFile. That being said, I wonder how many 
applications on Windows we may break by fixing this? Version 3.1.4 also 
used TemporaryFile, so this is not a new bug.


Are you sure there is anything to correct? In both cases, the object has 
the same methods available for manipulating files (t.write('a'), for 
example). They are not the same type of object, so they have different 
dir() output, but don't they have the same functionality? What 
specifically gets broken in util.FieldStorage?






Re: mod_python 3.2.3b available for testing

2005-10-25 Thread Jim Gallacher

Nick wrote:

Jim Gallacher wrote:

So this is an inconsistency within Python.  Should mod_python attempt 
to correct it, or just claim a Python bug?



I think we should correct it. I'm sure users don't care that we 
implement this with TemporaryFile. That being said, I wonder how many 
applications on Windows we may break by fixing this? Version 3.1.4 
also used TemporaryFile, so this is not a new bug.



Yeah, I never noticed it either until someone pointed it out to me.  I 
appreciated the change to TemporaryFile, but being primarily a Linux 
user I never noticed that this broke my code in Windows.


In any case, I'm still gonna have to implement a workaround in my own 
code to catch people using the different versions of mod_python out 
there, so I can live with whatever decision you guys make.  But here's 
+1 for making the interface consistent at least for mod_python users.  
As for code breakage, I would consider this a bug introduced in 3.1.4, 
which was the last official release of mod_python, which will be 
corrected in release 3.3.


You may have misunderstood. I was not suggesting that 
tempfile.TemporaryFile was introduced in 3.1.4, only that it existed 
there. Looking at the svn repository I see it's used in 3.0.0-beta and 
2.7.9, so this bug has been lurking for a while. ;)


Regards,
Jim


Re: mod_python 3.2.3b available for testing

2005-10-25 Thread Nick

Jim Gallacher wrote:
You may have misunderstood. I was not suggesting that 
tempfile.TemporaryFile was introduced in 3.1.4, only that it existed 
there. Looking at the svn repository I see it's used in 3.0.0-beta and 
2.7.9, so this bug has been lurking for a while. ;)


Yes, although the fact that the implementation of TemporaryFile changed in 
Python 2.3 may have something to do with it.  I honestly don't remember what 
the previous behavior was, but it worked OK for me at one time :)


Nick


Re: mod_python 3.2.3b available for testing

2005-10-25 Thread Jim Gallacher

Indrek Järve wrote:
This behaviour has been with Python for quite a while, so claiming it's 
simply a Python bug will be the same as declaring we don't support Windows.


Our company's software that runs on Windows and uses mod_python simply 
patches util.py with the following change:

227c227
 if isinstance(item.file, FileType):
---
  if isinstance(item.file, FileType) or 
(hasattr(item.file, 'file') and isinstance(item.file.file, FileType)):


I haven't tried this with mp32 yet (we're still running on Python 2.3 
and I haven't had time to investigate how to compile mp on Windows), but 
on 3.0/3.1 it appears to work just fine for our customers.


The relevant part of FieldStorage has changed in 3.2.

 isinstance(item.file, FileType) or \
isinstance(getattr(item.file, 'file', None), FileType):

so no more patching for you! Now I just need to understand what Nick is 
on about. ;)


Jim



Nick wrote:


More info:

python 2.4.2 on Linux:
 import tempfile
 t = tempfile.TemporaryFile()
 t
open file 'fdopen', mode 'w+b' at 0xb7df07b8
 type(t)
type 'file'
 dir(t)
['__class__', '__delattr__', '__doc__', '__getattribute__', 
'__hash__', '__init__', '__iter__', '__new__', '__reduce__', 
'__reduce_ex__', '__repr__', '__setattr__', '__str__', 'close', 
'closed', 'encoding', 'fileno', 'flush', 'isatty', 'mode', 'name', 
'newlines', 'next', 'read', 'readinto', 'readline', 'readlines', 
'seek', 'softspace', 'tell', 'truncate', 'write', 'writelines', 
'xreadlines']


python 2.4.1 on windows:
 import tempfile
 t = tempfile.TemporaryFile()
 t
open file 'fdopen', mode 'w+b' at 0x0099FBA8
 type(t)
type 'instance'
 dir(t)
['__doc__', '__getattr__', '__init__', '__module__', '__repr__', 
'close_called', 'file', 'name']


So this is an inconsistency within Python.  Should mod_python attempt 
to correct it, or just claim a Python bug?


Nick

Nick wrote:


This may be a Python Windows thing, but it shows up in mod_python:

When using util.FieldStorage on multipart/form-data encoded POST data 
containing a file, in Linux a field.file will yield a file object 
(actually a subclass of file), but in Windows you have to get the 
file object through field.file.file.  This probably has something to 
do with the fact that Windows' implementation of 
tempfile.TemporaryFile is different from Linux, but it should be made 
consistent in the mod_python interface.


Nick


Re: mod_python 3.2.3b available for testing

2005-10-25 Thread Jim Gallacher

Jorey Bump wrote:

Jim Gallacher wrote:


Nick wrote:


More info:

python 2.4.2 on Linux:
  import tempfile
  t = tempfile.TemporaryFile()
  t
open file 'fdopen', mode 'w+b' at 0xb7df07b8
  type(t)
type 'file'
  dir(t)
['__class__', '__delattr__', '__doc__', '__getattribute__', 
'__hash__', '__init__', '__iter__', '__new__', '__reduce__', 
'__reduce_ex__', '__repr__', '__setattr__', '__str__', 'close', 
'closed', 'encoding', 'fileno', 'flush', 'isatty', 'mode', 'name', 
'newlines', 'next', 'read', 'readinto', 'readline', 'readlines', 
'seek', 'softspace', 'tell', 'truncate', 'write', 'writelines', 
'xreadlines']


python 2.4.1 on windows:
  import tempfile
  t = tempfile.TemporaryFile()
  t
open file 'fdopen', mode 'w+b' at 0x0099FBA8
  type(t)
type 'instance'
  dir(t)
['__doc__', '__getattr__', '__init__', '__module__', '__repr__', 
'close_called', 'file', 'name']


So this is an inconsistency within Python.  Should mod_python attempt 
to correct it, or just claim a Python bug?




I think we should correct it. I'm sure users don't care that we 
implement this with TemporaryFile. That being said, I wonder how many 
applications on Windows we may break by fixing this? Version 3.1.4 
also used TemporaryFile, so this is not a new bug.



Are you sure there is anything to correct? In both cases, the object has 
the same methods available for manipulating files (t.write('a'), for 
example). They are not the same type of object, so they have different 
dir() output, but don't they have the same functionality? What 
specifically gets broken in util.FieldStorage?


No, I'm not sure. Now that I play around with it I'm not sure I 
understand the problem at all. Perhaps Nick could elaborate?


Testing with python3.2.3 on Wine:

 import tempfile
 from types import *
 t = tempfile.TemporaryFile()
 t
open file 'fdopen', mode 'w+b' at 0x40D6A560
 t.file
open file 'fdopen', mode 'w+b' at 0x40D6A560
 t.write('stuff')
 t.seek(0)
 t.read()
 isinstance(t, FileType)
False

Other than the fact that isinstance(t, FileType): returns False, I 
don't see the problem. Nick?


Jim