[issue11405] Wrong reference to string module in tutorial/inputoutput.rst

2011-03-05 Thread Ezio Melotti

Ezio Melotti ezio.melo...@gmail.com added the comment:

That sentence should be changed to mention the str method rather than the 
deprecated functions in the string module.
(The methods' names after the example should also link to the right str.method

--
assignee: docs@python - ezio.melotti
keywords: +easy
nosy: +ezio.melotti
stage:  - needs patch

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11405
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11404] support /dev/null for subprocess.call() and friends

2011-03-05 Thread Ross Lagerwall

Ross Lagerwall rosslagerw...@gmail.com added the comment:

I think this is a duplicate of issue5870.

--
nosy: +rosslagerwall

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11404
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue5091] Segfault in PyObject_Malloc(), address out of bounds

2011-03-05 Thread Ryan Kelly

Ryan Kelly r...@rfk.id.au added the comment:

Not sure if it's caused by the same thing, but I just got a segfault on the 
same line in my own program.  Running python 2.7.1.

I will try to dig out some more useful info but it's been a long time since I 
chased a segfault...

--
nosy: +rfk
status: pending - open

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue5091
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11404] support /dev/null for subprocess.call() and friends

2011-03-05 Thread Ned Deily

Changes by Ned Deily n...@acm.org:


--
resolution:  - duplicate
stage:  - committed/rejected
status: open - closed
superseder:  - subprocess.DEVNULL

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11404
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue5870] subprocess.DEVNULL

2011-03-05 Thread Ned Deily

Changes by Ned Deily n...@acm.org:


--
nosy: +mmarkk

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue5870
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue5870] subprocess.DEVNULL

2011-03-05 Thread Santoso Wijaya

Changes by Santoso Wijaya santoso.wij...@gmail.com:


--
nosy: +santa4nt

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue5870
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11406] There is no os.listdir() equivalent returning generator instead of list

2011-03-05 Thread Марк Коренберг

New submission from Марк Коренберг socketp...@gmail.com:

Big dirs are really slow to read at once. If user wants to read items one by 
one like here:
--
for i in os.listdir()
use(i)
--
having generator will gain performance, as big directories often very 
fragmented on disk. Also, dir_cache in kernel used more effectively.

--
components: Library (Lib)
messages: 130111
nosy: mmarkk
priority: normal
severity: normal
status: open
title: There is no os.listdir() equivalent returning generator instead of list
type: performance
versions: Python 3.3

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11406
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11406] There is no os.listdir() equivalent returning generator instead of list

2011-03-05 Thread Martin v . Löwis

Martin v. Löwis mar...@v.loewis.de added the comment:

 Big dirs are really slow to read at once. 

Do you a proof for that claim? How big, and how really slow?

 for i in os.listdir()
 use(i)

Also, how long does use(i) take, and what reduction (in percent)
can you gain from listdir iterating?

In short, I'm skeptical that there is an actual problem to be solved here.

--
nosy: +loewis

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11406
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue5091] Segfault in PyObject_Malloc(), address out of bounds

2011-03-05 Thread Charles-Francois Natali

Charles-Francois Natali neolo...@free.fr added the comment:

Do you have a coredump ?
It'd be curious to see this faulting address.
I didn't notice the first time, but in the OP case the address is definitely 
wrong: 0xecc778b7 is above PAGE_OFFSET (0xc000 on x86), so unless he's 
using a kernel with a 4G/4G split (and it's not the case since it seems to be a 
PAE kernel), it's definitely an invalid/corrupt address...

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue5091
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11406] There is no os.listdir() equivalent returning generator instead of list

2011-03-05 Thread Марк Коренберг

Марк Коренберг socketp...@gmail.com added the comment:

also, forgot... memory usage on big directories using list is a pain.

This is the same things as range() and xrange(). Why not to add os.xlistdir() ?

P.S.
Numerical answers will be available later.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11406
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue5091] Segfault in PyObject_Malloc(), address out of bounds

2011-03-05 Thread Ryan Kelly

Ryan Kelly r...@rfk.id.au added the comment:

Please remind me how to obtain an appropriate coredump (as I said, it's been a 
*long* time...)

Doing print bp shows an out-of-bounds address as for the original submitter.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue5091
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue5091] Segfault in PyObject_Malloc(), address out of bounds

2011-03-05 Thread Ryan Kelly

Ryan Kelly r...@rfk.id.au added the comment:

attaching core dump from a freshly-compiled python 2.7.1 at with -O0 -g in 
CFLAGS.

The code that is segfaulting is using pycrypto and sqlite3, so it may be that a 
bug in one of these is trampling on something.  No idea how to investigate any 
further.

--
Added file: http://bugs.python.org/file21004/core.27778.bz2

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue5091
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue5091] Segfault in PyObject_Malloc(), address out of bounds

2011-03-05 Thread Charles-Francois Natali

Charles-Francois Natali neolo...@free.fr added the comment:

 The code that is segfaulting is using pycrypto and sqlite3, so it may be that 
 a bug in one of these is trampling on something.  No idea how to investigate 
 any further. 

You could try valgrind:
$ valgrind --tool=memcheck -o /tmp/output.log prog arguments

This slows down the execution, but can reveal certain types of memory 
corruption.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue5091
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11401] email.header error during .flatten()

2011-03-05 Thread Steffen Daode Nurpmeso

Steffen Daode Nurpmeso sdao...@googlemail.com added the comment:

 Changes by R. David Murray rdmur...@bitdance.com:
 assignee:  - r.david.murray

David, i'm sending you data to reproduce the error on your local 
machine!

Please create a test directory and place the files therein 
(an output.mbox will be created).  Just do

  mkdir -p issue_11401/input.mdir/{cur,new,tmp}
  mv issue_11401_mail.txt issue_11401/input.mdir/cur/test:2,S
  mv issue_11401_runner.py issue_11401/
  cd issue_11401
  python3 issue_11401_runner.py

(I'm looking forward for a glass of red wine, just in case we'll 
ever meet.-)

--
Added file: http://bugs.python.org/file21005/issue_11401_mail.txt
Added file: http://bugs.python.org/file21006/issue_11401_runner.py

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11401
___Return-Path: mail-nore...@google.com
X-Original-To: steffen
Delivered-To: steffen@sherwood.local
Received: by sherwood.local (Postfix, from userid 502)
id 0302C6F8D01; Wed,  5 Jan 2011 16:07:15 +0100 (CET)
MIME-Version: 1.0
Received: from gmail-pop.l.google.com [74.125.79.109]
by sherwood.local with POP3 (fetchmail-6.3.11)
for steffen@localhost (single-drop); Wed, 05 Jan 2011 16:07:15 +0100 
(CET)
Received: by 10.216.183.130; Mon, 25 Oct 2009 05:50:04 -0700 (PDT)
Date: Mon, 25 Oct 2009 05:50:04 -0700
Subject: Import your contacts and old email
From: Google Mail Team mail-nore...@google.com
To: Steffen Daode Nurpmeso sdao...@googlemail.com
Content-Type: multipart/alternative; boundary=0016e6db7cbd62d15c0493706eea
Content-Length: 2490
Lines: 70
Status: RO
X-Status: 
X-Keywords: 
X-UID: 2

--0016e6db7cbd62d15c0493706eea
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

You can import your contacts and mail from Yahoo!, Hotmail, AOL, and many
other web mail or POP accounts. If you want, we'll even keep importing your
mail for the next 30 days.
 Import contacts and mail
=BBhttps://mail.google.com/mail/#settings/accounts

We know it can be a pain to switch email accounts, and we hope this makes
the transition to Google Mail a bit easier.

- The Google Mail Team

Please note that importing is not available if you're using Internet
Explorer 6.0. To take advantage of the latest Google Mail features,
please upgrade
to a fully supported
browserhttp://mail.google.com/support/bin/answer.py?answer=3D6557hl=3Den=
utm_source=3Dwel-emlutm_medium=3Demlutm_campaign=3Den
.

--0016e6db7cbd62d15c0493706eea
Content-Type: text/html; charset=ISO-8859-1

html
font face=Arial, Helvetica, sans-serif
pYou can import your contacts and mail from Yahoo!, Hotmail, AOL, and many
other web mail or POP accounts. If you want, we'll even keep importing your
mail for the next 30 days./p

table cellpadding=0 cellspacing=0
col style=width: 1px /col /col style=width: 1px /
tr
  td/td
  td height=1px style=background-color: #ddd/td
  td/td
/tr
tr
  td style=background-color: #ddd/td
  td 
background=https://mail.google.com/mail/images/welcome-button-background.png;
  style=background-color: #ddd; background-repeat: repeat-x
a href=https://mail.google.com/mail/#settings/accounts;
style=font-weight: bold; color: #000; text-decoration: none; display: 
block; padding: 0.5em 1em
  Import contacts and mail #187;/a/td
  td style=background-color: #ddd/td
/tr
tr
  td/td
  td height=1px style=background-color: #ddd/td
  td/td
/tr
/table

pWe know it can be a pain to switch email accounts, and we hope this makes
the transition to Google Mail a bit easier./p

p- The Google Mail Team/p

pfont size=-2 color=#999Please note that importing is not available if
you're using Internet Explorer 6.0. To take advantage of the latest Google Mail
features, please
a 
href=http://mail.google.com/support/bin/answer.py?answer=6557hl=enutm_source=wel-emlutm_medium=emlutm_campaign=en;font
 color=#999
upgrade to a fully supported browser/font/a./font/p

/font
/html

--0016e6db7cbd62d15c0493706eea--
import sys
import mailbox

VERBOSE = 1
def log(*args):
if not VERBOSE:
return
print('| ' + ''.join(str(i) for i in args), file=sys.stderr)

class MailboxHelper:
@staticmethod
def open(path, type='mbox', create=False):
log('Opening ', type, ' mailbox ', path)
if type == 'mbox':
mb = mailbox.mbox
elif type == 'maildir':
mb = mailbox.Maildir
#try:
mb = mb(path, create=create)
#except Exception:
# FIXME throws IOError (Errno 21) if dispatch specified a dir but
# dod not set a dir-based type..
#panic('Failed to open ', path, extb=E())
return mb

msg = None

inmb = MailboxHelper.open('input.mdir', type='maildir', create=False)
try:
log('* Box has ', len(inmb),
' messages, filtering through rulesets')
cnt = 0
for k in inmb.iterkeys():
cnt += 1

[issue11401] email.header error during .flatten()

2011-03-05 Thread Steffen Daode Nurpmeso

Changes by Steffen Daode Nurpmeso sdao...@googlemail.com:


--
versions: +Python 3.2

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11401
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11344] Add height argument to os.path.dirname()

2011-03-05 Thread R. David Murray

R. David Murray rdmur...@bitdance.com added the comment:

Ah, yes, splitpath is a function I've occasionally wanted.  I also remember 
being surprised that os.path.split didn't return such a list.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11344
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11407] unittest.TestCase.run should return result

2011-03-05 Thread Michael Foord

New submission from Michael Foord mich...@voidspace.org.uk:

If you call TestCase.run without an argument it will create a default 
TestResult and use it to execute the test. It should return the result so that 
you can introspect it.

--
assignee: michael.foord
messages: 130120
nosy: michael.foord
priority: normal
severity: normal
status: open
title: unittest.TestCase.run should return result
type: behavior
versions: Python 3.3

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11407
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11407] unittest.TestCase.run should return result

2011-03-05 Thread Ezio Melotti

Changes by Ezio Melotti ezio.melo...@gmail.com:


--
nosy: +ezio.melotti

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11407
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11408] python locks: blocking acquire calls useless gettimeofday

2011-03-05 Thread Charles-Francois Natali

New submission from Charles-Francois Natali neolo...@free.fr:

While tracing a program using multiprocessing queues, I noticed that there were 
many calls to gettimeofday.
It turns out that acquire_timed, used by lock_PyThread_acquire_lock and 
rlock_acquire, always call gettimeofday, even if no timeout argument is given.
Here's an example of the performance impact (I know it's a contrived example 
:-):

$ cat /tmp/test_lock.py 
import threading

lock = threading.Lock()

i = 0

def do_loop():
global i
for j in range(50):
lock.acquire()
i += 1
lock.release()


t1 = threading.Thread(target=do_loop)
t2 = threading.Thread(target=do_loop)
t1.start()
t2.start()
t1.join()
t2.join()

With current code:
$ time ./python /tmp/test_lock.py 

real0m5.200s
user0m3.288s
sys 0m1.896s

Without useless calls to gettimeofday:
$ time ./python /tmp/test_lock.py 

real0m3.091s
user0m3.056s
sys 0m0.020s

Note that the actual gain depends on the kernel, hardware and clocksource in 
use (the above measurements are on a Linux 2.6.32 kernel, using acpi_pm as 
clocksource).

Attached is a patch removing useless calls to gettimeofday.
Note that I also removed the check for expired timeout following trylock in 
case of PY_LOCK_INTR, since according to 
http://pubs.opengroup.org/onlinepubs/009695399/functions/sem_wait.html,  it 
seems that only sem_wait is interruptible, not sem_trywait (e.g. on Linux, 
sem_trywait is implemented using futex which handle non-contended case in 
user-space). Windows locking primitives can't return PY_LOCK_INTR. Anyway, even 
if it happend once in a blue moon, we would just retry a trylock, which kind of 
makes sense.

--
files: lock_gettimeofday_py3k.diff
keywords: patch
messages: 130121
nosy: neologix, pitrou
priority: normal
severity: normal
status: open
title: python locks: blocking acquire calls useless gettimeofday
type: performance
Added file: http://bugs.python.org/file21007/lock_gettimeofday_py3k.diff

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11408
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11406] There is no os.listdir() equivalent returning generator instead of list

2011-03-05 Thread Andreas Stührk

Changes by Andreas Stührk andy-pyt...@hammerhartes.de:


--
nosy: +Trundle

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11406
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11340] test_distutils fails

2011-03-05 Thread Éric Araujo

Éric Araujo mer...@netwok.org added the comment:

Thanks for the report.  What is your OS name and exact version?

--
assignee:  - tarek
components: +Distutils -Tests
nosy: +eric.araujo, tarek

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11340
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11398] http_proxy on windows won't function due to incorrect case handling

2011-03-05 Thread chris nojima

chris nojima chrisnoj...@gmail.com added the comment:

Sorry. You are correct, this must have been fixed in 3.1.2. The box I was on 
had 3.1.1 on it and some other configuration issues led me to believe this was 
happening in 3.2 as well.

--
resolution:  - fixed
status: open - closed

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11398
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11060] distutils2 sdist does not complain about version that is not PEP 386 compliant

2011-03-05 Thread yeswanth

yeswanth swamiyeswa...@yahoo.com added the comment:

I am trying for unit tests here , but would need some assistance. I included a 
file here , please review that. first of all i am not able to access 
self.data['version'](shows an exception , here). suggest me a solution here .

--
Added file: http://bugs.python.org/file21008/help.txt

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11060
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11406] There is no os.listdir() equivalent returning generator instead of list

2011-03-05 Thread Antoine Pitrou

Antoine Pitrou pit...@free.fr added the comment:

A generator listdir() geared towards performance should probably be able to 
work in batches, e.g. read 100 entries at once and buffer them in some internal 
storage (that might mean use readdir_r()). Bonus points if it doesn't release 
the GIL around each individual entry, but also batches that.

--
nosy: +neologix, pitrou

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11406
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11340] test_distutils fails

2011-03-05 Thread Westley Martínez

Westley Martínez aniko...@gmail.com added the comment:

Arch Linux
kernel 2.6.37.2
glibc 2.13

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11340
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11409] pysetup --search should return non-zero when a dist is not installed and print a message stating the fact.

2011-03-05 Thread Kelsey

New submission from Kelsey kelsey.highto...@gmail.com:

I would like to make pysetup easier to work with when called from shell scripts 
or similar tools that wish to take action based on the exit code of the pysetup 
--search command. In this case return 0 if a match is found and 1 otherwise.

As an enhancement, print a message to stdout that the dist is not installed.

Example:

# pysetup -s Mako
Mako is not installed

# echo $?
1

Please review my patch in my d2 patch queue:
https://bitbucket.org/khightower/distutils2-patch-queue/qseries?apply=tqs_apply=pysetup-search

--
assignee: tarek
components: Distutils2
files: pysetup-search.patch
keywords: patch
messages: 130127
nosy: alexis, eric.araujo, kelseyhightower, tarek
priority: normal
severity: normal
status: open
title: pysetup --search should return non-zero when a dist is not installed and 
print a message stating the fact.
type: behavior
versions: 3rd party, Python 2.5, Python 2.6, Python 2.7, Python 3.1, Python 
3.2, Python 3.3
Added file: http://bugs.python.org/file21009/pysetup-search.patch

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11409
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11406] There is no os.listdir() equivalent returning generator instead of list

2011-03-05 Thread Giampaolo Rodola'

Changes by Giampaolo Rodola' g.rod...@gmail.com:


--
nosy: +giampaolo.rodola

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11406
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11397] os.path.realpath() may produce incorrect results

2011-03-05 Thread Giampaolo Rodola'

Changes by Giampaolo Rodola' g.rod...@gmail.com:


--
nosy: +giampaolo.rodola

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11397
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11409] pysetup --search should return non-zero when a dist is not installed and print a message stating the fact.

2011-03-05 Thread Tarek Ziadé

Tarek Ziadé ziade.ta...@gmail.com added the comment:

pysetup is currently under heavy refactoring -- see the  
https://bitbucket.org/tarek/distutils2-new-cmdline clone if you want to help on 
this.

I am planning to merge it before the release, this week.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11409
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11406] There is no os.listdir() equivalent returning generator instead of list

2011-03-05 Thread Charles-Francois Natali

Charles-Francois Natali neolo...@free.fr added the comment:

 Big dirs are really slow to read at once. If user wants to read items one by 
 one like here

The problem is that readdir doesn't read a directory entry one at a time.
When you call readdir on an open DIR * for the first time, the libc calls the 
getdents syscall, requesting a whole bunch of dentry at a time (32768 on my 
box).
Then, the subsequent readdir calls are virtually free, and don't involve any 
syscall/IO at all (that is, until you hit the last cached dent, and then 
another getdents is performed until end of directory).

 Also, dir_cache in kernel used more effectively.

You mean the dcache ? Could you elaborate ?

 also, forgot... memory usage on big directories using list is a pain.

This would indeed be a good reason. Do you have numbers ?

 A generator listdir() geared towards performance should probably be able to 
 work in batches, e.g. read 100 entries at once and buffer them in some 
 internal storage (that might mean use readdir_r()).

That's exactly what readdir is doing :-)

 Bonus points if it doesn't release the GIL around each individual entry, but 
 also batches that.

Yes, since only one in 2**15 readdir call actually blocks, that could be a nice 
optimization (I've no idea of the potential gain though).

 Big dirs are really slow to read at once.

Are you using EXT3 ?
There are records of performance issues with getdents on EXT2/3 filesystems, 
see:
http://lwn.net/Articles/216948/
and this nice post by Linus:
https://lkml.org/lkml/2007/1/7/149

Could you provide the output of an strace -ttT python test script  (and 
also the time spent in os.listdir) ?

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11406
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11409] pysetup --search should return non-zero when a dist is not installed and print a message stating the fact.

2011-03-05 Thread Kelsey

Kelsey kelsey.highto...@gmail.com added the comment:

I will take a look, thanks.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11409
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11409] pysetup --search should return non-zero when a dist is not installed and print a message stating the fact.

2011-03-05 Thread Kelsey

Kelsey kelsey.highto...@gmail.com added the comment:

Updated patch based on the distutils2-new-cmdline repo

https://bitbucket.org/khightower/distutils2-new-cmdline-mq/qseries?apply=tqs_apply=pysetup-search-nonzero

--
Added file: http://bugs.python.org/file21010/pysetup-search-new-cmds.patch

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11409
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11397] os.path.realpath() may produce incorrect results

2011-03-05 Thread Wojciech Muła

Wojciech Muła wojciech_m...@poczta.onet.pl added the comment:

Confirmed in python3.2.

Lib/posixpath.py/_resolve_link: path returned by readlink
is normalized by normpath. In this case readlink('zlink')
returns 'xlink/../blink', then normpath is called, and
returns 'blink'. This ends processing because 'blink'
isn't a link.

I've attached procedure that does [IMHO] correct symlink
resolution (this is just proof-of-concept, it is slow and
doesn't deal with cyclic links).

--
nosy: +wm
versions: +Python 3.2
Added file: http://bugs.python.org/file21011/poc.py

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11397
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11397] os.path.realpath() may produce incorrect results

2011-03-05 Thread Santoso Wijaya

Changes by Santoso Wijaya santoso.wij...@gmail.com:


--
nosy: +santa4nt

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11397
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11395] print(s) fails on Windows with long strings

2011-03-05 Thread Santoso Wijaya

Santoso Wijaya santoso.wij...@gmail.com added the comment:

And a patch for the test + fix.

--
Added file: http://bugs.python.org/file21012/wconsole_large.patch

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11395
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11391] mmap write segfaults if PROT_WRITE bit is not set in prot

2011-03-05 Thread Antoine Pitrou

Antoine Pitrou pit...@free.fr added the comment:

Following error on the OpenIndiana buildbot:

test test_mmap failed -- Traceback (most recent call last):
  File 
/export/home/buildbot/32bits/3.1.cea-indiana-x86/build/Lib/test/test_mmap.py, 
line 242, in test_access_parameter
m = mmap.mmap(f.fileno(), mapsize, prot=~mmap.PROT_WRITE)
mmap.error: [Errno 13] Permission denied

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11391
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11395] print(s) fails on Windows with long strings

2011-03-05 Thread Santoso Wijaya

Santoso Wijaya santoso.wij...@gmail.com added the comment:

 Indeed, Python3.1 fails with the -u option.

I'm also attaching another test to reproduce the crash with '-u' option.

--
Added file: http://bugs.python.org/file21013/test_wconsole_binlarge.patch

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11395
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11391] mmap write segfaults if PROT_WRITE bit is not set in prot

2011-03-05 Thread Antoine Pitrou

Antoine Pitrou pit...@free.fr added the comment:

Buildbot failure should be fixed in e3eaf7dbb2b4.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11391
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11391] mmap write segfaults if PROT_WRITE bit is not set in prot

2011-03-05 Thread Antoine Pitrou

Antoine Pitrou pit...@free.fr added the comment:

Merged in 92ab79ca4eeb, f9f9662dfb1f, 2e4468841c4c. Thank you!

--
resolution:  - fixed
stage: patch review - committed/rejected
status: open - closed
versions: +Python 3.1

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11391
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue1724822] provide a shlex.split alternative for Windows shell syntax

2011-03-05 Thread Philip Jenvey

Philip Jenvey pjen...@underboss.org added the comment:

The code I linked to above implements those semantics in pure Python. It 
follows Microsoft's Parsing C Command-Line Arguments rules like 
CommandLineToArgvW does

Here's updated links, the older links seemed to have broken:

https://fisheye3.atlassian.com/browse/jython/trunk/jython/Lib/subprocess.py?r=6636#to566

tests: 
https://fisheye3.atlassian.com/browse/jython/trunk/jython/Lib/test/test_subprocess_jy.py?r=6464#to41

This code is basically the inverse of subprocess's list2cmdline

I don't mind incorporating this code into the stdlib, but we need to figure out 
where it would go. There was a discussion on stdlib-sig last year related to 
this topic, about the need for quoting and unquoting command lines.

We have some of this functionality for posix systems scattered throughout shlex 
and the pipes module, and then there's subprocess.list2cmdline. I think we 
could use a new module with all this functionality in one place.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue1724822
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue2771] test issue

2011-03-05 Thread Ned Deily

Ned Deily n...@acm.org added the comment:

Testing legacy svn references here (r88479) and new hg references here (67980) 
and here (284026e00342).

--
nosy: +ned.deily -ezio.melotti

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue2771
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue2771] test issue

2011-03-05 Thread Ned Deily

Ned Deily n...@acm.org added the comment:

Testing legacy svn references here r88479 and new hg references here 
284026e00342.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue2771
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue2771] test issue

2011-03-05 Thread Ned Deily

Changes by Ned Deily n...@acm.org:


--
Removed message: http://bugs.python.org/msg130139

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue2771
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue2771] test issue

2011-03-05 Thread Ned Deily

Changes by Ned Deily n...@acm.org:


--
Removed message: http://bugs.python.org/msg130140

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue2771
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue2771] test issue

2011-03-05 Thread Ned Deily

Changes by Ned Deily n...@acm.org:


--
nosy:  -ned.deily

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue2771
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11060] distutils2 sdist does not complain about version that is not PEP 386 compliant

2011-03-05 Thread yeswanth

yeswanth swamiyeswa...@yahoo.com added the comment:

is there any default version in pep 386?

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11060
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue2771] test issue

2011-03-05 Thread Ezio Melotti

Changes by Ezio Melotti ezio.melo...@gmail.com:


--
nosy: +ezio.melotti

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue2771
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11410] Use GCC visibility attrs in PyAPI_*

2011-03-05 Thread Thomas Wouters

New submission from Thomas Wouters tho...@python.org:

This patch adds support for the GCC visibility attributes to the PyAPI_* macros 
(currently only used for Windows.) GCC's default visibility is 'public', but 
can be changed to 'hidden' with the '-fvisibility=hidden' argument; see 
http://gcc.gnu.org/wiki/Visibility. This patch does not make the build use 
that, it merely makes Python function correctly when the default visibility 
*is* changed. (The benefit of building Python with -fvisibility=hidden is very 
small, as it causes only a handful of symbols to not be exported. When 
embedding Python, though, this can make a lot of difference.)

The patch also fixes a few modules that don't use PyMODINIT_FUNC for their 
module-init function definitions, like they should.

--
files: gcc-visibility.diff
keywords: needs review, patch
messages: 130143
nosy: twouters
priority: normal
severity: normal
status: open
title: Use GCC visibility attrs in PyAPI_*
Added file: http://bugs.python.org/file21014/gcc-visibility.diff

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11410
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11410] Use GCC visibility attrs in PyAPI_*

2011-03-05 Thread Thomas Wouters

Thomas Wouters tho...@python.org added the comment:

This patch adds support for the GCC visibility attributes to the PyAPI_* macros 
(currently only used for Windows.) GCC's default visibility is 'public', but 
can be changed to 'hidden' with the '-fvisibility=hidden' argument; see 
http://gcc.gnu.org/wiki/Visibility. This patch does not make the build use 
that, it merely makes Python function correctly when the default visibility 
*is* changed. (The benefit of building Python with -fvisibility=hidden is very 
small, as it causes only a handful of symbols to not be exported. When 
embedding Python, though, this can make a lot of difference.)

The patch also fixes a few modules that don't use PyMODINIT_FUNC for their 
module-init function definitions, like they should.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11410
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11410] Use GCC visibility attrs in PyAPI_*

2011-03-05 Thread Thomas Wouters

Changes by Thomas Wouters tho...@python.org:


--
Removed message: http://bugs.python.org/msg130144

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11410
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11410] Use GCC visibility attrs in PyAPI_*

2011-03-05 Thread Thomas Wouters

Thomas Wouters tho...@python.org added the comment:

Uploaded to Rietveld, too: http://codereview.appspot.com/4260052/

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11410
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11411] Fix typo in Makefile

2011-03-05 Thread Thomas Wouters

New submission from Thomas Wouters tho...@python.org:

Fix a (double) typo in the Makefile, which prevents 'make 
DESTDIR=relative/path' from working correctly.

--
files: destdir.diff
keywords: easy, needs review, patch
messages: 130146
nosy: twouters
priority: normal
severity: normal
status: open
title: Fix typo in Makefile
Added file: http://bugs.python.org/file21015/destdir.diff

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11411
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11412] Section numbers in the Library Reference have a trailing period

2011-03-05 Thread Raymond Hettinger

New submission from Raymond Hettinger rhettin...@users.sourceforge.net:

The section headings all look like this:

 4.11. Other Built-in Types
 4.11.1. Modules
 ...

http://docs.python.org/dev/library/stdtypes.html#classes-and-class-instances

It looks like there is one dot to many

--
assignee: georg.brandl
components: Documentation
messages: 130147
nosy: georg.brandl, rhettinger
priority: normal
severity: normal
status: open
title: Section numbers in the Library Reference have a trailing period
type: behavior

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11412
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11408] python locks: blocking acquire calls useless gettimeofday

2011-03-05 Thread Antoine Pitrou

Antoine Pitrou pit...@free.fr added the comment:

Pushed in 6ba9ba58499e, thank you.

--
resolution:  - fixed
stage:  - committed/rejected
status: open - closed
versions: +Python 3.3

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11408
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com