[issue34010] tarfile stream read performance

2018-07-03 Thread hajoscher


hajoscher  added the comment:

Yes, it performance is really bad for large files, and memory consumption as 
well.  I will write something for NEWS.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34038] urllib2.urlopen fails if http_proxy(s) is set to a sock5 proxy

2018-07-03 Thread T L


New submission from T L :

Changing the urlopen call to a curl commnand invoke works.

$ export http_proxy=socks5://127.0.0.1: https_proxy=socks5://127.0.0.1:

# this will raise an exception with string representation is a blank string
# at least for url: 
https://s3.amazonaws.com/mozilla-games/emscripten/packages/llvm/tag/linux_64bit/emscripten-llvm-e1.37.35.tar.gz

from urllib2 import urlopen, HTTPError

u = urlopen(url)
mkdir_p(os.path.dirname(file_name))
with open(file_name, 'wb') as f:
  file_size = get_content_length(u)
  if file_size > 0: print("Downloading: %s from %s, %s Bytes" % (file_name, 
url, file_size))
  else: print("Downloading: %s from %s" % (file_name, url))

  file_size_dl = 0
  block_sz = 8192
  while True:
  buffer = u.read(block_sz)
  if not buffer:
  break

  file_size_dl += len(buffer)
  f.write(buffer)


# this alternative way works

import commands

status, output = commands.getstatusoutput("curl -L --output " + file_name + 
" " + url)

--
components: Library (Lib)
messages: 321010
nosy: T L2
priority: normal
severity: normal
status: open
title: urllib2.urlopen fails if http_proxy(s) is set to a sock5 proxy
type: behavior
versions: Python 2.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33418] Memory leaks in functions

2018-07-03 Thread INADA Naoki


Change by INADA Naoki :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions:  -Python 2.7, Python 3.6, Python 3.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33418] Memory leaks in functions

2018-07-03 Thread INADA Naoki


INADA Naoki  added the comment:


New changeset 3c452404ae178b742967589a0bb4a5ec768d76e0 by INADA Naoki in branch 
'master':
bpo-33418: Add tp_clear for function object (GH-8058)
https://github.com/python/cpython/commit/3c452404ae178b742967589a0bb4a5ec768d76e0


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34031] [EASY] Incorrect usage of unittest.TestCase in test_urllib2_localnet

2018-07-03 Thread Bradley Laney


Bradley Laney  added the comment:

Hey again @pablogsal. Thanks for reviewing the email issue again. I'll try to 
fix and submit a PR for this if that's ok.

--
nosy: +Bradley Laney

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue32710] test_asyncio: ProactorEventLoopTests.test_sendfile_close_peer_in_middle_of_receiving() leaked [4, 4, 3] memory blocks on AMD64 Windows8.1 Refleaks 3.x

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:

See also bpo-33735: my commit 23401fb960bb94e6ea62d2999527968d53d3fc65 fixes a 
false alarm in regrtest when hunting leaks in test_multiprocessing_spawn or 
test_multiprocessing_forkserver.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue32710] test_asyncio: ProactorEventLoopTests.test_sendfile_close_peer_in_middle_of_receiving() leaked [4, 4, 3] memory blocks on AMD64 Windows8.1 Refleaks 3.x

2018-07-03 Thread STINNER Victor


Change by STINNER Victor :


--
title: test_asyncio leaked [4, 4, 3] memory blocks, sum=11 on AMD64 Windows8.1 
Refleaks 3.x -> test_asyncio: 
ProactorEventLoopTests.test_sendfile_close_peer_in_middle_of_receiving() leaked 
[4, 4, 3] memory blocks on AMD64 Windows8.1 Refleaks 3.x

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34037] test_asyncio: test_run_in_executor_cancel() leaked a dangling thread on AMD64 FreeBSD 10.x Shared 3.7

2018-07-03 Thread STINNER Victor


New submission from STINNER Victor :

AMD64 FreeBSD 10.x Shared 3.7:
http://buildbot.python.org/all/#/builders/124/builds/410

...
test_remove_fds_after_closing 
(test.test_asyncio.test_events.KqueueEventLoopTests) ... ok
test_run_in_executor (test.test_asyncio.test_events.KqueueEventLoopTests) ... ok
test_run_in_executor_cancel 
(test.test_asyncio.test_events.KqueueEventLoopTests) ...

  Warning -- threading_cleanup() failed to cleanup 1 threads (count: 1, 
dangling: 2)
  Dangling thread: 
  Dangling thread: <_MainThread(MainThread, started 34393318400)>

ok
test_run_until_complete (test.test_asyncio.test_events.KqueueEventLoopTests) 
... ok
test_run_until_complete_nesting 
(test.test_asyncio.test_events.KqueueEventLoopTests) ... ok
...
1 test altered the execution environment:
test_asyncio

--
components: Tests, asyncio
messages: 321006
nosy: asvetlov, vstinner, yselivanov
priority: normal
severity: normal
status: open
title: test_asyncio: test_run_in_executor_cancel() leaked a dangling thread on 
AMD64 FreeBSD 10.x Shared 3.7
versions: Python 3.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue16822] execv (et al.) should invoke atexit handlers before executing new code

2018-07-03 Thread Eric Snow


Change by Eric Snow :


--
nosy: +emilyemorehouse, eric.snow

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33944] Deprecate and remove pth files

2018-07-03 Thread Eric Snow


Eric Snow  added the comment:

@barry, make sure you take a look at https://bugs.python.org/issue14803.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33720] test_marshal: crash in Python 3.7b5 on Windows 10

2018-07-03 Thread Serhiy Storchaka


Change by Serhiy Storchaka :


--
pull_requests: +7681

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue24596] Script globals in a GC cycle not finalized when exiting with SystemExit

2018-07-03 Thread Antoine Pitrou


Change by Antoine Pitrou :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue24596] Script globals in a GC cycle not finalized when exiting with SystemExit

2018-07-03 Thread Antoine Pitrou


Antoine Pitrou  added the comment:


New changeset e1ebf51f76037b7e02711aaeb9bf66c9147f4c74 by Antoine Pitrou (Miss 
Islington (bot)) in branch '3.6':
bpo-24596: Decref module in PyRun_SimpleFileExFlags() on SystemExit (GH-7918) 
(GH-8069)
https://github.com/python/cpython/commit/e1ebf51f76037b7e02711aaeb9bf66c9147f4c74


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue24596] Script globals in a GC cycle not finalized when exiting with SystemExit

2018-07-03 Thread Antoine Pitrou


Antoine Pitrou  added the comment:


New changeset 20ae4c60258479a0732d12af292f422679444e2c by Antoine Pitrou (Miss 
Islington (bot)) in branch '3.7':
bpo-24596: Decref module in PyRun_SimpleFileExFlags() on SystemExit (GH-7918) 
(GH-8070)
https://github.com/python/cpython/commit/20ae4c60258479a0732d12af292f422679444e2c


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue29708] support reproducible Python builds

2018-07-03 Thread Bernhard M. Wiedemann


Bernhard M. Wiedemann  added the comment:

also related to this topic: https://github.com/pypa/pip/pull/5525 for pip's 
RECORD file.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue24596] Script globals in a GC cycle not finalized when exiting with SystemExit

2018-07-03 Thread miss-islington


Change by miss-islington :


--
pull_requests: +7680

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue24596] Script globals in a GC cycle not finalized when exiting with SystemExit

2018-07-03 Thread miss-islington


Change by miss-islington :


--
pull_requests: +7679

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue24596] Script globals in a GC cycle not finalized when exiting with SystemExit

2018-07-03 Thread Antoine Pitrou


Antoine Pitrou  added the comment:


New changeset d8cba5d16f1333fd625726fc72e66afbd45b8d00 by Antoine Pitrou 
(Zackery Spytz) in branch 'master':
bpo-24596: Decref module in PyRun_SimpleFileExFlags() on SystemExit (GH-7918)
https://github.com/python/cpython/commit/d8cba5d16f1333fd625726fc72e66afbd45b8d00


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34034] Python 3.7.0 multiprocessing forkserver ForkingPickler behaviour change

2018-07-03 Thread Antoine Pitrou


Antoine Pitrou  added the comment:

It could be many different things.  The bottom line here, though, is that the 
Process class is not designed to be picklable (how would it work?), which is 
probably why you're seeing this.

--
nosy: +pitrou

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34035] zipfile: AttributeError in "seek" method of "_SharedFile" class

2018-07-03 Thread Evgeny Prilepin


Evgeny Prilepin  added the comment:

I think the line 1031 also contains the misprint and will raise NameError.

> self._decompressor = zipfile._get_decompressor(self._compress_type)

"zipfile." is not correct code in this place.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34036] ModuleNotFoundError: No module named '_ctypes' when install Python 3.7 on Linux

2018-07-03 Thread Semyon Levin


New submission from Semyon Levin :

make install failed with
  File 
"/tmp/tmp2gwe2ma_/pip-10.0.1-py2.py3-none-any.whl/pip/_internal/utils/glibc.py",
 line 3, in 
  File "/common/dev/slevin/tools/Python-3.7.0/Lib/ctypes/__init__.py", line 7, 
in 
from _ctypes import Union, Structure, Array
ModuleNotFoundError: No module named '_ctypes'
make: *** [install] Error 1

I used PKG_CONFIG_PATH in config and LIBFFI_INCLUDEDIR was created correctly in 
Makefile. 

How to configure location for libffi.a ?

--
messages: 320998
nosy: semkin
priority: normal
severity: normal
status: open
title: ModuleNotFoundError: No module named '_ctypes' when install Python 3.7 
on Linux

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34036] ModuleNotFoundError: No module named '_ctypes' when install Python 3.7 on Linux

2018-07-03 Thread Semyon Levin


Change by Semyon Levin :


--
components: +Installation
versions: +Python 3.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33944] Deprecate and remove pth files

2018-07-03 Thread Barry A. Warsaw


Barry A. Warsaw  added the comment:

I think we'll clearly need a PEP for this clean up.  I'd like to see a separate 
"preload" feature as well, especially one that is deterministic and happens 
before site.py.  Not sure if that should be one PEP or two.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34035] zipfile: AttributeError in "seek" method of "_SharedFile" class

2018-07-03 Thread Serhiy Storchaka


Change by Serhiy Storchaka :


--
keywords: +easy
nosy: +serhiy.storchaka
stage:  -> needs patch
type: crash -> behavior
versions: +Python 3.6, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34035] zipfile: AttributeError in "seek" method of "_SharedFile" class

2018-07-03 Thread Evgeny Prilepin


New submission from Evgeny Prilepin :

The misprint in the file lib/zipfile.py in the line 704 leads to 
AttributeError: '_SharedFile' object has no attribute 'writing'

"self.writing()" should be replaced by "self._writing()". I also think this 
code shold be covered by tests.

--
components: Library (Lib)
messages: 320996
nosy: espdev
priority: normal
severity: normal
status: open
title: zipfile: AttributeError in "seek" method of "_SharedFile" class
type: crash
versions: Python 3.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34034] Python 3.7.0 multiprocessing forkserver ForkingPickler behaviour change

2018-07-03 Thread Santiago Hernandez


New submission from Santiago Hernandez :

Hi,

I am splitting some processing among different processes with the forkserver 
start method using multiprocessing.
In python 3.4 to 3.6 this worked fine.
In python 3.7.0 it's breaking with the following Traceback:

```
  File 
"/data/venvs/py37/Python-3.7.0/lib/python3.7/multiprocessing/process.py", line 
112, in start
self._popen = self._Popen(self)
  File 
"/data/venvs/py37/Python-3.7.0/lib/python3.7/multiprocessing/context.py", line 
223, in _Popen
return _default_context.get_context().Process._Popen(process_obj)
  File 
"/data/venvs/py37/Python-3.7.0/lib/python3.7/multiprocessing/context.py", line 
284, in _Popen
return Popen(process_obj)
  File 
"/data/venvs/py37/Python-3.7.0/lib/python3.7/multiprocessing/popen_spawn_posix.py",
 line 32, in __init__
super().__init__(process_obj)
  File 
"/data/venvs/py37/Python-3.7.0/lib/python3.7/multiprocessing/popen_fork.py", 
line 20, in __init__
self._launch(process_obj)
  File 
"/data/venvs/py37/Python-3.7.0/lib/python3.7/multiprocessing/popen_spawn_posix.py",
 line 47, in _launch
reduction.dump(process_obj, fp)
  File 
"/data/venvs/py37/Python-3.7.0/lib/python3.7/multiprocessing/reduction.py", 
line 60, in dump
ForkingPickler(file, protocol).dump(obj)
TypeError: can't pickle weakref objects
```

I am attaching a minimum example where this happens.
In the example this can be solved by making self._run_single a staticmethod.

However, I would like to understand what is going on and what changed in python 
for this to throw an exception now, when before it did not.

Thanks.
Santiago

--
files: example.py
messages: 320995
nosy: Santiago Hernandez
priority: normal
severity: normal
status: open
title: Python 3.7.0 multiprocessing forkserver ForkingPickler behaviour change
versions: Python 3.7
Added file: https://bugs.python.org/file47670/example.py

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue28657] cmd.Cmd.get_help() implementation can't see do_*() methods added dynamically by setattr()

2018-07-03 Thread Błażej Michalik

Błażej Michalik  added the comment:

I found it.

Our app had CLI that was so vast, that it didn't made sense to put all of the 
'do_xyz' methods into the same class that would run the interface internals. 
Instead, we had a child Cmd class that had a "add_command(self, command, func, 
helpstring=None)" method. 

That method would then perform an assignment with setattr() calls: 
setattr(self, "do_" + command, func). That's why the title of this issue has 
the innocent setattr() mentioned. I didn't knew at the time, whether or not the 
usage of it was important to the issue.

It made sense to us back then, since we had multiple components waiting for the 
user to interact with them, that mostly didn't had much of anything to do with 
each other. 
It also made keeping track of the commands much easier. Each component had its 
own set of command, callback and helpstring triplets, and putting them together 
into the Cmd class was a responsibility of a completely separate code.

It looked cleaner that way.

When I was talking about "modifying class definition", I had a 
"OurCmd().__class__.do_xyz = callback" situation in mind. I think that it makes 
it behave in the same way as with the patch, as long as there is only one 
OurCmd instance.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue32888] Improve exception message in ast.literal_eval

2018-07-03 Thread Serhiy Storchaka


Serhiy Storchaka  added the comment:

Please wait until issue32892 and issue32893 be committed or rejected before 
merging this PR.

--
dependencies: +Remove specific constant AST types in favor of ast.Constant, 
ast.literal_eval() shouldn't accept booleans as numbers in AST
nosy: +brian.curtin

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34027] python 3.7 openpty/forkpty build failure using nix package manager macOS environment

2018-07-03 Thread Daiderd Jordan


Daiderd Jordan  added the comment:

Either patch looks fine to me, should I close the pull request?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue1222585] C++ compilation support for distutils

2018-07-03 Thread Dmitry Kalinkin


Change by Dmitry Kalinkin :


Added file: https://bugs.python.org/file47669/python-3.8-distutils-C++.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34032] Add platlibdir to allow distinction between /usr/lib and /usr/lib64 for Linux

2018-07-03 Thread Matej Cepl


Change by Matej Cepl :


--
pull_requests: +7678
stage:  -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34033] distutils is not reproducible

2018-07-03 Thread Benjamin Peterson


Benjamin Peterson  added the comment:

I agree that we should fix the underlying issue (marshal) rather than papering 
over it by sorting. In fact, we should have a test that compiles a bunch of 
pycs in a random orders and sees if they're the same or not.

--
nosy: +benjamin.peterson

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34033] distutils is not reproducible

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:

Copy of https://bugzilla.opensuse.org/show_bug.cgi?id=1049186 first message:
"""
e.g. python-simplejson has one-bit diffs in .pyc files
See
http://rb.zq1.de/compare.factory-20170713/python-simplejson-compare.out


in python3-simplejson.rpm we get
-4e50  68 6f 72 5f 5f da 07 64  65 63 69 6d 61 6c 72 0c  |hor__..decimalr.|
+4e50  68 6f 72 5f 5f 5a 07 64  65 63 69 6d 61 6c 72 0c  |hor__Z.decimalr.|

in python3-simplejson-test.rpm we get the opposite change
-0580  72 13 00 00 00 5a 07 64  65 63 69 6d 61 6c 72 03  |rZ.decimalr.|
+0580  72 13 00 00 00 da 07 64  65 63 69 6d 61 6c 72 03  |r..decimalr.|


and it seems to be related to filesystem ordering, since it built reproducibly
when using a filesystem with sorted readdir
using disorderfs via reproducible-faketools-filesys from
https://build.opensuse.org/package/show/home:bmwiedemann:reproducible/reproducible-faketools
"""
https://bugzilla.opensuse.org/show_bug.cgi?id=1049186#c0

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34033] distutils is not reproducible

2018-07-03 Thread STINNER Victor


Change by STINNER Victor :


--
keywords: +patch
pull_requests: +7677
stage:  -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue29708] support reproducible Python builds

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:

I created bpo-34033: distutils is not reproducible.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34033] distutils is not reproducible

2018-07-03 Thread STINNER Victor


New submission from STINNER Victor :

Follow up of bpo-29708: OpenSUSE uses a downstream patch for distutils to fix 
https://bugzilla.opensuse.org/show_bug.cgi?id=1049186: 
distutils-reproducible-compile.patch. I converted the patch as a PR: PR 8057.

Naoki INADA wrote:
"""
Currently, marshal uses refcnt to determine using w_ref or not. Some immutable 
objects (especially, long and str) can be cached and reused. It may affects 
refcnt when byte compiling.

I think we should use more deterministic way instead of refcnt. Maybe, count 
all constants in the module before marshal, like we did in compiling function 
for co_consts and co_names.
As a bonus, it may reduce resource usage too by merging constants over 
functions.
(e.g. ('self',) co_varnames and (None,) co_consts)
"""
https://github.com/python/cpython/pull/8057#issuecomment-402065657

Serhiy Storchaka added:
"""
I think we need to understand the issue better before committing changes. When 
found the source of unstability of file names, we can find other similar 
sources and make them stable too. For example if the source is listdir() or 
glob(), we can consider sorting results of all listdir() or glob() in distutils 
and related methods.

On other side, if the problem is with reference counters in marshal, we can 
change the marshal module instead.
"""
https://github.com/python/cpython/pull/8057#issuecomment-402198390

--
components: Library (Lib)
messages: 320988
nosy: vstinner
priority: normal
severity: normal
status: open
title: distutils is not reproducible
versions: Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33996] Crash in gen_send_ex(): _PyErr_GetTopmostException() returns freed memory

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:

It's not a bug in Python but in greenlet:

* greenlet bug: https://github.com/python-greenlet/greenlet/issues/131
* my greenlet fix: https://github.com/python-greenlet/greenlet/pull/132
* Red Hat bug: https://bugzilla.redhat.com/show_bug.cgi?id=1594248

--
priority: release blocker -> 
resolution:  -> third party
stage:  -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34015] doc Add link to Descriptor HowTo Guide in Data Model

2018-07-03 Thread Raymond Hettinger


Raymond Hettinger  added the comment:

I don't want to do this.  The docs are the authoritative source and the how-to 
is a secondary source that is primarily about how particular descriptors are 
implemented.

--
nosy: +rhettinger
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34032] Add platlibdir to allow distinction between /usr/lib and /usr/lib64 for Linux

2018-07-03 Thread Matej Cepl


New submission from Matej Cepl :

Many Linux distribution (most of them) distinguish between library directory 
/usr/lib for noarch or 32bit libraries and /usr/lib64. This patch (originally 
from openSUSE) enables to capture this distinction.

--
components: Build
files: python-3.6.0-multilib-new.patch
keywords: patch
messages: 320985
nosy: mcepl, vstinner
priority: normal
severity: normal
status: open
title: Add platlibdir to allow distinction between /usr/lib and /usr/lib64 for 
Linux
versions: Python 3.8
Added file: https://bugs.python.org/file47668/python-3.6.0-multilib-new.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue24085] large memory overhead when pyc is recompiled

2018-07-03 Thread Serhiy Storchaka


Serhiy Storchaka  added the comment:

VmRSS for different versions:

  malloc jmalloc
2.7:  237316 kB   90524 kB
3.4:   53888 kB   14768 kB
3.5:   51396 kB   14908 kB
3.6:   90692 kB   31776 kB
3.7:  130952 kB   28296 kB
3.8:  130284 kB   27644 kB

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34031] [EASY] Incorrect usage of unittest.TestCase in test_urllib2_localnet

2018-07-03 Thread Pablo Galindo Salgado


Change by Pablo Galindo Salgado :


--
keywords: +easy
title: Incorrect usage of unittest.TestCase in test_urllib2_localnet -> [EASY] 
Incorrect usage of unittest.TestCase in test_urllib2_localnet

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34030] easy_install from Python 3.7 (Win64) cannot install modules

2018-07-03 Thread Ned Deily


Ned Deily  added the comment:

easy_install is part of the setuptools project and issues with it are handled 
here:

https://github.com/pypa/setuptools/issues
https://pypi.org/project/setuptools/

--
nosy: +ned.deily
resolution:  -> third party
stage:  -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34029] tkinter.filedialog.askdirectory() crashing before dialog opens when importing pywinauto

2018-07-03 Thread Ryan


Ryan  added the comment:

Okay so I'm an idiot and forgot that I'd commented out the pywinauto import in 
one of my project files, which is how I found out that was the issue in the 
first place. 

Crash is still occurring after a pywinauto reinstall.

--
status: closed -> open

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue24085] large memory overhead when pyc is recompiled

2018-07-03 Thread INADA Naoki


INADA Naoki  added the comment:

since anon_city_hoods has massive constants, compiler_add_const makes dict 
larger and larger.  It creates many large tuples too.
I suspect it makes glibc malloc unhappy.

Maybe, we can improve pymalloc for medium and large objects, by porting 
strategy from jemalloc.  It can be good GSoC project.

But I suggest close this issue as "won't fix" for now.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue24085] large memory overhead when pyc is recompiled

2018-07-03 Thread INADA Naoki


INADA Naoki  added the comment:

In case repro2, unreturned memory is in glibc malloc.
jemalloc mitigates this issue.
There are some fragmentation in pymalloc, but I think it's acceptable level.

$ python3 -B repro2.py
ready

1079124
VmHWM:   1079124 kB
VmRSS: 83588 kB

$ LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libjemalloc.so.1 python3 -B repro2.py
ready

1108424
VmHWM:   1108424 kB
VmRSS: 28140 kB

--
nosy: +inada.naoki

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34018] SQLite converters are documented to be sensitive to the case of type names, but they're not

2018-07-03 Thread Tal Einat


Change by Tal Einat :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34018] SQLite converters are documented to be sensitive to the case of type names, but they're not

2018-07-03 Thread Tal Einat


Tal Einat  added the comment:


New changeset 6699386231d326c50439b9e1df752e1aed7ca6b4 by Tal Einat (Miss 
Islington (bot)) in branch '3.7':
bpo-34018: Doc'd that type names of SQLite converters are case-insensitive. 
(GH-8042) (GH-8065)
https://github.com/python/cpython/commit/6699386231d326c50439b9e1df752e1aed7ca6b4


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34018] SQLite converters are documented to be sensitive to the case of type names, but they're not

2018-07-03 Thread Tal Einat


Tal Einat  added the comment:


New changeset f55a818954212e8e6c97e3d66cf1478120a3220f by Tal Einat (Miss 
Islington (bot)) in branch '3.6':
bpo-34018: Doc'd that type names of SQLite converters are case-insensitive. 
(GH-8042) (GH-8067)
https://github.com/python/cpython/commit/f55a818954212e8e6c97e3d66cf1478120a3220f


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34018] SQLite converters are documented to be sensitive to the case of type names, but they're not

2018-07-03 Thread Tal Einat


Tal Einat  added the comment:


New changeset 292ce153fcc2d991164d19ad3f3deb86157898d5 by Tal Einat (Miss 
Islington (bot)) in branch '2.7':
bpo-34018: Doc'd that type names of SQLite converters are case-insensitive. 
(GH-8042) (GH-8066)
https://github.com/python/cpython/commit/292ce153fcc2d991164d19ad3f3deb86157898d5


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34031] Incorrect usage of unittest.TestCase in test_urllib2_localnet

2018-07-03 Thread Pablo Galindo Salgado


Change by Pablo Galindo Salgado :


--
Removed message: https://bugs.python.org/msg320975

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34031] Incorrect usage of unittest.TestCase in test_urllib2_localnet

2018-07-03 Thread Pablo Galindo Salgado


Pablo Galindo Salgado  added the comment:

In /Lib/test/test_urllib2_localnet.py there is an incorrect usage of 
unittest.TestCase.fail (an extra comma makes it use two arguments instead of 
one):

class BasicAuthTests(unittest.TestCase):
...

def test_basic_auth_success(self):
...
try:
self.assertTrue(urllib.request.urlopen(self.server_url))
except urllib.error.HTTPError:
self.fail("Basic auth failed for the url: %s", self.server_url)

here self.fail takes two argument, but it only admits one. This produces this 
traceback if there are proxy issues when running the tests:

Traceback (most recent call last):
  File "/home7/pablogsal/Python-3.7.0/Lib/test/test_urllib2_localnet.py", line 
307, in test_basic_auth_success
self.assertTrue(urllib.request.urlopen(self.server_url))
  File "/home/pablogsal/Python-3.7.0/Lib/urllib/request.py", line 222, in 
urlopen
return opener.open(url, data, timeout)
  File "/home/pablogsal/Python-3.7.0/Lib/urllib/request.py", line 531, in open
response = meth(req, response)
  File "/home/pablogsal/Python-3.7.0/Lib/urllib/request.py", line 641, in 
http_response
'http', request, response, code, msg, hdrs)
  File "/home/pablogsal/Python-3.7.0/Lib/urllib/request.py", line 569, in error
return self._call_chain(*args)
  File "/home/pablogsal/Python-3.7.0/Lib/urllib/request.py", line 503, in 
_call_chain
result = func(*args)
  File "/home/pablogsal/Python-3.7.0/Lib/urllib/request.py", line 649, in 
http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pablogsal/Python-3.7.0/Lib/test/test_urllib2_localnet.py", line 
309, in test_basic_auth_success
self.fail("Basic auth failed for the url: %s", self.server_url)
TypeError: fail() takes from 1 to 2 positional arguments but 3 were given

--

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34031] Incorrect usage of unittest.TestCase in test_urllib2_localnet

2018-07-03 Thread Pablo Galindo Salgado


New submission from Pablo Galindo Salgado :

In /Lib/test/test_urllib2_localnet.py there is an incorrect usage of 
unittest.TestCase (an extra comma makes it use two arguments instead of one):

class BasicAuthTests(unittest.TestCase):
...

def test_basic_auth_success(self):
...
try:
self.assertTrue(urllib.request.urlopen(self.server_url))
except urllib.error.HTTPError:
self.fail("Basic auth failed for the url: %s", self.server_url)

here self.fail takes two argument, but it only admits one. This produces this 
traceback if there are proxy issues when running the tests:

Traceback (most recent call last):
  File "/home7/pablogsal/Python-3.7.0/Lib/test/test_urllib2_localnet.py", line 
307, in test_basic_auth_success
self.assertTrue(urllib.request.urlopen(self.server_url))
  File "/home/pablogsal/Python-3.7.0/Lib/urllib/request.py", line 222, in 
urlopen
return opener.open(url, data, timeout)
  File "/home/pablogsal/Python-3.7.0/Lib/urllib/request.py", line 531, in open
response = meth(req, response)
  File "/home/pablogsal/Python-3.7.0/Lib/urllib/request.py", line 641, in 
http_response
'http', request, response, code, msg, hdrs)
  File "/home/pablogsal/Python-3.7.0/Lib/urllib/request.py", line 569, in error
return self._call_chain(*args)
  File "/home/pablogsal/Python-3.7.0/Lib/urllib/request.py", line 503, in 
_call_chain
result = func(*args)
  File "/home/pablogsal/Python-3.7.0/Lib/urllib/request.py", line 649, in 
http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pablogsal/Python-3.7.0/Lib/test/test_urllib2_localnet.py", line 
309, in test_basic_auth_success
self.fail("Basic auth failed for the url: %s", self.server_url)
TypeError: fail() takes from 1 to 2 positional arguments but 3 were given

--

--
assignee: pablogsal
components: Tests
messages: 320975
nosy: pablogsal
priority: normal
severity: normal
status: open
title: Incorrect usage of unittest.TestCase in test_urllib2_localnet
type: behavior
versions: Python 2.7, Python 3.4, Python 3.5, Python 3.6, Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34019] webbrowser: wrong arguments for Opera browser.

2018-07-03 Thread miss-islington


miss-islington  added the comment:


New changeset dd5f43a023f25e8aea8c9297b5297d76668d64e1 by Miss Islington (bot) 
in branch '3.6':
bpo-34019: Fix wrong arguments for Opera Browser (GH-8047)
https://github.com/python/cpython/commit/dd5f43a023f25e8aea8c9297b5297d76668d64e1


--
nosy: +miss-islington

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34018] SQLite converters are documented to be sensitive to the case of type names, but they're not

2018-07-03 Thread miss-islington


Change by miss-islington :


--
pull_requests: +7676

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34018] SQLite converters are documented to be sensitive to the case of type names, but they're not

2018-07-03 Thread miss-islington


Change by miss-islington :


--
pull_requests: +7675

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34018] SQLite converters are documented to be sensitive to the case of type names, but they're not

2018-07-03 Thread Tal Einat


Tal Einat  added the comment:

I tested and indeed this is case-insensitive even on 2.7.

--
versions: +Python 2.7, Python 3.6, Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34018] SQLite converters are documented to be sensitive to the case of type names, but they're not

2018-07-03 Thread miss-islington


Change by miss-islington :


--
pull_requests: +7674

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34018] SQLite converters are documented to be sensitive to the case of type names, but they're not

2018-07-03 Thread Tal Einat


Tal Einat  added the comment:


New changeset 831c29721dcb1b768c6315a4b8a4059c4c97ee8b by Tal Einat (Sergey 
Fedoseev) in branch 'master':
bpo-34018: Doc'd that type names of SQLite converters are case-insensitive. 
(GH-8042)
https://github.com/python/cpython/commit/831c29721dcb1b768c6315a4b8a4059c4c97ee8b


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33735] test_multiprocessing_spawn leaked [1, 2, 1] memory blocks on AMD64 Windows8.1 Refleaks 3.7

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:

bpo-33984 has been marked as a duplicate of this issue: 
"test_multiprocessing_forkserver leaked [1, 2, 1] memory blocks on x86 Gentoo 
Refleaks 3.x".

Sadly, my commit 23401fb960bb94e6ea62d2999527968d53d3fc65 is not perfect, the 
test still fails when the system load is high:
https://bugs.python.org/issue33984#msg320967

But since tests are re-run sequentially, I hope that it will be fine.

I close the issue. I will reopen it if the bug reoccurs.

--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33735] test_multiprocessing_spawn leaked [1, 2, 1] memory blocks on AMD64 Windows8.1 Refleaks 3.7

2018-07-03 Thread miss-islington


miss-islington  added the comment:


New changeset 3bd9d3b934eb8b27553f19a7ab1c97f95745c68f by Miss Islington (bot) 
in branch '3.6':
bpo-33735: Fix test_multiprocessing random failure (GH-8059)
https://github.com/python/cpython/commit/3bd9d3b934eb8b27553f19a7ab1c97f95745c68f


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34018] SQLite converters are documented to be sensitive to the case of type names, but they're not

2018-07-03 Thread Tal Einat


Tal Einat  added the comment:

It's worth noting that the referenced commit where this change was made is from 
2006...

--
nosy: +taleinat

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33735] test_multiprocessing_spawn leaked [1, 2, 1] memory blocks on AMD64 Windows8.1 Refleaks 3.7

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:


New changeset 53fafafa340e292a1c9e4aacf5860999613c2b36 by Victor Stinner in 
branch '2.7':
bpo-33735: Fix test_multiprocessing random failure (GH-8059) (GH-8061)
https://github.com/python/cpython/commit/53fafafa340e292a1c9e4aacf5860999613c2b36


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34019] webbrowser: wrong arguments for Opera browser.

2018-07-03 Thread miss-islington


Change by miss-islington :


--
pull_requests: +7673

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34019] webbrowser: wrong arguments for Opera browser.

2018-07-03 Thread miss-islington


Change by miss-islington :


--
pull_requests: +7672

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33984] test_multiprocessing_forkserver leaked [1, 2, 1] memory blocks on x86 Gentoo Refleaks 3.x

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:

Hum. Sadly my commit 23401fb960bb94e6ea62d2999527968d53d3fc65 is not enough, 
the test still fails randomly:

pydev@stormageddon ~/cpython $ ./python -m test test_multiprocessing_forkserver 
-m test_imap_unordered -R 3:3 -F
Run tests sequentially
0:00:00 load avg: 5.79 [  1] test_multiprocessing_forkserver
beginning 6 repetitions
123456
..
0:00:28 load avg: 6.98 [  2] test_multiprocessing_forkserver
beginning 6 repetitions
123456
..
0:00:59 load avg: 7.69 [  3] test_multiprocessing_forkserver -- 
test_multiprocessing_forkserver passed in 30 sec 717 ms
beginning 6 repetitions
123456
..
0:01:28 load avg: 8.63 [  4] test_multiprocessing_forkserver
beginning 6 repetitions
123456
..
test_multiprocessing_forkserver leaked [2, 1, 1] memory blocks, sum=4
test_multiprocessing_forkserver failed

== Tests result: FAILURE ==

3 tests OK.

1 test failed:
test_multiprocessing_forkserver

Total duration: 1 min 55 sec
Tests result: FAILURE


The test failed when the system load was high (8.63).

I hope that in pratice, my change will be enough to get less random failures. 
The "Re-run in verbose mode" on the "idle" buildbot should make the bug 
disappear.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33735] test_multiprocessing_spawn leaked [1, 2, 1] memory blocks on AMD64 Windows8.1 Refleaks 3.7

2018-07-03 Thread miss-islington


miss-islington  added the comment:


New changeset 42b2f84a85fe3334c5d8098cf76dfa727b348c4f by Miss Islington (bot) 
in branch '3.7':
bpo-33735: Fix test_multiprocessing random failure (GH-8059)
https://github.com/python/cpython/commit/42b2f84a85fe3334c5d8098cf76dfa727b348c4f


--
nosy: +miss-islington

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33984] test_multiprocessing_forkserver leaked [1, 2, 1] memory blocks on x86 Gentoo Refleaks 3.x

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:

Oh. I have a very good news: this issue is a duplicate of bpo-33735 and I just 
identified and fixed bpo-33735!

--
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> test_multiprocessing_spawn leaked [1, 2, 1] memory blocks on 
AMD64 Windows8.1 Refleaks 3.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34019] webbrowser: wrong arguments for Opera browser.

2018-07-03 Thread Pablo Galindo Salgado


Pablo Galindo Salgado  added the comment:


New changeset 3cf1f154edb88c108877729ea09f4ac174697fea by Pablo Galindo (Bumsik 
Kim) in branch 'master':
 bpo-34019: Fix wrong arguments for Opera Browser (#8047)
https://github.com/python/cpython/commit/3cf1f154edb88c108877729ea09f4ac174697fea


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34010] tarfile stream read performance

2018-07-03 Thread INADA Naoki


Change by INADA Naoki :


--
versions:  -Python 3.4, Python 3.5

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34029] tkinter.filedialog.askdirectory() crashing before dialog opens when importing pywinauto

2018-07-03 Thread Ryan


Ryan  added the comment:

It seems reinstalling pywinauto has fixed this issue for now - I have no idea 
what could have caused it in the first place though.

--
stage:  -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33735] test_multiprocessing_spawn leaked [1, 2, 1] memory blocks on AMD64 Windows8.1 Refleaks 3.7

2018-07-03 Thread STINNER Victor


Change by STINNER Victor :


--
pull_requests: +7670

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33735] test_multiprocessing_spawn leaked [1, 2, 1] memory blocks on AMD64 Windows8.1 Refleaks 3.7

2018-07-03 Thread miss-islington


Change by miss-islington :


--
pull_requests: +7671

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33735] test_multiprocessing_spawn leaked [1, 2, 1] memory blocks on AMD64 Windows8.1 Refleaks 3.7

2018-07-03 Thread miss-islington


Change by miss-islington :


--
pull_requests: +7669

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33735] test_multiprocessing_spawn leaked [1, 2, 1] memory blocks on AMD64 Windows8.1 Refleaks 3.7

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:


New changeset 23401fb960bb94e6ea62d2999527968d53d3fc65 by Victor Stinner in 
branch 'master':
bpo-33735: Fix test_multiprocessing random failure (GH-8059)
https://github.com/python/cpython/commit/23401fb960bb94e6ea62d2999527968d53d3fc65


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34028] Python 3.7.0 wont compile with SSL Support 1.1.0 > alledged missing X509_VERIFY_PARAM_set1_host() support

2018-07-03 Thread Christian Heimes


Christian Heimes  added the comment:

configure is not able to find OpenSSL. You either have to configure Python to 
pick up your OpenSSL (./configure --with-openssl=/path/to/openssl) or install 
the OpenSSL developer packages. RHEL 7.5 comes with OpenSSL 1.0.2, so you are 
good.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue30183] [HPUX] compilation error in pytime.c with cc compiler

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:

Yes, I close the issue.

--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue30183] [HPUX] compilation error in pytime.c with cc compiler

2018-07-03 Thread Michael -O


Michael -O <1983-01...@gmx.net> added the comment:

I have applied the patch to 3.6.6 from the source tarball and I was able to 
proceed with the compilation.

I would take the failed tests as blocker. Try to solve them later.

Can this be closed?

--
nosy: +Michael -O

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33735] test_multiprocessing_spawn leaked [1, 2, 1] memory blocks on AMD64 Windows8.1 Refleaks 3.7

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:

> It failed for the first time on Ubuntu and then was successful for all the 
> rest of 5-6 runs.

The bug is random. But the problem is that sometimes, it fails. It must never 
fail, otherwise the buildbot fails randomly. The Gentoo Refleak buildbot runs 
multiple tests in parallel and so its system load is high, tests are run 
slower, making the failure more likely.

Anyway, I have a fix! PR 8059.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33735] test_multiprocessing_spawn leaked [1, 2, 1] memory blocks on AMD64 Windows8.1 Refleaks 3.7

2018-07-03 Thread STINNER Victor


Change by STINNER Victor :


--
keywords: +patch
pull_requests: +7668
stage:  -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34030] easy_install from Python 3.7 (Win64) cannot install modules

2018-07-03 Thread Gabriele Tornetta


New submission from Gabriele Tornetta :

When trying to install a module (pycrypto in this case), easy_install fails 
with the following error (run via Git Bash)

$ easy_install pycrypto-2.6.win-amd64-py3.3.exe
Processing pycrypto-2.6.win-amd64-py3.3.exe
error: [WinError 32] The process cannot access the file because it is being 
used by another process: 
'C:\\UsersAppData\\Local\\Temp\\easy_install-z4dfyyqo\\pycrypto-2.6-py3.7-win32.egg.tmp\\Crypto\\Cipher\\__pycache__\\AES.cpython-33.pyc'

The version of easy_install that ships with Python 3.6 works as expected.

--
components: Demos and Tools
messages: 320957
nosy: Gabriele Tornetta
priority: normal
severity: normal
status: open
title: easy_install from Python 3.7 (Win64) cannot install modules
type: behavior
versions: Python 3.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33735] test_multiprocessing_spawn leaked [1, 2, 1] memory blocks on AMD64 Windows8.1 Refleaks 3.7

2018-07-03 Thread Karthikeyan Singaravelan

Karthikeyan Singaravelan  added the comment:

It failed for the first time on Ubuntu and then was successful for all the rest 
of 5-6 runs. I don't know why for the failure run it has load avg as 0.00 and 
how to get to this stage.

# Shell session

➜  cpython git:(master) uname -a
Linux ubuntu-s-1vcpu-1gb-blr1-01 4.4.0-127-generic #153-Ubuntu SMP Sat May 19 
10:58:46 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
➜  cpython git:(master) ./python
Python 3.8.0a0 (heads/master:d824ca7, Jul  3 2018, 06:50:05)
[GCC 5.4.0 20160609] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> exit()
➜  cpython git:(master) ./python -m test test_multiprocessing_spawn -m 
test.test_multiprocessing_spawn.WithProcessesTestPool.test_imap_unordered -R 3:3
Run tests sequentially
0:00:00 load avg: 0.00 [1/1] test_multiprocessing_spawn
beginning 6 repetitions
123456
..
test_multiprocessing_spawn leaked [2, 2, 1] memory blocks, sum=5
test_multiprocessing_spawn failed

== Tests result: FAILURE ==

1 test failed:
test_multiprocessing_spawn

Total duration: 9 sec 221 ms
Tests result: FAILURE
➜  cpython git:(master) ./python -m test test_multiprocessing_spawn -m 
test.test_multiprocessing_spawn.WithProcessesTestPool.test_imap_unordered -R 3:3
Run tests sequentially
0:00:00 load avg: 0.34 [1/1] test_multiprocessing_spawn
beginning 6 repetitions
123456
..

== Tests result: SUCCESS ==

1 test OK.

Total duration: 8 sec 822 ms
Tests result: SUCCESS

--
nosy: +xtreak

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34028] Python 3.7.0 wont compile with SSL Support 1.1.0 > alledged missing X509_VERIFY_PARAM_set1_host() support

2018-07-03 Thread simon


simon  added the comment:

Apologies, my bad you are correct the function was defined in x509_vfy.h

Im compiling on RHEL
Red Hat Enterprise Linux Server release 7.5 (Maipo)
I have tried Openssl from source versions;
openssl-1.0.2o  (this releaseis a mess and the folder structure has been 
altered)
openssl-1.1.0h
openssl-1.1.0

I havce tried 
Python-3.7.0
Python-3.6.3

checking for pkg-config... /usr/bin/pkg-config
checking for openssl/ssl.h in /usr/local/ssl... no
checking for openssl/ssl.h in /usr/lib/ssl... no
checking for openssl/ssl.h in /usr/ssl... no
checking for openssl/ssl.h in /usr/pkg... no
checking for openssl/ssl.h in /usr/local... no
checking for openssl/ssl.h in /usr... no
checking whether compiling and linking against OpenSSL works... no
checking for --with-ssl-default-suites... python

My details of Setup are;

SSL=/home/{my_home_folder}/openssl
_ssl _ssl.c \
-DUSE_SSL -I$(SSL)/include -I$(SSL)/include/openssl \
-L$(SSL) -lssl -lcrypto

I now spot that the Linker is having issues (-L)

libssl.so & cyypt.so   is in /home/{my_home_folder}/openssl
all the header files are in;

=/home/{my_home_folder}/openssl/include/openssl

including opensslconf.h
however not of the declarations have been commented out including any of the 

DEPRECATEDIN_1_0_0  etc etc

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33418] Memory leaks in functions

2018-07-03 Thread Jeroen Demeyer


Jeroen Demeyer  added the comment:

> While this is a obvious bug, f.__module__ = f seems very unnatural.

Sure.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33418] Memory leaks in functions

2018-07-03 Thread INADA Naoki


INADA Naoki  added the comment:

I'm not sure this should be backported to 3.6 and 2.7.
While this is a obvious bug, f.__module__ = f seems very unnatural.

--
nosy: +inada.naoki

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33418] Memory leaks in functions

2018-07-03 Thread INADA Naoki


Change by INADA Naoki :


--
keywords: +patch
pull_requests: +7667
stage:  -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34029] tkinter.filedialog.askdirectory() crashing before dialog opens when importing pywinauto

2018-07-03 Thread Ryan


Change by Ryan :


Added file: https://bugs.python.org/file47667/minimal_file.py

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue21011] PyArg_ParseTupleAndKeywords doesn't take const char *keywords[]

2018-07-03 Thread Serhiy Storchaka


Serhiy Storchaka  added the comment:

We can't change this API because this would break virtually all user code.

But we can introduce a macro like PY_SSIZE_T_CLEAN. If it is defined before 
including Python.h, PyArg_ParseTupleAndKeywords() will take an array of const 
strings. This will help for compatibility with C++.

--
nosy: +serhiy.storchaka
type: resource usage -> enhancement

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34028] Python 3.7.0 wont compile with SSL Support 1.1.0 > alledged missing X509_VERIFY_PARAM_set1_host() support

2018-07-03 Thread Christian Heimes


Christian Heimes  added the comment:

The function definition should be in openssl/x509_vfy.h, not rsa.h. What's the 
output of configure on your system? You should see something like

./configure
...
checking for pkg-config... /usr/bin/pkg-config
checking whether compiling and linking against OpenSSL works... yes
checking for X509_VERIFY_PARAM_set1_host in libssl... yes
checking for --with-ssl-default-suites... python
...

What's your platform and openssl version?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue29708] support reproducible Python builds

2018-07-03 Thread Matej Cepl


Change by Matej Cepl :


--
nosy: +mcepl

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34029] tkinter.filedialog.askdirectory() crashing before dialog opens when importing pywinauto

2018-07-03 Thread Ryan


Change by Ryan :


--
title: tkinter.filedialog.askdirectory() crashing before dialog opens -> 
tkinter.filedialog.askdirectory() crashing before dialog opens when importing 
pywinauto

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33735] test_multiprocessing_spawn leaked [1, 2, 1] memory blocks on AMD64 Windows8.1 Refleaks 3.7

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:

> test_multiprocessing_spawn leaked [4, 5, 1, 5, 1, 2, 0, 0, 0, 0, 0, 0, 0, 0, 
> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] memory blocks, sum=18

Sorry, I forgot to mention that I modified libregrtest to get this output:

diff --git a/Lib/test/libregrtest/refleak.py b/Lib/test/libregrtest/refleak.py
index 6724488fcf..a3c50e21e0 100644
--- a/Lib/test/libregrtest/refleak.py
+++ b/Lib/test/libregrtest/refleak.py
@@ -101,7 +101,7 @@ def dash_R(the_module, test, indirect_test, huntrleaks):
 failed = False
 for deltas, item_name, checker in [
 (rc_deltas, 'references', check_rc_deltas),
-(alloc_deltas, 'memory blocks', check_rc_deltas),
+(alloc_deltas, 'memory blocks', check_fd_deltas),
 (fd_deltas, 'file descriptors', check_fd_deltas)
 ]:
 # ignore warmup runs

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34029] tkinter.filedialog.askdirectory() crashing before dialog opens

2018-07-03 Thread Ryan


Change by Ryan :


--
nosy: +serhiy.storchaka

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34029] tkinter.filedialog.askdirectory() crashing before dialog opens

2018-07-03 Thread Ryan


New submission from Ryan :

I'm creating a GUI application that needs to give the user the option to change 
a folder that's used for saving data.

I managed to track it down to the import of pywinauto to the application. All 
other filedialogs seem to work, it's only askdirectory that's having issues.

I've attached a small file that shows the crash - if you comment out the 
pywinauto import, no crash occurs.

--
components: Tkinter
messages: 320949
nosy: gpolo, rsteel1
priority: normal
severity: normal
status: open
title: tkinter.filedialog.askdirectory() crashing before dialog opens
type: crash
versions: Python 3.6

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33735] test_multiprocessing_spawn leaked [1, 2, 1] memory blocks on AMD64 Windows8.1 Refleaks 3.7

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:

It doesn't look like a real leak, but more a cache which takes multiple 
iterations to be fully filled.

pydev@stormageddon ~/cpython $ ./python -m test test_multiprocessing_spawn -m 
test.test_multiprocessing_spawn.WithProcessesTestPool.test_imap_unordered -R 
1:30
WARNING: Running tests with --huntrleaks/-R and less than 3 warmup repetitions 
can give false positives!
Run tests sequentially
0:00:00 load avg: 0.88 [1/1] test_multiprocessing_spawn
beginning 31 repetitions
1234567890123456789012345678901
...
test_multiprocessing_spawn leaked [4, 5, 1, 5, 1, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] memory blocks, sum=18
test_multiprocessing_spawn failed in 42 sec 470 ms

== Tests result: FAILURE ==

1 test failed:
test_multiprocessing_spawn

Total duration: 42 sec 490 ms
Tests result: FAILURE

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34028] Python 3.7.0 wont compile with SSL Support 1.1.0 > alledged missing X509_VERIFY_PARAM_set1_host() support

2018-07-03 Thread simon


New submission from simon :

when compiling Python 3.7.0 setup.py is reporting that the ssl module failed to 
compile due to missing support for X509_VERIFY_PARAM_set1_host()  despite it 
existing in rsa.h for all versions of OpenSSL 1.1.0.

Could not build the ssl module!
Python requires an OpenSSL 1.0.2 or 1.1 compatible libssl with 
X509_VERIFY_PARAM_set1_host().
LibreSSL 2.6.4 and earlier do not provide the necessary APIs, 
https://github.com/libressl-portable/portable/issues/381

In addition _ssl.o does actually compile.

The issue appears that _ssl is appearing in "missing", "self.failed", 
"self.failed_on_import"



setup.py

366 if any('_ssl' in l
367for l in (missing, self.failed, self.failed_on_import)):
368 print()
369 print("Could not build the ssl module!")
370 print("Python requires an OpenSSL 1.0.2 or 1.1 compatible "
371   "libssl with X509_VERIFY_PARAM_set1_host().")
372 print("LibreSSL 2.6.4 and earlier do not provide the 
necessary "
373   "APIs, 
https://github.com/libressl-portable/portable/issues/381;)
374 print()

I havent had time to go through the code yet to find out where the error is 
gettng flagged and if its a associated with how I have compiled openssl i.e. I 
need a compilation flag to enabled  X509_VERIFY_PARAM_set1_host() support.

--
assignee: christian.heimes
components: SSL
messages: 320947
nosy: christian.heimes, si...@simonfoley.net
priority: normal
severity: normal
status: open
title: Python 3.7.0 wont compile with SSL Support 1.1.0 > alledged missing 
X509_VERIFY_PARAM_set1_host()  support
versions: Python 3.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue33735] test_multiprocessing_spawn leaked [1, 2, 1] memory blocks on AMD64 Windows8.1 Refleaks 3.7

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:

I reproduced the issue on the Gentoo Refleak buildbot and I succeeded to bisect 
up to a single test: test_imap_unordered().

pydev@stormageddon ~/cpython $ ./python -m test test_multiprocessing_spawn -m 
test.test_multiprocessing_spawn.WithProcessesTestPool.test_imap_unordered -R 3:3
Run tests sequentially
0:00:00 load avg: 1.45 [1/1] test_multiprocessing_spawn
beginning 6 repetitions
123456
..
test_multiprocessing_spawn leaked [3, 2, 1] memory blocks, sum=6
test_multiprocessing_spawn failed

== Tests result: FAILURE ==

1 test failed:
test_multiprocessing_spawn

Total duration: 6 sec 548 ms
Tests result: FAILURE

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue21011] PyArg_ParseTupleAndKeywords doesn't take const char *keywords[]

2018-07-03 Thread INADA Naoki


INADA Naoki  added the comment:

I think we can't fix this until Python 4.
May I close this issue as "won't fix" for now?

Or can we add "Python 4" keyword to list backward incompatible changes we want 
to do in the future?

--
nosy: +inada.naoki
versions: +Python 3.8 -Python 3.4

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34022] 6 tests fail using SOURCE_DATE_EPOCH env var

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:

See bpo-29708 and PEP 552 for more info about reproducible builds.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue34022] 6 tests fail using SOURCE_DATE_EPOCH env var

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:

FAIL: test_invalidation_mode (test.test_py_compile.PyCompileTests)
--
Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_py_compile.py", 
line 153, in test_invalidation_mode
self.assertEqual(flags, 0b1)
AssertionError: 3 != 1


This failure looks suspicious. I looked at the code, and the tested function 
behaves differently depending of the SOURCE_DATE_EPOCH environment variable is 
set.

Aha! I found something:

$ SOURCE_DATE_EPOCH=1530605018 ./python -m test -j0
...
6 tests failed:
test_cmd_line_script test_compileall test_importlib
test_multiprocessing_main_handling test_py_compile test_runpy
...

--
title: Python 3.7: 6 tests failed on OpenSUSE and Debian -> 6 tests fail using 
SOURCE_DATE_EPOCH env var

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue29708] support reproducible Python builds

2018-07-03 Thread STINNER Victor


STINNER Victor  added the comment:

I created PR 8057 to upstream distutils-reproducible-compile.patch from 
OpenSUSE (context: see bpo-34022).

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



  1   2   >