[issue17408] second python execution fails when embedding

[Denny Weinberg]

Denny Weinberg added the comment:

Ok,

thank you very much for your comments.

See Issue27400

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[R. David Murray]

R. David Murray added the comment:

The interpreter is not crashing in your case, so this is a mostly-unrelated 
problem.  (The part that is related is that it is triggered by module 
finalization.)  As Berker said, please open a new issue, but be warned that it 
may get closed as a being addressed by the issue for rewriting the python 
startup sequence (pep 432 I think, which I think Nick has resurrected), since 
this is a systemic problem.  On the other hand there might be a way to fix it 
in the datetime module if someone decides it is worth doing.

--
nosy: +r.david.murray

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Berker Peksag]

Berker Peksag added the comment:

We don't re-open old issues (this was closed more than 3 years ago). Please 
open a new issue and provide a minimal reproducer. Thanks!

--
nosy: +berker.peksag

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Denny Weinberg]

Denny Weinberg added the comment:

Can we please reopen this issue?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Terry J. Reedy]

Changes by Terry J. Reedy :


--
nosy:  -terry.reedy

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Denny Weinberg]

Denny Weinberg added the comment:

Hi,

I think that the problem exists also in python 3.5.1

After calling Py_Finalize and Py_Initialize I get the message "attribute of 
type 'NoneType' is not callable" on the datetime.strptime method.

Example:
from datetime import datetime
s = '20160505 16'
refdatim = datetime.strptime(s, '%Y%m%d %H%M%S')

The first call works find but it crashes after the re initialization.

Workaround:
from datetime import datetime
s = '20160505 16'
try:
refdatim = datetime.strptime(s, '%Y%m%d %H%M%S')
except TypeError:
import time
refdatim = datetime.fromtimestamp(time.mktime(time.strptime(s, '%Y%m%d 
%H%M%S')))

Can anyone confirm this bug? Can you tell me if this will be fixed for python 
3.5/3.6/...?

All the other modules are working find after the re initialization but 
datetime.strptime.

--
nosy: +Denny Weinberg
versions: +Python 3.5

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Palm Kevin]

Changes by Palm Kevin :


--
nosy: +palm.kevin

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Antoine Pitrou]

Antoine Pitrou added the comment:

Should be fixed in 7de9852cdc0e, sorry.

--
resolution:  -> fixed
stage:  -> committed/rejected
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Arfrever Frehtes Taifersar Arahesis]

Arfrever Frehtes Taifersar Arahesis added the comment:

Commit 8c1385205a35 causes segmentation fault (in non-debug build) or abort (in 
debug build) during interpreter shutdown after copying of e.g. bytes or 
object().

$ python -c 'import copy; copy.copy(b""); print("text")'
text
Segmentation fault
$ python -c 'import copy; copy.copy(object()); print("text")'
text
Segmentation fault

--
nosy: +Arfrever
resolution: fixed -> 
stage: committed/rejected -> 
status: closed -> open

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Antoine Pitrou]

Antoine Pitrou added the comment:

Thank you for reporting! This should be fixed now.

--
components: +Interpreter Core -None
nosy: +pitrou
resolution:  -> fixed
stage: needs patch -> committed/rejected
status: open -> closed
versions: +Python 3.4

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Roundup Robot]

Roundup Robot added the comment:

New changeset 8c1385205a35 by Antoine Pitrou in branch '3.3':
Issue #17408: Avoid using an obsolete instance of the copyreg module when the 
interpreter is shutdown and then started again.
http://hg.python.org/cpython/rev/8c1385205a35

New changeset 0b34fd75b937 by Antoine Pitrou in branch 'default':
Issue #17408: Avoid using an obsolete instance of the copyreg module when the 
interpreter is shutdown and then started again.
http://hg.python.org/cpython/rev/0b34fd75b937

--
nosy: +python-dev

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Martin Morrison]

Changes by Martin Morrison :


--
nosy: +isoschiz, pconnell

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Ezio Melotti]

Changes by Ezio Melotti :


--
stage:  -> needs patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Amaury Forgeot d'Arc]

Amaury Forgeot d'Arc added the comment:

In 3.2, typeobject.c did not cache the copyreg module in import_copyreg(); 
PyImport_Import was always called.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Terry J. Reedy]

Terry J. Reedy added the comment:

Can you tell if the relevant 3.2 to 3.3 change is in Py_Initialize, 
Py_Finalize(), or typeobject.c?

--
nosy: +ncoghlan, terry.reedy

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Amaury Forgeot d'Arc]

Amaury Forgeot d'Arc added the comment:

Reproduced on Linux.
The reason is in Objects/typeobject.c: import_copyreg() has a static cache of 
the copyreg module.
When the interpreter stops, the module is filled with None... but gets reused 
in the next instance.

Resetting this "mod_copyreg" variable to NULL fixes the issue.
pickle is also broken for the same reason.

--
nosy: +amaury.forgeotdarc

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Vlad]

Vlad added the comment:

I'm trying to embed the python 3.3 engine for an app that need to run custom 
scripts in python. Since the scripts might be completely different, and 
sometimes user provided, I am trying to make each execution isolated and there 
is not need to preserve any data between execution of the different scripts.

So, my solution is to wrap each execution between 'Py_Initialize' and 
'Py_Finalize'. It looks something like that:

  void ExecuteScript(const char* script)
  {
Py_Initialize();
  
PyRun_SimpleString( script );
  
Py_Finalize();
  }

However, this fails for a particular python script the second time a script is 
executed with:

  done!
  Traceback (most recent call last):
File "", line 8, in 
File "\Python33Test\Output\Debug\Python33\Lib\copy.py", line 89, in copy
  rv = reductor(2)
  TypeError: attribute of type 'NoneType' is not callable


The python script looks like this:

  class Data:
  value1 = 'hello'
  value2 = 0
  
  import copy
  
  d = Data()
  dd = copy.copy( d )
  print ( 'done!' )

As you can see, the first time around the script was executed the 'done!' was 
printed out. But the second time it rises an exception inside the copy function.

It looks like the python engine was left in some weird state after the first 
initialize-finalize. Note, this is python 3.3.

Also, it is very interesting to note that Python 2.7 and Python 3.2 did not 
have this problem.

I guess there might be other examples that could reveal better what's going, 
but i haven't had the time to find yet.

I also put a copy of the project containing flag to switch between Python 3 and 
Python 2.7 (the file is 31 MB): 
https://docs.google.com/file/d/0B86-G0mwwxZvbWRldTd5b2NNMWM/edit?usp=sharing

Thanks, Vlad

--
Added file: http://bugs.python.org/file29398/Python33Test.zip

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Ned Deily]

Ned Deily added the comment:

Please add the detailed description of the problem and any test files to the 
issue here.  Information stored off-site is not searchable within the issue 
tracker and may not be permanently available.

--
nosy: +ned.deily

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17408] second python execution fails when embedding

[Vlad]

New submission from Vlad:

This issue is for Python3.3 and doesn't exist in Python3.2

Detailed description with source code can be found here:
http://stackoverflow.com/questions/15387035/second-python-execution-fails

--
components: None
messages: 184081
nosy: theDarkBrainer
priority: normal
severity: normal
status: open
title: second python execution fails when embedding
type: crash
versions: Python 3.3

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com