[issue23655] Memory corruption using pickle over pipe to subprocess

Changes by Serhiy Storchaka : -- status: open -> pending ___ Python tracker ___

[issue23655] Memory corruption using pickle over pipe to subprocess

Serhiy Storchaka added the comment: Without additional information we can't solve this issue. Is the problem still reproduced? -- status: pending -> open ___ Python tracker

[issue23655] Memory corruption using pickle over pipe to subprocess

Changes by Serhiy Storchaka : -- status: open -> pending ___ Python tracker ___

[issue23655] Memory corruption using pickle over pipe to subprocess

Changes by Ethan Furman et...@stoneleaf.us: -- nosy: -ethan.furman ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23655 ___ ___ Python-bugs-list

[issue23655] Memory corruption using pickle over pipe to subprocess

Changes by Ethan Furman et...@stoneleaf.us: -- nosy: +ethan.furman ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23655 ___ ___ Python-bugs-list

[issue23655] Memory corruption using pickle over pipe to subprocess

John Nagle added the comment: More info: the problem is on the unpickle side. If I use _Unpickle and Pickle, so the unpickle side is in Python, but the pickle side is in C, no problem. If I use Unpickle and _Pickle, so the unpickle side is C, crashes. --

[issue23655] Memory corruption using pickle over pipe to subprocess

Serhiy Storchaka added the comment: No, there are no subprocess specific tests for pickle. Pickle tests are in Lib/test/pickletester.py and Lib/test/test_pickle.py. First try dump pickled data to a file and then load it in other process. Is it still failed? --

[issue23655] Memory corruption using pickle over pipe to subprocess

Serhiy Storchaka added the comment: Could you please try to minimize you data and try to reproduce an issue without using third-party modules if this is possible? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23655

[issue23655] Memory corruption using pickle over pipe to subprocess

John Nagle added the comment: minimize you data - that's a big job here. Where are the tests for pickle? Is there one that talks to a subprocess over a pipe? Maybe I can adapt that. -- ___ Python tracker rep...@bugs.python.org

[issue23655] Memory corruption using pickle over pipe to subprocess

John Nagle added the comment: Or just use pickle._Pickler instead of pickle.Pickler and like (implementation detail!). Tried that. Changed my own code as follows: 25a26 71,72c72,73 self.reader = pickle.Unpickler(self.proc.stdout)# set up reader self.writer =

[issue23655] Memory corruption using pickle over pipe to subprocess

Serhiy Storchaka added the comment: sys.modules['_pickle'] del sys.modules['pickle'] # if exists import pickle Or just use pickle._Pickler instead of pickle.Pickler and like (implementation detail!). -- nosy: +alexandre.vassalotti, pitrou, serhiy.storchaka stage: - test needed type:

[issue23655] Memory corruption using pickle over pipe to subprocess

New submission from John Nagle: I'm porting a large, working system from Python 2 to Python 3, using six, so the same code works with both. One part of the system works a lot like the multiprocessing module, but predates it. It launches child processes with Popen and talks to them using