[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Dusan Gligoric <7...@protonmail.com> added the comment: Hey folks, This is still an issue with 3.7.2 === # Python 3.7.2 (default, Jan 10 2019, 23:51:51) # [GCC 8.2.1 20181127] on linux from multiprocessing import Manager manager = Manager() d =

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Snidhi Sofpro added the comment: Hi team, Looks like this issue remains per code below: import multiprocessing, sys, time, traceback; if __name__ == '__main__': print(sys.version); mpd = multiprocessing.Manager().dict(); mpd['prcss'] = {'q' : 'queue_1', 'ctlg' : 'ctlg_1' };

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Johannes added the comment: Hi all, I'm trying to use multiprocessing with a 3d list. From the documentation I expected it to work. As I found this report a bid later, I opened a bug report here: https://bugs.python.org/issue32538. Am I doing sth. wrong or is it still not working in 3.6.3? -

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Changes by Berker Peksag : -- status: open -> closed ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mai

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Davin Potts added the comment: Fixed in upcoming 3.6. -- resolution: -> fixed stage: patch review -> resolved ___ Python tracker ___ _

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Roundup Robot added the comment: New changeset 39e7307f9aee by Davin Potts in branch 'default': Fixes issue #6766: Updated multiprocessing Proxy Objects to support nesting https://hg.python.org/cpython/rev/39e7307f9aee -- nosy: +python-dev ___ Python

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Davin Potts added the comment: Attaching updated patch to reflect Yury's suggested changes from review. -- Added file: http://bugs.python.org/file44453/issue_6766_py36.nogit.yuryfeedback.patch ___ Python tracker __

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Davin Potts added the comment: Updating previously supplied patch for 3.6 to the right format. -- Added file: http://bugs.python.org/file8/issue_6766_py36.nogit.patch ___ Python tracker _

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Davin Potts added the comment: Attaching patch for default (3.6) branch which implements what was previously described and discussed, updates the documentation to explain this updated behavior, and includes new tests. @yselivanov: Can you think of any edge cases that should be handled but we'r

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Changes by Davin Potts : -- assignee: jnoller -> davin ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://m

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Davin Potts added the comment: Two core issues are compounding one another here: 1. An un-pythonic, inconsistent behavior currently exists with how managed lists and dicts return different types of values. 2. Confusion comes from reading what is currently in the docs regarding the expected beha

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Justin Patrin added the comment: I'm still running into these issues with Python 2.7.10. I'm trying to find a way to share dynamically allocated sub-dictionaries through multiprocessing as well as dynamically allocated RLock and Value instances. I can use the manager to create them but when I

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Changes by Waldemar Parzonka : -- nosy: +Waldemar.Parzonka ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Changes by Ned Deily : -- nosy: +davin, sbt ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Changes by Dan O'Reilly : -- nosy: +dan.oreilly versions: +Python 3.3 ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscr

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Richard Fothergill added the comment: I'm getting these results on both: Python 3.2.3 (default, Apr 10 2013, 06:11:55) [GCC 4.6.3] on linux2 and Python 2.7.3 (default, Apr 10 2013, 06:20:15) [GCC 4.6.3] on linux2 The symptoms are exactly as Terrence described. Nesting proxied containers is supp

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Changes by Ezio Melotti : -- stage: -> needs patch versions: +Python 2.7 -Python 2.6 ___ Python tracker ___ ___ Python-bugs-list maili

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Darío Suárez Gracia added the comment: Hello, Trying to share a dictionary of dictionaries of lists with a manager I get the same problem with the patch applied in Python 2.7 (r27:82500, Nov 24 2010, 18:24:29) [GCC 4.1.2 20080704 (Red Hat 4.1.2-48)] on linux2. The shared variable in results a

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Terrence Cole added the comment: Kaushik, in your example, d is a dict proxy, so assignment to d['f'] correctly ferries the assignment (a new normal dict) to the d['f'] in the original process. The new dict, however, is not a dict proxy, it's just a dict, so assignment of d['f']['msg'] goes

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Kaushik Ghose added the comment: Even with the patch, I can not resolve this problem. I can reproduce the problem with the patched version with the following code. My system is: Python 2.6.4 (r264:75821M, Oct 27 2009, 19:48:32) IPython 0.10 Platform is Mac OS X (10.5.8) Darwin Kernel Version 9

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Jesse Noller added the comment: Yeah, the auto-generation is too clever and needs to be pulled out entirely. -- ___ Python tracker ___ __

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Terrence Cole added the comment: The tests for the SyncManager are being automagically generated at import time -- I was not quite able to follow that well enough to know exactly what is getting tested, or if they are even enabled. It did not appear to contain any recursion, however. -

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Jesse Noller added the comment: Nothing jumps out to me off the top of my head - I can take a closer look at this after my pycon planning duties finish up in a few weeks. I agree this is unintended behavior. I'll need to audit the tests to make sure that A> This is being tested, and B> Those

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Terrence Cole added the comment: When a manager receives a message, it unpickles the arguments; this calls BaseProxy.__reduce__, which calls RebuildProxy. If we are in the manager, this returns the actual object, otherwise it returns a new proxy. If we naively disable the ability for proxied o

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Terrence Cole added the comment: I get the same results on: Python 2.6.2 (r262:71600, Sep 14 2009, 18:47:57) [GCC 4.3.2] on linux2 I think this is the same issue I was seeing yesterday. You can exercise the issue and cause an exception with just 6 lines: # CODE # from multiprocessing

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

Changes by R. David Murray : -- assignee: -> jnoller nosy: +jnoller ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscri

[issue6766] Cannot modify dictionaries inside dictionaries using Managers from multiprocessing

New submission from Carlos : It's not possible to modify a dict inside a dict using a manager from multiprocessing. Ex: from multiprocessing import Process,Manager def f(d): d['1'] = '1' d['2']['1'] = 'Try To Write' if __name__ == '__main__': manager = Manager() d = manager.