[issue46799] ShareableList memory bloat and performance improvement

Ting-Che Lin added the comment: A gentle Ping to the multiprocessing lib maintainers. Is there anything else I can do to move this forward? -- resolution: -> remind ___ Python tracker

[issue46799] ShareableList memory bloat and performance improvement

Ting-Che Lin added the comment: So I wrote a patch for this issue and published submitted a MR. When I was working on the patch, I realized that there is another issue related to how string and byte array size alignment is calculated. As seen here:

[issue46799] ShareableList memory bloat and performance improvement

Change by Ting-Che Lin : -- keywords: +patch pull_requests: +29597 stage: -> patch review pull_request: https://github.com/python/cpython/pull/31467 ___ Python tracker ___

[issue46799] ShareableList memory bloat and performance improvement

New submission from Ting-Che Lin : The current implementation of ShareableList keeps an unnecessary list of offsets in self._allocated_offsets. This list could have a large memory footprint if the number of items in the list is high. Additionally, this list will be copied in each process