New submission from Eric Snow <ericsnowcurren...@gmail.com>:
Currently we allocate each new PyInterpreterState in PyInterpreterState_New(). Furthermore, PyInterpreterState is full of pointers which are almost all allocated on the heap during runtime init. We can statically allocate (and initialize?) most of what goes into PyInterpreterState, as well as the main interpreter itself (as part of _PyRuntimeState). This includes each interpreter's initial PyThreadState. TODO: * [ ] add `PyInterpreterState main;` to _PyRuntimeState.interpreters and use it * [ ] change references from the pointer to the value * [ ] add `PyThreadState _main;` to PyInterpreterState.threads and use it * [ ] change references from the pointer to the value * [ ] change PyInterpreterState pointer fields to values (as much as possible) * [ ] change PyThreadState pointer fields to values (as much as possible) benefits: * fewer possible failures (no memory) during runtime/interpreter/thread init * improved memory locality for pointers looked up relative to interpreter/thread state There is one non-trivial bit: embedding the various PyObject values in PyInterpreterState and PyThreadState means hard-coding the various pieces of the object there (e.g. for dict, its keys/values; for list, its array), as well as adding necessary init code to PyInterpreterState_New() and PyThreadState_New(). The resulting added complexity can be mitigated somewhat with macros or even code generation. (In fact, there is probably significant overlap with Guido's deepfreeze tool.) Regardless, we'll probably need to factor out init funcs for a number of object types, where currently there are only "Py*_New()" funcs that combine allocation and init. ---------- assignee: eric.snow components: Interpreter Core messages: 407476 nosy: Mark.Shannon, eric.snow priority: normal severity: normal stage: needs patch status: open title: Statically allocate interpreter states as much as possible. versions: Python 3.11 _______________________________________ Python tracker <rep...@bugs.python.org> <https://bugs.python.org/issue45953> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
