[issue34296] Speed up python startup by pre-warming the vm

Change by Eric Snow : -- nosy: +eric.snow ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue34296] Speed up python startup by pre-warming the vm

INADA Naoki added the comment: On Thu, Aug 9, 2018 at 3:17 AM Cyker Way wrote: > > Cyker Way added the comment: > > I'm fine with stdlib, 3rd party tools, or whatever. My focus is to understand > is whether this idea can be correctly implemented on the python VM or not. > I've been

[issue34296] Speed up python startup by pre-warming the vm

Cyker Way added the comment: I'm fine with stdlib, 3rd party tools, or whatever. My focus is to understand is whether this idea can be correctly implemented on the python VM or not. I've been searching for similar implementations on standard JVM, but the results mostly come from research

[issue34296] Speed up python startup by pre-warming the vm

Ronald Oussoren added the comment: This might be a useful feature but I think it would be better to develop this outside the stdlib, especially when the mechanism needs application specific code (such as preloading modules used by a specific script). If/when such a tool has enough traction

[issue34296] Speed up python startup by pre-warming the vm

INADA Naoki added the comment: On Wed, Aug 8, 2018 at 6:40 AM Cyker Way wrote: > > Cyker Way added the comment: > > > While this issue is "pre warming VM", VM startup is not significant part > > of your 500ms. > > 10-20ms should be OK for shell scripts. But a fork is still faster. > > >

[issue34296] Speed up python startup by pre-warming the vm

Cyker Way added the comment: > While this issue is "pre warming VM", VM startup is not significant part of > your 500ms. 10-20ms should be OK for shell scripts. But a fork is still faster. > You're talking about application specific strategy now. It's different of > this issue.

[issue34296] Speed up python startup by pre-warming the vm

INADA Naoki added the comment: * While this issue is "pre warming VM", VM startup is not significant part of your 500ms. * You're talking about application specific strategy now. It's different of this issue. And many ideas like yours are already discussed on ML, again and again. I feel

[issue34296] Speed up python startup by pre-warming the vm

Cyker Way added the comment: It was tested on a x86_64 Linux system. The machine is not quite new but is OK for building and running python. The test script is actually a management tool for a larger project that is not released in public so I don't have right to disclose it here. When

[issue34296] Speed up python startup by pre-warming the vm

INADA Naoki added the comment: > I understand many things can happen while importing a library. But for a > specific program, its imports are usually fixed and very much likely the same > between runs. That's why I believe a zygote/fork/snapshot feature would still > be helpful to help

[issue34296] Speed up python startup by pre-warming the vm

INADA Naoki added the comment: > In my tests, a helloworld python script generally takes about 30-40 ms. [snip] > Finally, for simple and quick user scrips, the 30-40 ms startup time without > any import statements may not be a huge problem, but it's still tangible and > makes the program

[issue34296] Speed up python startup by pre-warming the vm

Cyker Way added the comment: > VM startup + `import site` are done in 10~20ms on common Linux machine. > While Python VM startup is not lightning fast, library import time is much > slower than VM startup in many cases. In my tests, a helloworld python script generally takes about 30-40

[issue34296] Speed up python startup by pre-warming the vm

INADA Naoki added the comment: > i did 2 implementations in both python and pure bash, python takes about > 500ms to run while bash is more than 10 times faster. VM startup + `import site` are done in 10~20ms on common Linux machine. It won't take 500ms. While Python VM startup is not

[issue34296] Speed up python startup by pre-warming the vm

Change by INADA Naoki : -- nosy: +inada.naoki versions: -Python 3.6, Python 3.7 ___ Python tracker ___ ___ Python-bugs-list

[issue34296] Speed up python startup by pre-warming the vm

Nick Coghlan added the comment: It isn't currently feasible to do anything along these lines, as the CPython runtime is highly configurable, so it's far from clear what, if anything, could be shared from run to run, and nor is it clear how the interpreter could check whether or not the

[issue34296] Speed up python startup by pre-warming the vm

Change by Barry A. Warsaw : -- nosy: +barry ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue34296] Speed up python startup by pre-warming the vm

Terry J. Reedy added the comment: We are aware that startup time is a issue, especially for quick scripts. I don't know if your ideas have been considered, so I added a couple of people who might. The python-ideas list would likely be a better place for discussion until there is some idea

[issue34296] Speed up python startup by pre-warming the vm

New submission from Cyker Way : I'm currently writing some shell tools with python3. While python can definitely do the job succinctly, there is one problem which made me feel I might have to switch to other languages or even pure bash scripts: python startup time. Shell tools are used very