[issue32776] asyncio SIGCHLD scalability problems

2019-04-04 Thread twisteroid ambassador
twisteroid ambassador added the comment: The child watchers are documented now, see here: https://docs.python.org/3/library/asyncio-policy.html#process-watchers Sounds like FastChildWatcher https://docs.python.org/3/library/asyncio-policy.html#asyncio.FastChildWatcher is exactly what you ne

[issue32776] asyncio SIGCHLD scalability problems

2019-04-04 Thread Roman Evstifeev
Change by Roman Evstifeev : -- nosy: +Roman.Evstifeev ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https:/

[issue32776] asyncio SIGCHLD scalability problems

2018-02-05 Thread Nathaniel Smith
Nathaniel Smith added the comment: There's two separate issues here: the warning spew because asyncio's internal signal handling code starts losing signals when they arrive too quickly, and the way the child reaping loop polls all the children on every SIGCHLD, which makes reaping N children

[issue32776] asyncio SIGCHLD scalability problems

2018-02-05 Thread holger
New submission from holger : I intended to use the asyncio framework for building an end-to-end test for our software. In the test I would spawn somewhere between 5k to 10k processes and have the same number of sockets to manage. When I built a prototype I ran into some scaling issues. Instead