On 2017-03-13 06:28, Benoit GEORGELIN - Association Web4all wrote:
Hi lxc-users ,

I would like to know if you have any experience with a large number of
LXC/LXD containers ?
In term of performance, stability and limitation .

I'm wondering for exemple, if having 100 containers behave the same of
having 1.000 or 10.000  with the same configuration to avoid to talk
about container usage.

I'm running LXD on several servers and I'm generally satisfied with it - performance, stability are fine. They are mostly <50 containers though.

I also have a LXD server which runs 100+ containers, which starts/stops/deletes dozens of containers daily and is used for automation. Approximately once every 1-2 months, "lxc stop" / "lxc restart" command will fail, which is a bit of stability concern for us.

The cause is unclear. In LXD log for the container, the only thing logged is:


lxc 20170301115514.738 WARN lxc_commands - commands.c:lxc_cmd_rsp_recv:172 - Command get_cgroup failed to receive response: Connection reset by peer.


When it starts to happen, it affects all containers - "lxc stop / lxc restart" will hang for any of the running containers. What's interesting, the container gets stopped with "lxc stop", the command just never returns. For "lxc restart" case, it will just stop the container (and the command will not return / will not start the container again).

The only thing which fixes that is server restart.

There is also no clear way to reproduce it reliably (other than running the server for long, and starting/stopping a large number of containers over that time...).

I think it's some kernel issue, but unfortunately I was not able to debug this any further.



Tomasz Chmielewski
https://lxadm.com
_______________________________________________
lxc-users mailing list
lxc-users@lists.linuxcontainers.org
http://lists.linuxcontainers.org/listinfo/lxc-users

Reply via email to