Hello I need to find a solution to one problem. Sometimes, ssh sessions to vms are terminated. Different sessions, at different places. I cannot find any explanation for this. Today in the morning I got ~20 times of this error. After a while it just disappeared. I just was running the test again and again until it is successful. The same VM, the same host, same test, same env. Errors are like:
2016-10-20 12:52:36,913 stacktrace L0044 ERROR| print_func) 2016-10-20 12:52:36,913 stacktrace L0044 ERROR| File "/usr/lib/python2.7/site-packages/aexpect/client.py", line 1136, in cmd_status_output 2016-10-20 12:52:36,913 stacktrace L0044 ERROR| o = self.cmd_output(cmd, timeout, internal_timeout, print_func, safe) 2016-10-20 12:52:36,913 stacktrace L0044 ERROR| File "/usr/lib/python2.7/site-packages/aexpect/client.py", line 1059, in cmd_output 2016-10-20 12:52:36,914 stacktrace L0044 ERROR| raise ShellProcessTerminatedError(cmd, e.status, o) 2016-10-20 12:52:36,914 stacktrace L0044 ERROR| ShellProcessTerminatedError: Shell process terminated while waiting for command to complete: 'export DISPLAY=:0.0' (status: 255, output: 'Write failed: Broken pipe\n') OR 2016-10-20 12:44:09,573 stacktrace L0044 ERROR| ShellStatusError: Could not get exit status of command: "ss -x src '*X11-unix*' | grep -q -s X11" (output: '') 2016-10-20 12:44:09,573 stacktrace L0045 ERROR| 2016-10-20 12:44:09,574 test L0572 ERROR| Traceback (most recent call last): 2016-10-20 12:44:09,574 test L0572 ERROR| File "/mnt/tests/spice/qe-tests/avocado-vt/avocado_vt/test.py", line 434, in _run_avocado raise test_exception 2016-10-20 12:44:09,574 test L0572 ERROR| ShellStatusError: Could not get exit status of command: "ss -x src '*X11-unix*' | grep -q -s X11" (output: '') 2016-10-20 12:44:09,574 test L0589 ERROR| ERROR 1-rv_connect_fail.172936.req__ss__password__on -> ShellStatusError: Could not get exit status of command: "ss -x src '*X11-unix*' | grep -q -s X11" (output: '') OR 2016-10-20 12:20:05,707 stacktrace L0044 ERROR| File "/usr/lib/python2.7/site-packages/aexpect/client.py", line 1059, in cmd_output 2016-10-20 12:20:05,707 stacktrace L0044 ERROR| raise ShellProcessTerminatedError(cmd, e.status, o) 2016-10-20 12:20:05,707 stacktrace L0044 ERROR| ShellProcessTerminatedError: Shell process terminated while waiting for command to complete: 'true 1>/var/tmp/tmp1SwO8Q 2>/var/tmp/tmpVN1k3u' (status: 255, output: 'Write failed: Broken pipe\n') 2016-10-20 12:20:05,707 stacktrace L0045 ERROR| 2016-10-20 12:20:05,708 test L0572 ERROR| Traceback (most recent call last): 2016-10-20 12:20:05,708 test L0572 ERROR| File "/mnt/tests/spice/qe-tests/avocado-vt/avocado_vt/test.py", line 434, in _run_avocado raise test_exception 2016-10-20 12:20:05,708 test L0572 ERROR| ShellProcessTerminatedError: Shell process terminated while waiting for command to complete: 'true 1>/var/tmp/tmp1SwO8Q 2>/var/tmp/tmpVN1k3u' (status: 255, output: 'Write failed: Broken pipe\n') I tried to stop vm and login from host to VM manually - always successful. Next 20 iterations of this test are successful. Sometimes it is really annoying. Any suggestions ?