On Thu, May 13, 2021 at 3:34 PM Sketch <ov...@rednsx.org> wrote:
>
> This is a new system is CentOS 8.3, with the oVirt-4.4 repo and all
> updates applied.  When I try to install the hosted engine with my engine
> backup from 4.3.10, the installation fails with a too many open files
> error.  My 8.3 hosts already had 1M system max files, which is more than
> any of my CentOS 7/oVirt 4.3 hosts have.  I tried increasing it to 2M with
> no luck, so my suspicion is that the error is on the engine itself?
>
> I tried provisioning a new engine just to test, and I get SSH key errors
> instead of this one.
>
> Any suggestions?
>
> 2021-05-12 23:09:44,731-0700 ERROR ansible failed {
>      "ansible_host": "localhost",
>      "ansible_playbook": 
> "/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml",
>      "ansible_result": {
>          "_ansible_no_log": false,
>          "exception": "Traceback (most recent call last):\n  File 
> \"/usr/lib/python3.6/site-packages/ansible/executor/task_executor.py\", line 
> 665, in _execute\n    result = self._handler.run(task_vars=variables)\n  File 
> \"/usr/lib/python3.6/site-packages/ansible/plugins/action/wait_for_connection.py\",
>  line 122, in run\n    
> self._remove_tmp_path(self._connection._shell.tmpdir)\n  File 
> \"/usr/lib/python3.6/site-packages/ansible/plugins/action/__init__.py\", line 
> 417, in _remove_tmp_path\n    tmp_rm_res = 
> self._low_level_execute_command(cmd, sudoable=False)\n  File 
> \"/usr/lib/python3.6/site-packages/ansible/plugins/action/__init__.py\", line 
> 1085, in _low_level_execute_command\n    rc, stdout, stderr = 
> self._connection.exec_command(cmd, in_data=in_data, sudoable=sudoable)\n  
> File \"/usr/lib/python3.6/site-packages/ansible/plugins/connection/ssh.py\", 
> line 1191, in exec_command\n    cmd = self._build_command(*args)\n  File 
> \"/usr/lib/python3.6/site-packages/ansible/plugins/connection/s
>  sh.py\", line 562, in _build_command\n    self.sshpass_pipe = 
> os.pipe()\nOSError: [Errno 24] Too many open files\n\nDuring handling of the 
> above exception, another exception occurred:\n\nTraceback (most recent call 
> last):\n  File 
> \"/usr/lib/python3.6/site-packages/ansible/executor/task_executor.py\", line 
> 147, in run\n    res = self._execute()\n  File 
> \"/usr/lib/python3.6/site-packages/ansible/executor/task_executor.py\", line 
> 673, in _execute\n    self._handler.cleanup()\n  File 
> \"/usr/lib/python3.6/site-packages/ansible/plugins/action/__init__.py\", line 
> 128, in cleanup\n    self._remove_tmp_path(self._connection._shell.tmpdir)\n  
> File \"/usr/lib/python3.6/site-packages/ansible/plugins/action/__init__.py\", 
> line 417, in _remove_tmp_path\n    tmp_rm_res = 
> self._low_level_execute_command(cmd, sudoable=False)\n  File 
> \"/usr/lib/python3.6/site-packages/ansible/plugins/action/__init__.py\", line 
> 1085, in _low_level_execute_command\n    rc, stdout, stderr = 
> self._connection.exec_command
>  (cmd, in_data=in_data, sudoable=sudoable)\n  File 
> \"/usr/lib/python3.6/site-packages/ansible/plugins/connection/ssh.py\", line 
> 1191, in exec_command\n    cmd = self._build_command(*args)\n  File 
> \"/usr/lib/python3.6/site-packages/ansible/plugins/connection/ssh.py\", line 
> 562, in _build_command\n    self.sshpass_pipe = os.pipe()\nOSError: [Errno 
> 24] Too many open files\n",
>          "msg": "Unexpected failure during module execution.",
>          "stdout": ""
>      },
>      "ansible_task": "Wait for the local VM",
>      "ansible_type": "task",
>      "status": "FAILED",
>      "task_duration": 3605

So I suppose it failed after 3605 seconds, or 721 attempts (of 5 seconds each).

Do you see the VM in 'virsh list'?
Can you see the VM running (e.g. 'ps auxww | grep qemu')?
Can you try to ssh to it from the host (search the logs for
local_vm_ip for its local/private temporary address)?
Perhaps open its console (Perhaps 'virsh console HostedEngineLocal')?

That said, I'd personally also consider it a bug in ansible, unless
you made some relevant custom changes - the bug is that it seems to
leak open files.

Thanks and best regards,
-- 
Didi
_______________________________________________
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/ICRTPOJ6HNZI3RUP6OFWKEKCWOF7J7KG/

Reply via email to