potiuk commented on issue #24466: URL: https://github.com/apache/airflow/issues/24466#issuecomment-1311890232
I do not think it is question of Airflow at all @SchernHe - this loosk like very different problem. Most likely you should set different keepalive on your SSH connection. It's likely GCP is much more aggressive on killing long-running outgoing connections without actitivity. Also I believe in GCP - regardless from keepalive, the GCP will kill long running connections anyway. I strongly suspect this is the reason. You can try it yourself by replacing the SSHOperator of yours with running SSH command in bash without more frequent keepalive (See SSHHook for details and SSH command line help on how you can do it) and see if you observe the same behaviours. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
