[ https://issues.apache.org/jira/browse/AIRFLOW-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16681516#comment-16681516 ]
John Cheng commented on AIRFLOW-3320: ------------------------------------- Oh, I didn't notice. Should be fixed after studying the latest code. > Sagemaker operator never ends when having "Stopped" status > ---------------------------------------------------------- > > Key: AIRFLOW-3320 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3320 > Project: Apache Airflow > Issue Type: Bug > Components: aws > Reporter: John Cheng > Assignee: Yang Yu > Priority: Minor > > Sagemaker operator never ends when having "Stopped" status. > {code:java} > [2018-11-08 20:15:27,864] {logging_mixin.py:95} INFO - [2018-11-08 > 20:15:27,864] {sagemaker_hook.py:129} INFO - Job still running for 2690 > seconds... current status is InProgress > [2018-11-08 20:15:32,917] {logging_mixin.py:95} INFO - [2018-11-08 > 20:15:32,917] {sagemaker_hook.py:129} INFO - Job still running for 2695 > seconds... current status is Stopping > [2018-11-08 20:15:37,963] {logging_mixin.py:95} INFO - [2018-11-08 > 20:15:37,963] {sagemaker_hook.py:129} INFO - Job still running for 2700 > seconds... current status is Stopping > [2018-11-08 20:15:43,012] {logging_mixin.py:95} INFO - [2018-11-08 > 20:15:43,012] {sagemaker_hook.py:129} INFO - Job still running for 2705 > seconds... current status is Stopping > [2018-11-08 20:15:48,060] {logging_mixin.py:95} INFO - [2018-11-08 > 20:15:48,060] {sagemaker_hook.py:129} INFO - Job still running for 2710 > seconds... current status is Stopping > [2018-11-08 20:15:53,108] {logging_mixin.py:95} INFO - [2018-11-08 > 20:15:53,108] {sagemaker_hook.py:129} INFO - Job still running for 2715 > seconds... current status is Stopping > [2018-11-08 20:15:58,153] {logging_mixin.py:95} INFO - [2018-11-08 > 20:15:58,153] {sagemaker_hook.py:129} INFO - Job still running for 2720 > seconds... current status is Stopping > [2018-11-08 20:16:03,206] {logging_mixin.py:95} INFO - [2018-11-08 > 20:16:03,206] {sagemaker_hook.py:129} INFO - Job still running for 2725 > seconds... current status is Stopping > [2018-11-08 20:16:08,255] {logging_mixin.py:95} INFO - [2018-11-08 > 20:16:08,255] {sagemaker_hook.py:129} INFO - Job still running for 2730 > seconds... current status is Stopping > [2018-11-08 20:16:13,298] {logging_mixin.py:95} INFO - [2018-11-08 > 20:16:13,298] {sagemaker_hook.py:129} INFO - Job still running for 2735 > seconds... current status is Stopping > [2018-11-08 20:16:18,349] {logging_mixin.py:95} INFO - [2018-11-08 > 20:16:18,349] {sagemaker_hook.py:129} INFO - Job still running for 2740 > seconds... current status is Stopping > [2018-11-08 20:16:23,398] {logging_mixin.py:95} INFO - [2018-11-08 > 20:16:23,398] {sagemaker_hook.py:129} INFO - Job still running for 2745 > seconds... current status is Stopping > [2018-11-08 20:16:28,445] {logging_mixin.py:95} INFO - [2018-11-08 > 20:16:28,445] {sagemaker_hook.py:129} INFO - Job still running for 2750 > seconds... current status is Stopping > [2018-11-08 20:16:33,497] {logging_mixin.py:95} INFO - [2018-11-08 > 20:16:33,497] {sagemaker_hook.py:129} INFO - Job still running for 2755 > seconds... current status is Stopping > [2018-11-08 20:16:38,545] {logging_mixin.py:95} INFO - [2018-11-08 > 20:16:38,545] {sagemaker_hook.py:129} INFO - Job still running for 2760 > seconds... current status is Stopping > [2018-11-08 20:16:43,593] {logging_mixin.py:95} INFO - [2018-11-08 > 20:16:43,593] {sagemaker_hook.py:129} INFO - Job still running for 2765 > seconds... current status is Stopping > [2018-11-08 20:16:48,639] {logging_mixin.py:95} INFO - [2018-11-08 > 20:16:48,639] {sagemaker_hook.py:129} INFO - Job still running for 2770 > seconds... current status is Stopping > [2018-11-08 20:16:53,724] {logging_mixin.py:95} INFO - [2018-11-08 > 20:16:53,724] {sagemaker_hook.py:129} INFO - Job still running for 2775 > seconds... current status is Stopping > [2018-11-08 20:16:58,773] {logging_mixin.py:95} INFO - [2018-11-08 > 20:16:58,773] {sagemaker_hook.py:129} INFO - Job still running for 2780 > seconds... current status is Stopping > [2018-11-08 20:17:03,835] {logging_mixin.py:95} INFO - [2018-11-08 > 20:17:03,835] {sagemaker_hook.py:129} INFO - Job still running for 2785 > seconds... current status is Stopping > [2018-11-08 20:17:08,880] {logging_mixin.py:95} INFO - [2018-11-08 > 20:17:08,880] {sagemaker_hook.py:129} INFO - Job still running for 2790 > seconds... current status is Stopping > [2018-11-08 20:17:13,931] {logging_mixin.py:95} INFO - [2018-11-08 > 20:17:13,931] {sagemaker_hook.py:129} INFO - Job still running for 2795 > seconds... current status is Stopping > [2018-11-08 20:17:18,976] {logging_mixin.py:95} INFO - [2018-11-08 > 20:17:18,976] {sagemaker_hook.py:129} INFO - Job still running for 2800 > seconds... current status is Stopping > [2018-11-08 20:17:24,020] {logging_mixin.py:95} INFO - [2018-11-08 > 20:17:24,020] {sagemaker_hook.py:129} INFO - Job still running for 2805 > seconds... current status is Stopping > [2018-11-08 20:17:29,070] {logging_mixin.py:95} INFO - [2018-11-08 > 20:17:29,070] {sagemaker_hook.py:129} INFO - Job still running for 2810 > seconds... current status is Stopping > [2018-11-08 20:17:34,119] {logging_mixin.py:95} INFO - [2018-11-08 > 20:17:34,119] {sagemaker_hook.py:129} INFO - Job still running for 2815 > seconds... current status is Stopping > [2018-11-08 20:17:39,125] {logging_mixin.py:95} INFO - [2018-11-08 > 20:17:39,125] {connectionpool.py:238} INFO - Resetting dropped connection: > api.sagemaker.us-west-2.amazonaws.com > [2018-11-08 20:17:39,254] {logging_mixin.py:95} INFO - [2018-11-08 > 20:17:39,253] {sagemaker_hook.py:129} INFO - Job still running for 2820 > seconds... current status is Stopping > [2018-11-08 20:17:44,302] {logging_mixin.py:95} INFO - [2018-11-08 > 20:17:44,302] {sagemaker_hook.py:129} INFO - Job still running for 2825 > seconds... current status is Stopping > [2018-11-08 20:17:49,344] {logging_mixin.py:95} INFO - [2018-11-08 > 20:17:49,343] {sagemaker_hook.py:129} INFO - Job still running for 2830 > seconds... current status is Stopping > [2018-11-08 20:17:54,391] {logging_mixin.py:95} INFO - [2018-11-08 > 20:17:54,390] {sagemaker_hook.py:129} INFO - Job still running for 2835 > seconds... current status is Stopped > [2018-11-08 20:17:59,440] {logging_mixin.py:95} INFO - [2018-11-08 > 20:17:59,440] {sagemaker_hook.py:129} INFO - Job still running for 2840 > seconds... current status is Stopped > [2018-11-08 20:18:04,489] {logging_mixin.py:95} INFO - [2018-11-08 > 20:18:04,489] {sagemaker_hook.py:129} INFO - Job still running for 2845 > seconds... current status is Stopped > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)