nenkie76 commented on issue #35533: URL: https://github.com/apache/airflow/issues/35533#issuecomment-1802447704
@Taragolis is you task and query actually completing in Athena? My task log in Airflow also outputs `\n ` in log, while then, later it fails: ``` [2023-11-08, 07:20:41 UTC] {athena.py:118} INFO - Running Query with params: {'QueryString': " --noqa\n\n --noqa\n\nalter table transactions add if not exists ......", 'QueryExecutionContext': {'Database': 'xxx', 'Catalog': 'AwsDataCatalog'}, 'ResultConfiguration': {'OutputLocation': 's3://....'}, 'WorkGroup': 'primary'} [2023-11-08, 07:20:41 UTC] {base_aws.py:581} WARNING - Unable to find AWS Connection ID 'aws_default', switching to empty. [2023-11-08, 07:20:41 UTC] {base_aws.py:161} INFO - No connection ID provided. Fallback on boto3 credential strategy (region_name=None). See: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html [2023-11-08, 07:20:42 UTC] {athena.py:121} INFO - Query execution id: ccf3adf4-460b-4b85-bd8d-f5dd040faa05 [2023-11-08, 07:20:42 UTC] {waiter_with_logging.py:78} INFO - Query execution id: ccf3adf4-460b-4b85-bd8d-f5dd040faa05, Query is still in non-terminal state: QUEUED [2023-11-08, 07:21:12 UTC] {waiter_with_logging.py:75} ERROR - Error while waiting for query ccf3adf4-460b-4b85-bd8d-f5dd040faa05 to complete: FAILED [2023-11-08, 07:21:12 UTC] {athena.py:267} WARNING - Error while waiting for query ccf3adf4-460b-4b85-bd8d-f5dd040faa05 to complete: Waiter query_complete failed: Waiter encountered a terminal failure state: For expression "QueryExecution.Status.State" we matched expected path: "FAILED" [2023-11-08, 07:21:12 UTC] {taskinstance.py:1937} ERROR - Task failed with exception Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/airflow/providers/amazon/aws/operators/athena.py", line 148, in execute raise Exception( Exception: Final state of Athena job is FAILED ``` I did not yet check open source version. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org