nenkie76 commented on issue #35533:
URL: https://github.com/apache/airflow/issues/35533#issuecomment-1802447704

   @Taragolis is you task and query actually completing in Athena?
   
   My task log in Airflow also outputs `\n ` in log, while then, later it fails:
   
   ```
   [2023-11-08, 07:20:41 UTC] {athena.py:118} INFO - Running Query with params: 
{'QueryString': " --noqa\n\n --noqa\n\nalter table transactions add if not 
exists ......", 'QueryExecutionContext': {'Database': 'xxx', 'Catalog': 
'AwsDataCatalog'}, 'ResultConfiguration': {'OutputLocation': 's3://....'}, 
'WorkGroup': 'primary'}
   [2023-11-08, 07:20:41 UTC] {base_aws.py:581} WARNING - Unable to find AWS 
Connection ID 'aws_default', switching to empty.
   [2023-11-08, 07:20:41 UTC] {base_aws.py:161} INFO - No connection ID 
provided. Fallback on boto3 credential strategy (region_name=None). See: 
https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html
   [2023-11-08, 07:20:42 UTC] {athena.py:121} INFO - Query execution id: 
ccf3adf4-460b-4b85-bd8d-f5dd040faa05
   [2023-11-08, 07:20:42 UTC] {waiter_with_logging.py:78} INFO - Query 
execution id: ccf3adf4-460b-4b85-bd8d-f5dd040faa05, Query is still in 
non-terminal state: QUEUED
   [2023-11-08, 07:21:12 UTC] {waiter_with_logging.py:75} ERROR - Error while 
waiting for query ccf3adf4-460b-4b85-bd8d-f5dd040faa05 to complete: FAILED
   [2023-11-08, 07:21:12 UTC] {athena.py:267} WARNING - Error while waiting for 
query ccf3adf4-460b-4b85-bd8d-f5dd040faa05 to complete: Waiter query_complete 
failed: Waiter encountered a terminal failure state: For expression 
"QueryExecution.Status.State" we matched expected path: "FAILED"
   [2023-11-08, 07:21:12 UTC] {taskinstance.py:1937} ERROR - Task failed with 
exception
   Traceback (most recent call last):
     File 
"/usr/local/lib/python3.11/site-packages/airflow/providers/amazon/aws/operators/athena.py",
 line 148, in execute
       raise Exception(
   Exception: Final state of Athena job is FAILED
   ```
   
   I did not yet check open source version. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to