[I] celery_executor got an unexpected keyword argument 'remove_running' [airflow]

[via GitHub]

potiuk opened a new issue, #40097:
URL: https://github.com/apache/airflow/issues/40097

   ### Discussed in https://github.com/apache/airflow/discussions/39980
   
   <div type='discussions-op-text'>
   
   <sup>Originally posted by **weitang2022** May 31, 2024</sup>
   I upgraded to Airflow 2.9.1. It's been running well for a week, but today I 
see the error below. I tried to downgrade to 2.8.3, but I still see the issue. 
All tasks are stuck in "scheduled" status. Any idea how to get around it? Thank 
you for your help!
   
   May 31, 2024 at 13:51 (UTC-4:00)     [2024-05-31T17:51:01.889+0000] 
{celery_executor.py:370} ERROR - Error syncing the Celery 
executor, ignoring it.       airflow_scheduler
   May 31, 2024 at 13:51 (UTC-4:00)     Traceback (most recent call last):      
airflow_scheduler
   May 31, 2024 at 13:51 (UTC-4:00)     File 
"/usr/local/lib/python3.11/site-packages/airflow/providers/celery/executors/celery_executor.py",
 line 362, in update_task_state    airflow_scheduler
   May 31, 2024 at 13:51 (UTC-4:00)     self.success(key, info) 
airflow_scheduler
   May 31, 2024 at 13:51 (UTC-4:00)     File 
"/usr/local/lib/python3.11/site-packages/airflow/executors/base_executor.py", 
line 332, in success airflow_scheduler
   May 31, 2024 at 13:51 (UTC-4:00)     self.change_state(key, 
TaskInstanceState.SUCCESS, info) airflow_scheduler
   May 31, 2024 at 13:51 (UTC-4:00)     File 
"/usr/local/lib/python3.11/site-packages/airflow/providers/celery/executors/celery_executor.py",
 line 351, in change_state airflow_scheduler
   May 31, 2024 at 13:51 (UTC-4:00)     super().change_state(key, state, info, 
remove_running=remove_running)   airflow_scheduler
   May 31, 2024 at 13:51 (UTC-4:00)     TypeError: BaseExecutor.change_state() 
got an unexpected keyword argument 'remove_running'      airflow_scheduler
   
   The code here is actually throwing a TypeError:
   ```
       def change_state(
           self, key: TaskInstanceKey, state: TaskInstanceState, info=None, 
remove_running=True
       ) -> None:
           try:
               super().change_state(key, state, info, 
remove_running=remove_running)
           except AttributeError:
               # Earlier versions of the BaseExecutor don't accept the 
remove_running parameter for this method
               # TODO: Remove when min airflow version >= 2.9.2
               super().change_state(key, state, info)
           self.tasks.pop(key, None)
   ```</div>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org