vatsrahul1001 opened a new issue, #35914:
URL: https://github.com/apache/airflow/issues/35914

   ### Apache Airflow version
   
   2.8.0b1
   
   ### What happened
   
   The scheduler getting crashed when downgrading from 2.8.0b1 to 2.7.3
   we had some running TIs when the downgrade happened, looks like Adopting 
tasks failing the scheduler.
   could be due to this [PR](https://github.com/apache/airflow/pull/35096/files)
   
   ### What you think should happen instead
   
   _No response_
   
   ### How to reproduce
   
   create 2.8.0b1 deployment
   execute a couple of dags
   downgrade to 2.7.3
   scheduler goes in crash loop
   
   **Logs:**
   [2023-11-28T07:14:26.927+0000] {process_utils.py:131} INFO - Sending 15 to 
group 32. PIDs of all processes in the group: [32]
   [2023-11-28T07:14:26.927+0000] {process_utils.py:86} INFO - Sending the 
signal 15 to group 32
   [2023-11-28T07:14:27.140+0000] {process_utils.py:79} INFO - Process 
psutil.Process(pid=32, status='terminated', exitcode=0, started='07:14:25') 
(32) terminated with exit code 0
   [2023-11-28T07:14:27.140+0000] {scheduler_job_runner.py:874} INFO - Exited 
execute loop
   [2023-11-28T07:14:27.145+0000] {scheduler_command.py:49} ERROR - Exception 
when running scheduler job
   Traceback (most recent call last):
     File 
"/usr/local/lib/python3.11/site-packages/airflow/cli/commands/scheduler_command.py",
 line 47, in _run_scheduler_job
       run_job(job=job_runner.job, execute_callable=job_runner._execute)
     File "/usr/local/lib/python3.11/site-packages/airflow/utils/session.py", 
line 77, in wrapper
       return func(*args, session=session, **kwargs)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
     File "/usr/local/lib/python3.11/site-packages/airflow/jobs/job.py", line 
289, in run_job
       return execute_job(job, execute_callable=execute_callable)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
     File "/usr/local/lib/python3.11/site-packages/airflow/jobs/job.py", line 
318, in execute_job
       ret = execute_callable()
             ^^^^^^^^^^^^^^^^^^
     File 
"/usr/local/lib/python3.11/site-packages/astronomer/airflow/version_check/plugin.py",
 line 30, in run_before
       fn(*args, **kwargs)
     File 
"/usr/local/lib/python3.11/site-packages/airflow/jobs/scheduler_job_runner.py", 
line 845, in _execute
       self._run_scheduler_loop()
     File 
"/usr/local/lib/python3.11/site-packages/airflow/jobs/scheduler_job_runner.py", 
line 927, in _run_scheduler_loop
       self.adopt_or_reset_orphaned_tasks()
     File "/usr/local/lib/python3.11/site-packages/airflow/utils/session.py", 
line 77, in wrapper
       return func(*args, session=session, **kwargs)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
     File 
"/usr/local/lib/python3.11/site-packages/airflow/jobs/scheduler_job_runner.py", 
line 1601, in adopt_or_reset_orphaned_tasks
       for attempt in run_with_db_retries(logger=self.log):
     File "/usr/local/lib/python3.11/site-packages/tenacity/__init__.py", line 
347, in __iter__
       do = self.iter(retry_state=retry_state)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
     File "/usr/local/lib/python3.11/site-packages/tenacity/__init__.py", line 
314, in iter
       return fut.result()
              ^^^^^^^^^^^^
     File "/usr/local/lib/python3.11/concurrent/futures/_base.py", line 449, in 
result
       return self.__get_result()
              ^^^^^^^^^^^^^^^^^^^
     File "/usr/local/lib/python3.11/concurrent/futures/_base.py", line 401, in 
__get_result
       raise self._exception
     File 
"/usr/local/lib/python3.11/site-packages/airflow/jobs/scheduler_job_runner.py", 
line 1645, in adopt_or_reset_orphaned_tasks
       tis_to_adopt_or_reset = session.scalars(tis_to_adopt_or_reset).all()
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
     File 
"/usr/local/lib/python3.11/site-packages/sqlalchemy/engine/result.py", line 
1476, in all
       return self._allrows()
              ^^^^^^^^^^^^^^^
     File 
"/usr/local/lib/python3.11/site-packages/sqlalchemy/engine/result.py", line 
401, in _allrows
       rows = self._fetchall_impl()
              ^^^^^^^^^^^^^^^^^^^^^
     File 
"/usr/local/lib/python3.11/site-packages/sqlalchemy/engine/result.py", line 
1389, in _fetchall_impl
       return self._real_result._fetchall_impl()
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
     File 
"/usr/local/lib/python3.11/site-packages/sqlalchemy/engine/result.py", line 
1813, in _fetchall_impl
       return list(self.iterator)
              ^^^^^^^^^^^^^^^^^^^
     File "/usr/local/lib/python3.11/site-packages/sqlalchemy/orm/loading.py", 
line 147, in chunks
       fetch = cursor._raw_all_rows()
               ^^^^^^^^^^^^^^^^^^^^^^
     File 
"/usr/local/lib/python3.11/site-packages/sqlalchemy/engine/result.py", line 
393, in _raw_all_rows
       return [make_row(row) for row in rows]
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
     File 
"/usr/local/lib/python3.11/site-packages/sqlalchemy/engine/result.py", line 
393, in <listcomp>
       return [make_row(row) for row in rows]
               ^^^^^^^^^^^^^
     File "/usr/local/lib/python3.11/site-packages/sqlalchemy/sql/sqltypes.py", 
line 1870, in process
       return loads(value)
              ^^^^^^^^^^^^
   AttributeError: Can't get attribute 'ConfDict' on <module 
'airflow.models.dagrun' from 
'/usr/local/lib/python3.11/site-packages/airflow/models/dagrun.py'>
   
   ### Operating System
   
   Linux
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Deployment
   
   Astronomer
   
   ### Deployment details
   
   _No response_
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to