Andrushika commented on PR #71213: URL: https://github.com/apache/airflow/pull/71213#issuecomment-5342522670
Just want to clarify a higher-level design question... Will the Lang SDK support stub syntax in native Dags in the future? (e.g. a native Java Dag that holds a Python or Go task) If not, please just ignore me. If it is planned, I think the current flag may not cover that case. Right now the same boolean means two different things: 1. On a Python Dag it is derived, and it means “this Dag has stub tasks”. 2. On a Lang-SDK Dag the producer sets it, and it means “this Dag is implementation-only, do not persist it” (if I read the planned flow right). A native Dag with stub tasks would hit both meanings at once. It has stub tasks, but it is also the real definition that should be persisted. Setting the flag to true would get it dropped, so it has no way to mark itself. If that case is planned, I would suggest a separate field such as `definition_role` (`primary` / `implementation_only`). Then this flag keeps one meaning only (“has stub tasks”), and the persist decision reads the role instead. Just a small suggestion and I could be completely wrong. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
