;>> I am not sure I understand your response to Nathan.
>>>>>>>>
>>>>>>>> I agree that it is also a valid use case, but I don't see how it
>>>>>>>> can be cleanly done while keeping TaskGroup only as a UI concept.
>>>>&
t;>
>>>>>>> On Fri, Mar 5, 2021 at 1:31 AM Kevin Yang wrote:
>>>>>>>
>>>>>>>> Hi Nathan,
>>>>>>>>
>>>>>>>> Thanks a lot for your input and it is indeed a valid use case. This
>>>&
task after the group that a sensor waits on
>
>
>
>So, I would certainly like TaskGroups to have some notion of run status as to
>better enable downstream decision making.
>
>
>
>I’ve already created a feature ticket to try to add some kind of TaskGroup
>Sensor but perhaps this
y, 4 March 2021 at 05:21
To: dev@airflow.apache.org [dev@airflow.apache.org] < dev@airflow.apache.org
[dev@airflow.apache.org] >
Subject: [DISCUSS] TaskGroup in Tree View
Hi team,
We are very glad to see the introduction of TaskGroup in Airflow 2.0 and really
like it. Thanks to Yu Qia
;>> nathan.hadfi...@king.com> wrote:
>>>>>>
>>>>>>> Hi Kevin,
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> A quick piece of input from our recent experiences of working with
tions:
>>>>>>
>>>>>>
>>>>>>
>>>>>>1. Create a sensor task in a DAG for every task in the group
>>>>>>2. Create a Dummy task after the group that a sensor waits on
>>>>>>
>>>>
;>>>>
>>>>>
>>>>>1. Create a sensor task in a DAG for every task in the group
>>>>>2. Create a Dummy task after the group that a sensor waits on
>>>>>
>>>>>
>>>>>
>>>>> So, I would certainly li
>>>> as to better enable downstream decision making.
>>>>
>>>>
>>>>
>>>> I’ve already created a feature ticket to try to add some kind of
>>>> TaskGroup Sensor but perhaps this can also form part of the wider
>>>> discussions h
notion of run status
>>> as to better enable downstream decision making.
>>>
>>>
>>>
>>> I’ve already created a feature ticket to try to add some kind of
>>> TaskGroup Sensor but perhaps this can also form part of the wider
>>> discuss
also form part of the wider
>> discussions here.
>>
>>
>>
>> https://github.com/apache/airflow/issues/14563
>>
>>
>>
>> Cheers,
>>
>>
>>
>> Nathan
>>
>>
>>
>> *From: *Kevin Yang
>> *Date: *Thurs
m: *Kevin Yang
> *Date: *Thursday, 4 March 2021 at 05:21
> *To: *dev@airflow.apache.org
> *Subject: *[DISCUSS] TaskGroup in Tree View
>
> Hi team,
>
>
>
> We are very glad to see the introduction of TaskGroup in Airflow 2.0 and
> really like it. Thanks to Yu Qian and e
perhaps this can also form part of the wider discussions here.
https://github.com/apache/airflow/issues/14563
Cheers,
Nathan
From: Kevin Yang
Date: Thursday, 4 March 2021 at 05:21
To: dev@airflow.apache.org
Subject: [DISCUSS] TaskGroup in Tree View
Hi team,
We are very glad to see the
Yes, those are correct. 👍
On Wed, Mar 3, 2021 at 9:47 PM Vikram Koka
wrote:
> Hey Kevin,
>
> One immediate clarifying question:
> - For your use case, it seems that you want to continue using TaskGroup
> only as a "pure UI concept".
> - But, you want it's representation to also be in the Tree Vi
Hey Kevin,
One immediate clarifying question:
- For your use case, it seems that you want to continue using TaskGroup
only as a "pure UI concept".
- But, you want it's representation to also be in the Tree View.
- You are not proposing any "execution or scheduling" enhancements [again
for your use
Hi team,
We are very glad to see the introduction of TaskGroup in Airflow 2.0 and
really like it. Thanks to Yu Qian and everyone that contributed to it. To
continue moving towards the goal of replacing SubDagOperator with
TaskGroup, I'd like to kick off a discussion on bringing TaskGroup into
Tree
15 matches
Mail list logo
