Re: [I] Support named mapping for task group [airflow]

2024-08-22 Thread via GitHub
kyleburke-meq commented on issue #40799: URL: https://github.com/apache/airflow/issues/40799#issuecomment-2304608656 @uranusjr There are no UI changes with this feature. I understand map indexes are for the task instance. But since the task instances get expanded together at the task group

Re: [I] Support named mapping for task group [airflow]

2024-08-21 Thread via GitHub
uranusjr commented on issue #40799: URL: https://github.com/apache/airflow/issues/40799#issuecomment-2303886710 Currently map indexes are only shown for task instances, which don’t have a notion for groups. Please be more specific. Some mock UI drawings would help. -- This is an automated

Re: [I] Support named mapping for task group [airflow]

2024-08-13 Thread via GitHub
kyleburke-meq commented on issue #40799: URL: https://github.com/apache/airflow/issues/40799#issuecomment-2286230070 @uranusjr in the same place the map index shows now. so no UI changes just being able to set a map index template at the task group level like in my example above. -- This

Re: [I] Support named mapping for task group [airflow]

2024-08-13 Thread via GitHub
uranusjr commented on issue #40799: URL: https://github.com/apache/airflow/issues/40799#issuecomment-2285657335 Where in the UI do you want the name to appear? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [I] Support named mapping for task group [airflow]

2024-08-09 Thread via GitHub
kyleburke-meq commented on issue #40799: URL: https://github.com/apache/airflow/issues/40799#issuecomment-2278016869 @uranusjr we want to be able to define a `map_index_template` at the task group level that all expanded tasks in the group will use. for example if i define a task group like

Re: [I] Support named mapping for task group [airflow]

2024-08-06 Thread via GitHub
uranusjr commented on issue #40799: URL: https://github.com/apache/airflow/issues/40799#issuecomment-2272644235 Please be more specific. How do you propose the value to be specified in a DAG? Should the value show up in the UI, API, and CLI? If so, where? -- This is an automated message f

Re: [I] Support named mapping for task group [airflow]

2024-08-06 Thread via GitHub
rzilkha commented on issue #40799: URL: https://github.com/apache/airflow/issues/40799#issuecomment-2271352591 @uranusjr we basically would like to have the same view as we have in dynamic tasks. where instead of indexes we would see labels which will generated as a function of the d

Re: [I] Support named mapping for task group [airflow]

2024-08-01 Thread via GitHub
uranusjr commented on issue #40799: URL: https://github.com/apache/airflow/issues/40799#issuecomment-2262299851 Can you provide an example how a DAG would look like using the feature? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [I] Support named mapping for task group [airflow]

2024-07-16 Thread via GitHub
kyleburke-meq commented on issue #40799: URL: https://github.com/apache/airflow/issues/40799#issuecomment-2230864811 I would also love to see this feature. My current work around was to create a custom decorator that expects a kwarg (in my case client_config) and use the name in the config

Re: [I] Support named mapping for task group [airflow]

2024-07-15 Thread via GitHub
rzilkha commented on issue #40799: URL: https://github.com/apache/airflow/issues/40799#issuecomment-2230056737 Hi @shahar1 appreciate the comment. After reviewing some of the code in that area, I understand now that you are probably right, so we would be glad if someone else in the commun

Re: [I] Support named mapping for task group [airflow]

2024-07-15 Thread via GitHub
shahar1 commented on issue #40799: URL: https://github.com/apache/airflow/issues/40799#issuecomment-2229409414 Thanks for creating the issue and welcome to Apache Airflow! I might be wrong, but it seems for me a bit challenging to solve as a first issue, as it involves changes in many dif

Re: [I] Support Named mapping for task group [airflow]

2024-07-15 Thread via GitHub
boring-cyborg[bot] commented on issue #40799: URL: https://github.com/apache/airflow/issues/40799#issuecomment-2229104203 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

[I] Support Named mapping for task group [airflow]

2024-07-15 Thread via GitHub
rzilkha opened a new issue, #40799: URL: https://github.com/apache/airflow/issues/40799 ### Description Currently, named mapping for dynamic tasks is supported through the map_index_template property. However, this feature is not available for task groups. We would be happy to