MatrixManAtYrService commented on issue #26360: URL: https://github.com/apache/airflow/issues/26360#issuecomment-1245825753
https://github.com/apache/airflow/pull/26369 fixes the problem that was preventing me from even running the DAG. Now I'm getting task failures: ``` {taskinstance.py:1168} INFO - Dependencies all met for <TaskInstance: two_kinds_dynamic_source.partial_dynamic scheduled__1970-01-01T00:00:00+00:00 map_index=0 [queued]> {taskinstance.py:1168} INFO - Dependencies all met for <TaskInstance: two_kinds_dynamic_source.partial_dynamic scheduled__1970-01-01T00:00:00+00:00 map_index=0 [queued]> {taskinstance.py:1367} INFO - ------------------------------------------------- {taskinstance.py:1368} INFO - Starting attempt 1 of 1 {taskinstance.py:1369} INFO - ------------------------------------------------- {taskinstance.py:1388} INFO - Executing <Mapped(PythonOperator): partial_dynamic> on 1970-01-01 00:00:00+00:00 {standard_task_runner.py:53} INFO - Started process 24193 to run task {standard_task_runner.py:81} INFO - Running: ['airflow', 'tasks', 'run', 'two_kinds_dynamic_source', 'partial_dynamic', 'scheduled__1970-01-01T00:00:00+00:00', '--job-id', '9', '--raw', '--subdir', 'DAGS_FOLDER/dynamic_dataset.py', '--cfg-path', '/var/folders/5m/nvs9yfcs6mlfm_63gnk6__3r0000gn/T/tmpmaqqw3sp', '--map-index', '0'] {standard_task_runner.py:82} INFO - Job 9: Subtask partial_dynamic {dagbag.py:522} INFO - Filling up the DagBag from /Users/matt/2022/09/13/dags/dynamic_dataset.py {task_command.py:382} INFO - Running <TaskInstance: two_kinds_dynamic_source.partial_dynamic scheduled__1970-01-01T00:00:00+00:00 map_index=0 [running]> on host LIGO.local {taskinstance.py:1856} ERROR - Task failed with exception Traceback (most recent call last): File "...site-packages/airflow/models/taskinstance.py", line 1462, in _run_raw_task self._execute_task_with_callbacks(context, test_mode) File "...site-packages/airflow/models/taskinstance.py", line 1581, in _execute_task_with_callbacks task_orig = self.render_templates(context=context) File "...site-packages/airflow/models/taskinstance.py", line 2198, in render_templates rendered_task = self.task.render_template_fields(context) File "...site-packages/airflow/models/mappedoperator.py", line 779, in render_template_fields unmapped_task = self.unmap(mapped_kwargs) File "...site-packages/airflow/models/mappedoperator.py", line 602, in unmap kwargs = self._get_unmap_kwargs(kwargs, strict=self._disallow_kwargs_override) File "...site-packages/airflow/models/mappedoperator.py", line 563, in _get_unmap_kwargs prevent_duplicates( File "...site-packages/airflow/models/mappedoperator.py", line 133, in prevent_duplicates raise TypeError(f"{fail_reason} argument: {duplicated_keys.pop()}") TypeError: unmappable or already specified argument: outlets {taskinstance.py:1898} ERROR - Unable to unmap task to determine if we need to send an alert email {taskinstance.py:1406} INFO - Marking task as FAILED. dag_id=two_kinds_dynamic_source, task_id=partial_dynamic, map_index=0, execution_date=19700101T000000, start_date=20220913T183429, end_date=20220913T183429 {standard_task_runner.py:101} ERROR - Failed to execute job 9 for task partial_dynamic (unmappable or already specified argument: outlets; 24193) {local_task_job.py:163} INFO - Task exited with return code 1 ``` If specifying outlets in this way is not supported, then `TypeError: unmappable or already specified argument: outlets` is a reasonable way to fail. So I guess the question now is: Is this a bug or a feature? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
