dabla commented on issue #58310:
URL: https://github.com/apache/airflow/issues/58310#issuecomment-4430660685
> We've noticed on our end than doing something like this causes the DAG
version to increment after a run has been triggered (when the dag processor
runs again), but not if we keep forcing to parse the DAG multiple times in a
row. Unclear why the difference.
>
> So essentially doing "parse, parse, parse" doesn't increment but "trigger
run, parse, trigger run, parse" does.
>
> + import uuid
>
> take_snapshot = RdsCreateDbSnapshotOperator(
> task_id="take_rds_snapshot",
> db_type="instance",
> db_identifier="xxxx",
> - db_snapshot_identifier=f"test",
> + db_snapshot_identifier=f"test{uuid.uuid4()}",
> )
> Removing the uuid effectively prevent this increment from happening. Is
there another way to create random strings which don't increment the DAG
version when it runs?
This example can indeed trigger a new Dag version, it's usually a bad idea
to defined dynamic stuff in operators as those may indeed influence the dag
parsing which can lead to new dag version on each parse.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
