potiuk commented on code in PR #30705:
URL: https://github.com/apache/airflow/pull/30705#discussion_r1170580465
##########
dev/breeze/src/airflow_breeze/utils/selective_checks.py:
##########
@@ -606,7 +606,43 @@ def parallel_test_types(self) -> str:
)
test_types_to_remove.add(test_type)
current_test_types = current_test_types - test_types_to_remove
- return " ".join(sorted(current_test_types))
+ for test_type in tuple(current_test_types):
+ if test_type == "Providers":
+ current_test_types.remove(test_type)
+ current_test_types.update(
+ ("Providers[amazon]", "Providers[google]",
"Providers[-amazon,google]")
+ )
+ elif test_type.startswith("Providers[") and "amazon" in test_type
or "google" in test_type:
+ current_test_types.remove(test_type)
+ if "amazon" in test_type:
+ current_test_types.add("Providers[amazon]")
+ if "google" in test_type:
+ current_test_types.add("Providers[google]")
Review Comment:
BTW. I am really not trying to mock you :D - it's just REALLY our tests are
ment to be collected and executed sequentially and it would be HUGE effort to
change it, that's why I figured out that more feasible way to utilise multiple
CPUs, one that does not cost enormoust amount of engineering time (not
mentioning mental breakdown while doing so) is to split the tests in sequential
chunks that are run in parallel each with own database and in an isolated
container.
This is a way to keep sanity.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
