o-nikolas opened a new issue, #35490:
URL: https://github.com/apache/airflow/issues/35490

   ### Description
   
   From feedback 
[here](https://github.com/apache/airflow/pull/34381#issuecomment-1796224734):
   
   The executor config [is scoped to 
overrides.containerOverrides](https://github.com/Joffreybvn/airflow/commit/8518785ea1078552d1d2bffe4543b927f67f030d#diff-127473a028d510b65de4dd84962b31ab703fbd821f9e871dd296b5c835ee3eebR264-R282).
 However there are relevant properties outside of overrides.containerOverrides 
that users may want to change.
   
   For example, our ECS Cluster is actually composed of 3 capacity providers: A 
General-Purpose Capacity Provider (which is our cluster's default provider and 
runs on M7g instances), Memory-Optimized (R7g instances) and Compute-Optimized 
(C7g instances). My version of the ECS Executor allows users to set the 
appropriate Capacity Provider via the operator's executor_config param so that 
we can run our jobs in the most cost-efficient environment.
   
   There are several other properties which airflow uses may want to set on a 
task-level, such as:
   
   - 
[overrides.cpu](https://docs.aws.amazon.com/AmazonECS/latest/APIReference/API_TaskOverride.html#ECS-Type-TaskOverride-cpu)
   - 
[overrides.memory](https://docs.aws.amazon.com/AmazonECS/latest/APIReference/API_TaskOverride.html#ECS-Type-TaskOverride-memory)
   - 
[networkConfiguration](https://docs.aws.amazon.com/AmazonECS/latest/APIReference/API_RunTask.html#ECS-RunTask-request-networkConfiguration)
   - 
[tags](https://docs.aws.amazon.com/AmazonECS/latest/APIReference/API_RunTask.html#ECS-RunTask-request-tags)
   - 
[placementConstraints](https://docs.aws.amazon.com/AmazonECS/latest/APIReference/API_RunTask.html#ECS-RunTask-request-placementConstraints)
   - 
[placementStrategy](https://docs.aws.amazon.com/AmazonECS/latest/APIReference/API_RunTask.html#ECS-RunTask-request-placementStrategy)
   
   ### Use case/motivation
   
   _No response_
   
   ### Related issues
   
   #34381
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to