-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51876/
-----------------------------------------------------------
Review request for Aurora, Joshua Cohen, Maxim Khutornenko, and Zameer Manji.
Bugs: AURORA-1225
https://issues.apache.org/jira/browse/AURORA-1225
Repository: aurora
Description
-------
Modify executor state transition logic to rely on health checks (if enabled).
[Summary]
Executor needs to start executing user content in STARTING and transition to
RUNNING when a successful required number of health checks is reached.
This review contains a series of executor changes that implement the health
check driven updates. It gives a more complete context of the design of this
feature.
[Background]
Please see this epic: https://issues.apache.org/jira/browse/AURORA-1225
and the design doc:
https://docs.google.com/document/d/1ZdgW8S4xMhvKW7iQUX99xZm10NXSxEWR0a-21FP5d94/edit#
for more details and background.
[Description]
If health check is enabled on vCurrent executor, the health checker will send a
"TASK_RUNNING" message when a successful required number of health checks is
reached within the initial_interval_secs. On the other hand, a "TASK_FAILED"
message was sent if if fail to satisift the required number of health checks
within the initial_interval_secs, or a maximum number of failed health check
limit is reached after the initital_interval_secs.
If health check is disabled on the vCurrent executor, it will sends
"TASK_RUNNING" message to scheduler, so the behavior will be the same as the
vPrev executor.
[Change List]
The current change set includes:
1. Removed the status memoization in StatusManager.
2. Modified the StatusManager to be edge triggered.
3. Changed the Aurora Executor callback function.
4. Modified the Health Checker and redefined the meaning initial_interval_secs.
[TODOs]
Currently I fixed all broken tests caused by my changes. However, more tests
needs to to be added to accomodate to the executor change. I will send
follow-up review update when I cover more edge cases. But any feedback on
implementation is highly appreciated.
Diffs
-----
src/main/python/apache/aurora/executor/aurora_executor.py
ce5ef680f01831cd89fced8969ae3246c7f60cfd
src/main/python/apache/aurora/executor/common/health_checker.py
5fc845eceac6f0c048d7489fdc4c672b0c609ea0
src/main/python/apache/aurora/executor/common/status_checker.py
795dae2d6b661fc528d952c2315196d94127961f
src/main/python/apache/aurora/executor/status_manager.py
228a99a05f339e21cd7e769a42b9b2276e7bc3fc
src/test/python/apache/aurora/executor/common/test_health_checker.py
bb6ea69dd94298c5b8cf4d5f06d06eea7790d66e
src/test/python/apache/aurora/executor/common/test_status_checker.py
5be1981c8c8e88258456adb21aa3ca7c0aa472a7
src/test/python/apache/aurora/executor/test_status_manager.py
ce4679ba1aa7b42cf0115c943d84663030182d23
src/test/python/apache/aurora/executor/test_thermos_executor.py
0bfe9e931f873c9f804f2ba4012e050e1f9fd24e
Diff: https://reviews.apache.org/r/51876/diff/
Testing
-------
./build-support/jenkins/build.sh
./pants test.pytest src/test/python/apache/aurora/executor::
Thanks,
Kai Huang
