Chaoran Yu created YUNIKORN-704: ----------------------------------- Summary: Scheduling of DaemonSet pods may fail Key: YUNIKORN-704 URL: https://issues.apache.org/jira/browse/YUNIKORN-704 Project: Apache YuniKorn Issue Type: Bug Components: shim - kubernetes Reporter: Chaoran Yu Attachments: fluent-bit-describe.yaml, fluent-bit.yaml
We sometimes see DaemonSet pods fail to be scheduled. Please see attached files for the YAML and _kubectl describe_ output of one such pod. We originally suspected [node reservation|https://github.com/apache/incubator-yunikorn-core/blob/v0.10.0/pkg/scheduler/context.go#L41] was to blame. But even after setting the DISABLE_RESERVATION environment variable to true, we still see such scheduling failures. The issue is especially severe when K8s nodes have disk pressure that causes lots of pods to be evicted. Newly created pods will stay in pending forever. We have to temporarily uninstall YuniKorn and let the default scheduler do the scheduling for these pods. This issue is critical because lots of important pods belong to a DaemonSet, such as Fluent Bit, a common logging solution. This is probably the last remaining roadblock for us to have the confidence to have YuniKorn entirely replace the default scheduler. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@yunikorn.apache.org For additional commands, e-mail: dev-h...@yunikorn.apache.org