Re: [DISCUSS] Deprecate core airflow k8s settings in KubernetesPodOperator

Small clarification, KPO doesn't currently take into account the default namespace specified in kube settings. AFAIK it considers the following: - in_cluster - cluster_context - config_file - enable_tcp_keepalive - verify_ssl And so my proposal would be that, after a deprecation p

[DISCUSS] Deprecate core airflow k8s settings in KubernetesPodOperator

Currently KPO uses "core" kubernetes utils for client generation. *(I'm working on migrating it to use the hook. The effort was waiting on a few other changes and i'm picking it back up now.)* In addition to using the core *utils*, it also uses the "core" airflow kubernetes *settings* from airflo

Re: [VOTE] Release Airflow 2.2.5 from 2.2.5rc3

+1 (non-binding) installed in virtualenv and ran a deferrable task and a KPO task >

Re: [DISCUSSION] let scheduler heal tasks stuck in queued state

Cool, I can start to work on it. Thanks, Ping On Fri, Apr 1, 2022 at 6:24 AM Jarek Potiuk wrote: > I think we all very much agree that first we need to define > responsibilities for those :). How about someone starts a nice design > doc with graphs etc. we can discuss :) ? > > On Thu, Mar 31

Re: [VOTE] Release Airflow 2.2.5 from 2.2.5rc3

+1 binding On Fri, 1 Apr 2022 at 11:19, Dennis Akpenyi wrote: > +1(non-binding) > > On Fri 1. Apr 2022 at 12:11, Kamil Breguła wrote: > >> +1 (binding) >> >> On Thu, Mar 31, 2022, 23:25 Jed Cunningham >> wrote: >> >>> +1 (binding) >>> >>> I gave it a spin in the helm chart. >>> >>> On Thu, Mar

Re: [DISCUSSION] AIP-49 OpenTelemetry Support for Apache Airflow

Or maybe that people are so stunned by the beauty and usefulness of it that they cannot even say a word :) On Thu, Mar 31, 2022 at 11:37 PM Howard Yoo wrote: > > I think it may mean all is well, perhaps :-) > Howard > > On Thu, Mar 31, 2022 at 9:29 AM Jarek Potiuk wrote: >> >> Hello everyone, >>

Re: [DISCUSSION] let scheduler heal tasks stuck in queued state

I think we all very much agree that first we need to define responsibilities for those :). How about someone starts a nice design doc with graphs etc. we can discuss :) ? On Thu, Mar 31, 2022 at 11:11 PM Ping Zhang wrote: >> >> Airflow would benefit overall from a clearer distinction of what par

Re: [VOTE] Release Airflow 2.2.5 from 2.2.5rc3

+1(non-binding) On Fri 1. Apr 2022 at 12:11, Kamil Breguła wrote: > +1 (binding) > > On Thu, Mar 31, 2022, 23:25 Jed Cunningham > wrote: > >> +1 (binding) >> >> I gave it a spin in the helm chart. >> >> On Thu, Mar 31, 2022 at 10:21 AM Josh Fell >> wrote: >> >>> +1 (non-binding) >>> >>> Verifi

Re: [VOTE] Release Airflow 2.2.5 from 2.2.5rc3

+1 (binding) On Thu, Mar 31, 2022, 23:25 Jed Cunningham wrote: > +1 (binding) > > I gave it a spin in the helm chart. > > On Thu, Mar 31, 2022 at 10:21 AM Josh Fell > wrote: > >> +1 (non-binding) >> >> Verified a few bug fixes, ran some DAGs using core modules. >> >> On Thu, Mar 31, 2022 at 10:

[DISCUSSION] Adding a new provider: Flyte

Hello, I work on an open-source project called Flyte , which is a container-native, structured programming and distributed processing platform that enables highly concurrent, scalable, and maintainable workflows for machine learning and data processing pipelines.