> >
> > > >>>>>>> > > > >
> > > >>>>>>>
> > >
> >
> https://github.com/astronomer/airflow-chart/blob/master/templates/scheduler/scheduler-deployment.yaml#L77-L84
> > > >>>>>>> &g
; > > > > > > > >
> > >>>>>>> > > > >
> > >>>>>>>
> >
> https://github.com/astronomer/airflow-chart/blob/master/templates/webserver/webserver-deployment.yaml#L58-L65
> > >>>>>>> > >
;>>> > > > > > > > > > > > and attempt to operate on new or missing
> >>>>>>> columns/tables
> >>>>>>> > > > > before the
> >>>>>>> > > > > > > > > > > > migr
gt;>>> > > > > > > > > > > > so that they don't boot up ahead of a
>>>>>>>> potentially
>>>>>>>> > > > > long-running
>>>>>>>> > > > > > > > > > migration
>>>
; > > > >
>>>>>>> > > > > > > > > > > > > >
>>>>>>> > > > > > > > > > > > > > @Tomasz great question. Our images are
>>>>&
; > > > > > > > published to
>>>>>> > > > > > > > > > > > > > DockerHub
>>>>>> > > > > > > > > > > > > >
>>>>>> > > > >
>>>>>>
t; > > > > > > > script that we include in the image that
>>>>> handles waiting
>>>>> > > > > for the
>>>>> > > > > > > > > > > > > database
>>>>> > > > >
gt;> > > > > > > > > > > > >
>>>> > > > > > > > > > > > >
>>>> > > > > > > > > >
>>>> > > > >
>>>> https://github.com/apache/airflow/pull/7832/files#diff-37
> > > > >
> > > > > > > > > > > > I think we also have to agree on the Airflow version
> > > > supported by the
> > > > > > > > > > > > official helm chart. I'd suggest we support 1.10.10+
>
; repo
>>> > > > > > > > > > > > > >
>>> https://github.com/astronomer/astronomer-airflow-scripts.
>>> > > > > Our
>>> > > > > > > > > > > > > Dockerfiles
>>>
> > > > > > > > > > > > migrations and cleaning up failed pods.
>> > > > > > > > > > > > > >
>> > > > > > > > > > > > >
>> > > > > > > > > > > > > I see two scripts:
>>
gt; > > > > > > > > > * waiting for migrations -> I think this is a good
> > > > > candidate to add
> > > > > > > > > > > > > *airflow
> > > > > > > > > > > > > db wait_for_migration*
; > > > > > > > > > official helm chart. I'd suggest we support 1.10.10+
> > > > > > > > > > > > and we
> > > > > > > > > incorporate
> > > > > > > > > > > > all
&g
> > > > > > > > > the changes needed to airflow (like the "db
> > > wait_for_migration")
> > > > > > > > into 2.0
> > > > > > > > > > > and 1.10 and we support both - image and helm chart for
>
;
>> base
>>
>> :).
>>
>>
>> @kaxil @jarek @aizhamal @ash if there’s no issues, can we please
>>
>> start
>>
>> the
>>
>> process of donation?
>>
>> +1 on my part, of course :)
>>
>>
>>
>> Daniel
; > > > > > > >
> > > > > > > > > >
> > > > > > > > > > > On Tue, Mar 24, 2020 at 10:49 AM Daniel Imberman <
> > > > > > > > > > > daniel.imber...@gmail.com>
> > > > &
ote:
> > > > > > > > > >
> > > > > > > > > > > @jarek I agree completely. I think that pairing an
> official helm
> > > > > > chart
> > > > > > > > > > > with the offic
k I agree completely. I think that pairing an official
> > > > > > > > > > helm
> > > > > chart
> > > > > > > > > > with the official image would make for a REALLY powerful
> > > > > > > &
e
>
> preparing
>
> my
>
> draft and we can make any adjustments needed to make it works
>
> with
>
> the
>
> helm
>
> chart - and I am super happy to collaborate on that.
>
> PR here: https://github.com/apache/airflow/pull/7832
>
> J.
>
>
> O
Cool! Everything is here:
https://github.com/apache/airflow/tree/master/scripts/ci/in_container/kubernetes
In short:
In "kubernetes" dir:
setup_kind_cluster.sh + kind-cluster-conf.yaml -> they are
use to create a kind Kubernetes cluster.
In "docker" subdir:
rebuild_airflow_im
> > > > Daniel
> > > > > > > On Mar 24, 2020, 7:40 AM -0700, Jarek Potiuk <
> > > > > jarek.pot...@polidea.com>,
> > > > > > > wrote:
> > > > > > > > +1. And it should be paired with the official imag
> >> > > > progress on. I looked a lot at the Astronomer's image while
> > >> preparing
> > >> > my
> > >> > > > draft and we can make any adjustments needed to make it works
> with
> > >> the
> > >> > >
that.
> >> > > >
> >> > > > PR here: https://github.com/apache/airflow/pull/7832
> >> > > >
> >> > > > J.
> >> > > >
> >> > > >
> >> > > > On Tue, Mar 24, 2020 at 3:15 PM
r 24, 2020 at 3:15 PM Kaxil Naik
>> > wrote:
>> > > >
>> > > > > @Tomasz Urbaszek :
>> > > > > Helm Chart Link: https://github.com/astronomer/airflow-chart
>> > > > >
>> > > > > On Tue, Mar 24,
..@apache.org>
> > > > > wrote:
> > > > >
> > > > > > An official helm chart is something our community needs! Using
> your
> > > > > > chart as the official makes a lot of sens to me because as you
> > > > > > mentioned - i
battle tested.
> > > > >
> > > > > One question: what Airflow image do you use? Also, would you mind
> > > > > sharing a link to the chart?
> > > > >
> > > > > Tomek
> > > > >
> > > > &g
t; > One question: what Airflow image do you use? Also, would you mind
> > > > sharing a link to the chart?
> > > >
> > > > Tomek
> > > >
> > > >
> > > > On Tue, Mar 24, 2020 at 2:07 PM Greg Neiheisel
> > > > wrote:
> >
you mind
> > > sharing a link to the chart?
> > >
> > > Tomek
> > >
> > >
> > > On Tue, Mar 24, 2020 at 2:07 PM Greg Neiheisel
> > > wrote:
> > > >
> > > > Hey everyone,
> > > >
> > > > Over t
Tomek
> >
> >
> > On Tue, Mar 24, 2020 at 2:07 PM Greg Neiheisel
> > wrote:
> > >
> > > Hey everyone,
> > >
> > > Over the past few years at Astronomer, we’ve created, managed, and
> > hardened
> > > a production-ready Hel
years at Astronomer, we’ve created, managed, and
> hardened
> > a production-ready Helm Chart for Airflow (
> > https://github.com/astronomer/airflow-chart) that is being used by both
> our
> > SaaS and Enterprise customers. This chart is battle-tested and running
> > hund
2:07 PM Greg Neiheisel
wrote:
>
> Hey everyone,
>
> Over the past few years at Astronomer, we’ve created, managed, and hardened
> a production-ready Helm Chart for Airflow (
> https://github.com/astronomer/airflow-chart) that is being used by both our
> SaaS and Enterprise custo
Hey everyone,
Over the past few years at Astronomer, we’ve created, managed, and hardened
a production-ready Helm Chart for Airflow (
https://github.com/astronomer/airflow-chart) that is being used by both our
SaaS and Enterprise customers. This chart is battle-tested and running
hundreds of
32 matches
Mail list logo
