Re: [VOTE] Graduate the Apache Airflow as a TLP

+1 (non-binding) Excited to see this community continue to grow, and sincere thanks to everyone involved in getting it here! 🙌 On Fri, Nov 30, 2018 at 2:22 PM Kevin Yang wrote: > +1 (non-binding) > > On Fri, Nov 30, 2018 at 2:15 PM Stefan Seelmann > wrote: > > > +1 (non-binding) > > > > On 11/

Re: [VOTE] Replace with Gitter with Slack?

+1 On Wed, Sep 5, 2018 at 7:46 PM, Beau Barker wrote: > +1 > > Sent from my iPhone > > > On 6 Sep 2018, at 12:45 pm, Sid Anand wrote: > > > > +1 > > > > On Wed, Sep 5, 2018 at 7:38 PM Steve Carpenter < > steve.carpen...@ibotta.com> > > wrote: > > > >> +1 > >> > >>> On Wed, Sep 5, 2018 at 8:30 P

Re: Very looong py files

+1 This was one of the first things that struck us when integrating Airflow, but as we aren't (weren't?) pythonist[a]s at the time, didn't necessarily feel comfortable chiming in with an Issue. On Wed, Mar 14, 2018 at 2:57 PM, George Leslie-Waksman < geo...@cloverhealth.com.invalid> wrote: > Thi

Re: Airflow 1.9.0 is released

Phew! Great job, all involved! 👏 On Tue, Jan 2, 2018 at 2:52 PM, Andy Loughran wrote: > Congratulations guys - lots and lots of voting and you got it over the > line. > > happy new year! > > Andy > > On 2 January 2018 at 22:45, Arthur Wiedmer > wrote: > > > Woohoo! 📣🍾 > > > > Thanks Chris! > >

Re: Data lineage and data portal

+1 On Mon, Nov 27, 2017 at 6:18 PM, Ruslan Dautkhanov wrote: > ‘’’ > I'm > now working on sql scanners, extractors and other tools that allow me to > populate the database > ‘’’ > > Very cool. Cloudera Navigator ( not an open source product) does this too > to some extent - collect metadata and

Re: Airflow Deployment tools

Samson deploy that runs a script running a Broadside deploy for ECS, which bounces the Web and Scheduler workers, and updates the DAG directory on the workers. Docker images come from a Github -> Travis -> Quay

Re: Airflow on ECS

We're actively following the Airflow/Kubernetes integration , and are eventually going to move to both running everything on k8s and using KubernetesExecutors for many things, but we've deployed Airflow to ECS from day one. It works mostly fine, a

Re: Meetup Interest?

+1 We'd definitely be in. Would love to chat more about K8s/Airflow--Data Eng has been a little twitchy about being the guinea pigs in our org, but the production app is now serving all traffic from it, so we're planning out our strategy. On Fri, Oct 13, 2017 at 1:29 PM, Daniel Imberman (BLOOMBER

Re: UI issues with DAGs

Hey Michal, We were running into the second issue once we bumped to 1.8.2, as well. I commented in the ticket, but the good news is that AIRFLOW-1655 is a duplicate of an already-known issue, and should be fixed in AIRFLOW-1519 , which is slated

Re: Airflow + Kubernetes update meeting

Perfect, thanks so much for your hard work, Daniel! On Tue, Sep 5, 2017 at 11:41 AM, Christopher Bockman wrote: > @Daniel great, thanks! We'd love to participate--have just started > combining Kubernetes+Airflow and are presumably hitting all of the same > issues everyone else is. > > On Tue, S

Re: Airflow + Kubernetes update meeting

There's a PagerDuty mini-conference in SF that I've vaguely penciled into my calendar for that day--I'm certainly more than happy to just review notes after the meeting if there are any, but just in the event anyone else in the area is also planning on going, since there might be some overlap. On

Re: Info needed regarding upgrading to 1.8.2

So spurred on by this thread, we were just having an internal discussion about how best to handle the situation when DAG definitions are updated, not just when new DAGs appear. Currently, we're doing it as part of a broader deploy that's also bouncing the scheduler... Is that common [or recommended

Re: Airflow + Kubernetes discussion

gout). > > Best, > Daniel > > On Thu, Jul 27, 2017 at 10:11 AM Marc Bollinger > wrote: > > > Is this still happening over a Zoom link to be distributed, or on the > > Google Hangouts link already associated with the invite? > > > > On Sun, Jul 23, 2017

Re: Airflow + Kubernetes discussion

Is this still happening over a Zoom link to be distributed, or on the Google Hangouts link already associated with the invite? On Sun, Jul 23, 2017 at 12:53 PM, Daniel Imberman wrote: > Hi Victor, > > This implementation is about allowing native kubernetes deployment of tasks > on airflow. There

Re: Airflow + Kubernetes discussion

+1 We're in the middle of moving some services to k8s, and have had our eye on Airflow. > On Jul 20, 2017, at 10:37 AM, Sumit Maheshwari wrote: > > I would join as well for sure. > > Thanks, > Sumit Maheshwari > cell. 9632202950 > > > On Thu, Jul 20, 2017 at 11:00 PM, Chris Riccomini > wrot

Re: DAG description parameter

We somehow just noticed this a few weeks ago when pondering how best to get more documentation into our DAGs, and just started using the heck out of it. On Sunday, June 4, 2017, Maxime Beauchemin wrote: > Also note this feature: > https://airflow.apache.org/concepts.html#documentation-notes > >

Re: Call for meetup talk

Not trying to start a +1 thread, just popping in because I work with Rob, but some of my hands-down favorite meetup events have been because of discussions from these BoF-style breakouts. On Fri, Oct 21, 2016 at 9:59 AM, Maxime Beauchemin < maximebeauche...@gmail.com> wrote: > Also I think it's a