Re: Airflow + Kubernetes update meeting
Morning everyone! So the meeting is going to start in ~ 15 minutes @ zoom.us/my/sig.big.data. We'll be using the sig-big-data google doc for notes/minutes ( https://docs.google.com/document/d/1pnF38NF6N5eM8DlK088XUW85Vms4V2uTsGZvSp8MNIA/edit#). Looking forward to seeing everyone there! Daniel On Wed, Sep 6, 2017 at 2:34 PM Daniel Imberman wrote: > Hey guys! > > @Dan & @Chris: Great! > @Marc: My pleasure :). > > So everything is all set for tomorrow at 10AM PST at > zoom.us/my/sig.big.data. Main points will be to update on the what we've > been working on and create a final roadmap for merging the PR. Looking > forward to seeing everyone there! > > > Daniel > > On Tue, Sep 5, 2017 at 1:12 PM Marc Bollinger wrote: > >> Perfect, thanks so much for your hard work, Daniel! >> >> On Tue, Sep 5, 2017 at 11:41 AM, Christopher Bockman < >> ch...@fathomhealth.co> wrote: >> >>> @Daniel great, thanks! We'd love to participate--have just started >>> combining Kubernetes+Airflow and are presumably hitting all of the same >>> issues everyone else is. >>> >>> On Tue, Sep 5, 2017 at 11:10 AM, Dan Davydov >>> wrote: >>> >>> > Works for me as well! >>> > >>> > On Tue, Sep 5, 2017 at 10:43 AM Daniel Imberman < >>> daniel.imber...@gmail.com> >>> > wrote: >>> > >>> >> @Marc we will make sure to record the meeting/supply notes. This >>> should >>> >> be a pretty straightforward update/overview meeint. >>> >> @ChrisB this meeting will be a virtual meeting, though Bloomberg is >>> >> definitely interested in hosting an airflow meetup at our SF location >>> if >>> >> there is sufficient interest :). >>> >> @ChrisR Great to hear :). We've been working with members of the >>> >> openshift community so we can definitely speak to those requirem >>> >> >>> >> >>> >> On Tue, Sep 5, 2017 at 10:24 AM Feng Lu >>> >> wrote: >>> >> >>> >>> +1, either way works for me. >>> >>> >>> >>> On Tue, Sep 5, 2017 at 10:10 AM, Chris Riccomini < >>> criccom...@apache.org> >>> >>> wrote: >>> >>> >>> >>> > Works for me. >>> >>> > >>> >>> > On Tue, Sep 5, 2017 at 7:44 AM, Grant Nicholas >>> >> >>> > northwestern.edu> wrote: >>> >>> > >>> >>> >> +1 for me if it works with others. >>> >>> >> >>> >>> >> On Mon, Sep 4, 2017 at 11:02 PM, Anirudh Ramanathan < >>> >>> >> ramanath...@google.com> wrote: >>> >>> >> >>> >>> >>> Date/time work for me if we get quorum from this group. >>> >>> >>> >>> >>> >>> On Thu, Aug 31, 2017 at 7:54 PM, Christopher Bockman < >>> >>> >>> ch...@fathomhealth.co> wrote: >>> >>> >>> >>> >>> Hi Daniel, would this be remote or in person? >>> >>> >>> >>> >>> >>> On Aug 31, 2017 4:16 PM, "Daniel Imberman" < >>> >>> daniel.imber...@gmail.com> >>> >>> wrote: >>> >>> >>> >>> Hey guys! >>> >>> >>> >>> So I wanted to set up a meeting to discuss some of the >>> >>> updates/current >>> >>> work >>> >>> that is going on with both the kubernetes operator and >>> kubernetes >>> >>> executor >>> >>> efforts. There has been some really cool updates/proposals on >>> the >>> >>> design of >>> >>> these two features and I would love to get some community >>> feedback >>> >>> to >>> >>> make >>> >>> sure that we are taking this in a direction that benefits >>> everyone. >>> >>> >>> >>> I am thinking of having this meeting at 10:00AM on Thursday, >>> >>> September >>> >>> 7th >>> >>> PST. Would this time/place work? >>> >>> >>> >>> Thanks! >>> >>> >>> >>> Daniel >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> -- >>> >>> >>> Anirudh Ramanathan >>> >>> >>> >>> >>> >> >>> >>> >> >>> >>> > >>> >>> >>> >> >>> >> >>
Re: Airflow + Kubernetes update meeting
Hey guys! @Dan & @Chris: Great! @Marc: My pleasure :). So everything is all set for tomorrow at 10AM PST at zoom.us/my/sig.big.data. Main points will be to update on the what we've been working on and create a final roadmap for merging the PR. Looking forward to seeing everyone there! Daniel On Tue, Sep 5, 2017 at 1:12 PM Marc Bollinger wrote: > Perfect, thanks so much for your hard work, Daniel! > > On Tue, Sep 5, 2017 at 11:41 AM, Christopher Bockman < > ch...@fathomhealth.co> wrote: > >> @Daniel great, thanks! We'd love to participate--have just started >> combining Kubernetes+Airflow and are presumably hitting all of the same >> issues everyone else is. >> >> On Tue, Sep 5, 2017 at 11:10 AM, Dan Davydov >> wrote: >> >> > Works for me as well! >> > >> > On Tue, Sep 5, 2017 at 10:43 AM Daniel Imberman < >> daniel.imber...@gmail.com> >> > wrote: >> > >> >> @Marc we will make sure to record the meeting/supply notes. This should >> >> be a pretty straightforward update/overview meeint. >> >> @ChrisB this meeting will be a virtual meeting, though Bloomberg is >> >> definitely interested in hosting an airflow meetup at our SF location >> if >> >> there is sufficient interest :). >> >> @ChrisR Great to hear :). We've been working with members of the >> >> openshift community so we can definitely speak to those requirem >> >> >> >> >> >> On Tue, Sep 5, 2017 at 10:24 AM Feng Lu >> >> wrote: >> >> >> >>> +1, either way works for me. >> >>> >> >>> On Tue, Sep 5, 2017 at 10:10 AM, Chris Riccomini < >> criccom...@apache.org> >> >>> wrote: >> >>> >> >>> > Works for me. >> >>> > >> >>> > On Tue, Sep 5, 2017 at 7:44 AM, Grant Nicholas > >>> > northwestern.edu> wrote: >> >>> > >> >>> >> +1 for me if it works with others. >> >>> >> >> >>> >> On Mon, Sep 4, 2017 at 11:02 PM, Anirudh Ramanathan < >> >>> >> ramanath...@google.com> wrote: >> >>> >> >> >>> >>> Date/time work for me if we get quorum from this group. >> >>> >>> >> >>> >>> On Thu, Aug 31, 2017 at 7:54 PM, Christopher Bockman < >> >>> >>> ch...@fathomhealth.co> wrote: >> >>> >>> >> >>> Hi Daniel, would this be remote or in person? >> >>> >> >>> >> >>> On Aug 31, 2017 4:16 PM, "Daniel Imberman" < >> >>> daniel.imber...@gmail.com> >> >>> wrote: >> >>> >> >>> Hey guys! >> >>> >> >>> So I wanted to set up a meeting to discuss some of the >> >>> updates/current >> >>> work >> >>> that is going on with both the kubernetes operator and kubernetes >> >>> executor >> >>> efforts. There has been some really cool updates/proposals on the >> >>> design of >> >>> these two features and I would love to get some community >> feedback >> >>> to >> >>> make >> >>> sure that we are taking this in a direction that benefits >> everyone. >> >>> >> >>> I am thinking of having this meeting at 10:00AM on Thursday, >> >>> September >> >>> 7th >> >>> PST. Would this time/place work? >> >>> >> >>> Thanks! >> >>> >> >>> Daniel >> >>> >> >>> >> >>> >> >>> >>> >> >>> >>> >> >>> >>> -- >> >>> >>> Anirudh Ramanathan >> >>> >>> >> >>> >> >> >>> >> >> >>> > >> >>> >> >> >> > >
Re: Airflow + Kubernetes update meeting
Perfect, thanks so much for your hard work, Daniel! On Tue, Sep 5, 2017 at 11:41 AM, Christopher Bockman wrote: > @Daniel great, thanks! We'd love to participate--have just started > combining Kubernetes+Airflow and are presumably hitting all of the same > issues everyone else is. > > On Tue, Sep 5, 2017 at 11:10 AM, Dan Davydov > wrote: > > > Works for me as well! > > > > On Tue, Sep 5, 2017 at 10:43 AM Daniel Imberman < > daniel.imber...@gmail.com> > > wrote: > > > >> @Marc we will make sure to record the meeting/supply notes. This should > >> be a pretty straightforward update/overview meeint. > >> @ChrisB this meeting will be a virtual meeting, though Bloomberg is > >> definitely interested in hosting an airflow meetup at our SF location if > >> there is sufficient interest :). > >> @ChrisR Great to hear :). We've been working with members of the > >> openshift community so we can definitely speak to those requirem > >> > >> > >> On Tue, Sep 5, 2017 at 10:24 AM Feng Lu > >> wrote: > >> > >>> +1, either way works for me. > >>> > >>> On Tue, Sep 5, 2017 at 10:10 AM, Chris Riccomini < > criccom...@apache.org> > >>> wrote: > >>> > >>> > Works for me. > >>> > > >>> > On Tue, Sep 5, 2017 at 7:44 AM, Grant Nicholas >>> > northwestern.edu> wrote: > >>> > > >>> >> +1 for me if it works with others. > >>> >> > >>> >> On Mon, Sep 4, 2017 at 11:02 PM, Anirudh Ramanathan < > >>> >> ramanath...@google.com> wrote: > >>> >> > >>> >>> Date/time work for me if we get quorum from this group. > >>> >>> > >>> >>> On Thu, Aug 31, 2017 at 7:54 PM, Christopher Bockman < > >>> >>> ch...@fathomhealth.co> wrote: > >>> >>> > >>> Hi Daniel, would this be remote or in person? > >>> > >>> > >>> On Aug 31, 2017 4:16 PM, "Daniel Imberman" < > >>> daniel.imber...@gmail.com> > >>> wrote: > >>> > >>> Hey guys! > >>> > >>> So I wanted to set up a meeting to discuss some of the > >>> updates/current > >>> work > >>> that is going on with both the kubernetes operator and kubernetes > >>> executor > >>> efforts. There has been some really cool updates/proposals on the > >>> design of > >>> these two features and I would love to get some community feedback > >>> to > >>> make > >>> sure that we are taking this in a direction that benefits > everyone. > >>> > >>> I am thinking of having this meeting at 10:00AM on Thursday, > >>> September > >>> 7th > >>> PST. Would this time/place work? > >>> > >>> Thanks! > >>> > >>> Daniel > >>> > >>> > >>> > >>> >>> > >>> >>> > >>> >>> -- > >>> >>> Anirudh Ramanathan > >>> >>> > >>> >> > >>> >> > >>> > > >>> > >> >
Re: Airflow + Kubernetes update meeting
@Daniel great, thanks! We'd love to participate--have just started combining Kubernetes+Airflow and are presumably hitting all of the same issues everyone else is. On Tue, Sep 5, 2017 at 11:10 AM, Dan Davydov wrote: > Works for me as well! > > On Tue, Sep 5, 2017 at 10:43 AM Daniel Imberman > wrote: > >> @Marc we will make sure to record the meeting/supply notes. This should >> be a pretty straightforward update/overview meeint. >> @ChrisB this meeting will be a virtual meeting, though Bloomberg is >> definitely interested in hosting an airflow meetup at our SF location if >> there is sufficient interest :). >> @ChrisR Great to hear :). We've been working with members of the >> openshift community so we can definitely speak to those requirem >> >> >> On Tue, Sep 5, 2017 at 10:24 AM Feng Lu >> wrote: >> >>> +1, either way works for me. >>> >>> On Tue, Sep 5, 2017 at 10:10 AM, Chris Riccomini >>> wrote: >>> >>> > Works for me. >>> > >>> > On Tue, Sep 5, 2017 at 7:44 AM, Grant Nicholas >> > northwestern.edu> wrote: >>> > >>> >> +1 for me if it works with others. >>> >> >>> >> On Mon, Sep 4, 2017 at 11:02 PM, Anirudh Ramanathan < >>> >> ramanath...@google.com> wrote: >>> >> >>> >>> Date/time work for me if we get quorum from this group. >>> >>> >>> >>> On Thu, Aug 31, 2017 at 7:54 PM, Christopher Bockman < >>> >>> ch...@fathomhealth.co> wrote: >>> >>> >>> Hi Daniel, would this be remote or in person? >>> >>> >>> On Aug 31, 2017 4:16 PM, "Daniel Imberman" < >>> daniel.imber...@gmail.com> >>> wrote: >>> >>> Hey guys! >>> >>> So I wanted to set up a meeting to discuss some of the >>> updates/current >>> work >>> that is going on with both the kubernetes operator and kubernetes >>> executor >>> efforts. There has been some really cool updates/proposals on the >>> design of >>> these two features and I would love to get some community feedback >>> to >>> make >>> sure that we are taking this in a direction that benefits everyone. >>> >>> I am thinking of having this meeting at 10:00AM on Thursday, >>> September >>> 7th >>> PST. Would this time/place work? >>> >>> Thanks! >>> >>> Daniel >>> >>> >>> >>> >>> >>> >>> >>> >>> -- >>> >>> Anirudh Ramanathan >>> >>> >>> >> >>> >> >>> > >>> >>
Re: Airflow + Kubernetes update meeting
Works for me as well! On Tue, Sep 5, 2017 at 10:43 AM Daniel Imberman wrote: > @Marc we will make sure to record the meeting/supply notes. This should be > a pretty straightforward update/overview meeint. > @ChrisB this meeting will be a virtual meeting, though Bloomberg is > definitely interested in hosting an airflow meetup at our SF location if > there is sufficient interest :). > @ChrisR Great to hear :). We've been working with members of the openshift > community so we can definitely speak to those requirem > > > On Tue, Sep 5, 2017 at 10:24 AM Feng Lu wrote: > >> +1, either way works for me. >> >> On Tue, Sep 5, 2017 at 10:10 AM, Chris Riccomini >> wrote: >> >> > Works for me. >> > >> > On Tue, Sep 5, 2017 at 7:44 AM, Grant Nicholas > > northwestern.edu> wrote: >> > >> >> +1 for me if it works with others. >> >> >> >> On Mon, Sep 4, 2017 at 11:02 PM, Anirudh Ramanathan < >> >> ramanath...@google.com> wrote: >> >> >> >>> Date/time work for me if we get quorum from this group. >> >>> >> >>> On Thu, Aug 31, 2017 at 7:54 PM, Christopher Bockman < >> >>> ch...@fathomhealth.co> wrote: >> >>> >> Hi Daniel, would this be remote or in person? >> >> >> On Aug 31, 2017 4:16 PM, "Daniel Imberman" < >> daniel.imber...@gmail.com> >> wrote: >> >> Hey guys! >> >> So I wanted to set up a meeting to discuss some of the >> updates/current >> work >> that is going on with both the kubernetes operator and kubernetes >> executor >> efforts. There has been some really cool updates/proposals on the >> design of >> these two features and I would love to get some community feedback to >> make >> sure that we are taking this in a direction that benefits everyone. >> >> I am thinking of having this meeting at 10:00AM on Thursday, >> September >> 7th >> PST. Would this time/place work? >> >> Thanks! >> >> Daniel >> >> >> >> >>> >> >>> >> >>> -- >> >>> Anirudh Ramanathan >> >>> >> >> >> >> >> > >> >
Re: Airflow + Kubernetes update meeting
@Marc we will make sure to record the meeting/supply notes. This should be a pretty straightforward update/overview meeint. @ChrisB this meeting will be a virtual meeting, though Bloomberg is definitely interested in hosting an airflow meetup at our SF location if there is sufficient interest :). @ChrisR Great to hear :). We've been working with members of the openshift community so we can definitely speak to those requirem On Tue, Sep 5, 2017 at 10:24 AM Feng Lu wrote: > +1, either way works for me. > > On Tue, Sep 5, 2017 at 10:10 AM, Chris Riccomini > wrote: > > > Works for me. > > > > On Tue, Sep 5, 2017 at 7:44 AM, Grant Nicholas > northwestern.edu> wrote: > > > >> +1 for me if it works with others. > >> > >> On Mon, Sep 4, 2017 at 11:02 PM, Anirudh Ramanathan < > >> ramanath...@google.com> wrote: > >> > >>> Date/time work for me if we get quorum from this group. > >>> > >>> On Thu, Aug 31, 2017 at 7:54 PM, Christopher Bockman < > >>> ch...@fathomhealth.co> wrote: > >>> > Hi Daniel, would this be remote or in person? > > > On Aug 31, 2017 4:16 PM, "Daniel Imberman" > > wrote: > > Hey guys! > > So I wanted to set up a meeting to discuss some of the updates/current > work > that is going on with both the kubernetes operator and kubernetes > executor > efforts. There has been some really cool updates/proposals on the > design of > these two features and I would love to get some community feedback to > make > sure that we are taking this in a direction that benefits everyone. > > I am thinking of having this meeting at 10:00AM on Thursday, September > 7th > PST. Would this time/place work? > > Thanks! > > Daniel > > > > >>> > >>> > >>> -- > >>> Anirudh Ramanathan > >>> > >> > >> > > >
Re: Airflow + Kubernetes update meeting
+1, either way works for me. On Tue, Sep 5, 2017 at 10:10 AM, Chris Riccomini wrote: > Works for me. > > On Tue, Sep 5, 2017 at 7:44 AM, Grant Nicholas northwestern.edu> wrote: > >> +1 for me if it works with others. >> >> On Mon, Sep 4, 2017 at 11:02 PM, Anirudh Ramanathan < >> ramanath...@google.com> wrote: >> >>> Date/time work for me if we get quorum from this group. >>> >>> On Thu, Aug 31, 2017 at 7:54 PM, Christopher Bockman < >>> ch...@fathomhealth.co> wrote: >>> Hi Daniel, would this be remote or in person? On Aug 31, 2017 4:16 PM, "Daniel Imberman" wrote: Hey guys! So I wanted to set up a meeting to discuss some of the updates/current work that is going on with both the kubernetes operator and kubernetes executor efforts. There has been some really cool updates/proposals on the design of these two features and I would love to get some community feedback to make sure that we are taking this in a direction that benefits everyone. I am thinking of having this meeting at 10:00AM on Thursday, September 7th PST. Would this time/place work? Thanks! Daniel >>> >>> >>> -- >>> Anirudh Ramanathan >>> >> >> >
Re: Airflow + Kubernetes update meeting
Works for me. On Tue, Sep 5, 2017 at 7:44 AM, Grant Nicholas < grantnicholas2...@u.northwestern.edu> wrote: > +1 for me if it works with others. > > On Mon, Sep 4, 2017 at 11:02 PM, Anirudh Ramanathan < > ramanath...@google.com> wrote: > >> Date/time work for me if we get quorum from this group. >> >> On Thu, Aug 31, 2017 at 7:54 PM, Christopher Bockman < >> ch...@fathomhealth.co> wrote: >> >>> Hi Daniel, would this be remote or in person? >>> >>> >>> On Aug 31, 2017 4:16 PM, "Daniel Imberman" >>> wrote: >>> >>> Hey guys! >>> >>> So I wanted to set up a meeting to discuss some of the updates/current >>> work >>> that is going on with both the kubernetes operator and kubernetes >>> executor >>> efforts. There has been some really cool updates/proposals on the design >>> of >>> these two features and I would love to get some community feedback to >>> make >>> sure that we are taking this in a direction that benefits everyone. >>> >>> I am thinking of having this meeting at 10:00AM on Thursday, September >>> 7th >>> PST. Would this time/place work? >>> >>> Thanks! >>> >>> Daniel >>> >>> >>> >> >> >> -- >> Anirudh Ramanathan >> > >
Re: Airflow + Kubernetes update meeting
+1 for me if it works with others. On Mon, Sep 4, 2017 at 11:02 PM, Anirudh Ramanathan wrote: > Date/time work for me if we get quorum from this group. > > On Thu, Aug 31, 2017 at 7:54 PM, Christopher Bockman < > ch...@fathomhealth.co> wrote: > >> Hi Daniel, would this be remote or in person? >> >> >> On Aug 31, 2017 4:16 PM, "Daniel Imberman" >> wrote: >> >> Hey guys! >> >> So I wanted to set up a meeting to discuss some of the updates/current >> work >> that is going on with both the kubernetes operator and kubernetes executor >> efforts. There has been some really cool updates/proposals on the design >> of >> these two features and I would love to get some community feedback to make >> sure that we are taking this in a direction that benefits everyone. >> >> I am thinking of having this meeting at 10:00AM on Thursday, September 7th >> PST. Would this time/place work? >> >> Thanks! >> >> Daniel >> >> >> > > > -- > Anirudh Ramanathan >
Re: Airflow + Kubernetes update meeting
Date/time work for me if we get quorum from this group. On Thu, Aug 31, 2017 at 7:54 PM, Christopher Bockman wrote: > Hi Daniel, would this be remote or in person? > > > On Aug 31, 2017 4:16 PM, "Daniel Imberman" > wrote: > > Hey guys! > > So I wanted to set up a meeting to discuss some of the updates/current work > that is going on with both the kubernetes operator and kubernetes executor > efforts. There has been some really cool updates/proposals on the design of > these two features and I would love to get some community feedback to make > sure that we are taking this in a direction that benefits everyone. > > I am thinking of having this meeting at 10:00AM on Thursday, September 7th > PST. Would this time/place work? > > Thanks! > > Daniel > > > -- Anirudh Ramanathan
Re: Airflow + Kubernetes update meeting
Hi Daniel, would this be remote or in person? On Aug 31, 2017 4:16 PM, "Daniel Imberman" wrote: Hey guys! So I wanted to set up a meeting to discuss some of the updates/current work that is going on with both the kubernetes operator and kubernetes executor efforts. There has been some really cool updates/proposals on the design of these two features and I would love to get some community feedback to make sure that we are taking this in a direction that benefits everyone. I am thinking of having this meeting at 10:00AM on Thursday, September 7th PST. Would this time/place work? Thanks! Daniel
Re: Airflow + Kubernetes update meeting
There's a PagerDuty mini-conference in SF that I've vaguely penciled into my calendar for that day--I'm certainly more than happy to just review notes after the meeting if there are any, but just in the event anyone else in the area is also planning on going, since there might be some overlap. On Thu, Aug 31, 2017 at 4:16 PM, Daniel Imberman wrote: > Hey guys! > > So I wanted to set up a meeting to discuss some of the updates/current work > that is going on with both the kubernetes operator and kubernetes executor > efforts. There has been some really cool updates/proposals on the design of > these two features and I would love to get some community feedback to make > sure that we are taking this in a direction that benefits everyone. > > I am thinking of having this meeting at 10:00AM on Thursday, September 7th > PST. Would this time/place work? > > Thanks! > > Daniel >
Airflow + Kubernetes update meeting
Hey guys! So I wanted to set up a meeting to discuss some of the updates/current work that is going on with both the kubernetes operator and kubernetes executor efforts. There has been some really cool updates/proposals on the design of these two features and I would love to get some community feedback to make sure that we are taking this in a direction that benefits everyone. I am thinking of having this meeting at 10:00AM on Thursday, September 7th PST. Would this time/place work? Thanks! Daniel
