Re: Airflow + Kubernetes discussion

2017-07-27 Thread Daniel Imberman
Hello all, the meeting will be moved to the following zoom.us: https://zoom.us/j/529334876 Sorry again for the confusion. On Thu, Jul 27, 2017 at 11:07 AM Daniel Imberman wrote: > Hi Guys, sorry about the technical difficulties. I will be switching this > call to zoom.us and send out a link sho

Re: Airflow + Kubernetes discussion

2017-07-27 Thread Daniel Imberman
Hi Guys, sorry about the technical difficulties. I will be switching this call to zoom.us and send out a link shortly On Thu, Jul 27, 2017 at 11:07 AM Maxime Beauchemin < maximebeauche...@gmail.com> wrote: > I see the same thing, "The call is full" > > On Thu, Jul 27, 2017 at 11:04 AM, Wilson Lia

Re: Airflow + Kubernetes discussion

2017-07-27 Thread Maxime Beauchemin
I see the same thing, "The call is full" On Thu, Jul 27, 2017 at 11:04 AM, Wilson Lian wrote: > The call is full :( > > On Thu, Jul 27, 2017 at 11:02 AM, Daniel Imberman < > daniel.imber...@gmail.com > > wrote: > > > Hello everyone, > > > > The kubernetes discussion is beginning now. I am includ

Re: Airflow + Kubernetes discussion

2017-07-27 Thread Wilson Lian
The call is full :( On Thu, Jul 27, 2017 at 11:02 AM, Daniel Imberman wrote: > Hello everyone, > > The kubernetes discussion is beginning now. I am including a link below, > but it can also be found in the calendar event itself. > > https://hangouts.google.com/hangouts/_/calendar/ > ZGFuaWVsLmlt

Re: Airflow + Kubernetes discussion

2017-07-27 Thread Daniel Imberman
Hello everyone, The kubernetes discussion is beginning now. I am including a link below, but it can also be found in the calendar event itself. https://hangouts.google.com/hangouts/_/calendar/ZGFuaWVsLmltYmVybWFuQGdtYWlsLmNvbQ.3jcahq63njusjbnc2l4po6t53a?authuser=0 On Thu, Jul 27, 2017 at 10:44 A

Re: Airflow + Kubernetes discussion

2017-07-27 Thread Marc Bollinger
Awesome, thanks! On Thu, Jul 27, 2017 at 10:38 AM, Daniel Imberman wrote: > Hi Marc, > > Sorry for the confusion. The meeting will take place over the google > hangout link on the event (zoom was just an early suggestion before I > realized we could just create the google hangout). > > Best, > D

Re: Airflow + Kubernetes discussion

2017-07-27 Thread Daniel Imberman
Hi Marc, Sorry for the confusion. The meeting will take place over the google hangout link on the event (zoom was just an early suggestion before I realized we could just create the google hangout). Best, Daniel On Thu, Jul 27, 2017 at 10:11 AM Marc Bollinger wrote: > Is this still happening o

Re: Airflow + Kubernetes discussion

2017-07-27 Thread Marc Bollinger
Is this still happening over a Zoom link to be distributed, or on the Google Hangouts link already associated with the invite? On Sun, Jul 23, 2017 at 12:53 PM, Daniel Imberman wrote: > Hi Victor, > > This implementation is about allowing native kubernetes deployment of tasks > on airflow. There

Declined: Invitation: Airflow + Kubernetes discussion @ Thu Jul 27, 2017 11am - 12:30pm (PDT) (dev@airflow.incubator.apache.org)

2017-07-25 Thread scott . halgrim
reply.ics Description: application/ics

Re: Airflow + Kubernetes discussion

2017-07-23 Thread Daniel Imberman
Hi Victor, This implementation is about allowing native kubernetes deployment of tasks on airflow. There are existing deployments/helm scripts with all the components needed to launch an airflow cluster, but these clusters basically consist of having a set up static workers run with celery to comm

Re: Airflow + Kubernetes discussion

2017-07-22 Thread Amit Kulkarni
I would like to join as well. Amit Kulkarni Site Reliability Engineer Mobile: (716)-352-3270 Payments partner to the platform economy On Sat, Jul 22, 2017 at 9:07 AM, Victor Monteiro wrote: > Hi everyone! > > I'm new here and I've read some of the discussions about K8s + Airflow. And > I wou

Re: Airflow + Kubernetes discussion

2017-07-22 Thread Victor Monteiro
Hi everyone! I'm new here and I've read some of the discussions about K8s + Airflow. And I would be very interested to join this meeting. But I'm not quiet sure what is this integration. Is it to make it easy to deploy Airflow to K8S and have scheduler, webserver and other airflow components insi

Invitation: Airflow + Kubernetes discussion @ Thu Jul 27, 2017 11am - 12:30pm (PDT) (dev@airflow.incubator.apache.org)

2017-07-21 Thread Daniel Imberman
BEGIN:VCALENDAR PRODID:-//Google Inc//Google Calendar 70.9054//EN VERSION:2.0 CALSCALE:GREGORIAN METHOD:REQUEST BEGIN:VEVENT DTSTART:20170727T18Z DTEND:20170727T193000Z DTSTAMP:20170721T154304Z ORGANIZER;CN=Daniel Imberman:mailto:daniel.imber...@gmail.com UID:3jcahq63njusjbnc2l4po6t...@google.c

Re: Airflow + Kubernetes discussion

2017-07-20 Thread Maxime Beauchemin
+1! On Thu, Jul 20, 2017 at 5:53 PM, Feng Lu wrote: > Would like to join, please kindly invite me. > Thanks! > > On Thu, Jul 20, 2017 at 9:54 AM, Daniel Imberman < > daniel.imber...@gmail.com> > wrote: > > > Hello everyone, > > > > Recently there's been a fair amount of discussion regarding the

Re: Airflow + Kubernetes discussion

2017-07-20 Thread Feng Lu
Would like to join, please kindly invite me. Thanks! On Thu, Jul 20, 2017 at 9:54 AM, Daniel Imberman wrote: > Hello everyone, > > Recently there's been a fair amount of discussion regarding the integration > of airflow with kubernetes. If there is interest I would love to host an > e-meeting to

Re: Airflow + Kubernetes discussion

2017-07-20 Thread Wilson Lian
Please send me an invite! On Thu, Jul 20, 2017 at 5:15 PM, Dan Davydov wrote: > I'm in. > > On Thu, Jul 20, 2017 at 4:30 PM, Daniel Imberman < > daniel.imber...@gmail.com> > wrote: > > > Glad to hear that people are interested! I've created a google calendar > > event and messaged everyone in th

Re: Airflow + Kubernetes discussion

2017-07-20 Thread Dan Davydov
I'm in. On Thu, Jul 20, 2017 at 4:30 PM, Daniel Imberman wrote: > Glad to hear that people are interested! I've created a google calendar > event and messaged everyone in this thread, if anyone else would like to > join please let me know! > > On Thu, Jul 20, 2017 at 1:04 PM Bolke de Bruin wrot

Re: Airflow + Kubernetes discussion

2017-07-20 Thread Daniel Imberman
Glad to hear that people are interested! I've created a google calendar event and messaged everyone in this thread, if anyone else would like to join please let me know! On Thu, Jul 20, 2017 at 1:04 PM Bolke de Bruin wrote: > Invite would be nice, I will try to join! > > > On 20 Jul 2017, at 20:

Re: Airflow + Kubernetes discussion

2017-07-20 Thread Bolke de Bruin
Invite would be nice, I will try to join! > On 20 Jul 2017, at 20:36, Gerard Toonstra wrote: > > send me an invite too! > > On Thu, Jul 20, 2017 at 8:17 PM, Jeremiah Lowin wrote: > >> I'm interested as well. >> >> On Thu, Jul 20, 2017 at 1:51 PM Marc Bollinger wrote: >> >>> +1 We're in the

Re: Airflow + Kubernetes discussion

2017-07-20 Thread Gerard Toonstra
send me an invite too! On Thu, Jul 20, 2017 at 8:17 PM, Jeremiah Lowin wrote: > I'm interested as well. > > On Thu, Jul 20, 2017 at 1:51 PM Marc Bollinger wrote: > > > +1 We're in the middle of moving some services to k8s, and have had our > > eye on Airflow. > > > > > On Jul 20, 2017, at 10:37

Re: Airflow + Kubernetes discussion

2017-07-20 Thread Jeremiah Lowin
I'm interested as well. On Thu, Jul 20, 2017 at 1:51 PM Marc Bollinger wrote: > +1 We're in the middle of moving some services to k8s, and have had our > eye on Airflow. > > > On Jul 20, 2017, at 10:37 AM, Sumit Maheshwari > wrote: > > > > I would join as well for sure. > > > > Thanks, > > Sumi

Re: Airflow + Kubernetes discussion

2017-07-20 Thread Marc Bollinger
+1 We're in the middle of moving some services to k8s, and have had our eye on Airflow. > On Jul 20, 2017, at 10:37 AM, Sumit Maheshwari wrote: > > I would join as well for sure. > > Thanks, > Sumit Maheshwari > cell. 9632202950 > > > On Thu, Jul 20, 2017 at 11:00 PM, Chris Riccomini > wrot

Re: Airflow + Kubernetes discussion

2017-07-20 Thread Sumit Maheshwari
I would join as well for sure. Thanks, Sumit Maheshwari cell. 9632202950 On Thu, Jul 20, 2017 at 11:00 PM, Chris Riccomini wrote: > I would definitely be up to joining. We're interested in the K8s work > that's going on. That time works for me. > > On Thu, Jul 20, 2017 at 9:54 AM, Daniel Imber

Re: Airflow + Kubernetes discussion

2017-07-20 Thread Chris Riccomini
I would definitely be up to joining. We're interested in the K8s work that's going on. That time works for me. On Thu, Jul 20, 2017 at 9:54 AM, Daniel Imberman wrote: > Hello everyone, > > Recently there's been a fair amount of discussion regarding the integration > of airflow with kubernetes. I

Airflow + Kubernetes discussion

2017-07-20 Thread Daniel Imberman
Hello everyone, Recently there's been a fair amount of discussion regarding the integration of airflow with kubernetes. If there is interest I would love to host an e-meeting to discuss this integration. I can go over the architecture as it stands right now and would love feedback on improvements/