I think I'm gathering a good picture of what is expected here. I'll try to
update the Confluence page as I go.
I'm hoping to get started tomorrow and package it early next week.
Max
On Wed, Jul 19, 2017 at 6:16 PM, siddharth anand wrote:
> FYI, can anyone pictorially describe the release proce
+1!
On Thu, Jul 20, 2017 at 5:53 PM, Feng Lu wrote:
> Would like to join, please kindly invite me.
> Thanks!
>
> On Thu, Jul 20, 2017 at 9:54 AM, Daniel Imberman <
> daniel.imber...@gmail.com>
> wrote:
>
> > Hello everyone,
> >
> > Recently there's been a fair amount of discussion regarding the
Would like to join, please kindly invite me.
Thanks!
On Thu, Jul 20, 2017 at 9:54 AM, Daniel Imberman
wrote:
> Hello everyone,
>
> Recently there's been a fair amount of discussion regarding the integration
> of airflow with kubernetes. If there is interest I would love to host an
> e-meeting to
Please send me an invite!
On Thu, Jul 20, 2017 at 5:15 PM, Dan Davydov wrote:
> I'm in.
>
> On Thu, Jul 20, 2017 at 4:30 PM, Daniel Imberman <
> daniel.imber...@gmail.com>
> wrote:
>
> > Glad to hear that people are interested! I've created a google calendar
> > event and messaged everyone in th
I'm in.
On Thu, Jul 20, 2017 at 4:30 PM, Daniel Imberman
wrote:
> Glad to hear that people are interested! I've created a google calendar
> event and messaged everyone in this thread, if anyone else would like to
> join please let me know!
>
> On Thu, Jul 20, 2017 at 1:04 PM Bolke de Bruin wrot
Glad to hear that people are interested! I've created a google calendar
event and messaged everyone in this thread, if anyone else would like to
join please let me know!
On Thu, Jul 20, 2017 at 1:04 PM Bolke de Bruin wrote:
> Invite would be nice, I will try to join!
>
> > On 20 Jul 2017, at 20:
Invite would be nice, I will try to join!
> On 20 Jul 2017, at 20:36, Gerard Toonstra wrote:
>
> send me an invite too!
>
> On Thu, Jul 20, 2017 at 8:17 PM, Jeremiah Lowin wrote:
>
>> I'm interested as well.
>>
>> On Thu, Jul 20, 2017 at 1:51 PM Marc Bollinger wrote:
>>
>>> +1 We're in the
The correct way to pass kwargs is through op_kwargs.
for log_type in LOG_TYPES:
raw_log_py_operator = PythonOperator(
task_id='{}-logs-copy-to-s3'.format(log_type),
provide_context=True,
python_callable=raw_log_callable,
dag=raw_log_dag,
op_kwargs={'log_
send me an invite too!
On Thu, Jul 20, 2017 at 8:17 PM, Jeremiah Lowin wrote:
> I'm interested as well.
>
> On Thu, Jul 20, 2017 at 1:51 PM Marc Bollinger wrote:
>
> > +1 We're in the middle of moving some services to k8s, and have had our
> > eye on Airflow.
> >
> > > On Jul 20, 2017, at 10:37
I'm trying to pass a custom arg to a python operator, but when trying to
resolve *kwargs.get('log_type')*, I get 'None'.
Anyone have any issues with this before?
*LOG_TYPES = ['abc_log', 'xyz_log']*
def raw_log_callable(ds, **kwargs):
exec_date = str(kwargs.get('task_instance').execution_da
I'm interested as well.
On Thu, Jul 20, 2017 at 1:51 PM Marc Bollinger wrote:
> +1 We're in the middle of moving some services to k8s, and have had our
> eye on Airflow.
>
> > On Jul 20, 2017, at 10:37 AM, Sumit Maheshwari
> wrote:
> >
> > I would join as well for sure.
> >
> > Thanks,
> > Sumi
+1 We're in the middle of moving some services to k8s, and have had our eye on
Airflow.
> On Jul 20, 2017, at 10:37 AM, Sumit Maheshwari wrote:
>
> I would join as well for sure.
>
> Thanks,
> Sumit Maheshwari
> cell. 9632202950
>
>
> On Thu, Jul 20, 2017 at 11:00 PM, Chris Riccomini
> wrot
I would join as well for sure.
Thanks,
Sumit Maheshwari
cell. 9632202950
On Thu, Jul 20, 2017 at 11:00 PM, Chris Riccomini
wrote:
> I would definitely be up to joining. We're interested in the K8s work
> that's going on. That time works for me.
>
> On Thu, Jul 20, 2017 at 9:54 AM, Daniel Imber
Hey Max,
Want to come down to WePay? We can set up a zoom for those that want to
join online, and record it as well to post for the community.
Since Joy is just getting started, and it looks like there's going to be a
K8s discussion next week, maybe we can shoot for the week after (the week
of th
I would definitely be up to joining. We're interested in the K8s work
that's going on. That time works for me.
On Thu, Jul 20, 2017 at 9:54 AM, Daniel Imberman
wrote:
> Hello everyone,
>
> Recently there's been a fair amount of discussion regarding the integration
> of airflow with kubernetes. I
Hello everyone,
Recently there's been a fair amount of discussion regarding the integration
of airflow with kubernetes. If there is interest I would love to host an
e-meeting to discuss this integration. I can go over the architecture as it
stands right now and would love feedback on improvements/
Sounds awesome, count me in!
* check out the prototype in my fork, I went far enough to hit some
hurdles, try different workarounds. I hooked up the Airflow Bootstrap
template too so that we feel at home in this new UI
* using a single `id` field is a requirement for FAB that airflow doesn't
respe
Hello Arthur,
Thanks for your help,
In your case I will have to update worker code, not necessarily
webserver/scheduler and I will set the option --ship_dag to False.
This deployment method imply that I have to pause all my dags, wait my queue is
empty and restart my worker to pull and install
18 matches
Mail list logo
