Re: Proposal: Automatically mark stale PRs in github

It's already on (or at least was on in December 2018). In any case here is a list of old PRs that are waiting for committers. [AIRFLOW-1956] Add parameter whether the navbar clock time is UTC https://github.com/apache/airflow/pull/2906 Status: ash commented but there are no further instructions.

Re: [PLEASE PARTICIPATE] Brainstorming ideas for Season of Docs

To be honest on of the things that is very hard for a first time user in Airflow is to decide which executor to use. It would be extremely helpful if it would be possible to generate a table to compare properties between them. ‐‐‐ Original Message ‐‐‐ On Tuesday, April 9, 2019 10:52 PM,

Re: Proposal: Automatically mark stale PRs in github

It closed a PR two days ago: https://github.com/apache/airflow/pull/4805#issuecomment-483531866 Cheers, Fokko Op do 18 apr. 2019 om 01:55 schreef Chao-Han Tsai > I think we already have a stalebot. > https://github.com/apache/airflow/pull/3478 was closed by the stalebot for > instance. > > We p

Re: [PLEASE PARTICIPATE] Brainstorming ideas for Season of Docs

Hi everyone, Here are a few updates on our application for Season of Docs: 1. I updated the document with more descriptions for each project idea and specified the deliverables[1]. 2. To submit our application, we need to publish our project ideas list. For this I will open Jira tickets with “gs

RE:;;;

De : JODEAU Martine Envoyé : jeudi 18 avril 2019 03:19 À : JODEAU Martine Objet : ;;; You have been Picked. For more info write {marilynboldon...@gmail.com}

scheduler logging

Hi All, We are running airflow 1.10.0 and I'm wondering how I can turn off or turn down the logging for the scheduler? I tried setting logging_level=WARN in airflow.cfg and restarting the process but I'm still seeing a ton of info logging to .out and .log. Thanks! -- Frank Maritato

Re: Proposal: Directly tie Jira into Github for airflow

+1 > On 18 Apr 2019, at 5:28 AM, Kaxil Naik wrote: > > +1 > > On Wed, Apr 17, 2019, 22:25 Tao Feng wrote: > >> +1 >> >> On Wed, Apr 17, 2019 at 2:19 PM Ash Berlin-Taylor wrote: >> >>> +1 >>> >>> I've ask in #asfinfra (on the-asfk.slack.com) to see if we can actually >>> use that on the Ap

Re: [ANNOUNCE] Please welcome new Airflow committer Jarek Potiuk

Congrats Jarek! XD On Thu, Apr 18, 2019 at 05:08 Jarek Potiuk wrote: > Thanks a lot! It's an honor to be part of such great community and I am > happy to take more responsibility as commiter. Looking forward to what we > can do together! > > J.. > > Principal Software Engineer > Phone: +4866079

Re: Proposal: Automatically mark stale PRs in github

I think we already have a stalebot. https://github.com/apache/airflow/pull/3478 was closed by the stalebot for instance. We probably can tune the stale criteria a bit to make it more aggressive. On Wed, Apr 17, 2019 at 2:29 PM Kaxil Naik wrote: > I think Sid had already enabled the stale bot fe

Re: Bay Area Airflow meetup

We've finalized the meetup logistics (details here ). Please send in your talk proposals! Thank you. Feng On Tue, Mar 12, 2019 at 1:15 PM Feng Lu wrote: > Hi all, > > It has been a while since we had the last Ba

Re: [ANNOUNCE] Please welcome new Airflow committer Jarek Potiuk

Awesome news, congrats Jarek! On Wed, Apr 17, 2019 at 2:25 PM Tao Feng wrote: > Congrats! > > On Wed, Apr 17, 2019 at 2:08 PM Jarek Potiuk > wrote: > > > Thanks a lot! It's an honor to be part of such great community and I am > > happy to take more responsibility as commiter. Looking forward to

Re: Proposal: Automatically mark stale PRs in github

I think Sid had already enabled the stale bot few months back On Wed, Apr 17, 2019, 22:12 Kamil Breguła wrote: > +1 > > On Wed, Apr 17, 2019, 11:10 PM Bas Harenslak < > basharens...@godatadriven.com> > wrote: > > > +1 > > > > Bas > > > > On 17 Apr 2019, at 23:09, Jarek Potiuk > jarek.pot...@pol

Re: Proposal: Directly tie Jira into Github for airflow

+1 On Wed, Apr 17, 2019, 22:25 Tao Feng wrote: > +1 > > On Wed, Apr 17, 2019 at 2:19 PM Ash Berlin-Taylor wrote: > > > +1 > > > > I've ask in #asfinfra (on the-asfk.slack.com) to see if we can actually > > use that on the Apache Jira install. > > > > -ash > > > > > On 17 Apr 2019, at 22:16, Kev

Re: [ANNOUNCE] Please welcome new Airflow committer Jarek Potiuk

Congrats! On Wed, Apr 17, 2019 at 2:08 PM Jarek Potiuk wrote: > Thanks a lot! It's an honor to be part of such great community and I am > happy to take more responsibility as commiter. Looking forward to what we > can do together! > > J.. > > Principal Software Engineer > Phone: +48660796129 > >

Re: Proposal: Directly tie Jira into Github for airflow

+1 On Wed, Apr 17, 2019 at 2:19 PM Ash Berlin-Taylor wrote: > +1 > > I've ask in #asfinfra (on the-asfk.slack.com) to see if we can actually > use that on the Apache Jira install. > > -ash > > > On 17 Apr 2019, at 22:16, Kevin Yang wrote: > > > > +1 > > > > Cheers, > > Kevin Y > > > > Bas Haren

Re: Proposal: Directly tie Jira into Github for airflow

+1 I've ask in #asfinfra (on the-asfk.slack.com) to see if we can actually use that on the Apache Jira install. -ash > On 17 Apr 2019, at 22:16, Kevin Yang wrote: > > +1 > > Cheers, > Kevin Y > > Bas Harenslak 于2019年4月17日 周三下午2:16写道： > >> Nice one +1 >> >> Bas >> >> On 17 Apr 2019, at 23

Re: Proposal: Directly tie Jira into Github for airflow

+1 Cheers, Kevin Y Bas Harenslak 于2019年4月17日 周三下午2:16写道： > Nice one +1 > > Bas > > On 17 Apr 2019, at 23:13, Daniel Imberman > wrote: > > Using the Github Jira integration > https://github.com/marketplace/jira-software-github we can make it easier > to ma

Re: Proposal: Directly tie Jira into Github for airflow

Nice one +1 Bas On 17 Apr 2019, at 23:13, Daniel Imberman mailto:dimberman.opensou...@gmail.com>> wrote: Using the Github Jira integration https://github.com/marketplace/jira-software-github we can make it easier to manage/track jira tickets from the PRs. This will make it easier to ensure we d

Proposal: Directly tie Jira into Github for airflow

Using the Github Jira integration https://github.com/marketplace/jira-software-github we can make it easier to manage/track jira tickets from the PRs. This will make it easier to ensure we don't have Zombie tickets for closed PRs and help us clean out our Jira :).

Re: Proposal: Automatically mark stale PRs in github

+1 On Wed, Apr 17, 2019, 11:10 PM Bas Harenslak wrote: > +1 > > Bas > > On 17 Apr 2019, at 23:09, Jarek Potiuk jarek.pot...@polidea.com>> wrote: > > +1 > > Principal Software Engineer > Phone: +48660796129 > > śr., 17 kwi 2019, 23:04 użytkownik Kevin Yang yrql...@gmail.com>> napisał: > > +1 >

Re: Current state of airflow on kubernetes

The reason we didn't do it this way is that we would have needed to copy all of the logic in the k8sPodOperator into the executor. This would've added a lot more code/complexity to the executor. While it does look silly from an external POV, it make sense from a seperations-of-concern POV. The exe

Re: Proposal: Automatically mark stale PRs in github

+1 Bas On 17 Apr 2019, at 23:09, Jarek Potiuk mailto:jarek.pot...@polidea.com>> wrote: +1 Principal Software Engineer Phone: +48660796129 śr., 17 kwi 2019, 23:04 użytkownik Kevin Yang mailto:yrql...@gmail.com>> napisał: +1 Cheers, Kevin Daniel Imberman mailto:dimberman.opensou...@gmail.c

Re: Proposal: Automatically mark stale PRs in github

+1 Principal Software Engineer Phone: +48660796129 śr., 17 kwi 2019, 23:04 użytkownik Kevin Yang napisał: > +1 > > Cheers, > Kevin > > Daniel Imberman 于2019年4月17日 周三下午2:02写道： > > > As part of our effort to reduce the PR backlog I wanted to proposed that > > we set the github stale action https

Re: [ANNOUNCE] Please welcome new Airflow committer Jarek Potiuk

Thanks a lot! It's an honor to be part of such great community and I am happy to take more responsibility as commiter. Looking forward to what we can do together! J.. Principal Software Engineer Phone: +48660796129 śr., 17 kwi 2019, 21:27 użytkownik Chao-Han Tsai napisał: > Congrats Jarek! > >

Re: Proposal: Automatically mark stale PRs in github

+1 Cheers, Kevin Daniel Imberman 于2019年4月17日 周三下午2:02写道： > As part of our effort to reduce the PR backlog I wanted to proposed that > we set the github stale action https://github.com/apps/stale. This will > allow us to temporarily close PRs/tickets that are not actively being > worked on. > >

Proposal: Automatically mark stale PRs in github

As part of our effort to reduce the PR backlog I wanted to proposed that we set the github stale action https://github.com/apps/stale. This will allow us to temporarily close PRs/tickets that are not actively being worked on. (note that this will not remove PRs, it will simply mark PRs as stale t

Re: schedule_interval question

Hi Pawel, I think you can change the start_date to later dates to avoid the DagRun of 2019-04-16 02:00 being scheduled. Chao-Han On Wed, Apr 17, 2019 at 10:13 AM Pawel Bartoszek < pawel.bartoszek@gmail.com> wrote: > Hi, > > Let's say I deploy the following DAG at 2019-04-17 5 PM > > DAG( >

Re: [ANNOUNCE] Please welcome new Airflow committer Jarek Potiuk

Congrats Jarek! On Wed, Apr 17, 2019 at 11:34 AM Kamil Breguła wrote: > Congratulations. I saw your great work on your AIPs. The whole community is > waiting for your development environment. I have been watching them since > the beginning and every day I use its first version. > > On Wed, Apr 1

Re: [ANNOUNCE] Please welcome new Airflow committer Jarek Potiuk

Congratulations. I saw your great work on your AIPs. The whole community is waiting for your development environment. I have been watching them since the beginning and every day I use its first version. On Wed, Apr 17, 2019 at 7:09 PM Jakob Homan wrote: > Howdy all- >I'm pleased to announce

Re: [ANNOUNCE] Please welcome new Airflow committer Jarek Potiuk

Congras Jarek :D Cheers! Kevin Y On Wed, Apr 17, 2019 at 11:12 AM Sid Anand wrote: > Welcome aboard Jarek! > -s > > On Wed, Apr 17, 2019 at 11:05 AM Daniel Imberman < > dimberman.opensou...@gmail.com> wrote: > > > Congratulations Jarek! > > > > On Wed, Apr 17, 2019 at 10:59 AM Arthur Wiedmer <

Re: [ANNOUNCE] Please welcome new Airflow committer Jarek Potiuk

Welcome aboard Jarek! -s On Wed, Apr 17, 2019 at 11:05 AM Daniel Imberman < dimberman.opensou...@gmail.com> wrote: > Congratulations Jarek! > > On Wed, Apr 17, 2019 at 10:59 AM Arthur Wiedmer > wrote: > > > Welcome aboard, Jarek! > > > > Best, > > Arthur > > > > On Wed, Apr 17, 2019, 10:09 Jakob

Re: [ANNOUNCE] Please welcome new Airflow committer Jarek Potiuk

Congratulations Jarek! On Wed, Apr 17, 2019 at 10:59 AM Arthur Wiedmer wrote: > Welcome aboard, Jarek! > > Best, > Arthur > > On Wed, Apr 17, 2019, 10:09 Jakob Homan wrote: > > > Howdy all- > >I'm pleased to announce that the Airflow PMC has voted in Jarek > > Potiuk to be a committer. Jar

Re: [ANNOUNCE] Please welcome new Airflow committer Jarek Potiuk

Welcome aboard Jarek 🎉 On Wed, Apr 17, 2019, 18:37 Szymon Przedwojski < szymon.przedwoj...@polidea.com> wrote: > Congratulations, Jarek! > This is well-deserved and having worked with you already for some time now > I know you will be a great committer. The Airflow community is lucky to > have yo

Re: [ANNOUNCE] Please welcome new Airflow committer Jarek Potiuk

Welcome aboard, Jarek! Best, Arthur On Wed, Apr 17, 2019, 10:09 Jakob Homan wrote: > Howdy all- >I'm pleased to announce that the Airflow PMC has voted in Jarek > Potiuk to be a committer. Jarek's been actively involved in the > project for some time now, contributing patches and participa

Re: [ANNOUNCE] Please welcome new Airflow committer Jarek Potiuk

Congratulations, Jarek! This is well-deserved and having worked with you already for some time now I know you will be a great committer. The Airflow community is lucky to have you :) *Szymon Przedwojski* Polidea | Software Engineer M: +48 500 330 790 On Wed, 17 Apr 2019 at 19:34, Aizhamal Nurma

Re: [ANNOUNCE] Please welcome new Airflow committer Jarek Potiuk

This is awesome news! Congratulations, Jarek! Cheers, Aizhamal On Wed, Apr 17, 2019 at 10:14 AM Driesprong, Fokko wrote: > Welcome Jarek! Great to have you on board! > > Cheers, Fokko > > Op wo 17 apr. 2019 om 19:09 schreef Jakob Homan > > > Howdy all- > >I'm pleased to announce that the A

Re: [ANNOUNCE] Please welcome new Airflow committer Jarek Potiuk

Welcome Jarek! Great to have you on board! Cheers, Fokko Op wo 17 apr. 2019 om 19:09 schreef Jakob Homan > Howdy all- >I'm pleased to announce that the Airflow PMC has voted in Jarek > Potiuk to be a committer. Jarek's been actively involved in the > project for some time now, contributing

schedule_interval question

Hi, Let's say I deploy the following DAG at 2019-04-17 5 PM DAG( dag_id="dag", start_date=datetime(year=2018, month=1, day=1, hour=2, minute=0), schedule_interval="0 2 * * *, default_view="graph", orientation="TB", concurrency=1, max_active_

[ANNOUNCE] Please welcome new Airflow committer Jarek Potiuk

Howdy all- I'm pleased to announce that the Airflow PMC has voted in Jarek Potiuk to be a committer. Jarek's been actively involved in the project for some time now, contributing patches and participating in the mailing list and AIP process. Welcome aboard, Jarek! -Jakob on behalf of the Airf

Re: Current state of airflow on kubernetes

Hey, That's an interesting example, you use the KubernetesExecutor along with the PodOperator, so basically a pod will be started and will poke the execution of another pod... it looks silly to me, monitor pod from the PodOperator should be done by the scheduler directly when using the KubernetesE