[ANNOUNCE] Apache Airflow version 1.10.10 Released

2020-04-09 Thread Kaxil Naik
Dear Airflow community, I am pleased to announce that Airflow 1.10.10 has just been released. Apache Airflow - A platform to programmatically author, schedule, and monitor workflows. The official source release: https://dist.apache.org/repos/dist/release/airflow/1.10.10 The PyPI package: https:

[RESULT][VOTE] Release Apache Airflow 1.10.10 based on 1.10.10rc5 (Accelerated vote)

2020-04-09 Thread Kaxil Naik
The vote to release Apache Apache Airflow version 1.10.10 based on 1.10.10.rc5 is now closed. The vote PASSED with 4 binding "+1", 0 non-binding "+1" and 0 "-1" votes: "+1" Binding votes: - Kaxil Naik - Ash Berlin-Taylor - Fokko Driesprong - Arthur Wiedmer I'll continue with the release process

Re: [VOTE] Release Apache Airflow 1.10.10 based on 1.10.10rc5 (Accelerated vote)

2020-04-09 Thread Arthur Wiedmer
+1 (binding) On Thu, Apr 9, 2020 at 11:55 AM Kaxil Naik wrote: > Hello Apache Airflow Community, > > This is a call for the vote to release Apache Airflow version 1.10.10. > > This RC has a single change ( > > https://github.com/apache/airflow/commit/f5833a9e57d8e85b1d2b1d93593bfc0089427e49 > )

Re: [VOTE] Release Apache Airflow 1.10.10 based on 1.10.10rc5 (Accelerated vote)

2020-04-09 Thread Driesprong, Fokko
+1 binding Op do 9 apr. 2020 om 21:11 schreef Ash Berlin-Taylor > Confirming differences between 1.10.10rc4 and rc5 > > diff -r /tmp/tmp.sgu8qJJFl9/airflow/models/chart.py > /tmp/tmp.HatTjZDbBh/airflow/models/chart.py > 23a24 > > from airflow.models.user import User > 44c45 > < "User", c

Re: [VOTE] Release Apache Airflow 1.10.10 based on 1.10.10rc5 (Accelerated vote)

2020-04-09 Thread Ash Berlin-Taylor
Confirming differences between 1.10.10rc4 and rc5 diff -r /tmp/tmp.sgu8qJJFl9/airflow/models/chart.py /tmp/tmp.HatTjZDbBh/airflow/models/chart.py 23a24 > from airflow.models.user import User 44c45 < "User", cascade=False, cascade_backrefs=False, backref='charts') --- > User, casca

Re: [VOTE] Release Apache Airflow 1.10.10 based on 1.10.10rc5 (Accelerated vote)

2020-04-09 Thread Kaxil Naik
+1 binding On Thu, Apr 9, 2020 at 7:55 PM Kaxil Naik wrote: > Hello Apache Airflow Community, > > This is a call for the vote to release Apache Airflow version 1.10.10. > > This RC has a single change ( > https://github.com/apache/airflow/commit/f5833a9e57d8e85b1d2b1d93593bfc0089427e49) > to fix

[VOTE] Release Apache Airflow 1.10.10 based on 1.10.10rc5 (Accelerated vote)

2020-04-09 Thread Kaxil Naik
Hello Apache Airflow Community, This is a call for the vote to release Apache Airflow version 1.10.10. This RC has a single change ( https://github.com/apache/airflow/commit/f5833a9e57d8e85b1d2b1d93593bfc0089427e49) to fix a breaking change introduced by SQLAlchemy 1.3.16 ( https://github.com/ap

[CLOSED][VOTE] Release Apache Airflow 1.10.10 based on 1.10.10rc4

2020-04-09 Thread Kaxil Naik
The voting period has ended, the vote has passed. However, to solve the issue with SQLA release, I have cut 1.10.10rc5 and would create an email thread for an accelerated vote, Regards, Kaxil On Thu, Apr 9, 2020 at 1:03 PM Ash Berlin-Taylor wrote: > https://github.com/apache/airflow/pull/8230 i

Capturing/Retrieving job id for a backfill

2020-04-09 Thread Victor Ignatenkov
Hello Airflow Community, Due to some unique circumstances we are running all of our backfills through the Rundeck, it is been working pretty great; however, we’re running into some issues. When a backfill is run via the airflow cli, a record for the job is created in airflow's `job` table wi

Re: API spec questions

2020-04-09 Thread Ash Berlin-Taylor
They are, but we _can_ make a choice to remove that feature -- it is not widely used and is confusing to many when they stumble on it. It's not something we should do lightly, but it is a possibility. I think I'm probably leaning towards the "ordinal" concept: /connections/hdfs_default -> list

RE: API spec questions

2020-04-09 Thread Shaw, Damian P.
FYI if you look back at the thread "Re: [2.0 spring cleaning] Require unique conn_id" on 2019-04-14 you can see a message from Kevin Yang stating that this random choice of connections is a "feature" used to load balance connections in AirBnB. So users are relying on this behavior. -Origi

Re: [VOTE] Release Apache Airflow 1.10.10 based on 1.10.10rc4

2020-04-09 Thread Ash Berlin-Taylor
https://github.com/apache/airflow/pull/8230 is the fix that we want to release with an accelerated vote for 1.10.10rc5. -ash On Apr 9 2020, at 12:54 pm, Ash Berlin-Taylor wrote: > +1 binding. > > Tested with Python 3.7, postgres 12 and celery worker. > > Checked version in archives. > Checked

Re: [VOTE] Release Apache Airflow 1.10.10 based on 1.10.10rc4

2020-04-09 Thread Ash Berlin-Taylor
+1 binding. Tested with Python 3.7, postgres 12 and celery worker. Checked version in archives. Checked keys and signatures. Tested RBAC and non RBAC UI (fix needed for non RBAC, see Kaxil's earlier message) -ash On Apr 9 2020, at 8:10 am, Jarek Potiuk wrote: > +1 (binding) Tested python 3.6 +

Re: [VOTE] Release Apache Airflow 1.10.10 based on 1.10.10rc4

2020-04-09 Thread Jarek Potiuk
+1 (binding) Tested python 3.6 + postgres, 2.7 + mysql. Rat check: jarek:~/Downloads/apache-airflow-1.10.10rc4] 12m17s 130 $ java -jar ../apache-rat-0.13/apache-rat-0.13.jar -E .rat-excludes --dir . Ignored 13 lines in your exclusion files as comments or empty lines. ***