Re: PR Review Request

2017-12-07 Thread Sumit Maheshwari
I think we need some more eyes on the PR. As of now, it got stuck between Bolke and me :). I am not able to convince Bolke, that to pre-generate all links on UI is a time & cpu consuming task, as web server has to prepare all such links before handing the rendering work to UI. While he is not abl

Delete variable API

2017-12-07 Thread Niranda Perera
Hi all, I was wondering, doesn't it make sense to add a delete(key) method for the Variable class? Best regards Niranda Perera Research Assistant Dept of CSE, University of Moratuwa niranda...@cse.mrt.ac.lk +94 71 554 8430 https://lk.linkedin.com/in/niranda

Re: [VOTE] Airflow 1.9.0rc5

2017-12-07 Thread Chris Riccomini
Yes, I cherry picked ash's patch. On Thu, Dec 7, 2017 at 10:24 AM, Bolke de Bruin wrote: > Did you include ash’s patch? I did not merge it in stable yet as I had to > back port the tests and wanted to know if they passed. > > B. > > Sent from my iPhone > > > On 7 Dec 2017, at 18:57, Chris Riccom

Re: [VOTE] Airflow 1.9.0rc5

2017-12-07 Thread Chris Riccomini
Sure, LMK when the patch is merged, and I can start RC6. :) On Thu, Dec 7, 2017 at 11:12 AM, Bolke de Bruin wrote: > Tests do not pass, on 1-9-test and stable. It is an issue with the test > not with the implementation. I can patch it pretty quickly if you want to > do a RC6... > > Verstuurd van

Re: [VOTE] Airflow 1.9.0rc5

2017-12-07 Thread Bolke de Bruin
Tests do not pass, on 1-9-test and stable. It is an issue with the test not with the implementation. I can patch it pretty quickly if you want to do a RC6... Verstuurd vanaf mijn iPad > Op 7 dec. 2017 om 19:24 heeft Bolke de Bruin het volgende > geschreven: > > Did you include ash’s patch? I

4/17 Airflow Meetup Slides

2017-12-07 Thread Dan Davydov
Here are the presentations from the 4/17 Airflow meetup at Airbnb. Unfortunately we weren't able to get the recording software working for the talk. Thank you all for coming!

Re: Celery set up issue

2017-12-07 Thread Veeranagouda Mukkanagoudar
Fokko, Thanks for clarifying. The tasks are still in waiting state, and they are not being run. The tasks are generated from scheduler, but not being executed from Celery. There is no communication happening between Celery and Airflow scheduler.. [2017-12-07 18:41:12,155] {dag_processing.py:559}

Re: [VOTE] Airflow 1.9.0rc5

2017-12-07 Thread Bolke de Bruin
Did you include ash’s patch? I did not merge it in stable yet as I had to back port the tests and wanted to know if they passed. B. Sent from my iPhone > On 7 Dec 2017, at 18:57, Chris Riccomini wrote: > > Hey all, > > I have cut Airflow 1.9.0 RC5. This email is calling a vote on the relea

[VOTE] Airflow 1.9.0rc5

2017-12-07 Thread Chris Riccomini
Hey all, I have cut Airflow 1.9.0 RC5. This email is calling a vote on the release, which will last for 72 hours. Consider this my (binding) +1. Airflow 1.9.0 RC5 is available at: https://dist.apache.org/repos/dist/dev/incubator/airflow/1.9.0rc5/ apache-airflow-1.9.0rc5+incubating-source.tar.gz

Re: Airflow logs are stored in Remote s3 and also in the base log folder

2017-12-07 Thread Somasundaram Sekar
When S3 remote log is configured, webui will access S3 for logs right(for read and write) so will we still be required to have them in the local filesystem? On 7 Dec 2017 1:20 pm, "Bolke de Bruin" wrote: > Safe being a relative thing, but yes. I would keep a few and remove old > ones. > > Sent f