Not a biggie but it’s there: ‘apache-airflow[slack’]
[cid:image001.png@01D5F7AF.93693220]
Thanks,
-Eugene
Curious, how did it go?
Thanks,
-Eugene
On 9/14/19, 4:14 PM, "Alex Guziel" wrote:
Agree with Bolke here. Not much is going on in worker as long as there
aren’t breaking changes.
On Sat, Sep 14, 2019 at 1:24 PM Bolke de Bruin wrote:
> I actually think that it is not
For what version you are targeting UI revamp?
-Eugene
On 2/11/20, 2:34 AM, "Kaxil Naik" wrote:
Oh yes, the DAG can run on the Timezone dependent schedules but the
webserver only shows it in UTC. We are going to revamp the UI to build all
the modern features including timezone supp
, "Bacal, Eugene" wrote:
Thank you, Daniel! Sorry for spamming.
https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstackoverflow.com%2Fquestions%2F57718658%2Fairflow-celery-workers-too-many-mysql-connections&data=01%7C01%7Cebaca
hat is probably a better way to help you through this.
We will need to see what exactly you are doing in your dag files and
potentially also hooks / operators.
Thanks
On Thu, Aug 29, 2019 at 10:41 AM Bacal, Eugene
wrote:
> Can someone advise if
ad Automation Engineer
Scheduling Platform Experience
Cell: 4802028764
Slack: @ebacal
DL: dl-pp-cdp-...@paypal.com
Scottsdale, Arizona
On 8/21/19, 2:36 PM, "Bacal, Eugene" wrote:
Hi Max,
We have ran few testing today from DB side and noticed that:
- DB conne
similar cases were reported some time back(2016),
https://issues.apache.org/jira/browse/AIRFLOW-680
On 8/20/19, 5:19 PM, "Bacal, Eugene" wrote:
Celery executor.
12 BareMetals: CPU(s):40, MHz 2494.015, RAM 378G - each box
Worker .cfg:
[core]
sq
at 7:50 AM Bacal, Eugene
wrote:
> Absolutely possible, Daniel,
>
> We are looking in all directions. Has anyone noticed performance
> improvements with PostgreSQL vs MySQL ?
>
> -Eugene
>
>
> On 8/15/19, 2:03 PM, "Daniel
very fast for this reason.
On Thu, Aug 15, 2019 at 1:45 PM Bacal, Eugene
wrote:
>
> Thank you for your reply, Max
>
> Dynamic DAGs query the database for tables and generates DAGs and tasks
> based on the output.
> For Python does not take
%2Fstackoverflow.com%2Fquestions%2F27743711%2Fcan-i-speedup-yaml&data=01%7C01%7Cebacal%40paypal.com%7Cb01b585b5bf348b7ee4808d721b1c363%7Cfb00791460204374977e21bac5f3f4c8%7C1&sdata=n05lhbbyxOVY96UgCkOOg7zRVZD0KD78oD98RotL224%3D&reserved=0
Max
On Wed, Aug 14, 2019 at
Hello Airflow team,
Please advise if you can. In our environment, we have noticed that dynamic
tasks place quite of stress on scheduler, webserver and increase MySQL DB
connections.
We are run about 1000 Dynamic Tasks every 30 min and parsing time increases
from 5 to 65 sec with Runtime from 2s
Hello there,
Please advise if you can. In our environment, we have noticed that dynamic
tasks place a lot of stress on scheduler, webserver and DB (connections wise)
We are running about 1000 Dynamic Tasks every 30 min and parsing time increases
from 5 to 65 sec with Runtime from 2sec to 350+ .
12 matches
Mail list logo
