Hi all,
*TL;DR*
Airflow doesn't have adequate built-in support for managing per-task
credentials, the concept of connection helps to certain extent but is not
very satisfactory. The current Airflow KubernetesExecutor work opens up the
possibility to handle task credentials at the framework level a
Thank you Siddharth!
On Wed, Aug 30, 2017 at 6:29 PM, siddharth anand wrote:
> I keep forgetting the images are stripped... I'm guessing you are *fenglu-g
> *from the list shown in the image link.
>
> https://www.dropbox.com/s/1bvh7pd1revb3x5/Screenshot%
> 202017-08-30%2018.26.53.png?dl=0
>
> On
I keep forgetting the images are stripped... I'm guessing you are *fenglu-g
*from the list shown in the image link.
https://www.dropbox.com/s/1bvh7pd1revb3x5/Screenshot%202017-08-30%2018.26.53.png?dl=0
On Wed, Aug 30, 2017 at 6:28 PM, siddharth anand wrote:
> I've granted you permissions. I'm g
I've granted you permissions. I'm guessing you are *fenglu-g*
[image: Inline image 1]
On Wed, Aug 30, 2017 at 5:42 PM, Feng Lu wrote:
> Hi,
>
> We would like to share a design proposal on the wiki page
> https://cwiki.apache.org/confluence/display/AIRFLOW, unfortunately it
> doesn't look like
Hi,
We would like to share a design proposal on the wiki page
https://cwiki.apache.org/confluence/display/AIRFLOW, unfortunately it
doesn't look like I have the permission to do so, could someone (the
committers?) kindly grant me edit access?
Thank you.
Feng
*to start the tuning process )
--
Ruslan Dautkhanov
On Wed, Aug 30, 2017 at 3:10 PM, Ruslan Dautkhanov
wrote:
> >> I tried to use NullPool ( change in Airflow) but creating over 1000
> >> connections in minutes is to high time overhead.
>
> It might be a tuning problem with your backend mssq
>> I tried to use NullPool ( change in Airflow) but creating over 1000
>> connections in minutes is to high time overhead.
It might be a tuning problem with your backend mssql database.
Try decreasing sql_alchemy_pool_size, parallelism, dag_concurrency to a
fairly small values to see if you can re
Hello,
I tried to use Airflow 1.8.2RC2 and 1.8.2.RC4 with MSSQL database.
Unfortunately I always got Airflow Scheduler hangs. It is always after a
few minutes after 'airflow scheduler ' process start. I would like to share
results of my investigation of this problem.
Here is example stacktrace
