Re: creating a pool automatically

2016-09-08 Thread siddharth anand
As with other Airflow CLI commands, you can pass the *-h* flag to see usage. [image: Inline image 2] To expose the list of available airflow CLI commands, type *airflow* or *airflow -h* ​Not sure when this will be released, it won't hurt to update your fork to this commit if releasing to your Q

Re: creating a pool automatically

2016-09-08 Thread הילה ויזן
when are you expecting release version to include this fix? On Thu, Sep 8, 2016 at 5:02 PM, הילה ויזן wrote: > Hi, > can you also provide command line parameters? > > i didn't find it in the documentation > > > On Wed, Sep 7, 2016 at 2:50 AM, siddharth anand wrote: > >> You can now create/modif

Re: creating a pool automatically

2016-09-08 Thread הילה ויזן
Hi, can you also provide command line parameters? i didn't find it in the documentation On Wed, Sep 7, 2016 at 2:50 AM, siddharth anand wrote: > You can now create/modify pools via the Airflow CLI. > > https://github.com/apache/incubator-airflow/pull/1735/commits > > -s > > Resources that are

Re: creating a pool automatically

2016-09-06 Thread siddharth anand
You can now create/modify pools via the Airflow CLI. https://github.com/apache/incubator-airflow/pull/1735/commits -s Resources that are typically modified via the webserver, such as pools, connections, & variables, should eventually be managed via the CLI to allow for better integration with au

Re: creating a pool automatically

2016-09-06 Thread harish singh
This is how we have been doing it. pool_name = "pool_A" num_slots = 10 # creating pool session = airflow.settings.Session() pool = ( session.query(Pool) .filter(Pool.pool == pool_name) .first()) if not pool: logging.info("Creating po

Re: creating a pool automatically

2016-09-06 Thread Lance Norskog
In the web UI, Admin->Pools lets you create, edit & view all Pools. On Sun, Sep 4, 2016 at 9:40 PM, הילה ויזן wrote: > Hi, > we use a pool of size 1 to restrict parallelism of a task in dag. > We created the pool via airflow webserver. > > Is there any other way to create it via a script? maybe

creating a pool automatically

2016-09-04 Thread הילה ויזן
Hi, we use a pool of size 1 to restrict parallelism of a task in dag. We created the pool via airflow webserver. Is there any other way to create it via a script? maybe sql query on DB? I didn't find an appropriate CLI command. Thanks, Hila