[GitHub] [airflow] boittega opened a new pull request #8305: Create doc skeleton

2020-04-14 Thread GitBox
boittega opened a new pull request #8305: Create doc skeleton URL: https://github.com/apache/airflow/pull/8305 Issue #8195 --- Make sure to mark the boxes below before creating PR: [x] - [ ] Description above provides context of the change - [ ] Unit tests coverage for

[GitHub] [airflow] jcarless opened a new pull request #8304: [Airflow-5565] Add extra_args param to s3hook

2020-04-14 Thread GitBox
jcarless opened a new pull request #8304: [Airflow-5565] Add extra_args param to s3hook URL: https://github.com/apache/airflow/pull/8304 Optional extra_args param was added to the load_bytes and load_file_object functions. test_load_fileobj_extra_args and test_load_bytes_extra_args unit

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8304: [Airflow-5565] Add extra_args param to s3hook

2020-04-14 Thread GitBox
boring-cyborg[bot] commented on issue #8304: [Airflow-5565] Add extra_args param to s3hook URL: https://github.com/apache/airflow/pull/8304#issuecomment-613675762 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure

[GitHub] [airflow] mik-laj commented on issue #8302: Remove unused code from Gannt View

2020-04-14 Thread GitBox
mik-laj commented on issue #8302: Remove unused code from Gannt View URL: https://github.com/apache/airflow/pull/8302#issuecomment-613674260 I hope that we will be able to resolve pylint errors soon so that it can detect similar problems automatically.

[jira] [Commented] (AIRFLOW-6776) Celery Executor Creates Zombie Tasks on Worker Death

2020-04-14 Thread Kimberly Orr (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083599#comment-17083599 ] Kimberly Orr commented on AIRFLOW-6776: --- Behavior is extremely similar to:

[jira] [Updated] (AIRFLOW-6776) Celery Executor Creates Zombie Tasks on Worker Death

2020-04-14 Thread Kimberly Orr (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kimberly Orr updated AIRFLOW-6776: -- Description: UPDATE: Since originally reported, we have moved off our custom fork and are

[jira] [Updated] (AIRFLOW-6776) Celery Executor Creates Zombie Tasks on Worker Death

2020-04-14 Thread Kimberly Orr (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kimberly Orr updated AIRFLOW-6776: -- Affects Version/s: (was: 1.10.4) 1.10.7 > Celery Executor Creates

[jira] [Updated] (AIRFLOW-6776) Celery Executor Creates Zombie Tasks on Worker Death

2020-04-14 Thread Kimberly Orr (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kimberly Orr updated AIRFLOW-6776: -- Description: UPDATE: Since originally reported, we have moved off our custom fork and are

[jira] [Updated] (AIRFLOW-6776) Celery Executor Creates Zombie Tasks on Worker Death

2020-04-14 Thread Kimberly Orr (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kimberly Orr updated AIRFLOW-6776: -- Environment: Dockerized CeleryExecutor (ElastiCache Redis) on AWS EC2 instances. (was:

[GitHub] [airflow] jloehel commented on a change in pull request #8256: updated _write_args on PythonVirtualenvOperator

2020-04-14 Thread GitBox
jloehel commented on a change in pull request #8256: updated _write_args on PythonVirtualenvOperator URL: https://github.com/apache/airflow/pull/8256#discussion_r408422100 ## File path: airflow/operators/python_operator.py ## @@ -330,13 +330,28 @@ def

[GitHub] [airflow] retornam commented on issue #7653: [AIRFLOW-6914] Add a default robots.txt

2020-04-14 Thread GitBox
retornam commented on issue #7653: [AIRFLOW-6914] Add a default robots.txt URL: https://github.com/apache/airflow/pull/7653#issuecomment-613670159 No I think I have enough based on the review, unless you have more to add. Thanks > On Apr 14, 2020, at 13:06, Kaxil Naik wrote: >

[GitHub] [airflow] KevinKobi opened a new issue #8303: BingAds to Google storage

2020-04-14 Thread GitBox
KevinKobi opened a new issue #8303: BingAds to Google storage URL: https://github.com/apache/airflow/issues/8303 **Description** I'm interested in getting BingAds data into GCS using Airflow SDK for python is available: https://github.com/BingAds/BingAds-Python-SDK

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8303: BingAds to Google storage

2020-04-14 Thread GitBox
boring-cyborg[bot] commented on issue #8303: BingAds to Google storage URL: https://github.com/apache/airflow/issues/8303#issuecomment-613669739 Thanks for opening your first issue here! Be sure to follow the issue template!

[GitHub] [airflow] kaxil opened a new pull request #8302: Remove unused code from Gannt View

2020-04-14 Thread GitBox
kaxil opened a new pull request #8302: Remove unused code from Gannt View URL: https://github.com/apache/airflow/pull/8302 After https://github.com/apache/airflow/pull/8220 we do not need `task_types` and `extra_links` variables --- Make sure to mark the boxes below before

[jira] [Commented] (AIRFLOW-4038) Remove DagBag from /home

2020-04-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083588#comment-17083588 ] ASF subversion and git services commented on AIRFLOW-4038: -- Commit

[jira] [Commented] (AIRFLOW-6351) security - ui - Add Cross Site Scripting defence

2020-04-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083589#comment-17083589 ] ASF subversion and git services commented on AIRFLOW-6351: -- Commit

[jira] [Commented] (AIRFLOW-4235) home page dags table: highlight rows on mouse hover

2020-04-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083586#comment-17083586 ] ASF subversion and git services commented on AIRFLOW-4235: -- Commit

[jira] [Commented] (AIRFLOW-7019) Add visual indication of failure to pause/unpause a dag

2020-04-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083587#comment-17083587 ] ASF subversion and git services commented on AIRFLOW-7019: -- Commit

[jira] [Commented] (AIRFLOW-7049) Make show_paused persistent across navigation

2020-04-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083590#comment-17083590 ] ASF subversion and git services commented on AIRFLOW-7049: -- Commit

[jira] [Commented] (AIRFLOW-6697) Base date and Search in Graph view don't dim when modal activate

2020-04-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083585#comment-17083585 ] ASF subversion and git services commented on AIRFLOW-6697: -- Commit

[GitHub] [airflow] feluelle commented on issue #7683: [AIRFLOW-7033] Change dag and task state meanwhile

2020-04-14 Thread GitBox
feluelle commented on issue #7683: [AIRFLOW-7033] Change dag and task state meanwhile URL: https://github.com/apache/airflow/pull/7683#issuecomment-613664451 Yes that’s the window I meant. Don‘t you think it would make more sense to add an optional button „task instances“ next to

[GitHub] [airflow] mik-laj commented on issue #8291: Enforce Connections & Pools

2020-04-14 Thread GitBox
mik-laj commented on issue #8291: Enforce Connections & Pools URL: https://github.com/apache/airflow/issues/8291#issuecomment-613662328 I also see the benefit but I also understand the technical limitations. We cannot introduce some feature, we will limit the flexibility of operators and

[GitHub] [airflow] kaxil commented on issue #7653: [AIRFLOW-6914] Add a default robots.txt

2020-04-14 Thread GitBox
kaxil commented on issue #7653: [AIRFLOW-6914] Add a default robots.txt URL: https://github.com/apache/airflow/pull/7653#issuecomment-613654409 Hey @retornam Do you need any more info to create a new PR to solve the same issue?

[jira] [Commented] (AIRFLOW-7049) Make show_paused persistent across navigation

2020-04-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083574#comment-17083574 ] ASF subversion and git services commented on AIRFLOW-7049: -- Commit

[jira] [Commented] (AIRFLOW-4038) Remove DagBag from /home

2020-04-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083572#comment-17083572 ] ASF subversion and git services commented on AIRFLOW-4038: -- Commit

[jira] [Commented] (AIRFLOW-6351) security - ui - Add Cross Site Scripting defence

2020-04-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083573#comment-17083573 ] ASF subversion and git services commented on AIRFLOW-6351: -- Commit

[jira] [Commented] (AIRFLOW-7019) Add visual indication of failure to pause/unpause a dag

2020-04-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083571#comment-17083571 ] ASF subversion and git services commented on AIRFLOW-7019: -- Commit

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8301: Support Duration in AwsHook when using assume role

2020-04-14 Thread GitBox
boring-cyborg[bot] commented on issue #8301: Support Duration in AwsHook when using assume role URL: https://github.com/apache/airflow/issues/8301#issuecomment-613649035 Thanks for opening your first issue here! Be sure to follow the issue template!

[GitHub] [airflow] snazzyfox opened a new issue #8301: Support Duration in AwsHook when using assume role

2020-04-14 Thread GitBox
snazzyfox opened a new issue #8301: Support Duration in AwsHook when using assume role URL: https://github.com/apache/airflow/issues/8301 **Description** Boto3 `assume_role` [supports a `DurationSeconds`

[jira] [Updated] (AIRFLOW-6351) security - ui - Add Cross Site Scripting defence

2020-04-14 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-6351: Fix Version/s: (was: 2.0.0) 1.10.11 > security - ui - Add Cross Site

[GitHub] [airflow] ashb merged pull request #8298: Fix confusing "heartbeat" name on DagFileProcessor class

2020-04-14 Thread GitBox
ashb merged pull request #8298: Fix confusing "heartbeat" name on DagFileProcessor class URL: https://github.com/apache/airflow/pull/8298 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] alexandraabbas commented on issue #8276: [Airflow-6295] Create guide for BigQuery operators

2020-04-14 Thread GitBox
alexandraabbas commented on issue #8276: [Airflow-6295] Create guide for BigQuery operators URL: https://github.com/apache/airflow/pull/8276#issuecomment-613643391 @mik-laj I added subtitles for each operator except `BigQueryExecuteQueryOperator` as that is the only operator discussed in

[jira] [Resolved] (AIRFLOW-4038) Remove DagBag from /home

2020-04-14 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-4038. - Fix Version/s: (was: 2.0.0) 1.10.11 Resolution: Fixed > Remove

[jira] [Commented] (AIRFLOW-6747) UI - Show count of tasks in each dag on the main dags page

2020-04-14 Thread Roster (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083559#comment-17083559 ] Roster commented on AIRFLOW-6747: - [~maubeh1] the request was to count tasks not dags. so: 2. Show the

[GitHub] [airflow] RosterIn commented on issue #8291: Enforce Connections & Pools

2020-04-14 Thread GitBox
RosterIn commented on issue #8291: Enforce Connections & Pools URL: https://github.com/apache/airflow/issues/8291#issuecomment-613636952 I will give it a try. as for the feature... I really see Pools as extension of Connection. In my opinion they should be combined if users wish

[GitHub] [airflow] potiuk commented on issue #8290: Add airflow info command

2020-04-14 Thread GitBox
potiuk commented on issue #8290: Add airflow info command URL: https://github.com/apache/airflow/pull/8290#issuecomment-613634334 @kaxil -> FYI ^^ This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] potiuk commented on issue #8290: Add airflow info command

2020-04-14 Thread GitBox
potiuk commented on issue #8290: Add airflow info command URL: https://github.com/apache/airflow/pull/8290#issuecomment-613634169 LGTM! Great tool that we shoudl start using soon! Maybe a good candidate for 1.10.11 cherry-pick.

[GitHub] [airflow] mik-laj commented on issue #8290: Add airflow info command

2020-04-14 Thread GitBox
mik-laj commented on issue #8290: Add airflow info command URL: https://github.com/apache/airflow/pull/8290#issuecomment-613631254 Ready for review. This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (AIRFLOW-4235) home page dags table: highlight rows on mouse hover

2020-04-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083524#comment-17083524 ] ASF subversion and git services commented on AIRFLOW-4235: -- Commit

[jira] [Updated] (AIRFLOW-4235) home page dags table: highlight rows on mouse hover

2020-04-14 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-4235: Fix Version/s: (was: 2.0.0) 1.10.11 > home page dags table: highlight

[GitHub] [airflow] codecov-io edited a comment on issue #8228: Expose Airflow Webserver Port in Production Docker Image

2020-04-14 Thread GitBox
codecov-io edited a comment on issue #8228: Expose Airflow Webserver Port in Production Docker Image URL: https://github.com/apache/airflow/pull/8228#issuecomment-613449528 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8228?src=pr=h1) Report > Merging

[GitHub] [airflow] mik-laj commented on issue #8291: Enforce Connections & Pools

2020-04-14 Thread GitBox
mik-laj commented on issue #8291: Enforce Connections & Pools URL: https://github.com/apache/airflow/issues/8291#issuecomment-613607028 The cluster policy can make any modifications on the task or DAG after loading it. You can do any modification in the task, in particular check which

[GitHub] [airflow] RosterIn commented on issue #8296: Make execute and on_kill as abstractmethod in baseoperator

2020-04-14 Thread GitBox
RosterIn commented on issue #8296: Make execute and on_kill as abstractmethod in baseoperator URL: https://github.com/apache/airflow/pull/8296#issuecomment-613605288 The problem is also where you need to kill a process on remote machine.

[jira] [Commented] (AIRFLOW-6697) Base date and Search in Graph view don't dim when modal activate

2020-04-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083487#comment-17083487 ] ASF subversion and git services commented on AIRFLOW-6697: -- Commit

[jira] [Resolved] (AIRFLOW-6697) Base date and Search in Graph view don't dim when modal activate

2020-04-14 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-6697. - Fix Version/s: 1.10.11 Resolution: Fixed > Base date and Search in Graph view don't dim

[GitHub] [airflow] RosterIn edited a comment on issue #8291: Enforce Connections & Pools

2020-04-14 Thread GitBox
RosterIn edited a comment on issue #8291: Enforce Connections & Pools URL: https://github.com/apache/airflow/issues/8291#issuecomment-613596062 @mik-laj correct me if I'm wrong but cluster policy can't enforce pool. It can enforce queues (celery). If I understand this correctly the

[GitHub] [airflow] RosterIn commented on issue #8291: Enforce Connections & Pools

2020-04-14 Thread GitBox
RosterIn commented on issue #8291: Enforce Connections & Pools URL: https://github.com/apache/airflow/issues/8291#issuecomment-613596062 @mik-laj correct me if I'm wrong but cluster policy can't enforce pool. It can enforce queues (celery). If I understand this correctly the cluster

[GitHub] [airflow] mik-laj commented on issue #8276: [Airflow-6295] Create guide for BigQuery operators

2020-04-14 Thread GitBox
mik-laj commented on issue #8276: [Airflow-6295] Create guide for BigQuery operators URL: https://github.com/apache/airflow/pull/8276#issuecomment-613569372 Hi. Thank you for the guide, but could you put each operator in a separate section / subsection. This is important because it makes

[GitHub] [airflow] kaxil commented on issue #8293: Architecture diagram on Documentation is broken

2020-04-14 Thread GitBox
kaxil commented on issue #8293: Architecture diagram on Documentation is broken URL: https://github.com/apache/airflow/issues/8293#issuecomment-613556774 Fixed: ![image](https://user-images.githubusercontent.com/8811558/79251806-950c2d80-7e78-11ea-8999-76cfd4bf80b6.png)

[airflow-site] branch asf-site updated: Update - Tue 14 Apr 2020 17:50:46 BST

2020-04-14 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/asf-site by this push: new ffde01b Update - Tue 14 Apr 2020

[GitHub] [airflow] mik-laj commented on a change in pull request #8290: Add airflow info command

2020-04-14 Thread GitBox
mik-laj commented on a change in pull request #8290: Add airflow info command URL: https://github.com/apache/airflow/pull/8290#discussion_r408284496 ## File path: airflow/cli/commands/info_command.py ## @@ -310,9 +375,50 @@ def __str__(self): ) +class

[airflow-site] branch master updated: Docs for 1.10.10 (#265)

2020-04-14 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/master by this push: new 7de3d01 Docs for 1.10.10 (#265)

[GitHub] [airflow] kaxil closed issue #8293: Architecture diagram on Documentation is broken

2020-04-14 Thread GitBox
kaxil closed issue #8293: Architecture diagram on Documentation is broken URL: https://github.com/apache/airflow/issues/8293 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow-site] kaxil merged pull request #265: Fix Celery Architecture Dia for 1.10.10

2020-04-14 Thread GitBox
kaxil merged pull request #265: Fix Celery Architecture Dia for 1.10.10 URL: https://github.com/apache/airflow-site/pull/265 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow-site] kaxil opened a new pull request #265: Fix Celery Architecture Dia for 1.10.10

2020-04-14 Thread GitBox
kaxil opened a new pull request #265: Fix Celery Architecture Dia for 1.10.10 URL: https://github.com/apache/airflow-site/pull/265 This is an automated message from the Apache Git Service. To respond to the message, please

[airflow-site] branch Fix-Celery-Architecture-dia-for-1.10.10 created (now 71430f0)

2020-04-14 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch Fix-Celery-Architecture-dia-for-1.10.10 in repository https://gitbox.apache.org/repos/asf/airflow-site.git. at 71430f0 Docs for 1.10.10 This branch includes the following new commits:

[GitHub] [airflow] kaxil commented on issue #8293: Architecture diagram on Documentation is broken

2020-04-14 Thread GitBox
kaxil commented on issue #8293: Architecture diagram on Documentation is broken URL: https://github.com/apache/airflow/issues/8293#issuecomment-613550947 PR: https://github.com/apache/airflow-site/pull/265 This is an

[airflow-site] 01/01: Docs for 1.10.10

2020-04-14 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch Fix-Celery-Architecture-dia-for-1.10.10 in repository https://gitbox.apache.org/repos/asf/airflow-site.git commit 71430f062ec8b1916a79eb5e4c9c48737d5e063a Author: Kaxil Naik AuthorDate: Tue

[GitHub] [airflow] zhongjiajie commented on issue #8296: Make execute and on_kill as abstractmethod in baseoperator

2020-04-14 Thread GitBox
zhongjiajie commented on issue #8296: Make execute and on_kill as abstractmethod in baseoperator URL: https://github.com/apache/airflow/pull/8296#issuecomment-613550711 > How many don't have an on_kill? Almost a half? I guess > All child processes for tasks should be killed

[GitHub] [airflow] zhongjiajie commented on issue #8231: Dag bulk_sync_to_db dag_tag only remove not exists

2020-04-14 Thread GitBox
zhongjiajie commented on issue #8231: Dag bulk_sync_to_db dag_tag only remove not exists URL: https://github.com/apache/airflow/pull/8231#issuecomment-613543650 > I looked and your change is correct, but I wonder if we lack tests to automatically detect similar situations? Ok, then

[GitHub] [airflow] dimberman commented on a change in pull request #8219: [WIP] Add migration waiting script and log cleaner

2020-04-14 Thread GitBox
dimberman commented on a change in pull request #8219: [WIP] Add migration waiting script and log cleaner URL: https://github.com/apache/airflow/pull/8219#discussion_r408270362 ## File path: clean-logs.sh ## @@ -0,0 +1,37 @@ +#!/usr/bin/env bash + +# Licensed to the

[GitHub] [airflow] zhongjiajie commented on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3

2020-04-14 Thread GitBox
zhongjiajie commented on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3 URL: https://github.com/apache/airflow/pull/5659#issuecomment-613536469 BTW, that a good new for AIP-3 This is an automated message from the

[GitHub] [airflow] zhongjiajie commented on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3

2020-04-14 Thread GitBox
zhongjiajie commented on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3 URL: https://github.com/apache/airflow/pull/5659#issuecomment-613535956 Ohh, I remember we could not reopen PR closed by stale-bot, am I wrong?

[GitHub] [airflow] zhongjiajie commented on issue #7683: [AIRFLOW-7033] Change dag and task state meanwhile

2020-04-14 Thread GitBox
zhongjiajie commented on issue #7683: [AIRFLOW-7033] Change dag and task state meanwhile URL: https://github.com/apache/airflow/pull/7683#issuecomment-613534495 BTW, I just checkout and find out we already have this function in tree view dagrun

[GitHub] [airflow] potiuk commented on issue #8228: Expose Airflow Webserver Port in Production Docker Image

2020-04-14 Thread GitBox
potiuk commented on issue #8228: Expose Airflow Webserver Port in Production Docker Image URL: https://github.com/apache/airflow/pull/8228#issuecomment-613532777 Perfect! Thanks @feluelle ! Let's wait for Travis and I am super happy to merge it :)

[GitHub] [airflow] zhongjiajie commented on issue #7683: [AIRFLOW-7033] Change dag and task state meanwhile

2020-04-14 Thread GitBox
zhongjiajie commented on issue #7683: [AIRFLOW-7033] Change dag and task state meanwhile URL: https://github.com/apache/airflow/pull/7683#issuecomment-613532992 @feluelle You'r right, I that another way to mark dag run state. But this PR is try to fix the exists bug(maybe) in tool view in

[GitHub] [airflow] potiuk commented on a change in pull request #8290: Add airflow info command

2020-04-14 Thread GitBox
potiuk commented on a change in pull request #8290: Add airflow info command URL: https://github.com/apache/airflow/pull/8290#discussion_r408255802 ## File path: airflow/cli/commands/info_command.py ## @@ -310,9 +375,50 @@ def __str__(self): ) +class

[GitHub] [airflow] potiuk commented on issue #8297: Customizable configurable footer in admin web interface

2020-04-14 Thread GitBox
potiuk commented on issue #8297: Customizable configurable footer in admin web interface URL: https://github.com/apache/airflow/issues/8297#issuecomment-613530551 I would not recommend anyone open up the admin interface of Airflow to the public. And authentication is a must. While I agree

[GitHub] [airflow] dimberman commented on issue #7626: [AIRFLOW-5575] Cannot use the mark future success/failure feature in the UI

2020-04-14 Thread GitBox
dimberman commented on issue #7626: [AIRFLOW-5575] Cannot use the mark future success/failure feature in the UI URL: https://github.com/apache/airflow/pull/7626#issuecomment-613530480 @crhyatt I have no idea why it's doing that... can you rebase again? I'm not too worried about codecov

[GitHub] [airflow] ashb commented on issue #8298: Fix confusing "heartbeat" name on DagFileProcessor class

2020-04-14 Thread GitBox
ashb commented on issue #8298: Fix confusing "heartbeat" name on DagFileProcessor class URL: https://github.com/apache/airflow/pull/8298#issuecomment-613525985 Travis being slow, I guess I can wait :) This is an automated

[jira] [Commented] (AIRFLOW-5033) Cannot install apache-airflow[kerberos] on Python 3

2020-04-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083364#comment-17083364 ] ASF GitHub Bot commented on AIRFLOW-5033: - potiuk commented on pull request #5659:

[GitHub] [airflow] potiuk opened a new pull request #5659: [AIRFLOW-5033] Switched to snakebite-py3

2020-04-14 Thread GitBox
potiuk opened a new pull request #5659: [AIRFLOW-5033] Switched to snakebite-py3 URL: https://github.com/apache/airflow/pull/5659 NOTE TO REVIEWER: It depends on #7278 - so please check only the last commit. Make sure you have checked _all_ steps below. ### Jira - [x]

[GitHub] [airflow] potiuk commented on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3

2020-04-14 Thread GitBox
potiuk commented on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3 URL: https://github.com/apache/airflow/pull/5659#issuecomment-613522972 I will take a look shortly while I will be looking at removing conflicting requirements. The state for this snakebite is that it has been fixed

[GitHub] [airflow] zhongjiajie commented on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3

2020-04-14 Thread GitBox
zhongjiajie commented on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3 URL: https://github.com/apache/airflow/pull/5659#issuecomment-613517140 @wittfabian No, this PR was close by stale-bot and I think no one could open it again, feel free to continue the PR by create new one if

[GitHub] [airflow] mik-laj commented on issue #8231: Dag bulk_sync_to_db dag_tag only remove not exists

2020-04-14 Thread GitBox
mik-laj commented on issue #8231: Dag bulk_sync_to_db dag_tag only remove not exists URL: https://github.com/apache/airflow/pull/8231#issuecomment-613515485 I looked and your change is correct, but I wonder if we lack tests to automatically detect similar situations?

[GitHub] [airflow] mik-laj commented on issue #8231: Dag bulk_sync_to_db dag_tag only remove not exists

2020-04-14 Thread GitBox
mik-laj commented on issue #8231: Dag bulk_sync_to_db dag_tag only remove not exists URL: https://github.com/apache/airflow/pull/8231#issuecomment-613511771 @zhongjiajie Here is SQL statements with parameters for your changes. ``` root@eeefbb427a9c:/opt/airflow# pytest

[GitHub] [airflow] ashb commented on issue #8298: Fix confusing "heartbeat" name on DagFileProcessor class

2020-04-14 Thread GitBox
ashb commented on issue #8298: Fix confusing "heartbeat" name on DagFileProcessor class URL: https://github.com/apache/airflow/pull/8298#issuecomment-613511008 #drive-by-refactoring This is an automated message from the

[GitHub] [airflow] feluelle commented on issue #7683: [AIRFLOW-7033] Change dag and task state meanwhile

2020-04-14 Thread GitBox
feluelle commented on issue #7683: [AIRFLOW-7033] Change dag and task state meanwhile URL: https://github.com/apache/airflow/pull/7683#issuecomment-613503822 No, I mean on the tree view page. So you can click on one dag run and can mark this dagrun and maybe future or past ones (as

[GitHub] [airflow] wittfabian commented on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3

2020-04-14 Thread GitBox
wittfabian commented on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3 URL: https://github.com/apache/airflow/pull/5659#issuecomment-613502788 Any updates here? This is an automated message from the Apache Git Service.

[GitHub] [airflow] mik-laj commented on issue #8300: No way to create a Dataflow job with Private IP configuration

2020-04-14 Thread GitBox
mik-laj commented on issue #8300: No way to create a Dataflow job with Private IP configuration URL: https://github.com/apache/airflow/issues/8300#issuecomment-613499271 Hi. It looks like a real bug. In the near future, I will try to address this problem. Thanks for the report.

[GitHub] [airflow] mik-laj commented on issue #8213: Fix issue #8163 where gcp auth fails

2020-04-14 Thread GitBox
mik-laj commented on issue #8213: Fix issue #8163 where gcp auth fails URL: https://github.com/apache/airflow/pull/8213#issuecomment-613496409 Thanks. Would you not like another GCP ticket yet? I have created several and are available on the list. ;-)

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8300: No way to create a Dataflow job with Private IP configuration

2020-04-14 Thread GitBox
boring-cyborg[bot] commented on issue #8300: No way to create a Dataflow job with Private IP configuration URL: https://github.com/apache/airflow/issues/8300#issuecomment-613496367 Thanks for opening your first issue here! Be sure to follow the issue template!

[GitHub] [airflow] sgringwe opened a new issue #8300: No way to create a Dataflow job with Private IP configuration

2020-04-14 Thread GitBox
sgringwe opened a new issue #8300: No way to create a Dataflow job with Private IP configuration URL: https://github.com/apache/airflow/issues/8300 **Description** It does not appear that Airflow supports

[GitHub] [airflow] mik-laj closed issue #8163: Google `Credentials` object has not attribute `with_subject`

2020-04-14 Thread GitBox
mik-laj closed issue #8163: Google `Credentials` object has not attribute `with_subject` URL: https://github.com/apache/airflow/issues/8163 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] mik-laj merged pull request #8213: Fix issue #8163 where gcp auth fails

2020-04-14 Thread GitBox
mik-laj merged pull request #8213: Fix issue #8163 where gcp auth fails URL: https://github.com/apache/airflow/pull/8213 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8213: Fix issue #8163 where gcp auth fails

2020-04-14 Thread GitBox
boring-cyborg[bot] commented on issue #8213: Fix issue #8163 where gcp auth fails URL: https://github.com/apache/airflow/pull/8213#issuecomment-613495346 Awesome work, congrats on your first merged pull request! This is

[GitHub] [airflow] mik-laj commented on issue #8296: Make execute and on_kill as abstractmethod in baseoperator

2020-04-14 Thread GitBox
mik-laj commented on issue #8296: Make execute and on_kill as abstractmethod in baseoperator URL: https://github.com/apache/airflow/pull/8296#issuecomment-613492486 All child processes for tasks should be killed by a task runner

[GitHub] [airflow] mik-laj commented on issue #8296: Make execute and on_kill as abstractmethod in baseoperator

2020-04-14 Thread GitBox
mik-laj commented on issue #8296: Make execute and on_kill as abstractmethod in baseoperator URL: https://github.com/apache/airflow/pull/8296#issuecomment-613491585 In the case of Google, only operators for Dataflow and BigQuery have the on_kill method. I think this is an important

[GitHub] [airflow] dimberman opened a new pull request #8299: Clarify docs for on delete_worker_pods_on_success

2020-04-14 Thread GitBox
dimberman opened a new pull request #8299: Clarify docs for on delete_worker_pods_on_success URL: https://github.com/apache/airflow/pull/8299 This PR adds a description of how `delete_worker_pods_on_success` interacts with `delete_worker_pods` --- Make sure to mark the boxes

[GitHub] [airflow] MShekow commented on issue #8297: Customizable configurable footer in admin web interface

2020-04-14 Thread GitBox
MShekow commented on issue #8297: Customizable configurable footer in admin web interface URL: https://github.com/apache/airflow/issues/8297#issuecomment-613485641 I don't have a link at hand, but you're right in your assumption that the regulations only apply to public websites. However,

[airflow-site] branch master updated: Redirect Airflow 1.10.10 API/Macros/CLI refs to new URLs (#264)

2020-04-14 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/master by this push: new 0ed5de9 Redirect Airflow 1.10.10

[GitHub] [airflow-site] dimberman merged pull request #264: Redirect Airflow 1.10.10 API/Macros/CLI refs to new URLs

2020-04-14 Thread GitBox
dimberman merged pull request #264: Redirect Airflow 1.10.10 API/Macros/CLI refs to new URLs URL: https://github.com/apache/airflow-site/pull/264 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] mik-laj edited a comment on issue #8290: Add airflow info command

2020-04-14 Thread GitBox
mik-laj edited a comment on issue #8290: Add airflow info command URL: https://github.com/apache/airflow/pull/8290#issuecomment-613481597 Hello, I do the following changes: * add tests * add `--file-io` flags * add SQL Alchemy conn with anonymization

[GitHub] [airflow] mik-laj commented on issue #8290: Add airflow info command

2020-04-14 Thread GitBox
mik-laj commented on issue #8290: Add airflow info command URL: https://github.com/apache/airflow/pull/8290#issuecomment-613481597 Hello, I do the following changes: * add tests * add `file-io` flags * add SQL Alchemy conn with anonymization

[GitHub] [airflow] feluelle commented on issue #8228: Expose Airflow Webserver Port in Production Docker Image

2020-04-14 Thread GitBox
feluelle commented on issue #8228: Expose Airflow Webserver Port in Production Docker Image URL: https://github.com/apache/airflow/pull/8228#issuecomment-613478395 @potiuk can you check again, please? This is an automated

[jira] [Assigned] (AIRFLOW-7111) Expose generate_presigned_url of boto3 to S3Hook

2020-04-14 Thread Jerome Carless (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerome Carless reassigned AIRFLOW-7111: --- Assignee: Jerome Carless > Expose generate_presigned_url of boto3 to S3Hook >

[jira] [Assigned] (AIRFLOW-5565) Add boto extraArgs to S3Hook load_bytes and load_file_obj

2020-04-14 Thread Jerome Carless (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerome Carless reassigned AIRFLOW-5565: --- Assignee: Jerome Carless > Add boto extraArgs to S3Hook load_bytes and

[GitHub] [airflow] preston-m-price commented on issue #7843: Colorblind friendly UI

2020-04-14 Thread GitBox
preston-m-price commented on issue #7843: Colorblind friendly UI URL: https://github.com/apache/airflow/issues/7843#issuecomment-613476621 I also have a difficult time with the reds/greens when looking at past DAG runs. Another approach I've seen used successfully is to use different

[GitHub] [airflow] jaketf commented on issue #7197: [AIRFLOW-6586][WIP] Improvements to gcs sensor

2020-04-14 Thread GitBox
jaketf commented on issue #7197: [AIRFLOW-6586][WIP] Improvements to gcs sensor URL: https://github.com/apache/airflow/pull/7197#issuecomment-613476722 Apologies for letting this go stale I will revive this later this week.

[GitHub] [airflow] ashb opened a new pull request #8298: Fix confusing "heartbeat" name on DagFileProcessor class

2020-04-14 Thread GitBox
ashb opened a new pull request #8298: Fix confusing "heartbeat" name on DagFileProcessor class URL: https://github.com/apache/airflow/pull/8298 This method was called "heartbeat" and was called from within SchedulerJob, but it does something very different to a job heartbeat -- and

<    1   2   3   4   >