[GitHub] [airflow] svivier-orange commented on a change in pull request #6501: [AIRFLOW-5831] Prod image support. Depends on [AIRFLOW-5704] [AIRFLOW-5842] [AIRFLOW-5828]

2019-11-18 Thread GitBox
svivier-orange commented on a change in pull request #6501: [AIRFLOW-5831] Prod image support. Depends on [AIRFLOW-5704] [AIRFLOW-5842] [AIRFLOW-5828] URL: https://github.com/apache/airflow/pull/6501#discussion_r345599242 ## File path: Dockerfile ## @@ -355,21 +348,135 @@

[GitHub] [airflow] RosterIn commented on a change in pull request #6578: [DEPENDS ON #6575][DEPENDS ON #6577][AIRFLOW-5907] Add S3 to MySql Operator

2019-11-18 Thread GitBox
RosterIn commented on a change in pull request #6578: [DEPENDS ON #6575][DEPENDS ON #6577][AIRFLOW-5907] Add S3 to MySql Operator URL: https://github.com/apache/airflow/pull/6578#discussion_r347757745 ## File path: airflow/operators/s3_to_mysql.py ## @@ -0,0 +1,65 @@ +from

[GitHub] [airflow] yuqian90 commented on issue #6392: [AIRFLOW-5648] Add ClearTaskOperator for clearing tasks in a DAG

2019-11-18 Thread GitBox
yuqian90 commented on issue #6392: [AIRFLOW-5648] Add ClearTaskOperator for clearing tasks in a DAG URL: https://github.com/apache/airflow/pull/6392#issuecomment-555353514 > @yuqian90 Yes if you use pool, SubDagOperator can become problematic. The changes to SubDagOperator may be released

[GitHub] [airflow] feng-tao commented on a change in pull request #6564: [AIRFLOW-5911] Simplify lineage API and improve robustness

2019-11-18 Thread GitBox
feng-tao commented on a change in pull request #6564: [AIRFLOW-5911] Simplify lineage API and improve robustness URL: https://github.com/apache/airflow/pull/6564#discussion_r347732639 ## File path: airflow/lineage/__init__.py ## @@ -92,51 +116,46 @@ def prepare_lineage(fun

[GitHub] [airflow] feng-tao commented on a change in pull request #6564: [AIRFLOW-5911] Simplify lineage API and improve robustness

2019-11-18 Thread GitBox
feng-tao commented on a change in pull request #6564: [AIRFLOW-5911] Simplify lineage API and improve robustness URL: https://github.com/apache/airflow/pull/6564#discussion_r346094426 ## File path: airflow/lineage/__init__.py ## @@ -18,18 +18,25 @@ # under the License.

[GitHub] [airflow] feng-tao commented on a change in pull request #6564: [AIRFLOW-5911] Simplify lineage API and improve robustness

2019-11-18 Thread GitBox
feng-tao commented on a change in pull request #6564: [AIRFLOW-5911] Simplify lineage API and improve robustness URL: https://github.com/apache/airflow/pull/6564#discussion_r347732863 ## File path: airflow/lineage/entities.py ## @@ -0,0 +1,97 @@ +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] feng-tao commented on a change in pull request #6564: [AIRFLOW-5911] Simplify lineage API and improve robustness

2019-11-18 Thread GitBox
feng-tao commented on a change in pull request #6564: [AIRFLOW-5911] Simplify lineage API and improve robustness URL: https://github.com/apache/airflow/pull/6564#discussion_r347732639 ## File path: airflow/lineage/__init__.py ## @@ -92,51 +116,46 @@ def prepare_lineage(fun

[GitHub] [airflow] mingrammer edited a comment on issue #6595: [AIRFLOW-6002] Drop support for python 3.5

2019-11-18 Thread GitBox
mingrammer edited a comment on issue #6595: [AIRFLOW-6002] Drop support for python 3.5 URL: https://github.com/apache/airflow/pull/6595#issuecomment-555320011 The badge for python versions should be updated as well. (remove `3.5` part) https://img.shields.io/pypi/pyversions/apache-ai

[GitHub] [airflow] mingrammer edited a comment on issue #6595: [AIRFLOW-6002] Drop support for python 3.5

2019-11-18 Thread GitBox
mingrammer edited a comment on issue #6595: [AIRFLOW-6002] Drop support for python 3.5 URL: https://github.com/apache/airflow/pull/6595#issuecomment-555320011 The badge for python versions should be updated as well. (remove `3.5`) https://img.shields.io/pypi/pyversions/apache-airflow

[GitHub] [airflow] mingrammer commented on issue #6595: [AIRFLOW-6002] Drop support for python 3.5

2019-11-18 Thread GitBox
mingrammer commented on issue #6595: [AIRFLOW-6002] Drop support for python 3.5 URL: https://github.com/apache/airflow/pull/6595#issuecomment-555320011 The badge for python versions should be updated as well. https://img.shields.io/pypi/pyversions/apache-airflow.svg -

[jira] [Resolved] (AIRFLOW-3209) return job id on BigQuery operators

2019-11-18 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-3209. Fix Version/s: 2.0.0 Resolution: Cannot Reproduce Currently these IDs are availabl

[GitHub] [airflow] mik-laj commented on issue #6599: [AIRFLOW-6007] Check providers instead of provider package. Depends on [AIRFLOW-6010][AIRFLOW-6004]

2019-11-18 Thread GitBox
mik-laj commented on issue #6599: [AIRFLOW-6007] Check providers instead of provider package. Depends on [AIRFLOW-6010][AIRFLOW-6004] URL: https://github.com/apache/airflow/pull/6599#issuecomment-555298795 Are these dependencies needed? It seems to me that this change can be merged to the

[GitHub] [airflow] mik-laj commented on issue #6594: [AIRFLOW-6001] Lazy load CLI commands

2019-11-18 Thread GitBox
mik-laj commented on issue #6594: [AIRFLOW-6001] Lazy load CLI commands URL: https://github.com/apache/airflow/pull/6594#issuecomment-555297472 I rebased the rebased, took into account the comments. Can I do something else? T

[GitHub] [airflow] codecov-io edited a comment on issue #6594: [AIRFLOW-6001] Lazy load CLI commands

2019-11-18 Thread GitBox
codecov-io edited a comment on issue #6594: [AIRFLOW-6001] Lazy load CLI commands URL: https://github.com/apache/airflow/pull/6594#issuecomment-554772240 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6594?src=pr&el=h1) Report > Merging [#6594](https://codecov.io/gh/apache/airfl

[GitHub] [airflow] codecov-io edited a comment on issue #6594: [AIRFLOW-6001] Lazy load CLI commands

2019-11-18 Thread GitBox
codecov-io edited a comment on issue #6594: [AIRFLOW-6001] Lazy load CLI commands URL: https://github.com/apache/airflow/pull/6594#issuecomment-554772240 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6594?src=pr&el=h1) Report > Merging [#6594](https://codecov.io/gh/apache/airfl

[GitHub] [airflow] potiuk edited a comment on issue #6597: [AIRFLOW-6005] Remove airflow airflow exception imports. Depends on [AIRFLOW-6004]

2019-11-18 Thread GitBox
potiuk edited a comment on issue #6597: [AIRFLOW-6005] Remove airflow airflow exception imports. Depends on [AIRFLOW-6004] URL: https://github.com/apache/airflow/pull/6597#issuecomment-555279205 @ashb - I looked at the options and now I implemented quickly version that does not do deprecat

[GitHub] [airflow] potiuk edited a comment on issue #6597: [AIRFLOW-6005] Remove airflow airflow exception imports. Depends on [AIRFLOW-6004]

2019-11-18 Thread GitBox
potiuk edited a comment on issue #6597: [AIRFLOW-6005] Remove airflow airflow exception imports. Depends on [AIRFLOW-6004] URL: https://github.com/apache/airflow/pull/6597#issuecomment-555279205 @ashb - I looked at the options and now I implemented quickly version that does not do deprecat

[GitHub] [airflow] potiuk commented on issue #6597: [AIRFLOW-6005] Remove airflow airflow exception imports. Depends on [AIRFLOW-6004]

2019-11-18 Thread GitBox
potiuk commented on issue #6597: [AIRFLOW-6005] Remove airflow airflow exception imports. Depends on [AIRFLOW-6004] URL: https://github.com/apache/airflow/pull/6597#issuecomment-555279205 @ashb - I looked at the options and now I implemented quickly version that does not do deprecation, bu

[GitHub] [airflow] mik-laj commented on a change in pull request #6590: [AIRFLOW-5520] Add options to run Dataflow in a virtual environment

2019-11-18 Thread GitBox
mik-laj commented on a change in pull request #6590: [AIRFLOW-5520] Add options to run Dataflow in a virtual environment URL: https://github.com/apache/airflow/pull/6590#discussion_r347680244 ## File path: airflow/gcp/hooks/dataflow.py ## @@ -481,30 +483,43 @@ def start_py

[GitHub] [airflow] potiuk commented on a change in pull request #6597: [AIRFLOW-6005] Remove airflow airflow exception imports. Depends on [AIRFLOW-6004]

2019-11-18 Thread GitBox
potiuk commented on a change in pull request #6597: [AIRFLOW-6005] Remove airflow airflow exception imports. Depends on [AIRFLOW-6004] URL: https://github.com/apache/airflow/pull/6597#discussion_r347675389 ## File path: airflow/__init__.py ## @@ -29,15 +29,20 @@ # flake

[GitHub] [airflow] potiuk commented on a change in pull request #6597: [AIRFLOW-6005] Remove airflow airflow exception imports. Depends on [AIRFLOW-6004]

2019-11-18 Thread GitBox
potiuk commented on a change in pull request #6597: [AIRFLOW-6005] Remove airflow airflow exception imports. Depends on [AIRFLOW-6004] URL: https://github.com/apache/airflow/pull/6597#discussion_r347675389 ## File path: airflow/__init__.py ## @@ -29,15 +29,20 @@ # flake

[GitHub] [airflow] potiuk commented on a change in pull request #6601: [AIRFLOW-6010] Do not import airflow settings directly.

2019-11-18 Thread GitBox
potiuk commented on a change in pull request #6601: [AIRFLOW-6010] Do not import airflow settings directly. URL: https://github.com/apache/airflow/pull/6601#discussion_r347670717 ## File path: airflow/bin/cli.py ## @@ -70,10 +70,18 @@ LOG = LoggingMixin().log -DAGS_FO

[jira] [Commented] (AIRFLOW-5781) Migrate AWS Kinesis to /providers/aws [AIP-21]

2019-11-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976982#comment-16976982 ] ASF subversion and git services commented on AIRFLOW-5781: -- Co

[jira] [Commented] (AIRFLOW-5781) Migrate AWS Kinesis to /providers/aws [AIP-21]

2019-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976981#comment-16976981 ] ASF GitHub Bot commented on AIRFLOW-5781: - potiuk commented on pull request #65

[jira] [Resolved] (AIRFLOW-5781) Migrate AWS Kinesis to /providers/aws [AIP-21]

2019-11-18 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5781. --- Fix Version/s: 2.0.0 Resolution: Fixed > Migrate AWS Kinesis to /providers/aws [AIP-

[GitHub] [airflow] potiuk merged pull request #6588: [AIRFLOW-5781] AIP-21 Migrate AWS Kinesis to /providers/amazon/aws

2019-11-18 Thread GitBox
potiuk merged pull request #6588: [AIRFLOW-5781] AIP-21 Migrate AWS Kinesis to /providers/amazon/aws URL: https://github.com/apache/airflow/pull/6588 This is an automated message from the Apache Git Service. To respond to th

[GitHub] [airflow] potiuk merged pull request #6603: [AIRFLOW-XXX] Update list of pre-commits

2019-11-18 Thread GitBox
potiuk merged pull request #6603: [AIRFLOW-XXX] Update list of pre-commits URL: https://github.com/apache/airflow/pull/6603 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow-site] mik-laj merged pull request #177: Make scrollbar in docs sidenav always visible

2019-11-18 Thread GitBox
mik-laj merged pull request #177: Make scrollbar in docs sidenav always visible URL: https://github.com/apache/airflow-site/pull/177 This is an automated message from the Apache Git Service. To respond to the message, please

[airflow-site] branch aip-11 updated (67abe0d -> f4fca20)

2019-11-18 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch aip-11 in repository https://gitbox.apache.org/repos/asf/airflow-site.git. from 67abe0d Fix form input minimal width (#176) add f4fca20 Make scrollbar in docs sidenav always visi

[airflow-site] branch aip-11 updated (3fe24f6 -> 67abe0d)

2019-11-18 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch aip-11 in repository https://gitbox.apache.org/repos/asf/airflow-site.git. from 3fe24f6 Correct meta titles and twitter image (#180) add 67abe0d Fix form input minimal width (#17

[GitHub] [airflow-site] mik-laj merged pull request #176: Fix form input minimal width

2019-11-18 Thread GitBox
mik-laj merged pull request #176: Fix form input minimal width URL: https://github.com/apache/airflow-site/pull/176 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Updated] (AIRFLOW-6013) Last heartbeat check does not account for execution time of session.commit()

2019-11-18 Thread Alex (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex updated AIRFLOW-6013: -- Summary: Last heartbeat check does not account for execution time of session.commit() (was: Last heartbeat c

[jira] [Created] (AIRFLOW-6013) Last heartbeat check is too precise

2019-11-18 Thread Alex (Jira)
Alex created AIRFLOW-6013: - Summary: Last heartbeat check is too precise Key: AIRFLOW-6013 URL: https://issues.apache.org/jira/browse/AIRFLOW-6013 Project: Apache Airflow Issue Type: Bug Co

[GitHub] [airflow-site] mik-laj merged pull request #180: Correct meta titles and twitter image

2019-11-18 Thread GitBox
mik-laj merged pull request #180: Correct meta titles and twitter image URL: https://github.com/apache/airflow-site/pull/180 This is an automated message from the Apache Git Service. To respond to the message, please log on t

[airflow-site] branch aip-11 updated (5692b61 -> 3fe24f6)

2019-11-18 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch aip-11 in repository https://gitbox.apache.org/repos/asf/airflow-site.git. from 5692b61 Update navbar on docs (#181) add 3fe24f6 Correct meta titles and twitter image (#180) No

[GitHub] [airflow-site] mik-laj merged pull request #181: change Case studies to Use cases in navbar

2019-11-18 Thread GitBox
mik-laj merged pull request #181: change Case studies to Use cases in navbar URL: https://github.com/apache/airflow-site/pull/181 This is an automated message from the Apache Git Service. To respond to the message, please log

[airflow-site] branch aip-11 updated (2bf1ca7 -> 5692b61)

2019-11-18 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch aip-11 in repository https://gitbox.apache.org/repos/asf/airflow-site.git. from 2bf1ca7 Add Apache Airflow videos (#182) add 5692b61 Update navbar on docs (#181) No new revision

[GitHub] [airflow-site] mik-laj merged pull request #182: Add Apache Airflow videos

2019-11-18 Thread GitBox
mik-laj merged pull request #182: Add Apache Airflow videos URL: https://github.com/apache/airflow-site/pull/182 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[airflow-site] branch aip-11 updated (3855f98 -> 2bf1ca7)

2019-11-18 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch aip-11 in repository https://gitbox.apache.org/repos/asf/airflow-site.git. from 3855f98 Replace favicons with transparent versions (#179) add 2bf1ca7 Add Apache Airflow videos (#

[GitHub] [airflow-site] mik-laj commented on a change in pull request #183: Content/commiters fix

2019-11-18 Thread GitBox
mik-laj commented on a change in pull request #183: Content/commiters fix URL: https://github.com/apache/airflow-site/pull/183#discussion_r347646506 ## File path: landing-pages/site/assets/scss/_list-boxes.scss ## @@ -63,9 +63,11 @@ $card-margin: 20px; border-radius: 5px

[GitHub] [airflow-site] mik-laj merged pull request #179: Replace favicons with transparent versions

2019-11-18 Thread GitBox
mik-laj merged pull request #179: Replace favicons with transparent versions URL: https://github.com/apache/airflow-site/pull/179 This is an automated message from the Apache Git Service. To respond to the message, please log

[airflow-site] branch aip-11 updated (d99bd89 -> 3855f98)

2019-11-18 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch aip-11 in repository https://gitbox.apache.org/repos/asf/airflow-site.git. from d99bd89 Enable CSS autoprefixer on development build (#178) add 3855f98 Replace favicons with tran

[GitHub] [airflow] codecov-io edited a comment on issue #6588: [AIRFLOW-5781] AIP-21 Migrate AWS Kinesis to /providers/amazon/aws

2019-11-18 Thread GitBox
codecov-io edited a comment on issue #6588: [AIRFLOW-5781] AIP-21 Migrate AWS Kinesis to /providers/amazon/aws URL: https://github.com/apache/airflow/pull/6588#issuecomment-555240845 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6588?src=pr&el=h1) Report > Merging [#6588](https

[GitHub] [airflow] codecov-io commented on issue #6588: [AIRFLOW-5781] AIP-21 Migrate AWS Kinesis to /providers/amazon/aws

2019-11-18 Thread GitBox
codecov-io commented on issue #6588: [AIRFLOW-5781] AIP-21 Migrate AWS Kinesis to /providers/amazon/aws URL: https://github.com/apache/airflow/pull/6588#issuecomment-555240845 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6588?src=pr&el=h1) Report > Merging [#6588](https://code

[airflow-site] branch aip-11 updated (5248201 -> d99bd89)

2019-11-18 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch aip-11 in repository https://gitbox.apache.org/repos/asf/airflow-site.git. from 5248201 Update persons list (#175) add d99bd89 Enable CSS autoprefixer on development build (#178)

[GitHub] [airflow-site] mik-laj merged pull request #178: Enable css autoprefixer on development build

2019-11-18 Thread GitBox
mik-laj merged pull request #178: Enable css autoprefixer on development build URL: https://github.com/apache/airflow-site/pull/178 This is an automated message from the Apache Git Service. To respond to the message, please l

[jira] [Commented] (AIRFLOW-6000) Fix the test randomly fail - TestCliConnections.test_cli_connections_add_delete

2019-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976934#comment-16976934 ] ASF GitHub Bot commented on AIRFLOW-6000: - mik-laj commented on pull request #6

[jira] [Commented] (AIRFLOW-6000) Fix the test randomly fail - TestCliConnections.test_cli_connections_add_delete

2019-11-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976935#comment-16976935 ] ASF subversion and git services commented on AIRFLOW-6000: -- Co

[jira] [Resolved] (AIRFLOW-6000) Fix the test randomly fail - TestCliConnections.test_cli_connections_add_delete

2019-11-18 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-6000. Fix Version/s: 1.10.7 Resolution: Fixed > Fix the test randomly fail - > TestCli

[GitHub] [airflow] mik-laj merged pull request #6593: [AIRFLOW-6000] Fix the test randomly fail - TestCliConnections.test_cli_connections_add_delete

2019-11-18 Thread GitBox
mik-laj merged pull request #6593: [AIRFLOW-6000] Fix the test randomly fail - TestCliConnections.test_cli_connections_add_delete URL: https://github.com/apache/airflow/pull/6593 This is an automated message from the Apache

[jira] [Commented] (AIRFLOW-5920) Add support to execute OpenCypher query against Neo4j

2019-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976927#comment-16976927 ] ASF GitHub Bot commented on AIRFLOW-5920: - tfindlay-au commented on pull reques

[GitHub] [airflow] tfindlay-au opened a new pull request #6604: [AIRFLOW-5920] *DRAFT* Neo4j operator and hook

2019-11-18 Thread GitBox
tfindlay-au opened a new pull request #6604: [AIRFLOW-5920] *DRAFT* Neo4j operator and hook URL: https://github.com/apache/airflow/pull/6604 Make sure you have checked _all_ steps below. ### Jira [AIRFLOW-5920] ### Description These changes add the ability for a pipeline

[GitHub] [airflow] potiuk commented on a change in pull request #6596: [AIRFLOW-6004] Untangle Executors class to avoid cyclic imports. Depends on [AIRFLOW-6010]

2019-11-18 Thread GitBox
potiuk commented on a change in pull request #6596: [AIRFLOW-6004] Untangle Executors class to avoid cyclic imports. Depends on [AIRFLOW-6010] URL: https://github.com/apache/airflow/pull/6596#discussion_r347606197 ## File path: tests/dags/test_subdag.py ## @@ -24,7 +24,7 @

[jira] [Comment Edited] (AIRFLOW-6011) Airflow treats local dependencies as DAG files if they contain the string "DAG"

2019-11-18 Thread Aaron Liblong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976872#comment-16976872 ] Aaron Liblong edited comment on AIRFLOW-6011 at 11/18/19 8:55 PM: ---

[jira] [Comment Edited] (AIRFLOW-6011) Airflow treats local dependencies as DAG files if they contain the string "DAG"

2019-11-18 Thread Aaron Liblong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976872#comment-16976872 ] Aaron Liblong edited comment on AIRFLOW-6011 at 11/18/19 8:53 PM: ---

[GitHub] [airflow] codecov-io commented on issue #6602: [AIRFLOW-6012] - performance improvement to cleanup

2019-11-18 Thread GitBox
codecov-io commented on issue #6602: [AIRFLOW-6012] - performance improvement to cleanup URL: https://github.com/apache/airflow/pull/6602#issuecomment-555203828 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6602?src=pr&el=h1) Report > Merging [#6602](https://codecov.io/gh/apach

[jira] [Comment Edited] (AIRFLOW-6011) Airflow treats local dependencies as DAG files if they contain the string "DAG"

2019-11-18 Thread Aaron Liblong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976872#comment-16976872 ] Aaron Liblong edited comment on AIRFLOW-6011 at 11/18/19 8:49 PM: ---

[jira] [Commented] (AIRFLOW-6011) Airflow treats local dependencies as DAG files if they contain the string "DAG"

2019-11-18 Thread Aaron Liblong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976872#comment-16976872 ] Aaron Liblong commented on AIRFLOW-6011: That documentation on packaged DAGs sa

[GitHub] [airflow] jaketf commented on a change in pull request #6590: [AIRFLOW-5520] Add options to run Dataflow in a virtual environment

2019-11-18 Thread GitBox
jaketf commented on a change in pull request #6590: [AIRFLOW-5520] Add options to run Dataflow in a virtual environment URL: https://github.com/apache/airflow/pull/6590#discussion_r347600964 ## File path: airflow/gcp/hooks/dataflow.py ## @@ -515,8 +530,20 @@ def label_form

[GitHub] [airflow] ashb commented on a change in pull request #6601: [AIRFLOW-6010] Do not import airflow settings directly.

2019-11-18 Thread GitBox
ashb commented on a change in pull request #6601: [AIRFLOW-6010] Do not import airflow settings directly. URL: https://github.com/apache/airflow/pull/6601#discussion_r347592059 ## File path: airflow/bin/cli.py ## @@ -70,10 +70,18 @@ LOG = LoggingMixin().log -DAGS_FOLD

[GitHub] [airflow] bolkedebruin commented on a change in pull request #6564: [AIRFLOW-5911] Simplify lineage API and improve robustness

2019-11-18 Thread GitBox
bolkedebruin commented on a change in pull request #6564: [AIRFLOW-5911] Simplify lineage API and improve robustness URL: https://github.com/apache/airflow/pull/6564#discussion_r347589035 ## File path: airflow/models/baseoperator.py ## @@ -316,8 +316,8 @@ def __init__(

[GitHub] [airflow] potiuk opened a new pull request #6603: [AIRFLOW-XXX] Update list of pre-commits

2019-11-18 Thread GitBox
potiuk opened a new pull request #6603: [AIRFLOW-XXX] Update list of pre-commits URL: https://github.com/apache/airflow/pull/6603 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIR

[GitHub] [airflow] potiuk commented on a change in pull request #6601: [AIRFLOW-6010] Do not import airflow settings directly.

2019-11-18 Thread GitBox
potiuk commented on a change in pull request #6601: [AIRFLOW-6010] Do not import airflow settings directly. URL: https://github.com/apache/airflow/pull/6601#discussion_r347572687 ## File path: airflow/bin/cli.py ## @@ -70,10 +70,18 @@ LOG = LoggingMixin().log -DAGS_FO

[GitHub] [airflow] potiuk commented on a change in pull request #6601: [AIRFLOW-6010] Do not import airflow settings directly.

2019-11-18 Thread GitBox
potiuk commented on a change in pull request #6601: [AIRFLOW-6010] Do not import airflow settings directly. URL: https://github.com/apache/airflow/pull/6601#discussion_r347572687 ## File path: airflow/bin/cli.py ## @@ -70,10 +70,18 @@ LOG = LoggingMixin().log -DAGS_FO

[GitHub] [airflow] wyndhblb opened a new pull request #6602: [AIRFLOW-6012] - performance improvement to cleanup

2019-11-18 Thread GitBox
wyndhblb opened a new pull request #6602: [AIRFLOW-6012] - performance improvement to cleanup URL: https://github.com/apache/airflow/pull/6602 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/j

[jira] [Commented] (AIRFLOW-6012) Kubernetes Executer very slow to Clean finished tasks

2019-11-18 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976792#comment-16976792 ] Ash Berlin-Taylor commented on AIRFLOW-6012: Related to AIRFLOW-5660 > Kub

[jira] [Commented] (AIRFLOW-6012) Kubernetes Executer very slow to Clean finished tasks

2019-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976793#comment-16976793 ] ASF GitHub Bot commented on AIRFLOW-6012: - wyndhblb commented on pull request #

[jira] [Created] (AIRFLOW-6012) Kubernetes Executer very slow to Clean finished tasks

2019-11-18 Thread Bo Blanton (Jira)
Bo Blanton created AIRFLOW-6012: --- Summary: Kubernetes Executer very slow to Clean finished tasks Key: AIRFLOW-6012 URL: https://issues.apache.org/jira/browse/AIRFLOW-6012 Project: Apache Airflow

[jira] [Resolved] (AIRFLOW-6009) Only kubernetes tests need travis_wait

2019-11-18 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-6009. --- Fix Version/s: 2.0.0 Resolution: Fixed > Only kubernetes tests need travis_wait > --

[jira] [Commented] (AIRFLOW-6009) Only kubernetes tests need travis_wait

2019-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976784#comment-16976784 ] ASF GitHub Bot commented on AIRFLOW-6009: - potiuk commented on pull request #66

[jira] [Commented] (AIRFLOW-6009) Only kubernetes tests need travis_wait

2019-11-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976785#comment-16976785 ] ASF subversion and git services commented on AIRFLOW-6009: -- Co

[GitHub] [airflow] potiuk merged pull request #6600: [AIRFLOW-6009] Switch off travis_wait for regular tests

2019-11-18 Thread GitBox
potiuk merged pull request #6600: [AIRFLOW-6009] Switch off travis_wait for regular tests URL: https://github.com/apache/airflow/pull/6600 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] bolkedebruin commented on a change in pull request #6564: [AIRFLOW-5911] Simplify lineage API and improve robustness

2019-11-18 Thread GitBox
bolkedebruin commented on a change in pull request #6564: [AIRFLOW-5911] Simplify lineage API and improve robustness URL: https://github.com/apache/airflow/pull/6564#discussion_r347547302 ## File path: airflow/models/baseoperator.py ## @@ -316,8 +316,8 @@ def __init__(

[GitHub] [airflow] yhlee-tw commented on issue #6422: [AIRFLOW-5690] Change log level local_task_job.py

2019-11-18 Thread GitBox
yhlee-tw commented on issue #6422: [AIRFLOW-5690] Change log level local_task_job.py URL: https://github.com/apache/airflow/pull/6422#issuecomment-555152597 @Fokko I have a similar question - the logging seems excessively and not very helpful. Looking at https://github.com/apach

[GitHub] [airflow] codecov-io edited a comment on issue #6593: [AIRFLOW-6000] Fix the test randomly fail - TestCliConnections.test_cli_connections_add_delete

2019-11-18 Thread GitBox
codecov-io edited a comment on issue #6593: [AIRFLOW-6000] Fix the test randomly fail - TestCliConnections.test_cli_connections_add_delete URL: https://github.com/apache/airflow/pull/6593#issuecomment-554706612 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6593?src=pr&el=h1) Report

[GitHub] [airflow] codecov-io edited a comment on issue #6593: [AIRFLOW-6000] Fix the test randomly fail - TestCliConnections.test_cli_connections_add_delete

2019-11-18 Thread GitBox
codecov-io edited a comment on issue #6593: [AIRFLOW-6000] Fix the test randomly fail - TestCliConnections.test_cli_connections_add_delete URL: https://github.com/apache/airflow/pull/6593#issuecomment-554706612 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6593?src=pr&el=h1) Report

[GitHub] [airflow] potiuk commented on a change in pull request #6596: [AIRFLOW-6004] Untangle Executors class to avoid cyclic imports. Depends on [AIRFLOW-6010][AIRFLOW-6009][AIRFLOW-6010]

2019-11-18 Thread GitBox
potiuk commented on a change in pull request #6596: [AIRFLOW-6004] Untangle Executors class to avoid cyclic imports. Depends on [AIRFLOW-6010][AIRFLOW-6009][AIRFLOW-6010] URL: https://github.com/apache/airflow/pull/6596#discussion_r347507868 ## File path: airflow/dag_context_manage

[GitHub] [airflow] ashb commented on a change in pull request #6601: [AIRFLOW-6010] Do not import airflow settings directly. Depends on [AIRFLOW-6009]

2019-11-18 Thread GitBox
ashb commented on a change in pull request #6601: [AIRFLOW-6010] Do not import airflow settings directly. Depends on [AIRFLOW-6009] URL: https://github.com/apache/airflow/pull/6601#discussion_r347507567 ## File path: airflow/bin/cli.py ## @@ -70,10 +70,18 @@ LOG = Loggi

[GitHub] [airflow] potiuk commented on a change in pull request #6596: [AIRFLOW-6004] Untangle Executors class to avoid cyclic imports. Depends on [AIRFLOW-6010][AIRFLOW-6009][AIRFLOW-6010]

2019-11-18 Thread GitBox
potiuk commented on a change in pull request #6596: [AIRFLOW-6004] Untangle Executors class to avoid cyclic imports. Depends on [AIRFLOW-6010][AIRFLOW-6009][AIRFLOW-6010] URL: https://github.com/apache/airflow/pull/6596#discussion_r347506905 ## File path: airflow/executors/__init__

[jira] [Commented] (AIRFLOW-6011) Airflow treats local dependencies as DAG files if they contain the string "DAG"

2019-11-18 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976713#comment-16976713 ] Ash Berlin-Taylor commented on AIRFLOW-6011: https://airflow.apache.org/con

[GitHub] [airflow] ashb commented on a change in pull request #6489: [AIRFLOW-3959] [AIRFLOW-4026] Add filter by DAG tags

2019-11-18 Thread GitBox
ashb commented on a change in pull request #6489: [AIRFLOW-3959] [AIRFLOW-4026] Add filter by DAG tags URL: https://github.com/apache/airflow/pull/6489#discussion_r347502474 ## File path: airflow/www/views.py ## @@ -213,6 +218,18 @@ def get_int_arg(value, default=0):

[jira] [Commented] (AIRFLOW-6010) The "from airflow import settings" is used far too often

2019-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976707#comment-16976707 ] ASF GitHub Bot commented on AIRFLOW-6010: - potiuk commented on pull request #66

[GitHub] [airflow] ashb commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run

2019-11-18 Thread GitBox
ashb commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run URL: https://github.com/apache/airflow/pull/4751#discussion_r347502238 ## File path: airflow/jobs/scheduler_job.py ## @@ -721,25 +721,14 @@ def _process_task_insta

[GitHub] [airflow] potiuk opened a new pull request #6601: [AIRFLOW-6010] Do not import airflow settings directly

2019-11-18 Thread GitBox
potiuk opened a new pull request #6601: [AIRFLOW-6010] Do not import airflow settings directly URL: https://github.com/apache/airflow/pull/6601 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.apache.org/

[jira] [Commented] (AIRFLOW-6009) Only kubernetes tests need travis_wait

2019-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976706#comment-16976706 ] ASF GitHub Bot commented on AIRFLOW-6009: - potiuk commented on pull request #66

[GitHub] [airflow] potiuk opened a new pull request #6600: [AIRFLOW-6009] Switch off travis_wait for regular tests

2019-11-18 Thread GitBox
potiuk opened a new pull request #6600: [AIRFLOW-6009] Switch off travis_wait for regular tests URL: https://github.com/apache/airflow/pull/6600 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.apache.org

[GitHub] [airflow] ashb commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run

2019-11-18 Thread GitBox
ashb commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run URL: https://github.com/apache/airflow/pull/4751#discussion_r347500085 ## File path: airflow/jobs/scheduler_job.py ## @@ -721,25 +721,14 @@ def _process_task_insta

[GitHub] [airflow] ashb commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run

2019-11-18 Thread GitBox
ashb commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run URL: https://github.com/apache/airflow/pull/4751#discussion_r347499072 ## File path: airflow/jobs/scheduler_job.py ## @@ -721,25 +721,14 @@ def _process_task_insta

[GitHub] [airflow] acroos commented on a change in pull request #6380: [AIRFLOW-3632] Allow replace_microseconds in trigger_dag REST request

2019-11-18 Thread GitBox
acroos commented on a change in pull request #6380: [AIRFLOW-3632] Allow replace_microseconds in trigger_dag REST request URL: https://github.com/apache/airflow/pull/6380#discussion_r347498374 ## File path: UPDATING.md ## @@ -93,6 +93,28 @@ delete this option. The Trigger

[GitHub] [airflow] acroos commented on a change in pull request #6380: [AIRFLOW-3632] Allow replace_microseconds in trigger_dag REST request

2019-11-18 Thread GitBox
acroos commented on a change in pull request #6380: [AIRFLOW-3632] Allow replace_microseconds in trigger_dag REST request URL: https://github.com/apache/airflow/pull/6380#discussion_r347497640 ## File path: UPDATING.md ## @@ -93,6 +93,28 @@ delete this option. The Trigger

[GitHub] [airflow] amichai07 commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run

2019-11-18 Thread GitBox
amichai07 commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run URL: https://github.com/apache/airflow/pull/4751#discussion_r347493137 ## File path: airflow/ti_deps/deps/trigger_rule_dep.py ## @@ -49,33 +75,33 @@ def _get_

[GitHub] [airflow] amichai07 commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run

2019-11-18 Thread GitBox
amichai07 commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run URL: https://github.com/apache/airflow/pull/4751#discussion_r347492605 ## File path: airflow/ti_deps/dep_context.py ## @@ -67,6 +67,8 @@ class DepContext:

[GitHub] [airflow] ashb commented on a change in pull request #6489: [AIRFLOW-3959] [AIRFLOW-4026] Add filter by DAG tags

2019-11-18 Thread GitBox
ashb commented on a change in pull request #6489: [AIRFLOW-3959] [AIRFLOW-4026] Add filter by DAG tags URL: https://github.com/apache/airflow/pull/6489#discussion_r347492662 ## File path: airflow/www/utils.py ## @@ -471,9 +471,12 @@ def clean_column_names(): def is_

[GitHub] [airflow] ashb commented on a change in pull request #6489: [AIRFLOW-3959] [AIRFLOW-4026] Add filter by DAG tags

2019-11-18 Thread GitBox
ashb commented on a change in pull request #6489: [AIRFLOW-3959] [AIRFLOW-4026] Add filter by DAG tags URL: https://github.com/apache/airflow/pull/6489#discussion_r347492287 ## File path: airflow/www/templates/airflow/dags.html ## @@ -81,9 +92,17 @@ DAGs

[GitHub] [airflow] amichai07 commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run

2019-11-18 Thread GitBox
amichai07 commented on a change in pull request #4751: [AIRFLOW-3607] collected trigger rule dep check per dag run URL: https://github.com/apache/airflow/pull/4751#discussion_r347492605 ## File path: airflow/ti_deps/dep_context.py ## @@ -67,6 +67,8 @@ class DepContext:

[GitHub] [airflow] ashb commented on a change in pull request #6489: [AIRFLOW-3959] [AIRFLOW-4026] Add filter by DAG tags

2019-11-18 Thread GitBox
ashb commented on a change in pull request #6489: [AIRFLOW-3959] [AIRFLOW-4026] Add filter by DAG tags URL: https://github.com/apache/airflow/pull/6489#discussion_r347491899 ## File path: airflow/www/app.py ## @@ -65,6 +66,7 @@ def create_app(config=None, session=None, tes

[GitHub] [airflow] ashb commented on a change in pull request #6596: [AIRFLOW-6004] Untangle Executors class to avoid cyclic imports

2019-11-18 Thread GitBox
ashb commented on a change in pull request #6596: [AIRFLOW-6004] Untangle Executors class to avoid cyclic imports URL: https://github.com/apache/airflow/pull/6596#discussion_r347486502 ## File path: tests/dags/test_subdag.py ## @@ -24,7 +24,7 @@ from datetime import dat

[GitHub] [airflow] potiuk commented on a change in pull request #6596: [AIRFLOW-6004] Untangle Executors class to avoid cyclic imports

2019-11-18 Thread GitBox
potiuk commented on a change in pull request #6596: [AIRFLOW-6004] Untangle Executors class to avoid cyclic imports URL: https://github.com/apache/airflow/pull/6596#discussion_r347483917 ## File path: airflow/executors/dask_executor.py ## @@ -44,6 +42,7 @@ def __init__(sel

[GitHub] [airflow] potiuk commented on a change in pull request #6596: [AIRFLOW-6004] Untangle Executors class to avoid cyclic imports

2019-11-18 Thread GitBox
potiuk commented on a change in pull request #6596: [AIRFLOW-6004] Untangle Executors class to avoid cyclic imports URL: https://github.com/apache/airflow/pull/6596#discussion_r347483571 ## File path: airflow/executors/dask_executor.py ## @@ -44,6 +42,7 @@ def __init__(sel

[GitHub] [airflow] ashb commented on a change in pull request #6380: [AIRFLOW-3632] Allow replace_microseconds in trigger_dag REST request

2019-11-18 Thread GitBox
ashb commented on a change in pull request #6380: [AIRFLOW-3632] Allow replace_microseconds in trigger_dag REST request URL: https://github.com/apache/airflow/pull/6380#discussion_r347482612 ## File path: UPDATING.md ## @@ -93,6 +93,28 @@ delete this option. The TriggerDa

  1   2   >