[GitHub] codecov-io edited a comment on issue #4550: [Airflow 3714] Correct DAG name in docs/start.rst

2019-01-18 Thread GitBox
codecov-io edited a comment on issue #4550: [Airflow 3714] Correct DAG name in docs/start.rst URL: https://github.com/apache/airflow/pull/4550#issuecomment-455434092 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4550?src=pr&el=h1) Report > Merging [#4550](https://codecov.io/gh/

[GitHub] zhongjiajie commented on issue #4552: [Airflow 3728] remove double comma in hive_hooks.py

2019-01-18 Thread GitBox
zhongjiajie commented on issue #4552: [Airflow 3728] remove double comma in hive_hooks.py URL: https://github.com/apache/airflow/pull/4552#issuecomment-455742265 > For minor changes, you can just use AIRFLOW-XXX as the jira - no need to create a JIRA. @r39132 Ok, next time I will do

[GitHub] Licht-T commented on issue #2906: [AIRFLOW-1956] Add parameter whether the navbar clock time is UTC

2019-01-18 Thread GitBox
Licht-T commented on issue #2906: [AIRFLOW-1956] Add parameter whether the navbar clock time is UTC URL: https://github.com/apache/airflow/pull/2906#issuecomment-455737905 @nmcalabroso @ron819 Now the navbar clock follows the Airflow internal timezone setting. Should I change the JIRA's

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249219842 ## File path: airflow/contrib/operators/azure_livysparksubmit_operator.py ###

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249218997 ## File path: airflow/contrib/hooks/azure_hdinsight_hook.py ## @@ -0

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249218997 ## File path: airflow/contrib/hooks/azure_hdinsight_hook.py ## @@ -0

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249218710 ## File path: airflow/contrib/operators/azure_livysparksubmit_operator.py ###

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249218208 ## File path: airflow/contrib/operators/azure_livysparksubmit_operator.py ###

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249217537 ## File path: airflow/contrib/operators/azure_livysparksubmit_operator.py ###

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249217451 ## File path: airflow/contrib/operators/azure_hdinsight_create_cluster_operato

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249217487 ## File path: airflow/contrib/operators/azure_hdinsight_delete_cluster_operato

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249217378 ## File path: airflow/contrib/hooks/azure_hdinsight_hook.py ## @@ -0

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249216549 ## File path: airflow/contrib/hooks/azure_hdinsight_hook.py ## @@ -0

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249216549 ## File path: airflow/contrib/hooks/azure_hdinsight_hook.py ## @@ -0

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249216301 ## File path: airflow/contrib/hooks/azure_hdinsight_hook.py ## @@ -0

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249216102 ## File path: airflow/contrib/hooks/azure_hdinsight_hook.py ## @@ -0

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249215973 ## File path: airflow/contrib/hooks/azure_hdinsight_hook.py ## @@ -0

[jira] [Created] (AIRFLOW-3730) Improper use of logs mechanisms.

2019-01-18 Thread Kamil Bregula (JIRA)
Kamil Bregula created AIRFLOW-3730: -- Summary: Improper use of logs mechanisms. Key: AIRFLOW-3730 URL: https://issues.apache.org/jira/browse/AIRFLOW-3730 Project: Apache Airflow Issue Type: I

[GitHub] feng-tao commented on issue #4396: [AIRFLOW-3585] - Add edges to database

2019-01-18 Thread GitBox
feng-tao commented on issue #4396: [AIRFLOW-3585] - Add edges to database URL: https://github.com/apache/airflow/pull/4396#issuecomment-455718628 Just catching up with this pr. This seems to a very big change. I might miss the email, but do you think that it may be a good idea to discuss th

[jira] [Commented] (AIRFLOW-3730) Improper use of logs mechanisms.

2019-01-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16746765#comment-16746765 ] ASF GitHub Bot commented on AIRFLOW-3730: - mik-laj commented on pull request #4

[GitHub] mik-laj opened a new pull request #4556: [AIRFLOW-3730] Standarization use of logs mechanisms

2019-01-18 Thread GitBox
mik-laj opened a new pull request #4556: [AIRFLOW-3730] Standarization use of logs mechanisms URL: https://github.com/apache/airflow/pull/4556 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/j

[GitHub] mik-laj commented on a change in pull request #4494: [AIRFLOW-3284] Azure Batch AI Operator

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4494: [AIRFLOW-3284] Azure Batch AI Operator URL: https://github.com/apache/airflow/pull/4494#discussion_r249207779 ## File path: airflow/contrib/operators/azure_batchai_operator.py ## @@ -0,0 +1,190 @@ +# -*- coding: utf-8 -*

[GitHub] mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator URL: https://github.com/apache/airflow/pull/4530#discussion_r249203936 ## File path: airflow/contrib/operators/aks_operator.py ## @@ -0,0 +1,200 @@ +# -*- coding

[GitHub] mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator URL: https://github.com/apache/airflow/pull/4530#discussion_r249206027 ## File path: airflow/utils/db.py ## @@ -284,6 +284,10 @@ def initdb(): Connectio

[GitHub] mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator URL: https://github.com/apache/airflow/pull/4530#discussion_r249205505 ## File path: setup.py ## @@ -337,6 +342,7 @@ def do_setup(): 'async': async_

[GitHub] mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator URL: https://github.com/apache/airflow/pull/4530#discussion_r249205052 ## File path: airflow/contrib/operators/aks_operator.py ## @@ -0,0 +1,200 @@ +# -*- coding

[GitHub] mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator URL: https://github.com/apache/airflow/pull/4530#discussion_r249204162 ## File path: airflow/contrib/operators/aks_operator.py ## @@ -0,0 +1,200 @@ +# -*- coding

[GitHub] mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator URL: https://github.com/apache/airflow/pull/4530#discussion_r249203936 ## File path: airflow/contrib/operators/aks_operator.py ## @@ -0,0 +1,200 @@ +# -*- coding

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249193359 ## File path: setup.py ## @@ -211,27 +217,44 @@ def write_version(filename=os.path.join(*['airflo

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249197669 ## File path: airflow/utils/log/s3_task_handler.py ## @@ -45,7 +45,7 @@ def _build_hook(self):

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249193359 ## File path: setup.py ## @@ -211,27 +217,44 @@ def write_version(filename=os.path.join(*['airflo

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249193359 ## File path: setup.py ## @@ -211,27 +217,44 @@ def write_version(filename=os.path.join(*['airflo

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249193359 ## File path: setup.py ## @@ -211,27 +217,44 @@ def write_version(filename=os.path.join(*['airflo

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249197669 ## File path: airflow/utils/log/s3_task_handler.py ## @@ -45,7 +45,7 @@ def _build_hook(self):

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249195694 ## File path: airflow/utils/log/s3_task_handler.py ## @@ -45,7 +45,7 @@ def _build_hook(self):

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249195694 ## File path: airflow/utils/log/s3_task_handler.py ## @@ -45,7 +45,7 @@ def _build_hook(self):

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249195694 ## File path: airflow/utils/log/s3_task_handler.py ## @@ -45,7 +45,7 @@ def _build_hook(self):

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249193359 ## File path: setup.py ## @@ -211,27 +217,44 @@ def write_version(filename=os.path.join(*['airflo

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249193359 ## File path: setup.py ## @@ -211,27 +217,44 @@ def write_version(filename=os.path.join(*['airflo

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249192231 ## File path: setup.py ## @@ -157,30 +160,29 @@ def write_version(filename=os.path.join(*['airflo

[GitHub] feng-tao merged pull request #4555: [AIRFLOW-XXX] Add Firestone Inventing as a Big Data & AI company uses Apache Airflow into README.md

2019-01-18 Thread GitBox
feng-tao merged pull request #4555: [AIRFLOW-XXX] Add Firestone Inventing as a Big Data & AI company uses Apache Airflow into README.md URL: https://github.com/apache/airflow/pull/4555 This is an automated message from the A

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249178310 ## File path: setup.py ## @@ -157,30 +160,29 @@ def write_version(filename=os.path.join(*['airflow',

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249178692 ## File path: setup.py ## @@ -211,27 +217,44 @@ def write_version(filename=os.path.join(*['airflow',

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249178779 ## File path: setup.py ## @@ -335,10 +383,8 @@ def do_setup(): 'all_dbs': all_dbs,

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249177730 ## File path: UPDATING.md ## @@ -24,6 +24,15 @@ assists users migrating to a new version. ## Airf

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249177607 ## File path: UPDATING.md ## @@ -24,6 +24,15 @@ assists users migrating to a new version. ## Airf

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249177814 ## File path: UPDATING.md ## @@ -24,6 +24,15 @@ assists users migrating to a new version. ## Airf

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249178124 ## File path: docs/installation.rst ## @@ -56,6 +56,10 @@ Here's the list of the subpackages and wha

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249177942 ## File path: airflow/utils/log/s3_task_handler.py ## @@ -45,7 +45,7 @@ def _build_hook(self):

[jira] [Commented] (AIRFLOW-2319) Table "dag_run" has (bad) second index on (dag_id, execution_date)

2019-01-18 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16746638#comment-16746638 ] Ash Berlin-Taylor commented on AIRFLOW-2319: My guess as to what happened:

[GitHub] max-sixty commented on issue #4511: [AIRFLOW-3695] Replace Flake8 by Pylint

2019-01-18 Thread GitBox
max-sixty commented on issue #4511: [AIRFLOW-3695] Replace Flake8 by Pylint URL: https://github.com/apache/airflow/pull/4511#issuecomment-455671280 I haven't been involved as an airflow developer, but saw this on the mailing list and thought it would be helpful to comment given my experienc

[GitHub] villasv commented on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12

2019-01-18 Thread GitBox
villasv commented on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12 URL: https://github.com/apache/airflow/pull/3723#issuecomment-455660200 In #4217 I’ve tried to use tenacity>5 and tests didn’t pass. Also the example HttpOperator DAG breaks. --

[GitHub] criccomini commented on issue #4549: [AIRFLOW-3725] Add private_key to bigquery_hook get_pandas_df

2019-01-18 Thread GitBox
criccomini commented on issue #4549: [AIRFLOW-3725] Add private_key to bigquery_hook get_pandas_df URL: https://github.com/apache/airflow/pull/4549#issuecomment-455658442 Failures in CI test are K8s issues that are unrelated to this PR and are currently failing on master: https://tr

[jira] [Comment Edited] (AIRFLOW-2319) Table "dag_run" has (bad) second index on (dag_id, execution_date)

2019-01-18 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16746574#comment-16746574 ] Andreas Költringer edited comment on AIRFLOW-2319 at 1/18/19 7:07 PM: ---

[GitHub] dargueta edited a comment on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12

2019-01-18 Thread GitBox
dargueta edited a comment on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12 URL: https://github.com/apache/airflow/pull/3723#issuecomment-455650114 This isn't my PR, unfortunately. @Fokko could you fix the conflicts and change the pinning to `>= 4.11.0, <5.0`? I think 5.x will work but

[GitHub] dargueta commented on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12

2019-01-18 Thread GitBox
dargueta commented on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12 URL: https://github.com/apache/airflow/pull/3723#issuecomment-455650114 This isn't my PR, unfortunately. @Fokko could you fix the conflicts and change the pinning to `>= 4.10.0, <5.0`? I think 5.x will work but it's b

[jira] [Commented] (AIRFLOW-2319) Table "dag_run" has (bad) second index on (dag_id, execution_date)

2019-01-18 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16746574#comment-16746574 ] Andreas Költringer commented on AIRFLOW-2319: - Well, as of now, on the mast

[GitHub] codecov-io edited a comment on issue #4551: [AIRFLOW-2955] Fix kubernetes pod operator to set requests and limits on task pods

2019-01-18 Thread GitBox
codecov-io edited a comment on issue #4551: [AIRFLOW-2955] Fix kubernetes pod operator to set requests and limits on task pods URL: https://github.com/apache/airflow/pull/4551#issuecomment-455531251 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4551?src=pr&el=h1) Report > Mergin

[jira] [Commented] (AIRFLOW-3726) Change the description and the default value for broker_url in airflow.cfg

2019-01-18 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16746532#comment-16746532 ] Ash Berlin-Taylor commented on AIRFLOW-3726: 4.1 added support for it back

[GitHub] zihengCat opened a new pull request #4555: [AIRFLOW-XXX] Add Firestone Inventing as a Big Data & AI company uses Apache Airflow into README.md

2019-01-18 Thread GitBox
zihengCat opened a new pull request #4555: [AIRFLOW-XXX] Add Firestone Inventing as a Big Data & AI company uses Apache Airflow into README.md URL: https://github.com/apache/airflow/pull/4555 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the

[jira] [Commented] (AIRFLOW-2876) Bump version of Tenacity

2019-01-18 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16746527#comment-16746527 ] Ash Berlin-Taylor commented on AIRFLOW-2876: If we work with v5 (and I thin

[jira] [Closed] (AIRFLOW-3728) double comma in function `to_csv` in hive_hooks.py

2019-01-18 Thread Siddharth Anand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand closed AIRFLOW-3728. Resolution: Fixed > double comma in function `to_csv` in hive_hooks.py > ---

[GitHub] potiuk commented on issue #4543: [AIRFLOW-3718] Multi-layered version of the docker image

2019-01-18 Thread GitBox
potiuk commented on issue #4543: [AIRFLOW-3718] Multi-layered version of the docker image URL: https://github.com/apache/airflow/pull/4543#issuecomment-455621176 Ok. Cool. It's good to disagree sometimes as it might lead to better final results :). I can do those things now:

[jira] [Assigned] (AIRFLOW-3391) Upgrade pendulum to latest major version

2019-01-18 Thread Siddharth Anand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand reassigned AIRFLOW-3391: Assignee: Bolke de Bruin > Upgrade pendulum to latest major version > --

[GitHub] r39132 merged pull request #4552: [Airflow 3728] remove double comma in hive_hooks.py

2019-01-18 Thread GitBox
r39132 merged pull request #4552: [Airflow 3728] remove double comma in hive_hooks.py URL: https://github.com/apache/airflow/pull/4552 This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] r39132 commented on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12

2019-01-18 Thread GitBox
r39132 commented on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12 URL: https://github.com/apache/airflow/pull/3723#issuecomment-455617713 @dargueta I'll try to find some time to verify this on a linux VM and get back to you. In the meantime, can you resolve the conflicts? if it works,

[GitHub] codecov-io edited a comment on issue #4523: [AIRFLOW-3616] Add aliases for schema with underscore

2019-01-18 Thread GitBox
codecov-io edited a comment on issue #4523: [AIRFLOW-3616] Add aliases for schema with underscore URL: https://github.com/apache/airflow/pull/4523#issuecomment-454115923 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4523?src=pr&el=h1) Report > Merging [#4523](https://codecov.io

[jira] [Commented] (AIRFLOW-3591) Fix start date, end date, duration for rescheduled tasks

2019-01-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16746483#comment-16746483 ] ASF GitHub Bot commented on AIRFLOW-3591: - ashb commented on pull request #4502

[jira] [Commented] (AIRFLOW-3591) Fix start date, end date, duration for rescheduled tasks

2019-01-18 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16746484#comment-16746484 ] ASF subversion and git services commented on AIRFLOW-3591: -- Co

[jira] [Resolved] (AIRFLOW-3591) Fix start date, end date, duration for rescheduled tasks

2019-01-18 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-3591. Resolution: Fixed Fix Version/s: 1.10.3 > Fix start date, end date, durati

[GitHub] ashb merged pull request #4502: [AIRFLOW-3591] Fix start date, end date, duration for rescheduled tasks

2019-01-18 Thread GitBox
ashb merged pull request #4502: [AIRFLOW-3591] Fix start date, end date, duration for rescheduled tasks URL: https://github.com/apache/airflow/pull/4502 This is an automated message from the Apache Git Service. To respond to

[GitHub] ashb commented on a change in pull request #4502: [AIRFLOW-3591] Fix start date, end date, duration for rescheduled tasks

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4502: [AIRFLOW-3591] Fix start date, end date, duration for rescheduled tasks URL: https://github.com/apache/airflow/pull/4502#discussion_r249115654 ## File path: airflow/www/views.py ## @@ -1728,33 +1728,15 @@ def gantt(self, se

[GitHub] ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image URL: https://github.com/apache/airflow/pull/4543#discussion_r249112432 ## File path: Dockerfile ## @@ -16,26 +16,77 @@ FROM python:3.6-slim -COPY . /opt/airflow/

[GitHub] ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image URL: https://github.com/apache/airflow/pull/4543#discussion_r249112331 ## File path: Dockerfile ## @@ -16,26 +16,77 @@ FROM python:3.6-slim -COPY . /opt/airflow/

[GitHub] ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image URL: https://github.com/apache/airflow/pull/4543#discussion_r249111627 ## File path: .dockerignore ## @@ -0,0 +1,23 @@ +# +# Licensed to the Apache Software Foundatio

[GitHub] ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image URL: https://github.com/apache/airflow/pull/4543#discussion_r249112795 ## File path: Dockerfile ## @@ -16,26 +16,77 @@ FROM python:3.6-slim -COPY . /opt/airflow/

[GitHub] ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image URL: https://github.com/apache/airflow/pull/4543#discussion_r249112971 ## File path: Dockerfile ## @@ -16,26 +16,77 @@ FROM python:3.6-slim -COPY . /opt/airflow/

[jira] [Commented] (AIRFLOW-2319) Table "dag_run" has (bad) second index on (dag_id, execution_date)

2019-01-18 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16746465#comment-16746465 ] Ash Berlin-Taylor commented on AIRFLOW-2319: The unique constraint on (dag_

[GitHub] ashb commented on a change in pull request #4523: [AIRFLOW-3616] Add aliases for schema with underscore

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4523: [AIRFLOW-3616] Add aliases for schema with underscore URL: https://github.com/apache/airflow/pull/4523#discussion_r249109494 ## File path: docs/howto/manage-connections.rst ## @@ -151,6 +156,29 @@ Scopes (comma separated)

[GitHub] ashb commented on a change in pull request #4523: [AIRFLOW-3616] Add aliases for schema with underscore

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4523: [AIRFLOW-3616] Add aliases for schema with underscore URL: https://github.com/apache/airflow/pull/4523#discussion_r249109381 ## File path: docs/howto/manage-connections.rst ## @@ -70,10 +70,15 @@ When referencing the connec

[GitHub] ashb commented on a change in pull request #4523: [AIRFLOW-3616] Add aliases for schema with underscore

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4523: [AIRFLOW-3616] Add aliases for schema with underscore URL: https://github.com/apache/airflow/pull/4523#discussion_r249109716 ## File path: tests/models.py ## @@ -3077,6 +3077,23 @@ def test_connection_from_uri_no_schema(sel

[GitHub] ashb commented on a change in pull request #4225: [AIRFLOW-3383] Rotate fernet keys.

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4225: [AIRFLOW-3383] Rotate fernet keys. URL: https://github.com/apache/airflow/pull/4225#discussion_r249108558 ## File path: airflow/bin/cli.py ## @@ -2109,7 +2120,12 @@ class CLIFactory(object): 'func': next_execut

[jira] [Created] (AIRFLOW-3729) Support env variables with pod runtime information in KubernetesPodOperator

2019-01-18 Thread Bruno Campos (JIRA)
Bruno Campos created AIRFLOW-3729: - Summary: Support env variables with pod runtime information in KubernetesPodOperator Key: AIRFLOW-3729 URL: https://issues.apache.org/jira/browse/AIRFLOW-3729 Proje

[GitHub] ashb commented on a change in pull request #4225: [AIRFLOW-3383] Rotate fernet keys.

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4225: [AIRFLOW-3383] Rotate fernet keys. URL: https://github.com/apache/airflow/pull/4225#discussion_r249108075 ## File path: tests/models.py ## @@ -2991,27 +2993,118 @@ def test_xcom_get_many(self): self.assertEqual

[jira] [Commented] (AIRFLOW-3729) Support env variables with pod runtime information in KubernetesPodOperator

2019-01-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16746458#comment-16746458 ] ASF GitHub Bot commented on AIRFLOW-3729: - bbcbruno commented on pull request #

[GitHub] bbcbruno opened a new pull request #4554: [AIRFLOW-3729] Support env variables with pod runtime information in KubernetesPodOperator

2019-01-18 Thread GitBox
bbcbruno opened a new pull request #4554: [AIRFLOW-3729] Support env variables with pod runtime information in KubernetesPodOperator URL: https://github.com/apache/airflow/pull/4554 ### Jira - [X] https://issues.apache.org/jira/browse/AIRFLOW-3729 ### Description - [X]

[GitHub] ashb commented on issue #4475: [AIRFLOW-3602] Changes ImapHook to raise an exception on no attachments

2019-01-18 Thread GitBox
ashb commented on issue #4475: [AIRFLOW-3602] Changes ImapHook to raise an exception on no attachments URL: https://github.com/apache/airflow/pull/4475#issuecomment-455605712 ```bash $ mkdir tmp $ ls tmp/ $ echo $? 0 ``` --

[jira] [Resolved] (AIRFLOW-1383) CLI clear command always resets DAG runs

2019-01-18 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-1383. Resolution: Duplicate > CLI clear command always resets DAG runs > --

[GitHub] Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database

2019-01-18 Thread GitBox
Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database URL: https://github.com/apache/airflow/pull/4396#discussion_r249076129 ## File path: airflow/models/__init__.py ## @@ -703,6 +644,57 @@ def __init__(self, task, execution_date, state=

[GitHub] Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database

2019-01-18 Thread GitBox
Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database URL: https://github.com/apache/airflow/pull/4396#discussion_r249076362 ## File path: airflow/models/__init__.py ## @@ -703,6 +644,57 @@ def __init__(self, task, execution_date, state=

[GitHub] Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database

2019-01-18 Thread GitBox
Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database URL: https://github.com/apache/airflow/pull/4396#discussion_r249078245 ## File path: tests/core.py ## @@ -1807,6 +1819,11 @@ def tearDown(self): @unittest.skip(reason="Skipping becau

[GitHub] Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database

2019-01-18 Thread GitBox
Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database URL: https://github.com/apache/airflow/pull/4396#discussion_r249077794 ## File path: airflow/models/__init__.py ## @@ -4189,16 +4243,18 @@ def create_dagrun(self, conf=co

[GitHub] Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database

2019-01-18 Thread GitBox
Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database URL: https://github.com/apache/airflow/pull/4396#discussion_r249078557 ## File path: tests/www/test_views.py ## @@ -728,15 +728,22 @@ def __init__(self, test, endpoint): def setU

[GitHub] Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database

2019-01-18 Thread GitBox
Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database URL: https://github.com/apache/airflow/pull/4396#discussion_r249078144 ## File path: tests/core.py ## @@ -107,7 +107,17 @@ def execute(*args, **kwargs): class CoreTest(unittest.TestC

[GitHub] codecov-io edited a comment on issue #4396: [AIRFLOW-3585] - Adding edges to database

2019-01-18 Thread GitBox
codecov-io edited a comment on issue #4396: [AIRFLOW-3585] - Adding edges to database URL: https://github.com/apache/airflow/pull/4396#issuecomment-450633941 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4396?src=pr&el=h1) Report > Merging [#4396](https://codecov.io/gh/apache/a

[GitHub] codecov-io edited a comment on issue #4396: [AIRFLOW-3585] - Adding edges to database

2019-01-18 Thread GitBox
codecov-io edited a comment on issue #4396: [AIRFLOW-3585] - Adding edges to database URL: https://github.com/apache/airflow/pull/4396#issuecomment-450633941 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4396?src=pr&el=h1) Report > Merging [#4396](https://codecov.io/gh/apache/a

[GitHub] stale[bot] commented on issue #3367: [AIRFLOW-2475] Reference triggered dag when using TriggerDagRunOperator

2019-01-18 Thread GitBox
stale[bot] commented on issue #3367: [AIRFLOW-2475] Reference triggered dag when using TriggerDagRunOperator URL: https://github.com/apache/airflow/pull/3367#issuecomment-43114 This issue has been automatically marked as stale because it has not had recent activity. It will be closed i

[jira] [Commented] (AIRFLOW-3541) Include --useAvroLogicalTypes setting for the Airflow operator GoogleCloudStorageToBigQueryOperator

2019-01-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16746267#comment-16746267 ] ASF GitHub Bot commented on AIRFLOW-3541: - BrechtDeVlieger commented on pull re

[GitHub] BrechtDeVlieger opened a new pull request #4553: [AIRFLOW-3541] Add Avro logical type conversion to bigquery hook

2019-01-18 Thread GitBox
BrechtDeVlieger opened a new pull request #4553: [AIRFLOW-3541] Add Avro logical type conversion to bigquery hook URL: https://github.com/apache/airflow/pull/4553 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](https:/

[GitHub] codecov-io edited a comment on issue #4551: [AIRFLOW-2955] Fix kubernetes pod operator to set requests and limits on task pods

2019-01-18 Thread GitBox
codecov-io edited a comment on issue #4551: [AIRFLOW-2955] Fix kubernetes pod operator to set requests and limits on task pods URL: https://github.com/apache/airflow/pull/4551#issuecomment-455531251 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4551?src=pr&el=h1) Report > Mergin

  1   2   >