[jira] [Created] (AIRFLOW-4831) conf.has_option raises an error if the given section is missing instead of returning false

2019-06-20 Thread Hao Liang (JIRA)
Hao Liang created AIRFLOW-4831: -- Summary: conf.has_option raises an error if the given section is missing instead of returning false Key: AIRFLOW-4831 URL: https://issues.apache.org/jira/browse/AIRFLOW-4831

[GitHub] [airflow] zhongjiajie opened a new pull request #5454: [AIRFLOW-XXX] Add next/prev ds not correct in faq

2019-06-20 Thread GitBox
zhongjiajie opened a new pull request #5454: [AIRFLOW-XXX] Add next/prev ds not correct in faq URL: https://github.com/apache/airflow/pull/5454 ### Description Add `[next|prev]_ds[_nodash]` not correct in Faq.md ### Code Quality - [x] Passes `flake8`

[jira] [Commented] (AIRFLOW-4422) Stats about pool utilization

2019-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869195#comment-16869195 ] ASF GitHub Bot commented on AIRFLOW-4422: - milton0825 commented on pull request #5453:

[GitHub] [airflow] milton0825 opened a new pull request #5453: [AIRFLOW-4422] Pool utilization stats

2019-06-20 Thread GitBox
milton0825 opened a new pull request #5453: [AIRFLOW-4422] Pool utilization stats URL: https://github.com/apache/airflow/pull/5453 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow

[GitHub] [airflow] jmcarp commented on issue #5259: [AIRFLOW-4478] Lazily instantiate default `Resources` object

2019-06-20 Thread GitBox
jmcarp commented on issue #5259: [AIRFLOW-4478] Lazily instantiate default `Resources` object URL: https://github.com/apache/airflow/pull/5259#issuecomment-504288261 Anything else I should update @potiuk? This is an

[GitHub] [airflow] zhongjiajie commented on issue #5448: [AIRFLOW-4827] Remove compatible test for python 2

2019-06-20 Thread GitBox
zhongjiajie commented on issue #5448: [AIRFLOW-4827] Remove compatible test for python 2 URL: https://github.com/apache/airflow/pull/5448#issuecomment-504287974 CI green, PTAL @XD-DENG thanks. This is an automated message

[GitHub] [airflow] codecov-io edited a comment on issue #5448: [AIRFLOW-4827] Remove compatible test for python 2

2019-06-20 Thread GitBox
codecov-io edited a comment on issue #5448: [AIRFLOW-4827] Remove compatible test for python 2 URL: https://github.com/apache/airflow/pull/5448#issuecomment-504164379 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5448?src=pr=h1) Report > Merging

[jira] [Closed] (AIRFLOW-4828) Remove param python_version in PythonVirtualenvOperator

2019-06-20 Thread zhongjiajie (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhongjiajie closed AIRFLOW-4828. Resolution: Won't Fix According to Kurqq comment on Github > I don't think we should remove

[jira] [Commented] (AIRFLOW-4828) Remove param python_version in PythonVirtualenvOperator

2019-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869114#comment-16869114 ] ASF GitHub Bot commented on AIRFLOW-4828: - zhongjiajie commented on pull request #5449:

[GitHub] [airflow] XD-DENG commented on issue #5449: [AIRFLOW-4828] Remove parameter python_version

2019-06-20 Thread GitBox
XD-DENG commented on issue #5449: [AIRFLOW-4828] Remove parameter python_version URL: https://github.com/apache/airflow/pull/5449#issuecomment-504269383 Thanks @zhongjiajie This is an automated message from the Apache Git

[GitHub] [airflow] zhongjiajie commented on a change in pull request #5448: [AIRFLOW-4827] Remove compatible test for python 2

2019-06-20 Thread GitBox
zhongjiajie commented on a change in pull request #5448: [AIRFLOW-4827] Remove compatible test for python 2 URL: https://github.com/apache/airflow/pull/5448#discussion_r296072721 ## File path: tests/hooks/test_hive_hook.py ## @@ -460,23 +458,7 @@ def

[GitHub] [airflow] zhongjiajie closed pull request #5449: [AIRFLOW-4828] Remove parameter python_version

2019-06-20 Thread GitBox
zhongjiajie closed pull request #5449: [AIRFLOW-4828] Remove parameter python_version URL: https://github.com/apache/airflow/pull/5449 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] zhongjiajie commented on issue #5449: [AIRFLOW-4828] Remove parameter python_version

2019-06-20 Thread GitBox
zhongjiajie commented on issue #5449: [AIRFLOW-4828] Remove parameter python_version URL: https://github.com/apache/airflow/pull/5449#issuecomment-504269187 Will close it, thanks for the clarification @kurtqq @XD-DENG This

[GitHub] [airflow] zhongjiajie commented on a change in pull request #5448: [AIRFLOW-4827] Remove compatible test for python 2

2019-06-20 Thread GitBox
zhongjiajie commented on a change in pull request #5448: [AIRFLOW-4827] Remove compatible test for python 2 URL: https://github.com/apache/airflow/pull/5448#discussion_r296072721 ## File path: tests/hooks/test_hive_hook.py ## @@ -460,23 +458,7 @@ def

[GitHub] [airflow] zhongjiajie commented on a change in pull request #5448: [AIRFLOW-4827] Remove compatible test for python 2

2019-06-20 Thread GitBox
zhongjiajie commented on a change in pull request #5448: [AIRFLOW-4827] Remove compatible test for python 2 URL: https://github.com/apache/airflow/pull/5448#discussion_r296072633 ## File path: tests/hooks/test_hive_hook.py ## @@ -460,23 +458,7 @@ def

[GitHub] [airflow] XD-DENG commented on issue #5449: [AIRFLOW-4828] Remove parameter python_version

2019-06-20 Thread GitBox
XD-DENG commented on issue #5449: [AIRFLOW-4828] Remove parameter python_version URL: https://github.com/apache/airflow/pull/5449#issuecomment-504258657 Agree with @kurtqq . - To my understanding, [AIP-3 drop support Python 2] is to drop Py2 support to Airflow itself only. -

[GitHub] [airflow] XD-DENG commented on a change in pull request #5448: [AIRFLOW-4827] Remove compatible test for python 2

2019-06-20 Thread GitBox
XD-DENG commented on a change in pull request #5448: [AIRFLOW-4827] Remove compatible test for python 2 URL: https://github.com/apache/airflow/pull/5448#discussion_r296070298 ## File path: tests/hooks/test_hive_hook.py ## @@ -460,23 +458,7 @@ def

[jira] [Created] (AIRFLOW-4830) Timezone ignored if default_args used for multiple dags

2019-06-20 Thread Dean (JIRA)
Dean created AIRFLOW-4830: - Summary: Timezone ignored if default_args used for multiple dags Key: AIRFLOW-4830 URL: https://issues.apache.org/jira/browse/AIRFLOW-4830 Project: Apache Airflow Issue

[GitHub] [airflow] dstandish commented on a change in pull request #5332: [AIRFLOW-3391] Upgrade pendulum to latest major version.

2019-06-20 Thread GitBox
dstandish commented on a change in pull request #5332: [AIRFLOW-3391] Upgrade pendulum to latest major version. URL: https://github.com/apache/airflow/pull/5332#discussion_r296034481 ## File path: airflow/utils/timezone.py ## @@ -89,10 +89,11 @@ def convert_to_utc(value):

[jira] [Commented] (AIRFLOW-4791) SnowflakeOperator doesn't support schema argument

2019-06-20 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868988#comment-16868988 ] ASF subversion and git services commented on AIRFLOW-4791: -- Commit

[jira] [Commented] (AIRFLOW-4791) SnowflakeOperator doesn't support schema argument

2019-06-20 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868989#comment-16868989 ] ASF subversion and git services commented on AIRFLOW-4791: -- Commit

[jira] [Commented] (AIRFLOW-4791) SnowflakeOperator doesn't support schema argument

2019-06-20 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868987#comment-16868987 ] ASF subversion and git services commented on AIRFLOW-4791: -- Commit

[jira] [Commented] (AIRFLOW-4791) SnowflakeOperator doesn't support schema argument

2019-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868986#comment-16868986 ] ASF GitHub Bot commented on AIRFLOW-4791: - jghoman commented on pull request #5415:

[GitHub] [airflow] jghoman merged pull request #5415: AIRFLOW-4791 add "schema" keyword arg to SnowflakeOperator

2019-06-20 Thread GitBox
jghoman merged pull request #5415: AIRFLOW-4791 add "schema" keyword arg to SnowflakeOperator URL: https://github.com/apache/airflow/pull/5415 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] jghoman commented on issue #5415: AIRFLOW-4791 add "schema" keyword arg to SnowflakeOperator

2019-06-20 Thread GitBox
jghoman commented on issue #5415: AIRFLOW-4791 add "schema" keyword arg to SnowflakeOperator URL: https://github.com/apache/airflow/pull/5415#issuecomment-504222581 +1. Thanks, Jake. This is an automated message from the

[GitHub] [airflow] dstandish commented on a change in pull request #5332: [AIRFLOW-3391] Upgrade pendulum to latest major version.

2019-06-20 Thread GitBox
dstandish commented on a change in pull request #5332: [AIRFLOW-3391] Upgrade pendulum to latest major version. URL: https://github.com/apache/airflow/pull/5332#discussion_r296034481 ## File path: airflow/utils/timezone.py ## @@ -89,10 +89,11 @@ def convert_to_utc(value):

[GitHub] [airflow] kpathak13 commented on a change in pull request #5356: [AIRFLOW-4363] Fix Json encoding error when retrieving `status` from cli in docker operator

2019-06-20 Thread GitBox
kpathak13 commented on a change in pull request #5356: [AIRFLOW-4363] Fix Json encoding error when retrieving `status` from cli in docker operator URL: https://github.com/apache/airflow/pull/5356#discussion_r296029509 ## File path: airflow/operators/docker_operator.py ##

[GitHub] [airflow] kpathak13 commented on a change in pull request #5356: [AIRFLOW-4363] Fix Json encoding error when retrieving `status` from cli in docker operator

2019-06-20 Thread GitBox
kpathak13 commented on a change in pull request #5356: [AIRFLOW-4363] Fix Json encoding error when retrieving `status` from cli in docker operator URL: https://github.com/apache/airflow/pull/5356#discussion_r296028365 ## File path: airflow/operators/docker_operator.py ##

[GitHub] [airflow] kpathak13 commented on a change in pull request #5356: [AIRFLOW-4363] Fix Json encoding error when retrieving `status` from cli in docker operator

2019-06-20 Thread GitBox
kpathak13 commented on a change in pull request #5356: [AIRFLOW-4363] Fix Json encoding error when retrieving `status` from cli in docker operator URL: https://github.com/apache/airflow/pull/5356#discussion_r296028365 ## File path: airflow/operators/docker_operator.py ##

[GitHub] [airflow] kpathak13 commented on a change in pull request #5356: [AIRFLOW-4363] Fix Json encoding error when retrieving `status` from cli in docker operator

2019-06-20 Thread GitBox
kpathak13 commented on a change in pull request #5356: [AIRFLOW-4363] Fix Json encoding error when retrieving `status` from cli in docker operator URL: https://github.com/apache/airflow/pull/5356#discussion_r296028365 ## File path: airflow/operators/docker_operator.py ##

[GitHub] [airflow] kpathak13 commented on a change in pull request #5356: [AIRFLOW-4363] Fix Json encoding error when retrieving `status` from cli in docker operator

2019-06-20 Thread GitBox
kpathak13 commented on a change in pull request #5356: [AIRFLOW-4363] Fix Json encoding error when retrieving `status` from cli in docker operator URL: https://github.com/apache/airflow/pull/5356#discussion_r296028365 ## File path: airflow/operators/docker_operator.py ##

[GitHub] [airflow] kpathak13 commented on a change in pull request #5356: [AIRFLOW-4363] Fix Json encoding error when retrieving `status` from cli in docker operator

2019-06-20 Thread GitBox
kpathak13 commented on a change in pull request #5356: [AIRFLOW-4363] Fix Json encoding error when retrieving `status` from cli in docker operator URL: https://github.com/apache/airflow/pull/5356#discussion_r296027561 ## File path: airflow/operators/docker_operator.py ##

[GitHub] [airflow] OmerJog commented on issue #1942: [AIRFLOW-697] Add exclusion of tasks.

2019-06-20 Thread GitBox
OmerJog commented on issue #1942: [AIRFLOW-697] Add exclusion of tasks. URL: https://github.com/apache/airflow/pull/1942#issuecomment-504178925 @YangLeoZhao if you implemented it and can share with the community it would be appriciated.

[jira] [Commented] (AIRFLOW-1148) Airflow cannot handle datetime(6) column values(execution_time, start_date, end_date)

2019-06-20 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868928#comment-16868928 ] jack commented on AIRFLOW-1148: --- Can you check this against newer airflow version? > Airflow cannot

[jira] [Commented] (AIRFLOW-1446) Have option to clear cross dag dependencies if you clear a task

2019-06-20 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868911#comment-16868911 ] jack commented on AIRFLOW-1446: --- This can be an extension of 

[jira] [Updated] (AIRFLOW-3146) TimeDeltaSensor - add end time stamp

2019-06-20 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3146: -- Labels: sensors (was: ) > TimeDeltaSensor - add end time stamp > - > >

[GitHub] [airflow] codecov-io commented on issue #5448: [AIRFLOW-4827] Remove compatible test for python 2

2019-06-20 Thread GitBox
codecov-io commented on issue #5448: [AIRFLOW-4827] Remove compatible test for python 2 URL: https://github.com/apache/airflow/pull/5448#issuecomment-504164379 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5448?src=pr=h1) Report > Merging

[GitHub] [airflow] ryw commented on issue #2460: [AIRFLOW-1424] make the next execution date of DAGs visible

2019-06-20 Thread GitBox
ryw commented on issue #2460: [AIRFLOW-1424] make the next execution date of DAGs visible URL: https://github.com/apache/airflow/pull/2460#issuecomment-504161646 @ashb is this on your radar to move forward? Looks like nice feature.

[jira] [Commented] (AIRFLOW-4829) EMR job flow and step sensor should provide a reason why the job failed

2019-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868887#comment-16868887 ] ASF GitHub Bot commented on AIRFLOW-4829: - jzucker2 commented on pull request #5452:

[GitHub] [airflow] jzucker2 opened a new pull request #5452: [AIRFLOW-4829] More descriptive exceptions for EMR sensors

2019-06-20 Thread GitBox
jzucker2 opened a new pull request #5452: [AIRFLOW-4829] More descriptive exceptions for EMR sensors URL: https://github.com/apache/airflow/pull/5452 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Updated] (AIRFLOW-4829) EMR job flow and step sensor should provide a reason why the job failed

2019-06-20 Thread Jordan Zucker (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jordan Zucker updated AIRFLOW-4829: --- Description: Currently, when using the EmrJobFlowSensor and the EmrStepSensor there is an

[jira] [Updated] (AIRFLOW-4829) EMR job flow and step sensor should provide a reason why the job failed

2019-06-20 Thread Jordan Zucker (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jordan Zucker updated AIRFLOW-4829: --- Summary: EMR job flow and step sensor should provide a reason why the job failed (was:

[jira] [Commented] (AIRFLOW-4805) Add py_file as templated field in DataflowPythonOperator

2019-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868872#comment-16868872 ] ASF GitHub Bot commented on AIRFLOW-4805: - eladkal commented on pull request #5451:

[GitHub] [airflow] eladkal opened a new pull request #5451: [AIRFLOW-4805] Add py_file as templated field in DataflowPythonOperator

2019-06-20 Thread GitBox
eladkal opened a new pull request #5451: [AIRFLOW-4805] Add py_file as templated field in DataflowPythonOperator URL: https://github.com/apache/airflow/pull/5451 ### Jira - [ ] My PR addresses the following https://issues.apache.org/jira/browse/AIRFLOW-4805 ###

[jira] [Created] (AIRFLOW-4829) EMR job flow sensor should provide a reason why the job failed

2019-06-20 Thread Jordan Zucker (JIRA)
Jordan Zucker created AIRFLOW-4829: -- Summary: EMR job flow sensor should provide a reason why the job failed Key: AIRFLOW-4829 URL: https://issues.apache.org/jira/browse/AIRFLOW-4829 Project: Apache

[GitHub] [airflow] codecov-io commented on issue #5447: [AIRFLOW-4826] Fix warning in resetdb command

2019-06-20 Thread GitBox
codecov-io commented on issue #5447: [AIRFLOW-4826] Fix warning in resetdb command URL: https://github.com/apache/airflow/pull/5447#issuecomment-504147830 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5447?src=pr=h1) Report > Merging

[GitHub] [airflow] HaloKo4 commented on issue #2206: [AIRFLOW-922] Update PrestoHook to enable synchronous execution

2019-06-20 Thread GitBox
HaloKo4 commented on issue #2206: [AIRFLOW-922] Update PrestoHook to enable synchronous execution URL: https://github.com/apache/airflow/pull/2206#issuecomment-504138100 @patrickmckenna is there a chance you will continue to work on that? It's shame that this amazing work will go to

[GitHub] [airflow] codecov-io edited a comment on issue #5255: [AIRFLOW-4462] Fix incorrect datetime column types when using MSSQL backend

2019-06-20 Thread GitBox
codecov-io edited a comment on issue #5255: [AIRFLOW-4462] Fix incorrect datetime column types when using MSSQL backend URL: https://github.com/apache/airflow/pull/5255#issuecomment-490256665 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5255?src=pr=h1) Report > Merging

[GitHub] [airflow] kurtqq commented on issue #5450: [AIRFLOW-4775] - fix incorrect parameter order in GceHook

2019-06-20 Thread GitBox
kurtqq commented on issue #5450: [AIRFLOW-4775] - fix incorrect parameter order in GceHook URL: https://github.com/apache/airflow/pull/5450#issuecomment-504120947 @mik-laj I'm not really sure what you are asking to test? The tests of `wait_for_operation_to_complete` are fine and

[GitHub] [airflow] mik-laj commented on issue #5450: [AIRFLOW-4775] - fix incorrect parameter order in GceHook

2019-06-20 Thread GitBox
mik-laj commented on issue #5450: [AIRFLOW-4775] - fix incorrect parameter order in GceHook URL: https://github.com/apache/airflow/pull/5450#issuecomment-504117094 Can you complete the tests to detect a similar case in the future?

[GitHub] [airflow] kurtqq commented on issue #5449: [AIRFLOW-4828] Remove parameter python_version

2019-06-20 Thread GitBox
kurtqq commented on issue #5449: [AIRFLOW-4828] Remove parameter python_version URL: https://github.com/apache/airflow/pull/5449#issuecomment-504115895 I don't think we should remove `python_version `parameter. If I run Airflow on Python 3.5 and want to run a task with Python 3.7 I need

[jira] [Commented] (AIRFLOW-4775) GceHook ommited num_retries parameter

2019-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868748#comment-16868748 ] ASF GitHub Bot commented on AIRFLOW-4775: - kurtqq commented on pull request #5450:

[GitHub] [airflow] kurtqq opened a new pull request #5450: [AIRFLOW-4775] - fix incorrect parameter order in GceHook (#1)

2019-06-20 Thread GitBox
kurtqq opened a new pull request #5450: [AIRFLOW-4775] - fix incorrect parameter order in GceHook (#1) URL: https://github.com/apache/airflow/pull/5450 PR https://github.com/apache/airflow/pull/5117 introduced num_retries for GCP. it seems like one function call was not changed

[jira] [Resolved] (AIRFLOW-4591) Tag tasks with default pool

2019-06-20 Thread Tao Feng (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Feng resolved AIRFLOW-4591. --- Resolution: Fixed Fix Version/s: 2.0.0 > Tag tasks with default pool >

[jira] [Commented] (AIRFLOW-4591) Tag tasks with default pool

2019-06-20 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868739#comment-16868739 ] ASF subversion and git services commented on AIRFLOW-4591: -- Commit

[jira] [Reopened] (AIRFLOW-4591) Tag tasks with default pool

2019-06-20 Thread Tao Feng (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Feng reopened AIRFLOW-4591: --- > Tag tasks with default pool > --- > > Key: AIRFLOW-4591 >

[jira] [Resolved] (AIRFLOW-4591) Tag tasks with default pool

2019-06-20 Thread Tao Feng (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Feng resolved AIRFLOW-4591. --- Resolution: Fixed > Tag tasks with default pool > --- > >

[GitHub] [airflow] feng-tao commented on issue #5349: [AIRFLOW-4591] Make default_pool a real pool

2019-06-20 Thread GitBox
feng-tao commented on issue #5349: [AIRFLOW-4591] Make default_pool a real pool URL: https://github.com/apache/airflow/pull/5349#issuecomment-504109989 ship This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] feng-tao merged pull request #5349: [AIRFLOW-4591] Make default_pool a real pool

2019-06-20 Thread GitBox
feng-tao merged pull request #5349: [AIRFLOW-4591] Make default_pool a real pool URL: https://github.com/apache/airflow/pull/5349 This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Commented] (AIRFLOW-4591) Tag tasks with default pool

2019-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868738#comment-16868738 ] ASF GitHub Bot commented on AIRFLOW-4591: - feng-tao commented on pull request #5349:

[GitHub] [airflow] milton0825 commented on issue #5349: [AIRFLOW-4591] Make default_pool a real pool

2019-06-20 Thread GitBox
milton0825 commented on issue #5349: [AIRFLOW-4591] Make default_pool a real pool URL: https://github.com/apache/airflow/pull/5349#issuecomment-504109166 @feng-tao I have resolved the conflicts and now CI is green. This is

[jira] [Commented] (AIRFLOW-4825) BigQueryOperator execute a list of SQL queries doesn't work

2019-06-20 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868729#comment-16868729 ] jack commented on AIRFLOW-4825: --- It doesn't support list. The BigQuery hook support only str:

[GitHub] [airflow] OmerJog edited a comment on issue #5448: [AIRFLOW-4196] Remove compatible test for python 2

2019-06-20 Thread GitBox
OmerJog edited a comment on issue #5448: [AIRFLOW-4196] Remove compatible test for python 2 URL: https://github.com/apache/airflow/pull/5448#issuecomment-504103212 Shouldnt you target https://issues.apache.org/jira/browse/AIRFLOW-4827 ?

[GitHub] [airflow] OmerJog commented on issue #5448: [AIRFLOW-4196] Remove compatible test for python 2

2019-06-20 Thread GitBox
OmerJog commented on issue #5448: [AIRFLOW-4196] Remove compatible test for python 2 URL: https://github.com/apache/airflow/pull/5448#issuecomment-504103212 Shouldnt you target https://issues.apache.org/jira/browse/AIRFLOW-4827?

[jira] [Commented] (AIRFLOW-4196) AIP-3 Drop support for Python 2

2019-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868714#comment-16868714 ] ASF GitHub Bot commented on AIRFLOW-4196: - zhongjiajie commented on pull request #5449:

[GitHub] [airflow] zhongjiajie opened a new pull request #5449: [AIRFLOW-4196] Remove parameter python_version

2019-06-20 Thread GitBox
zhongjiajie opened a new pull request #5449: [AIRFLOW-4196] Remove parameter python_version URL: https://github.com/apache/airflow/pull/5449 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-4828) Remove param python_version in PythonVirtualenvOperator

2019-06-20 Thread zhongjiajie (JIRA)
zhongjiajie created AIRFLOW-4828: Summary: Remove param python_version in PythonVirtualenvOperator Key: AIRFLOW-4828 URL: https://issues.apache.org/jira/browse/AIRFLOW-4828 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-4196) AIP-3 Drop support for Python 2

2019-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868683#comment-16868683 ] ASF GitHub Bot commented on AIRFLOW-4196: - zhongjiajie commented on pull request #5448:

[GitHub] [airflow] zhongjiajie opened a new pull request #5448: [AIRFLOW-4196] Remove compatible test for python 2

2019-06-20 Thread GitBox
zhongjiajie opened a new pull request #5448: [AIRFLOW-4196] Remove compatible test for python 2 URL: https://github.com/apache/airflow/pull/5448 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-4827) Remove compatible test for python 2

2019-06-20 Thread zhongjiajie (JIRA)
zhongjiajie created AIRFLOW-4827: Summary: Remove compatible test for python 2 Key: AIRFLOW-4827 URL: https://issues.apache.org/jira/browse/AIRFLOW-4827 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-4826) Resetdb command throws warning in new version of alembic

2019-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868659#comment-16868659 ] ASF GitHub Bot commented on AIRFLOW-4826: - thomashillyer commented on pull request #5447:

[GitHub] [airflow] thomashillyer opened a new pull request #5447: [AIRFLOW-4826] Fix warning in resetdb command

2019-06-20 Thread GitBox
thomashillyer opened a new pull request #5447: [AIRFLOW-4826] Fix warning in resetdb command URL: https://github.com/apache/airflow/pull/5447 Change engine to connection because error is thrown from new alembic version. Connection is expected. Make sure you have checked _all_

[jira] [Created] (AIRFLOW-4826) Resetdb command throws warning in new version of alembic

2019-06-20 Thread Thomas Hillyer (JIRA)
Thomas Hillyer created AIRFLOW-4826: --- Summary: Resetdb command throws warning in new version of alembic Key: AIRFLOW-4826 URL: https://issues.apache.org/jira/browse/AIRFLOW-4826 Project: Apache

[jira] [Created] (AIRFLOW-4825) BigQueryOperator execute a list of SQL queries doesn't work

2019-06-20 Thread Evgeny (JIRA)
Evgeny created AIRFLOW-4825: --- Summary: BigQueryOperator execute a list of SQL queries doesn't work Key: AIRFLOW-4825 URL: https://issues.apache.org/jira/browse/AIRFLOW-4825 Project: Apache Airflow

[jira] [Created] (AIRFLOW-4824) MySqlHook needs to override DbApiHook.get_uri to pull in extra for charset=utf-8 during create_engine

2019-06-20 Thread Lola Slade (JIRA)
Lola Slade created AIRFLOW-4824: --- Summary: MySqlHook needs to override DbApiHook.get_uri to pull in extra for charset=utf-8 during create_engine Key: AIRFLOW-4824 URL:

[jira] [Commented] (AIRFLOW-4584) Error when using ssh operateur to execute a sh script from an remote server

2019-06-20 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868534#comment-16868534 ] Ash Berlin-Taylor commented on AIRFLOW-4584: Does that .kjb file get printed by the

[GitHub] [airflow] XD-DENG commented on a change in pull request #5435: [AIRFLOW-4759] Don't error when marking sucessful run as failed

2019-06-20 Thread GitBox
XD-DENG commented on a change in pull request #5435: [AIRFLOW-4759] Don't error when marking sucessful run as failed URL: https://github.com/apache/airflow/pull/5435#discussion_r295795875 ## File path: airflow/api/common/experimental/mark_tasks.py ## @@ -337,6 +340,9 @@

[GitHub] [airflow] XD-DENG commented on a change in pull request #5435: [AIRFLOW-4759] Don't error when marking sucessful run as failed

2019-06-20 Thread GitBox
XD-DENG commented on a change in pull request #5435: [AIRFLOW-4759] Don't error when marking sucessful run as failed URL: https://github.com/apache/airflow/pull/5435#discussion_r295795875 ## File path: airflow/api/common/experimental/mark_tasks.py ## @@ -337,6 +340,9 @@

[jira] [Updated] (AIRFLOW-4409) UI duration view can be broken by task faile null duration column

2019-06-20 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-4409: --- Fix Version/s: (was: 2.0.0) 1.10.4 > UI duration view can

[GitHub] [airflow] kaxil merged pull request #5446: Add Crealytics to the list of Airflow users

2019-06-20 Thread GitBox
kaxil merged pull request #5446: Add Crealytics to the list of Airflow users URL: https://github.com/apache/airflow/pull/5446 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] manu-crealytics opened a new pull request #5446: Add Crealytics to the list of Airflow users

2019-06-20 Thread GitBox
manu-crealytics opened a new pull request #5446: Add Crealytics to the list of Airflow users URL: https://github.com/apache/airflow/pull/5446 Make sure you have checked _all_ steps below. ### Jira N/A, just changing the README. ### Description Simply adding

[GitHub] [airflow] chaimt commented on a change in pull request #4633: AIRFLOW-3791: Dataflow

2019-06-20 Thread GitBox
chaimt commented on a change in pull request #4633: AIRFLOW-3791: Dataflow URL: https://github.com/apache/airflow/pull/4633#discussion_r295766277 ## File path: airflow/contrib/operators/dataflow_operator.py ## @@ -118,6 +118,8 @@ def __init__(

[jira] [Comment Edited] (AIRFLOW-4801) trigger dag got when dag is zipped

2019-06-20 Thread Rinat Abdullin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868447#comment-16868447 ] Rinat Abdullin edited comment on AIRFLOW-4801 at 6/20/19 11:32 AM: ---

[jira] [Commented] (AIRFLOW-4823) Add the ability to toggle creation of default connections on deployment

2019-06-20 Thread jagan kumar (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868458#comment-16868458 ] jagan kumar commented on AIRFLOW-4823: -- [https://github.com/apache/airflow/pull/5443] > Add the

[jira] [Resolved] (AIRFLOW-4048) HttpSensor provide context to response_check

2019-06-20 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-4048. Resolution: Fixed > HttpSensor provide context to response_check >

[jira] [Commented] (AIRFLOW-4048) HttpSensor provide context to response_check

2019-06-20 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868456#comment-16868456 ] ASF subversion and git services commented on AIRFLOW-4048: -- Commit

[jira] [Commented] (AIRFLOW-4048) HttpSensor provide context to response_check

2019-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868455#comment-16868455 ] ASF GitHub Bot commented on AIRFLOW-4048: - ashb commented on pull request #4890: [AIRFLOW-4048]

[GitHub] [airflow] ashb merged pull request #4890: [AIRFLOW-4048] HttpSensor provide-context to response_check

2019-06-20 Thread GitBox
ashb merged pull request #4890: [AIRFLOW-4048] HttpSensor provide-context to response_check URL: https://github.com/apache/airflow/pull/4890 This is an automated message from the Apache Git Service. To respond to the

[jira] [Comment Edited] (AIRFLOW-4801) trigger dag got when dag is zipped

2019-06-20 Thread Rinat Abdullin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868447#comment-16868447 ] Rinat Abdullin edited comment on AIRFLOW-4801 at 6/20/19 11:17 AM: ---

[jira] [Commented] (AIRFLOW-4801) trigger dag got when dag is zipped

2019-06-20 Thread Rinat Abdullin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868447#comment-16868447 ] Rinat Abdullin commented on AIRFLOW-4801: - [~mithril] could you, please, try renaming bug to

[GitHub] [airflow] OmerJog commented on issue #5229: [AIRFLOW-XXX] Links to Pendulum in macros.rst

2019-06-20 Thread GitBox
OmerJog commented on issue #5229: [AIRFLOW-XXX] Links to Pendulum in macros.rst URL: https://github.com/apache/airflow/pull/5229#issuecomment-503948120 @mik-laj ready to merge? This is an automated message from the Apache Git

[GitHub] [airflow] Jagankmr3 commented on issue #5443: [AIRFLOW-4823] modified the source to have create_default_connections flag in config

2019-06-20 Thread GitBox
Jagankmr3 commented on issue #5443: [AIRFLOW-4823] modified the source to have create_default_connections flag in config URL: https://github.com/apache/airflow/pull/5443#issuecomment-503947605 Updated the default_airflow.cfg to have a flag "create_default_connection" the same variable

[jira] [Updated] (AIRFLOW-800) Initialize default Google BigQuery Connection with valid conn_type

2019-06-20 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-800: -- Component/s: gcp > Initialize default Google BigQuery Connection with valid conn_type >

[jira] [Updated] (AIRFLOW-3495) DataProcSparkSqlOperator and DataProcHiveOperator should raise error when query and query_uri are both provided

2019-06-20 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-3495: --- Component/s: gcp > DataProcSparkSqlOperator and DataProcHiveOperator should raise error

[jira] [Updated] (AIRFLOW-3143) Support auto-zone in DataprocClusterCreateOperator

2019-06-20 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-3143: --- Component/s: gcp > Support auto-zone in DataprocClusterCreateOperator >

[jira] [Updated] (AIRFLOW-3550) GKEClusterHook doesn't use gcp_conn_id

2019-06-20 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-3550: --- Component/s: gcp > GKEClusterHook doesn't use gcp_conn_id >

[jira] [Updated] (AIRFLOW-3401) Properly encode templated fields in Cloud Pub/Sub example DAG

2019-06-20 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-3401: --- Component/s: gcp > Properly encode templated fields in Cloud Pub/Sub example DAG >

[jira] [Created] (AIRFLOW-4823) Add the ability to toggle creation of default connections on deployment

2019-06-20 Thread Richard Jarvis (JIRA)
Richard Jarvis created AIRFLOW-4823: --- Summary: Add the ability to toggle creation of default connections on deployment Key: AIRFLOW-4823 URL: https://issues.apache.org/jira/browse/AIRFLOW-4823

[jira] [Commented] (AIRFLOW-4805) Add py_file as templated field in DataflowPythonOperator

2019-06-20 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868360#comment-16868360 ] Kamil Bregula commented on AIRFLOW-4805: [~wwlian] Can you add a GCP component to this ticket?

[jira] [Commented] (AIRFLOW-4804) Enable CORS (Cross-Origin Request Sharing) for the API

2019-06-20 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868356#comment-16868356 ] Kamil Bregula commented on AIRFLOW-4804:

  1   2   >