[GitHub] [airflow] jhtimmins opened a new pull request #10398: Capitalize 'Python' properly in Concepts docs

2020-08-18 Thread GitBox
jhtimmins opened a new pull request #10398: URL: https://github.com/apache/airflow/pull/10398 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for

[GitHub] [airflow] jhtimmins opened a new pull request #10397: Remove run-ons from scheduler docs.

2020-08-18 Thread GitBox
jhtimmins opened a new pull request #10397: URL: https://github.com/apache/airflow/pull/10397 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for

[GitHub] [airflow] AndersonReyes commented on pull request #10349: infer multiple_output from return type annotation

2020-08-18 Thread GitBox
AndersonReyes commented on pull request #10349: URL: https://github.com/apache/airflow/pull/10349#issuecomment-675833028 not sure whats up with the one test case getting exit 137 but cant tell if its me or github actions

[GitHub] [airflow] mik-laj commented on issue #10389: Documentation is missing instructions for preparing database for Airflow (during installation)

2020-08-18 Thread GitBox
mik-laj commented on issue #10389: URL: https://github.com/apache/airflow/issues/10389#issuecomment-675815272 Thanks for your feedback. Wouldn't you like to contribute this documentation change? You can do it even using Github UI.

[GitHub] [airflow] mik-laj closed issue #9111: API Endpoint - CRUD - XCOM

2020-08-18 Thread GitBox
mik-laj closed issue #9111: URL: https://github.com/apache/airflow/issues/9111 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] mik-laj closed issue #8143: Docs for REST API

2020-08-18 Thread GitBox
mik-laj closed issue #8143: URL: https://github.com/apache/airflow/issues/8143 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] mik-laj commented on a change in pull request #10390: When precommits are run, output is silenced

2020-08-18 Thread GitBox
mik-laj commented on a change in pull request #10390: URL: https://github.com/apache/airflow/pull/10390#discussion_r472590273 ## File path: scripts/ci/libraries/_build_images.sh ## @@ -559,12 +558,27 @@ function build_ci_image() { echo >&2 exit 1 fi +

[GitHub] [airflow] mik-laj commented on a change in pull request #10377: Allow running spellcheck or building docs separately

2020-08-18 Thread GitBox
mik-laj commented on a change in pull request #10377: URL: https://github.com/apache/airflow/pull/10377#discussion_r472582617 ## File path: docs/build_docs.py ## @@ -15,8 +15,8 @@ # KIND, either express or implied. See the License for the # specific language governing

[GitHub] [airflow] amirulmenjeni commented on issue #10395: Invalid Syntax Error When Importing hdfs_hook

2020-08-18 Thread GitBox
amirulmenjeni commented on issue #10395: URL: https://github.com/apache/airflow/issues/10395#issuecomment-675798131 Relevant: https://github.com/spotify/snakebite/issues/216 This is an automated message from the Apache Git

[GitHub] [airflow] mik-laj opened a new pull request #10396: Improve headings on docs/executor

2020-08-18 Thread GitBox
mik-laj opened a new pull request #10396: URL: https://github.com/apache/airflow/pull/10396 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] houqp commented on a change in pull request #10356: Add basic auth API auth backend

2020-08-18 Thread GitBox
houqp commented on a change in pull request #10356: URL: https://github.com/apache/airflow/pull/10356#discussion_r472578878 ## File path: docs/security/api.rst ## @@ -116,3 +116,41 @@ look like the following. -H 'Content-Type: application/json' \ -H

[airflow] branch master updated (a3df617 -> ba00db3)

2020-08-18 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from a3df617 Add guide about custom API authentication (#10312) add ba00db3 Consistently refer to section

[airflow] branch master updated (a3df617 -> ba00db3)

2020-08-18 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from a3df617 Add guide about custom API authentication (#10312) add ba00db3 Consistently refer to section

[airflow] branch master updated (306a666 -> a3df617)

2020-08-18 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 306a666 Docker images are now consistently labelled and a bit smaller (#10387) add a3df617 Add guide

[GitHub] [airflow] mik-laj merged pull request #10369: Consistently refer to section names

2020-08-18 Thread GitBox
mik-laj merged pull request #10369: URL: https://github.com/apache/airflow/pull/10369 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch master updated (306a666 -> a3df617)

2020-08-18 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 306a666 Docker images are now consistently labelled and a bit smaller (#10387) add a3df617 Add guide

[GitHub] [airflow] amirulmenjeni opened a new issue #10395: Invalid Syntax Error When Importing hdfs_hook

2020-08-18 Thread GitBox
amirulmenjeni opened a new issue #10395: URL: https://github.com/apache/airflow/issues/10395 **Airflow Version**: 1.10.10 **Issue**: When importing from `airflow.hooks.hdfs_hook` on Python 3.7.8. Here's the error message: ``` Traceback (most recent call last): File

[GitHub] [airflow] boring-cyborg[bot] commented on issue #10395: Invalid Syntax Error When Importing hdfs_hook

2020-08-18 Thread GitBox
boring-cyborg[bot] commented on issue #10395: URL: https://github.com/apache/airflow/issues/10395#issuecomment-675791136 Thanks for opening your first issue here! Be sure to follow the issue template! This is an

[airflow] branch master updated (306a666 -> a3df617)

2020-08-18 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 306a666 Docker images are now consistently labelled and a bit smaller (#10387) add a3df617 Add guide

[GitHub] [airflow] mik-laj merged pull request #10312: Add guide about custom API authentication

2020-08-18 Thread GitBox
mik-laj merged pull request #10312: URL: https://github.com/apache/airflow/pull/10312 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] mik-laj closed issue #8123: Guide about API authentication (including custom)

2020-08-18 Thread GitBox
mik-laj closed issue #8123: URL: https://github.com/apache/airflow/issues/8123 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (AIRFLOW-3964) Consolidate and de-duplicate sensor tasks

2020-08-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180189#comment-17180189 ] ASF GitHub Bot commented on AIRFLOW-3964: - YingboWang commented on a change in pull request

[GitHub] [airflow] YingboWang commented on a change in pull request #5499: [AIRFLOW-3964][AIP-17] Build smart sensor

2020-08-18 Thread GitBox
YingboWang commented on a change in pull request #5499: URL: https://github.com/apache/airflow/pull/5499#discussion_r472571844 ## File path: airflow/sensors/smart_sensor_operator.py ## @@ -0,0 +1,764 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or

[jira] [Commented] (AIRFLOW-3964) Consolidate and de-duplicate sensor tasks

2020-08-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180188#comment-17180188 ] ASF GitHub Bot commented on AIRFLOW-3964: - YingboWang commented on a change in pull request

[GitHub] [airflow] YingboWang commented on a change in pull request #5499: [AIRFLOW-3964][AIP-17] Build smart sensor

2020-08-18 Thread GitBox
YingboWang commented on a change in pull request #5499: URL: https://github.com/apache/airflow/pull/5499#discussion_r472571728 ## File path: airflow/smart_sensor_dags/smart_sensor_group.py ## @@ -0,0 +1,64 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +#

[GitHub] [airflow] mik-laj opened a new pull request #10394: Group monitoring guides in one section

2020-08-18 Thread GitBox
mik-laj opened a new pull request #10394: URL: https://github.com/apache/airflow/pull/10394 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] dimberman opened a new pull request #10393: Simplify the K8sExecutor and K8sPodOperator

2020-08-18 Thread GitBox
dimberman opened a new pull request #10393: URL: https://github.com/apache/airflow/pull/10393 As discussed in an earlier email thread, this PR removes much of the configuration elements of the K8sExecutor for a much simpler design. ` --- **^ Add meaningful description

[airflow] branch master updated (d6f6d53 -> 306a666)

2020-08-18 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from d6f6d53 Expand JenkinsJobTriggerOperator unit tests (#10353) add 306a666 Docker images are now consistently

[GitHub] [airflow] potiuk merged pull request #10387: Docker images are now consistently labelled and a bit smaller

2020-08-18 Thread GitBox
potiuk merged pull request #10387: URL: https://github.com/apache/airflow/pull/10387 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] yuqian90 commented on a change in pull request #10153: [AIP-34] Alternative proposal: Add TaskGroup as a DAG construction helper and UI concept with example

2020-08-18 Thread GitBox
yuqian90 commented on a change in pull request #10153: URL: https://github.com/apache/airflow/pull/10153#discussion_r472553598 ## File path: airflow/models/baseoperator.py ## @@ -382,7 +389,16 @@ def __init__( stacklevel=3 )

[GitHub] [airflow] mik-laj opened a new pull request #10392: Moved description of page size limit to security/

2020-08-18 Thread GitBox
mik-laj opened a new pull request #10392: URL: https://github.com/apache/airflow/pull/10392 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] potiuk edited a comment on pull request #10390: When precommits are run, output is silenced

2020-08-18 Thread GitBox
potiuk edited a comment on pull request #10390: URL: https://github.com/apache/airflow/pull/10390#issuecomment-675759812 @mik-laj -> this one nicely fixes the output of pre-commits locally and GitHub actions so that no extra stuff is visible. Still it keeps pre-commit spinner /progress

[jira] [Commented] (AIRFLOW-3964) Consolidate and de-duplicate sensor tasks

2020-08-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180162#comment-17180162 ] ASF GitHub Bot commented on AIRFLOW-3964: - kaxil commented on a change in pull request #5499:

[GitHub] [airflow] kaxil commented on a change in pull request #5499: [AIRFLOW-3964][AIP-17] Build smart sensor

2020-08-18 Thread GitBox
kaxil commented on a change in pull request #5499: URL: https://github.com/apache/airflow/pull/5499#discussion_r472543736 ## File path: airflow/smart_sensor_dags/smart_sensor_group.py ## @@ -0,0 +1,64 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or

[jira] [Commented] (AIRFLOW-3964) Consolidate and de-duplicate sensor tasks

2020-08-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180161#comment-17180161 ] ASF GitHub Bot commented on AIRFLOW-3964: - kaxil commented on a change in pull request #5499:

[GitHub] [airflow] kaxil commented on a change in pull request #5499: [AIRFLOW-3964][AIP-17] Build smart sensor

2020-08-18 Thread GitBox
kaxil commented on a change in pull request #5499: URL: https://github.com/apache/airflow/pull/5499#discussion_r472543249 ## File path: airflow/sensors/smart_sensor_operator.py ## @@ -0,0 +1,764 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[airflow] branch master updated (a32e90a -> d6f6d53)

2020-08-18 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from a32e90a Update github flags for Breeze (#10384) add d6f6d53 Expand JenkinsJobTriggerOperator unit tests

[GitHub] [airflow] potiuk commented on pull request #10390: When precommits are run, output is silenced

2020-08-18 Thread GitBox
potiuk commented on pull request #10390: URL: https://github.com/apache/airflow/pull/10390#issuecomment-675759812 @mik-laj -> this one nicely fixes the output of pre-commits locally and GitHub actions so that no extra stuff is visible. Still it keeps pre-commit spinner /progress running

[GitHub] [airflow] ipeluffo commented on pull request #10004: Add Amazon SES hook

2020-08-18 Thread GitBox
ipeluffo commented on pull request #10004: URL: https://github.com/apache/airflow/pull/10004#issuecomment-675759314 New PR created: https://github.com/apache/airflow/pull/10391 This is an automated message from the Apache

[airflow] branch master updated (a32e90a -> d6f6d53)

2020-08-18 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from a32e90a Update github flags for Breeze (#10384) add d6f6d53 Expand JenkinsJobTriggerOperator unit tests

[airflow] branch master updated (b28ea7a -> a32e90a)

2020-08-18 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from b28ea7a Docs: Fix spacing bug in 'Dag Run' (#10372) add a32e90a Update github flags for Breeze (#10384) No

[GitHub] [airflow] ipeluffo opened a new pull request #10391: Amazon SES Hook

2020-08-18 Thread GitBox
ipeluffo opened a new pull request #10391: URL: https://github.com/apache/airflow/pull/10391 This PR adds a new hook for Amazon Simple Email Service (SES). --- Read the **[Pull Request

[GitHub] [airflow] mik-laj edited a comment on issue #10388: Windows support using Daemoniker

2020-08-18 Thread GitBox
mik-laj edited a comment on issue #10388: URL: https://github.com/apache/airflow/issues/10388#issuecomment-675758417 have you encountered other problems with running Airflow on Windows? Windows support is highly anticipated by our users, but no one has dealt with this topic intensively

[airflow] branch master updated (a32e90a -> d6f6d53)

2020-08-18 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from a32e90a Update github flags for Breeze (#10384) add d6f6d53 Expand JenkinsJobTriggerOperator unit tests

[GitHub] [airflow] mik-laj edited a comment on issue #10388: Windows support using Daemoniker

2020-08-18 Thread GitBox
mik-laj edited a comment on issue #10388: URL: https://github.com/apache/airflow/issues/10388#issuecomment-675758417 have you encountered other problems with running Airflow on Windows? Windows support is highly anticipated by our users, but no one has dealt with this topic intensively

[airflow] branch master updated (9228bf2 -> b28ea7a)

2020-08-18 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 9228bf2 You can disable spellcheck or documentation when building docs. (#10377) add b28ea7a Docs: Fix

[airflow] branch master updated (b28ea7a -> a32e90a)

2020-08-18 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from b28ea7a Docs: Fix spacing bug in 'Dag Run' (#10372) add a32e90a Update github flags for Breeze (#10384) No

[GitHub] [airflow] kaxil merged pull request #10353: Expand JenkinsJobTriggerOperator unit tests

2020-08-18 Thread GitBox
kaxil merged pull request #10353: URL: https://github.com/apache/airflow/pull/10353 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] mik-laj commented on issue #10388: Windows support using Daemoniker

2020-08-18 Thread GitBox
mik-laj commented on issue #10388: URL: https://github.com/apache/airflow/issues/10388#issuecomment-675758417 have you encountered other problems with running Airflow on Windows? Windows support is highly anticipated by our users, but no one has dealt with this topic intensively yet.

[GitHub] [airflow] potiuk merged pull request #10384: Update github flags for Breeze

2020-08-18 Thread GitBox
potiuk merged pull request #10384: URL: https://github.com/apache/airflow/pull/10384 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] kaxil closed issue #10132: Increase unit test coverage for Jenkins job trigger

2020-08-18 Thread GitBox
kaxil closed issue #10132: URL: https://github.com/apache/airflow/issues/10132 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[airflow] branch master updated (9228bf2 -> b28ea7a)

2020-08-18 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 9228bf2 You can disable spellcheck or documentation when building docs. (#10377) add b28ea7a Docs: Fix

[GitHub] [airflow] kaxil merged pull request #10372: Fix spacing bug in 'Dag Run'.

2020-08-18 Thread GitBox
kaxil merged pull request #10372: URL: https://github.com/apache/airflow/pull/10372 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] potiuk opened a new pull request #10390: When precommits are run, output is silenced

2020-08-18 Thread GitBox
potiuk opened a new pull request #10390: URL: https://github.com/apache/airflow/pull/10390 The output of pre-commit builds on both CI and locally is now limited to only show errors, unless verbose variable is set. We are utilising aliases if possible but in case of

[GitHub] [airflow] kaxil commented on a change in pull request #10356: add basic auth API auth backend

2020-08-18 Thread GitBox
kaxil commented on a change in pull request #10356: URL: https://github.com/apache/airflow/pull/10356#discussion_r472527642 ## File path: docs/security/api.rst ## @@ -116,3 +116,41 @@ look like the following. -H 'Content-Type: application/json' \ -H

[GitHub] [airflow] kaxil commented on a change in pull request #10356: add basic auth API auth backend

2020-08-18 Thread GitBox
kaxil commented on a change in pull request #10356: URL: https://github.com/apache/airflow/pull/10356#discussion_r472527063 ## File path: docs/security/api.rst ## @@ -116,3 +116,41 @@ look like the following. -H 'Content-Type: application/json' \ -H

[GitHub] [airflow] kaxil commented on a change in pull request #10356: add basic auth API auth backend

2020-08-18 Thread GitBox
kaxil commented on a change in pull request #10356: URL: https://github.com/apache/airflow/pull/10356#discussion_r472526744 ## File path: docs/security/api.rst ## @@ -116,3 +116,41 @@ look like the following. -H 'Content-Type: application/json' \ -H

[GitHub] [airflow] atsalolikhin-spokeo opened a new issue #10389: Documentation is missing instructions for preparing database for Airflow (during installation)

2020-08-18 Thread GitBox
atsalolikhin-spokeo opened a new issue #10389: URL: https://github.com/apache/airflow/issues/10389 **Apache Airflow version**: 1.10.11 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): N/A **Environment**: - **Cloud provider or hardware

[GitHub] [airflow] boring-cyborg[bot] commented on issue #10389: Documentation is missing instructions for preparing database for Airflow (during installation)

2020-08-18 Thread GitBox
boring-cyborg[bot] commented on issue #10389: URL: https://github.com/apache/airflow/issues/10389#issuecomment-675748178 Thanks for opening your first issue here! Be sure to follow the issue template! This is an

[GitHub] [airflow] houqp commented on a change in pull request #10356: add basic auth API auth backend

2020-08-18 Thread GitBox
houqp commented on a change in pull request #10356: URL: https://github.com/apache/airflow/pull/10356#discussion_r472523072 ## File path: tests/api/auth/backend/test_basic_auth.py ## @@ -0,0 +1,135 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] shachibista opened a new issue #10388: Windows support using Daemoniker

2020-08-18 Thread GitBox
shachibista opened a new issue #10388: URL: https://github.com/apache/airflow/issues/10388 **Description** Currently, the airflow project uses PEP-3143 style daemons to launch tasks (as implemented in https://pypi.org/project/python-daemon/), however this is targeted towards unix

[GitHub] [airflow] boring-cyborg[bot] commented on issue #10388: Windows support using Daemoniker

2020-08-18 Thread GitBox
boring-cyborg[bot] commented on issue #10388: URL: https://github.com/apache/airflow/issues/10388#issuecomment-675732354 Thanks for opening your first issue here! Be sure to follow the issue template! This is an

[GitHub] [airflow] houqp commented on a change in pull request #10153: [AIP-34] Alternative proposal: Add TaskGroup as a DAG construction helper and UI concept with example

2020-08-18 Thread GitBox
houqp commented on a change in pull request #10153: URL: https://github.com/apache/airflow/pull/10153#discussion_r472502513 ## File path: airflow/models/baseoperator.py ## @@ -382,7 +389,16 @@ def __init__( stacklevel=3 )

[GitHub] [airflow] houqp commented on a change in pull request #10153: [AIP-34] Alternative proposal: Add TaskGroup as a DAG construction helper and UI concept with example

2020-08-18 Thread GitBox
houqp commented on a change in pull request #10153: URL: https://github.com/apache/airflow/pull/10153#discussion_r472499741 ## File path: airflow/models/baseoperator.py ## @@ -359,9 +363,12 @@ def __init__( do_xcom_push: bool = True, inlets: Optional[Any] =

[GitHub] [airflow] potiuk opened a new pull request #10387: Docker images are now consistently labelled and a bit smaller

2020-08-18 Thread GitBox
potiuk opened a new pull request #10387: URL: https://github.com/apache/airflow/pull/10387 Extracted from #10368 --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] ipeluffo commented on pull request #10004: Add Amazon SES hook

2020-08-18 Thread GitBox
ipeluffo commented on pull request #10004: URL: https://github.com/apache/airflow/pull/10004#issuecomment-675668086 Sorry for the delay responding, I've been off for a few days. I'll try to make a new PR between today and tomorrow morning. Thanks

[GitHub] [airflow] jaketf commented on issue #10382: Add on_kill method to BigQueryInsertJobOperator

2020-08-18 Thread GitBox
jaketf commented on issue #10382: URL: https://github.com/apache/airflow/issues/10382#issuecomment-675661153 I think this is straightforward for import / query / copy jobs as they are all internal to bigquery and committed atomically. There may be a corner case with extract (to GCS)

[GitHub] [airflow] potiuk opened a new issue #10386: Add list of prerequisites that new provider package should fulfill

2020-08-18 Thread GitBox
potiuk opened a new issue #10386: URL: https://github.com/apache/airflow/issues/10386 **Description** We need to have a folder template (ideally) and list of prerequisites that each provider should fulfill when it is created. **Use case / motivation** To make it easy

[airflow] branch v1-10-test updated: Fix failing insert-license pre-commit check

2020-08-18 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v1-10-test by this push: new 090f231 Fix failing insert-license

[GitHub] [airflow] jaketf edited a comment on issue #10381: Add on_kill method to DataprocSubmitJobOperator

2020-08-18 Thread GitBox
jaketf edited a comment on issue #10381: URL: https://github.com/apache/airflow/issues/10381#issuecomment-675654161 Dataproc jobs are kind of a wild wild west and may have significant side effects. From a documentation perspective we should call out that `on_kill` simply kills the job but

[GitHub] [airflow] jaketf commented on issue #10381: Add on_kill method to DataprocSubmitJobOperator

2020-08-18 Thread GitBox
jaketf commented on issue #10381: URL: https://github.com/apache/airflow/issues/10381#issuecomment-675654161 Dataproc jobs are kind of a wild wild west and may have significant side effects. From a documentation perspective we should call out that `on_kill` simply kills the job but will

[GitHub] [airflow] jaketf edited a comment on issue #10381: Add on_kill method to DataprocSubmitJobOperator

2020-08-18 Thread GitBox
jaketf edited a comment on issue #10381: URL: https://github.com/apache/airflow/issues/10381#issuecomment-675654161 Dataproc jobs are kind of a wild wild west and may have significant side effects. From a documentation perspective we should call out that `on_kill` simply kills the job but

[GitHub] [airflow] casassg commented on a change in pull request #10349: infer multiple_output from return type annotation

2020-08-18 Thread GitBox
casassg commented on a change in pull request #10349: URL: https://github.com/apache/airflow/pull/10349#discussion_r472406776 ## File path: tests/operators/test_python.py ## @@ -327,6 +328,98 @@ def test_python_operator_python_callable_is_callable(self): with

[GitHub] [airflow] jaketf commented on issue #10381: Add on_kill method to DataprocSubmitJobOperator

2020-08-18 Thread GitBox
jaketf commented on issue #10381: URL: https://github.com/apache/airflow/issues/10381#issuecomment-675650088 Sounds like a good feature to have. My only thought is that we should also add similar `on_kill` method for workflow template operators.

[GitHub] [airflow] jaketf opened a new issue #10385: Add on_kill method to DataprocWorkflowTemplateInstantiate[Inline]Operator

2020-08-18 Thread GitBox
jaketf opened a new issue #10385: URL: https://github.com/apache/airflow/issues/10385 **Description** This operator should cancel running workflow template `on_kill`. This option probably should be configurable because of request_id prameter in a job definition:

[GitHub] [airflow] AndersonReyes commented on a change in pull request #10349: infer multiple_output from return type annotation

2020-08-18 Thread GitBox
AndersonReyes commented on a change in pull request #10349: URL: https://github.com/apache/airflow/pull/10349#discussion_r472402592 ## File path: airflow/operators/python.py ## @@ -276,6 +280,17 @@ def task( :type multiple_outputs: bool """ + +if

[GitHub] [airflow] AndersonReyes commented on a change in pull request #10349: infer multiple_output from return type annotation

2020-08-18 Thread GitBox
AndersonReyes commented on a change in pull request #10349: URL: https://github.com/apache/airflow/pull/10349#discussion_r472402253 ## File path: tests/operators/test_python.py ## @@ -327,6 +328,98 @@ def test_python_operator_python_callable_is_callable(self): with

[GitHub] [airflow] shivanshs9 commented on issue #10341: Newly-created DAG is loaded in DB but existing DagBag instances are unable to get the DAG

2020-08-18 Thread GitBox
shivanshs9 commented on issue #10341: URL: https://github.com/apache/airflow/issues/10341#issuecomment-675642866 > That will refresh DAGs from DB if DAG Serialization is enabled, if not it will refresh them from DAG files I understand that but I'd again like to confirm that it'll

[GitHub] [airflow] mik-laj commented on pull request #10356: add basic auth API auth backend

2020-08-18 Thread GitBox
mik-laj commented on pull request #10356: URL: https://github.com/apache/airflow/pull/10356#issuecomment-675629482 Can you add tests for experimental API? This is an automated message from the Apache Git Service. To respond

[airflow] branch v1-10-stable updated (760bcb8 -> 779fbe0)

2020-08-18 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch v1-10-stable in repository https://gitbox.apache.org/repos/asf/airflow.git. from 760bcb8 Fix PythonVirtualenvOperator when using provide_context=True (#8256) add 8746f52 Sort

[airflow] annotated tag 1.10.12rc2 updated (779fbe0 -> d127a67)

2020-08-18 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to annotated tag 1.10.12rc2 in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag 1.10.12rc2 was modified! *** from 779fbe0 (commit) to d127a67 (tag) tagging

svn commit: r41028 - /dev/airflow/1.10.12rc2/

2020-08-18 Thread kaxilnaik
Author: kaxilnaik Date: Tue Aug 18 17:57:54 2020 New Revision: 41028 Log: Add artifacts for Airflow 1.10.12rc2 Added: dev/airflow/1.10.12rc2/ dev/airflow/1.10.12rc2/apache-airflow-1.10.12rc2-bin.tar.gz (with props) dev/airflow/1.10.12rc2/apache-airflow-1.10.12rc2-bin.tar.gz.asc

[GitHub] [airflow] houqp commented on pull request #10356: add basic auth API auth backend

2020-08-18 Thread GitBox
houqp commented on pull request #10356: URL: https://github.com/apache/airflow/pull/10356#issuecomment-675626431 thanks @jhtimmins for the tip, I have it setup locally, but just forgot to run it for that commit :P @mik-laj let me add a check for content type in test

[GitHub] [airflow] mik-laj commented on pull request #10356: add basic auth API auth backend

2020-08-18 Thread GitBox
mik-laj commented on pull request #10356: URL: https://github.com/apache/airflow/pull/10356#issuecomment-675625402 LGTM. but I'd like to do a final check while I'm on my computer and able to run the code. Now I am wondering if the Content-Type headers are correct. Thank you very

[airflow] branch v1-10-test updated: Update Changelog for 1.10.12rc2

2020-08-18 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v1-10-test by this push: new 779fbe0 Update Changelog for

[GitHub] [airflow] potiuk merged pull request #10377: Allow running spellcheck or building docs separately

2020-08-18 Thread GitBox
potiuk merged pull request #10377: URL: https://github.com/apache/airflow/pull/10377 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch master updated: You can disable spellcheck or documentation when building docs. (#10377)

2020-08-18 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 9228bf2 You can disable spellcheck or

[GitHub] [airflow] houqp commented on a change in pull request #10356: add basic auth API auth backend

2020-08-18 Thread GitBox
houqp commented on a change in pull request #10356: URL: https://github.com/apache/airflow/pull/10356#discussion_r472370372 ## File path: tests/api/auth/backend/test_basic_auth.py ## @@ -0,0 +1,106 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] potiuk opened a new pull request #10384: Update github flags for Breeze

2020-08-18 Thread GitBox
potiuk opened a new pull request #10384: URL: https://github.com/apache/airflow/pull/10384 Part of #10368 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)**

[airflow] branch constraints-1-10 updated: Updating constraints. GH run id:213841848

2020-08-18 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-1-10 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-1-10 by this push: new 66db1ca Updating

[GitHub] [airflow] potiuk commented on issue #10363: Clearer documentation about production image usage

2020-08-18 Thread GitBox
potiuk commented on issue #10363: URL: https://github.com/apache/airflow/issues/10363#issuecomment-675602257 Feel free :). Assigned you to it and happy to review it! This is an automated message from the Apache Git Service.

[GitHub] [airflow] prakshalj0512 commented on pull request #9065: ADD ldap and self-signed certificate

2020-08-18 Thread GitBox
prakshalj0512 commented on pull request #9065: URL: https://github.com/apache/airflow/pull/9065#issuecomment-675606979 @NBardelot Thanks for creating this. Been really useful to me lately! This is an automated message from

[GitHub] [airflow] sanjana1604 commented on issue #10363: Clearer documentation about production image usage

2020-08-18 Thread GitBox
sanjana1604 commented on issue #10363: URL: https://github.com/apache/airflow/issues/10363#issuecomment-675597826 @potiuk I would like to solve this issue. This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] krisdock commented on issue #10383: Add on_kill method to KubernetesPodOperator

2020-08-18 Thread GitBox
krisdock commented on issue #10383: URL: https://github.com/apache/airflow/issues/10383#issuecomment-675589854 @dimberman This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] boring-cyborg[bot] commented on issue #10383: Add on_kill method to KubernetesPodOperator

2020-08-18 Thread GitBox
boring-cyborg[bot] commented on issue #10383: URL: https://github.com/apache/airflow/issues/10383#issuecomment-675589478 Thanks for opening your first issue here! Be sure to follow the issue template! This is an

[GitHub] [airflow] krisdock opened a new issue #10383: Add on_kill method to KubernetesPodOperator

2020-08-18 Thread GitBox
krisdock opened a new issue #10383: URL: https://github.com/apache/airflow/issues/10383 **Description** Kubernetes Pods that are created by KubernetesPodOperator aren't deleted when a running task is killed/cleared from the Airflow UI. There's a known function (on_kill) that can be

[GitHub] [airflow] potiuk commented on pull request #10344: Fixes optimisation where doc only change should build much faster

2020-08-18 Thread GitBox
potiuk commented on pull request #10344: URL: https://github.com/apache/airflow/pull/10344#issuecomment-675588115 Hello . A fix here waiting @kaxil @mik-laj . I'd love to merge it all to rebase the CI change to see what's left and decide how to further split it :)

[GitHub] [airflow] potiuk commented on issue #8107: AIP-32 - Airflow REST API - High-level info

2020-08-18 Thread GitBox
potiuk commented on issue #8107: URL: https://github.com/apache/airflow/issues/8107#issuecomment-675583326 From the very beginning of the project we track it in this project and @mik-laj excellently planned the work and managed the status all the time in the project (Kudos @mik-laj ), so

[GitHub] [airflow] ryw commented on issue #8107: AIP-32 - Airflow REST API - High-level info

2020-08-18 Thread GitBox
ryw commented on issue #8107: URL: https://github.com/apache/airflow/issues/8107#issuecomment-675582622 ah thank you! This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] potiuk commented on issue #8107: AIP-32 - Airflow REST API - High-level info

2020-08-18 Thread GitBox
potiuk commented on issue #8107: URL: https://github.com/apache/airflow/issues/8107#issuecomment-675579472 I believe it's this: https://github.com/apache/airflow/projects/1 This is an automated message from the Apache Git

  1   2   3   >