[GitHub] [airflow] jhtimmins opened a new pull request #10372: Fix spacing bug in 'Dag Run'.

2020-08-17 Thread GitBox
jhtimmins opened a new pull request #10372: URL: https://github.com/apache/airflow/pull/10372 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for

[GitHub] [airflow] jhtimmins opened a new pull request #10371: Correct verb tense for re-running task docs.

2020-08-17 Thread GitBox
jhtimmins opened a new pull request #10371: URL: https://github.com/apache/airflow/pull/10371 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for

[GitHub] [airflow] jhtimmins opened a new pull request #10370: Simplify cron preset language in docs.

2020-08-17 Thread GitBox
jhtimmins opened a new pull request #10370: URL: https://github.com/apache/airflow/pull/10370 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for

[GitHub] [airflow] mik-laj opened a new pull request #10369: Consistently refer to section names

2020-08-17 Thread GitBox
mik-laj opened a new pull request #10369: URL: https://github.com/apache/airflow/pull/10369 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] mik-laj commented on a change in pull request #10356: add basic auth API auth backend

2020-08-17 Thread GitBox
mik-laj commented on a change in pull request #10356: URL: https://github.com/apache/airflow/pull/10356#discussion_r471876678 ## File path: tests/api/auth/backend/test_basic_auth.py ## @@ -0,0 +1,106 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] mik-laj commented on a change in pull request #10356: add basic auth API auth backend

2020-08-17 Thread GitBox
mik-laj commented on a change in pull request #10356: URL: https://github.com/apache/airflow/pull/10356#discussion_r471878722 ## File path: tests/api/auth/backend/test_basic_auth.py ## @@ -0,0 +1,106 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] mik-laj commented on a change in pull request #10356: add basic auth API auth backend

2020-08-17 Thread GitBox
mik-laj commented on a change in pull request #10356: URL: https://github.com/apache/airflow/pull/10356#discussion_r471876678 ## File path: tests/api/auth/backend/test_basic_auth.py ## @@ -0,0 +1,106 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] mik-laj commented on a change in pull request #10356: add basic auth API auth backend

2020-08-17 Thread GitBox
mik-laj commented on a change in pull request #10356: URL: https://github.com/apache/airflow/pull/10356#discussion_r471876678 ## File path: tests/api/auth/backend/test_basic_auth.py ## @@ -0,0 +1,106 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] mik-laj commented on a change in pull request #10356: add basic auth API auth backend

2020-08-17 Thread GitBox
mik-laj commented on a change in pull request #10356: URL: https://github.com/apache/airflow/pull/10356#discussion_r471876678 ## File path: tests/api/auth/backend/test_basic_auth.py ## @@ -0,0 +1,106 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] AndersonReyes commented on pull request #10349: infer multiple_output from return type annotation

2020-08-17 Thread GitBox
AndersonReyes commented on pull request #10349: URL: https://github.com/apache/airflow/pull/10349#issuecomment-675211484 I can't quite figure a clean unpacking of the xcomargs without knowing the size of the output in advance. Right now i have this which is not clean, infer the number of

[GitHub] [airflow] houqp commented on pull request #10356: add basic auth API auth backend

2020-08-17 Thread GitBox
houqp commented on pull request #10356: URL: https://github.com/apache/airflow/pull/10356#issuecomment-675210340 @jhtimmins would be nice to get a review from you as well :) This is an automated message from the Apache Git

[GitHub] [airflow] ad-m commented on a change in pull request #10368: CI Images are now pre-build and stored in registry

2020-08-17 Thread GitBox
ad-m commented on a change in pull request #10368: URL: https://github.com/apache/airflow/pull/10368#discussion_r471851549 ## File path: BREEZE.rst ## @@ -1135,6 +1167,12 @@ This is the current syntax for `./breeze <./breeze>`_: You can also pass

[GitHub] [airflow] mik-laj edited a comment on pull request #10368: CI Images are now pre-build and stored in registry

2020-08-17 Thread GitBox
mik-laj edited a comment on pull request #10368: URL: https://github.com/apache/airflow/pull/10368#issuecomment-675196719 This change is huge. What can we reduce its size? I can see a few changes that we can extract and do as a separate change: * merging to ``--github-organisation`` and

[GitHub] [airflow] mik-laj commented on pull request #10368: CI Images are now pre-build and stored in registry

2020-08-17 Thread GitBox
mik-laj commented on pull request #10368: URL: https://github.com/apache/airflow/pull/10368#issuecomment-675196719 This change is huge. What can we reduce its size? I can see a few changes that we can extract and do as a separate change: * merging to ``--github-organisation`` and

[GitHub] [airflow] potiuk edited a comment on pull request #10368: CI Images are now pre-build and stored in registry

2020-08-17 Thread GitBox
potiuk edited a comment on pull request #10368: URL: https://github.com/apache/airflow/pull/10368#issuecomment-675177393 Hello everyone. This is a major overhaul of the way how we are utilizing GitHub Actions - something that was enabled by recent features released by GitHub Actions

[GitHub] [airflow] potiuk commented on pull request #10368: CI Images are now pre-build and stored in registry

2020-08-17 Thread GitBox
potiuk commented on pull request #10368: URL: https://github.com/apache/airflow/pull/10368#issuecomment-675183645 CC: @ad-m This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] potiuk commented on pull request #10368: CI Images are now pre-build and stored in registry

2020-08-17 Thread GitBox
potiuk commented on pull request #10368: URL: https://github.com/apache/airflow/pull/10368#issuecomment-675177393 Hello everyone. This is a major overhaul of the way how we are utilizing GitHub Actions - something that was enabled by recent features released by GitHub Actions (namely

[GitHub] [airflow] potiuk opened a new pull request #10368: CI Images are now pre-build and stored in registry

2020-08-17 Thread GitBox
potiuk opened a new pull request #10368: URL: https://github.com/apache/airflow/pull/10368 With this change we utilise the latest pull_request_target event type from Github Actions and we are building the CI image only once (per version) for the entire run. This safes from 2 to

[airflow-site] branch asf-site updated: Update asf-site to output generated at e7e5638

2020-08-17 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 87a0b1b Update asf-site to

[airflow-site] branch master updated: Remove duplicate Breeze description in blog post (#283)

2020-08-17 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/master by this push: new e7e5638 Remove duplicate Breeze

[GitHub] [airflow-site] mik-laj merged pull request #283: Remove duplicate Breeze Section in blog post

2020-08-17 Thread GitBox
mik-laj merged pull request #283: URL: https://github.com/apache/airflow-site/pull/283 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] guptamyr commented on issue #10014: Release a 2nd wave of Backport packages

2020-08-17 Thread GitBox
guptamyr commented on issue #10014: URL: https://github.com/apache/airflow/issues/10014#issuecomment-675156890 Hi, could you please also make sure to include this new operator for AWS SageMaker: https://github.com/apache/airflow/pull/9594. Thanks!

[GitHub] [airflow] mik-laj commented on issue #10367: Markdown table is not rendered in doc_md attribute for DAG

2020-08-17 Thread GitBox
mik-laj commented on issue #10367: URL: https://github.com/apache/airflow/issues/10367#issuecomment-675156444 It seems that the original markdown specification does not provide support for tables https://daringfireball.net/projects/markdown/syntax We have to activate it with the

[GitHub] [airflow-site] ephraimbuddy opened a new pull request #283: Remove duplicate Breeze Section in blog post

2020-08-17 Thread GitBox
ephraimbuddy opened a new pull request #283: URL: https://github.com/apache/airflow-site/pull/283 Hi, Breeze Section appeared twice. I mistakenly left it at the bottom. This PR removes it cc: @mik-laj @potiuk This is an

[GitHub] [airflow] mik-laj commented on issue #10367: Markdown table is not rendered in doc_md attribute for DAG

2020-08-17 Thread GitBox
mik-laj commented on issue #10367: URL: https://github.com/apache/airflow/issues/10367#issuecomment-675154696 It seems worth taking care of this. Do you want me to assign you this ticket? I will be happy to help if you need any support and reviews.

[GitHub] [airflow] mik-laj commented on a change in pull request #10356: add basic auth API auth backend

2020-08-17 Thread GitBox
mik-laj commented on a change in pull request #10356: URL: https://github.com/apache/airflow/pull/10356#discussion_r471814852 ## File path: tests/api/auth/backend/test_basic_auth.py ## @@ -0,0 +1,102 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] mik-laj commented on a change in pull request #10356: add basic auth API auth backend

2020-08-17 Thread GitBox
mik-laj commented on a change in pull request #10356: URL: https://github.com/apache/airflow/pull/10356#discussion_r471813795 ## File path: docs/security.rst ## @@ -160,6 +160,43 @@ look like the following. -H 'Cache-Control: no-cache' \ -H

[GitHub] [airflow] kaxil commented on pull request #10356: add basic auth API auth backend

2020-08-17 Thread GitBox
kaxil commented on pull request #10356: URL: https://github.com/apache/airflow/pull/10356#issuecomment-675147837 cc @jhtimmins This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Commented] (AIRFLOW-5841) Tree view has been reversed

2020-08-17 Thread Selva Thiruarul (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179259#comment-17179259 ] Selva Thiruarul commented on AIRFLOW-5841: --  Any update on this issue? The change in tree view

[GitHub] [airflow] kaxil edited a comment on issue #10362: Airflow 1.10.12rc1, KubernetesPodOperator broken with secret & deploy_type "volume"

2020-08-17 Thread GitBox
kaxil edited a comment on issue #10362: URL: https://github.com/apache/airflow/issues/10362#issuecomment-675132778 Unfortunately, the PR hasn't passed the tests, so we will have to wait for tomorrow to cut rc2. This is an

[GitHub] [airflow] houqp commented on pull request #10153: [AIP-34] Alternative proposal: Add TaskGroup as a DAG construction helper and UI concept with example

2020-08-17 Thread GitBox
houqp commented on pull request #10153: URL: https://github.com/apache/airflow/pull/10153#issuecomment-675145414 Thanks @yuqian90 for the update, I left one comment around a change that I think we should be more careful about, the rest looks good to me  would love to hear about other

[GitHub] [airflow] kaxil commented on pull request #10153: [AIP-34] Alternative proposal: Add TaskGroup as a DAG construction helper and UI concept with example

2020-08-17 Thread GitBox
kaxil commented on pull request #10153: URL: https://github.com/apache/airflow/pull/10153#issuecomment-675145311 Thanks for the PR, I will definitely take a look at it since Airflow 1.10.12 is released :) This is an

[GitHub] [airflow] houqp commented on a change in pull request #10153: [AIP-34] Alternative proposal: Add TaskGroup as a DAG construction helper and UI concept with example

2020-08-17 Thread GitBox
houqp commented on a change in pull request #10153: URL: https://github.com/apache/airflow/pull/10153#discussion_r471805675 ## File path: airflow/serialization/serialized_objects.py ## @@ -626,3 +653,60 @@ def from_dict(cls, serialized_obj: dict) -> 'SerializedDAG':

[GitHub] [airflow] jelther opened a new issue #10367: Markdown table is not rendered in doc_md attribute for DAG

2020-08-17 Thread GitBox
jelther opened a new issue #10367: URL: https://github.com/apache/airflow/issues/10367 **Apache Airflow version**: 1.10.11 **Environment**: Python 3.7 - **Cloud provider or hardware configuration**: - **OS** (e.g. from /etc/os-release): PRETTY_NAME="Debian GNU/Linux 10

[GitHub] [airflow] boring-cyborg[bot] commented on issue #10367: Markdown table is not rendered in doc_md attribute for DAG

2020-08-17 Thread GitBox
boring-cyborg[bot] commented on issue #10367: URL: https://github.com/apache/airflow/issues/10367#issuecomment-675141626 Thanks for opening your first issue here! Be sure to follow the issue template! This is an

[GitHub] [airflow-site] ephraimbuddy commented on pull request #282: Add instructions for adding blog posts with images

2020-08-17 Thread GitBox
ephraimbuddy commented on pull request #282: URL: https://github.com/apache/airflow-site/pull/282#issuecomment-675137349 Nice. very helpful! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow-site] ephraimbuddy commented on pull request #272: airflow for new comers

2020-08-17 Thread GitBox
ephraimbuddy commented on pull request #272: URL: https://github.com/apache/airflow-site/pull/272#issuecomment-675136694  This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] kaxil commented on issue #10362: Airflow 1.10.12rc1, KubernetesPodOperator broken with secret & deploy_type "volume"

2020-08-17 Thread GitBox
kaxil commented on issue #10362: URL: https://github.com/apache/airflow/issues/10362#issuecomment-675132778 Unfortunately, the PR hasn't passed the tests, so we will have to wait for tomorrow. This is an automated message

[GitHub] [airflow] kaxil edited a comment on issue #10362: Airflow 1.10.12rc1, KubernetesPodOperator broken with secret & deploy_type "volume"

2020-08-17 Thread GitBox
kaxil edited a comment on issue #10362: URL: https://github.com/apache/airflow/issues/10362#issuecomment-675132778 Unfortunately, the PR hasn't passed the tests, so we will have to wait for tomorrow to cur rc2. This is an

[airflow-site] branch asf-site updated: Update asf-site to output generated at 006e929

2020-08-17 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/asf-site by this push: new ac97b6a Update asf-site to

[airflow-site] branch master updated: Add instructions for adding blog posts with images (#282)

2020-08-17 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/master by this push: new 006e929 Add instructions for adding

[GitHub] [airflow-site] kaxil merged pull request #282: Add instructions for adding blog posts with images

2020-08-17 Thread GitBox
kaxil merged pull request #282: URL: https://github.com/apache/airflow-site/pull/282 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] yesemsanthoshkumar commented on a change in pull request #10343: [WIP] Add extra links for google dataproc

2020-08-17 Thread GitBox
yesemsanthoshkumar commented on a change in pull request #10343: URL: https://github.com/apache/airflow/pull/10343#discussion_r471780005 ## File path: tests/providers/google/cloud/operators/test_dataproc.py ## @@ -419,6 +428,24 @@ def test_execute(self, mock_hook): class

[GitHub] [airflow] turbaszek commented on a change in pull request #10343: [WIP] Add extra links for google dataproc

2020-08-17 Thread GitBox
turbaszek commented on a change in pull request #10343: URL: https://github.com/apache/airflow/pull/10343#discussion_r471766806 ## File path: tests/providers/google/cloud/operators/test_dataproc.py ## @@ -419,6 +428,24 @@ def test_execute(self, mock_hook): class

[airflow-site] branch asf-site updated: Update asf-site to output generated at 8b3b80c

2020-08-17 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 887570e Update asf-site to

[GitHub] [airflow-site] potiuk commented on pull request #282: Add instructions for ading blogs with images

2020-08-17 Thread GitBox
potiuk commented on pull request #282: URL: https://github.com/apache/airflow-site/pull/282#issuecomment-675089066 cc: @ephraimbuddy This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow-site] potiuk opened a new pull request #282: Add instructions for ading blogs with images

2020-08-17 Thread GitBox
potiuk opened a new pull request #282: URL: https://github.com/apache/airflow-site/pull/282 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[airflow-site] branch master updated: Move Ephraim's post to folder to render images properly (#281)

2020-08-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/master by this push: new 8b3b80c Move Ephraim's post to folder to

[GitHub] [airflow-site] potiuk merged pull request #281: Move Ephraim's post to folder to render images properly

2020-08-17 Thread GitBox
potiuk merged pull request #281: URL: https://github.com/apache/airflow-site/pull/281 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow-site] branch add-instructions-for-blogs-with-images created (now 74c1eb2)

2020-08-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch add-instructions-for-blogs-with-images in repository https://gitbox.apache.org/repos/asf/airflow-site.git. at 74c1eb2 Add instructions for ading blogs with images This branch includes

[airflow-site] 01/01: Add instructions for ading blogs with images

2020-08-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch add-instructions-for-blogs-with-images in repository https://gitbox.apache.org/repos/asf/airflow-site.git commit 74c1eb23ad1334792be430225b203ca1cbae57ce Author: Jarek Potiuk AuthorDate: Mon Aug

[GitHub] [airflow] bbenzikry commented on pull request #10023: spark-on-k8s sensor - add driver logs

2020-08-17 Thread GitBox
bbenzikry commented on pull request #10023: URL: https://github.com/apache/airflow/pull/10023#issuecomment-675086606 > Is this log available in another application? Maybe a better solution would be to add a link to another console?

[GitHub] [airflow-site] potiuk commented on pull request #272: airflow for new comers

2020-08-17 Thread GitBox
potiuk commented on pull request #272: URL: https://github.com/apache/airflow-site/pull/272#issuecomment-675085679 Thank @Kaxil. works like a charm ! ![Screenshot from 2020-08-17

[GitHub] [airflow] houqp commented on a change in pull request #10356: add basic auth API auth backend

2020-08-17 Thread GitBox
houqp commented on a change in pull request #10356: URL: https://github.com/apache/airflow/pull/10356#discussion_r471743601 ## File path: airflow/api/auth/backend/basic_auth.py ## @@ -0,0 +1,65 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow-site] potiuk commented on pull request #281: Move Ephraim's post to folder to render images properly

2020-08-17 Thread GitBox
potiuk commented on pull request #281: URL: https://github.com/apache/airflow-site/pull/281#issuecomment-675080899 cc: @ephraimbuddy :) This is an automated message from the Apache Git Service. To respond to the message,

[airflow-site] branch move-ephraim-post-to-folder created (now 632504d)

2020-08-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch move-ephraim-post-to-folder in repository https://gitbox.apache.org/repos/asf/airflow-site.git. at 632504d Move Ephraim's post to folder to render images properly This branch includes

[GitHub] [airflow-site] potiuk opened a new pull request #281: Move Ephraim's post to folder to render images properly

2020-08-17 Thread GitBox
potiuk opened a new pull request #281: URL: https://github.com/apache/airflow-site/pull/281 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[airflow-site] 01/01: Move Ephraim's post to folder to render images properly

2020-08-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch move-ephraim-post-to-folder in repository https://gitbox.apache.org/repos/asf/airflow-site.git commit 632504d1177cd26e53e1bd4684e161ce558669c2 Author: Jarek Potiuk AuthorDate: Mon Aug 17

[GitHub] [airflow] houqp commented on a change in pull request #10356: add basic auth API auth backend

2020-08-17 Thread GitBox
houqp commented on a change in pull request #10356: URL: https://github.com/apache/airflow/pull/10356#discussion_r471740036 ## File path: docs/security.rst ## @@ -160,6 +160,26 @@ look like the following. -H 'Cache-Control: no-cache' \ -H "Authorization:

[GitHub] [airflow] bbenzikry commented on a change in pull request #10023: spark-on-k8s sensor - add driver logs

2020-08-17 Thread GitBox
bbenzikry commented on a change in pull request #10023: URL: https://github.com/apache/airflow/pull/10023#discussion_r471736799 ## File path: airflow/providers/cncf/kubernetes/hooks/kubernetes.py ## @@ -99,19 +97,76 @@ def create_custom_resource_definition(self,

[GitHub] [airflow] kaxil commented on issue #10341: Newly-created DAG is loaded in DB but existing DagBag instances are unable to get the DAG

2020-08-17 Thread GitBox
kaxil commented on issue #10341: URL: https://github.com/apache/airflow/issues/10341#issuecomment-675071337 > @kaxil that would refresh DAGs from the DB only for the process that received the POST request, right? > I think it would still randomly fail when opening the DAG even after

[GitHub] [airflow-site] kaxil commented on pull request #272: airflow for new comers

2020-08-17 Thread GitBox
kaxil commented on pull request #272: URL: https://github.com/apache/airflow-site/pull/272#issuecomment-675070640 I used folder to manage all the dependent files: Example: https://github.com/apache/airflow-site/tree/master/landing-pages/site/content/en/blog/airflow-1.10.10

[GitHub] [airflow-site] mik-laj commented on pull request #272: airflow for new comers

2020-08-17 Thread GitBox
mik-laj commented on pull request #272: URL: https://github.com/apache/airflow-site/pull/272#issuecomment-675070008 @potiuk We use Hugo for content management. It might be helpful for us. https://discourse.gohugo.io/t/solved-how-to-insert-image-in-my-post/1473

[airflow] branch v1-10-test updated: Sort connection type list in add/edit page alphabetically (#8692)

2020-08-17 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v1-10-test by this push: new 8746f52 Sort connection type list

[GitHub] [airflow-site] potiuk commented on pull request #272: airflow for new comers

2020-08-17 Thread GitBox
potiuk commented on pull request #272: URL: https://github.com/apache/airflow-site/pull/272#issuecomment-675065611 Somehow the images are not showing up - so let's wait with promotion  @mik-laj -> how do we add the images to be displayed? Should we move them to static ? And how to

[GitHub] [airflow] shivanshs9 commented on issue #10341: Newly-created DAG is loaded in DB but existing DagBag instances are unable to get the DAG

2020-08-17 Thread GitBox
shivanshs9 commented on issue #10341: URL: https://github.com/apache/airflow/issues/10341#issuecomment-675065066 @kaxil that would refresh DAGs from the DB only for the process that received the POST request, right? I think it would still randomly fail when opening the DAG even after

[GitHub] [airflow] mik-laj commented on pull request #10023: spark-on-k8s sensor - add driver logs

2020-08-17 Thread GitBox
mik-laj commented on pull request #10023: URL: https://github.com/apache/airflow/pull/10023#issuecomment-675061920 Is this log available in another application? Maybe a better solution would be to add a link to another console?

[airflow] branch master updated (dea345b -> 558be73)

2020-08-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from dea345b Fix AwsGlueJobSensor to stop running after the Glue job finished (#9022) add 558be73 Add redbubble

[GitHub] [airflow] potiuk merged pull request #10359: Add redbubble link to Airflow merch

2020-08-17 Thread GitBox
potiuk merged pull request #10359: URL: https://github.com/apache/airflow/pull/10359 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch v1-10-test updated (f487f2f -> 760bcb8)

2020-08-17 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git. from f487f2f Add Changelog for 1.10.12 add 760bcb8 Fix PythonVirtualenvOperator when using

[GitHub] [airflow] mik-laj commented on a change in pull request #10023: spark-on-k8s sensor - add driver logs

2020-08-17 Thread GitBox
mik-laj commented on a change in pull request #10023: URL: https://github.com/apache/airflow/pull/10023#discussion_r471719367 ## File path: airflow/providers/cncf/kubernetes/sensors/spark_kubernetes.py ## @@ -37,38 +39,75 @@ class SparkKubernetesSensor(BaseSensorOperator):

[airflow-site] branch asf-site updated: Update asf-site to output generated at 9db07f5

2020-08-17 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 8df37fd Update asf-site to

[GitHub] [airflow] kaxil closed issue #8177: provide_context=True not working with PythonVirtualenvOperator

2020-08-17 Thread GitBox
kaxil closed issue #8177: URL: https://github.com/apache/airflow/issues/8177 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] kaxil commented on issue #8177: provide_context=True not working with PythonVirtualenvOperator

2020-08-17 Thread GitBox
kaxil commented on issue #8177: URL: https://github.com/apache/airflow/issues/8177#issuecomment-675059404 PR merged, will be part of 1.10.12rc2 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow-site] kaxil commented on pull request #272: airflow for new comers

2020-08-17 Thread GitBox
kaxil commented on pull request #272: URL: https://github.com/apache/airflow-site/pull/272#issuecomment-675058902 Wohoo   This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] mik-laj commented on a change in pull request #10023: spark-on-k8s sensor - add driver logs

2020-08-17 Thread GitBox
mik-laj commented on a change in pull request #10023: URL: https://github.com/apache/airflow/pull/10023#discussion_r471716895 ## File path: airflow/providers/cncf/kubernetes/hooks/kubernetes.py ## @@ -99,19 +97,76 @@ def create_custom_resource_definition(self,

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #8256: updated _write_args on PythonVirtualenvOperator

2020-08-17 Thread GitBox
boring-cyborg[bot] commented on pull request #8256: URL: https://github.com/apache/airflow/pull/8256#issuecomment-675058110 Awesome work, congrats on your first merged pull request! This is an automated message from the

[GitHub] [airflow] kaxil merged pull request #8256: updated _write_args on PythonVirtualenvOperator

2020-08-17 Thread GitBox
kaxil merged pull request #8256: URL: https://github.com/apache/airflow/pull/8256 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[airflow] branch v1-10-stable updated: Fix PythonVirtualenvOperator when using provide_context=True (#8256)

2020-08-17 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch v1-10-stable in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v1-10-stable by this push: new 760bcb8 Fix

[GitHub] [airflow-site] potiuk commented on pull request #272: airflow for new comers

2020-08-17 Thread GitBox
potiuk commented on pull request #272: URL: https://github.com/apache/airflow-site/pull/272#issuecomment-675057319         @kaxil @turbaszek @ephraimbuddy -> once it builds, we can promote it This is an

[airflow-site] branch master updated: airflow for new comers (#272)

2020-08-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/master by this push: new 9db07f5 airflow for new comers (#272)

[GitHub] [airflow-site] potiuk merged pull request #272: airflow for new comers

2020-08-17 Thread GitBox
potiuk merged pull request #272: URL: https://github.com/apache/airflow-site/pull/272 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch v1-10-test updated (1ad6ec4 -> f487f2f)

2020-08-17 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git. omit 1ad6ec4 Fix issue with mounting volumes from secrets This update removed existing revisions from the

[GitHub] [airflow] kaxil opened a new pull request #10366: Fix issue with mounting volumes from secrets

2020-08-17 Thread GitBox
kaxil opened a new pull request #10366: URL: https://github.com/apache/airflow/pull/10366 Previously, we were using the "name" variable to merge or extend items, however this was problematic in volumes generated by secrets as the generated names would not collide leading to duplicate

[GitHub] [airflow] mik-laj commented on issue #10306: Add Kerberos Support for Presto Hook

2020-08-17 Thread GitBox
mik-laj commented on issue #10306: URL: https://github.com/apache/airflow/issues/10306#issuecomment-675045982 Small update: I tried to complete this ticket but couldn't test Airflow with Kerberos because the Kerberos setup in Breeze is not complete. I have a new setup:

[jira] [Commented] (AIRFLOW-3964) Consolidate and de-duplicate sensor tasks

2020-08-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179165#comment-17179165 ] ASF GitHub Bot commented on AIRFLOW-3964: - YingboWang commented on a change in pull request

[GitHub] [airflow] YingboWang commented on a change in pull request #5499: [AIRFLOW-3964][AIP-17] Build smart sensor

2020-08-17 Thread GitBox
YingboWang commented on a change in pull request #5499: URL: https://github.com/apache/airflow/pull/5499#discussion_r471684614 ## File path: airflow/sensors/smart_sensor_operator.py ## @@ -0,0 +1,730 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] mik-laj commented on pull request #10365: Simplified GCSTaskHandler configuration

2020-08-17 Thread GitBox
mik-laj commented on pull request #10365: URL: https://github.com/apache/airflow/pull/10365#issuecomment-675031890 CC: @mhenc This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] mik-laj opened a new pull request #10365: Simplified GCSTaskHandler configuration

2020-08-17 Thread GitBox
mik-laj opened a new pull request #10365: URL: https://github.com/apache/airflow/pull/10365 The change aims to simplify the configuration of logging, to prevent corruption of the instance configuration by changing the value controlled by the user - connection entry. If you configure a

[GitHub] [airflow] kaxil commented on issue #10362: Airflow 1.10.12rc1, KubernetesPodOperator broken with secret & deploy_type "volume"

2020-08-17 Thread GitBox
kaxil commented on issue #10362: URL: https://github.com/apache/airflow/issues/10362#issuecomment-675009686 Awesome, we will create 1.10.12rc2 in an hour This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] jhtimmins commented on issue #10364: Auth backends for new API

2020-08-17 Thread GitBox
jhtimmins commented on issue #10364: URL: https://github.com/apache/airflow/issues/10364#issuecomment-675008767 @houqp That's awesome! I don't care who does the work I'm just glad it's getting done :) @mik-laj I think this is good for now. If we need to add additional schemes in

[GitHub] [airflow] jhtimmins closed issue #10364: Auth backends for new API

2020-08-17 Thread GitBox
jhtimmins closed issue #10364: URL: https://github.com/apache/airflow/issues/10364 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] FloChehab commented on issue #10362: Airflow 1.10.12rc1, KubernetesPodOperator broken with secret & deploy_type "volume"

2020-08-17 Thread GitBox
FloChehab commented on issue #10362: URL: https://github.com/apache/airflow/issues/10362#issuecomment-675008416 The fix has solved this particular issue @dimberman ! Thanks This is an automated message from the Apache Git

[GitHub] [airflow] yesemsanthoshkumar commented on a change in pull request #10343: [WIP] Add extra links for google dataproc

2020-08-17 Thread GitBox
yesemsanthoshkumar commented on a change in pull request #10343: URL: https://github.com/apache/airflow/pull/10343#discussion_r471629234 ## File path: tests/providers/google/cloud/operators/test_dataproc.py ## @@ -763,6 +854,23 @@ class

[GitHub] [airflow] yesemsanthoshkumar commented on a change in pull request #10343: [WIP] Add extra links for google dataproc

2020-08-17 Thread GitBox
yesemsanthoshkumar commented on a change in pull request #10343: URL: https://github.com/apache/airflow/pull/10343#discussion_r471627286 ## File path: tests/providers/google/cloud/operators/test_dataproc.py ## @@ -590,7 +681,7 @@ def test_execute(self, mock_hook, mock_uuid):

[GitHub] [airflow] yesemsanthoshkumar commented on a change in pull request #10343: [WIP] Add extra links for google dataproc

2020-08-17 Thread GitBox
yesemsanthoshkumar commented on a change in pull request #10343: URL: https://github.com/apache/airflow/pull/10343#discussion_r471626971 ## File path: tests/providers/google/cloud/operators/test_dataproc.py ## @@ -453,6 +480,70 @@ def test_execute(self, mock_hook):

[GitHub] [airflow] yesemsanthoshkumar commented on a change in pull request #10343: [WIP] Add extra links for google dataproc

2020-08-17 Thread GitBox
yesemsanthoshkumar commented on a change in pull request #10343: URL: https://github.com/apache/airflow/pull/10343#discussion_r471624064 ## File path: tests/providers/google/cloud/operators/test_dataproc.py ## @@ -419,6 +428,24 @@ def test_execute(self, mock_hook): class

[GitHub] [airflow] yesemsanthoshkumar commented on a change in pull request #10343: [WIP] Add extra links for google dataproc

2020-08-17 Thread GitBox
yesemsanthoshkumar commented on a change in pull request #10343: URL: https://github.com/apache/airflow/pull/10343#discussion_r471618635 ## File path: airflow/providers/google/cloud/operators/dataproc.py ## @@ -1704,6 +1743,8 @@ def execute(self, context: Dict): )

[GitHub] [airflow] yesemsanthoshkumar commented on a change in pull request #10343: [WIP] Add extra links for google dataproc

2020-08-17 Thread GitBox
yesemsanthoshkumar commented on a change in pull request #10343: URL: https://github.com/apache/airflow/pull/10343#discussion_r471617008 ## File path: tests/providers/google/cloud/operators/test_dataproc.py ## @@ -453,6 +477,50 @@ def test_execute(self, mock_hook):

[GitHub] [airflow] yesemsanthoshkumar commented on a change in pull request #10343: [WIP] Add extra links for google dataproc

2020-08-17 Thread GitBox
yesemsanthoshkumar commented on a change in pull request #10343: URL: https://github.com/apache/airflow/pull/10343#discussion_r471616705 ## File path: tests/providers/google/cloud/operators/test_dataproc.py ## @@ -453,6 +477,50 @@ def test_execute(self, mock_hook):

  1   2   3   >