[GitHub] [airflow] malthe commented on pull request #17576: Add pre/post execution hooks

2021-08-12 Thread GitBox
malthe commented on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-898216061 @potiuk in `BaseOperator.get_serialized_fields` I see for example "_upstream_task_ids" but not "_downstream_task_ids". What's the logic? And do I need to add these new `_

[GitHub] [airflow] rchangj removed a comment on issue #17558: New job fail immediately after start, no logs

2021-08-12 Thread GitBox
rchangj removed a comment on issue #17558: URL: https://github.com/apache/airflow/issues/17558#issuecomment-898195873 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [airflow] roestzwiee edited a comment on issue #15340: helm install airflow in namespace get error: File "", line 32, in TimeoutError: There are still unapplied migrations af

2021-08-12 Thread GitBox
roestzwiee edited a comment on issue #15340: URL: https://github.com/apache/airflow/issues/15340#issuecomment-897729319 tldr; @autarchprinceps I'm having the same trouble here. When deploying the chart to our local machines all runs fine. But deploying the chart to our cluster us

[GitHub] [airflow] rchangj commented on issue #17558: New job fail immediately after start, no logs

2021-08-12 Thread GitBox
rchangj commented on issue #17558: URL: https://github.com/apache/airflow/issues/17558#issuecomment-898201909 Providers info: apache-airflow-providers-amazon==2.1.0 apache-airflow-providers-apache-hdfs==2.0.0 apache-airflow-providers-ftp==2.0.0 apache-airflow-providers-imap==2.0.

[GitHub] [airflow] rchangj commented on issue #17558: New job fail immediately after start, no logs

2021-08-12 Thread GitBox
rchangj commented on issue #17558: URL: https://github.com/apache/airflow/issues/17558#issuecomment-898195873 Hi, I updated to the latest airflow 2.1.2. I got this error: Python version: 3.7.10 Airflow version: 2.1.2 Node: ip-10-77-52-33.vpc.internal

[airflow] branch constraints-2-1 updated: Updating constraints. Build id:1112181300

2021-08-12 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-2-1 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-1 by this push: new d2c6feb Updating constra

[GitHub] [airflow] ferruzzi commented on a change in pull request #16571: Implemented Basic EKS Integration

2021-08-12 Thread GitBox
ferruzzi commented on a change in pull request #16571: URL: https://github.com/apache/airflow/pull/16571#discussion_r688203241 ## File path: airflow/providers/amazon/aws/hooks/eks.py ## @@ -0,0 +1,420 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more c

[GitHub] [airflow] mik-laj commented on pull request #17591: Use gunicorn to serve logs generated by worker

2021-08-12 Thread GitBox
mik-laj commented on pull request #17591: URL: https://github.com/apache/airflow/pull/17591#issuecomment-898119170 @potiuk @kaxil Updated PR description. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [airflow-client-python] byingyang opened a new issue #28: Pools API broken using airflow 2.1.2

2021-08-12 Thread GitBox
byingyang opened a new issue #28: URL: https://github.com/apache/airflow-client-python/issues/28 Calling `pool_client.get_pools()` I get this error: ``` Invalid inputs given to generate an instance of 'PoolCollectionAllOf'. The input data was invalid for the allOf schema 'PoolColl

[GitHub] [airflow] yuqian90 commented on a change in pull request #17578: Improve validation of Group id

2021-08-12 Thread GitBox
yuqian90 commented on a change in pull request #17578: URL: https://github.com/apache/airflow/pull/17578#discussion_r688197269 ## File path: airflow/utils/task_group.py ## @@ -94,10 +95,15 @@ def __init__( self.used_group_ids: Set[Optional[str]] = set()

[GitHub] [airflow] ShakaibKhan commented on pull request #15385: Added table to view providers in airflow ui under admin tab

2021-08-12 Thread GitBox
ShakaibKhan commented on pull request #15385: URL: https://github.com/apache/airflow/pull/15385#issuecomment-898104022 Failing the static check "Don't use safe in templates". I was wondering if there was another way to render html passed to a template? -- This is an automated message fro

[GitHub] [airflow] github-actions[bot] commented on pull request #17595: Remove redundant note on HTTP Provider

2021-08-12 Thread GitBox
github-actions[bot] commented on pull request #17595: URL: https://github.com/apache/airflow/pull/17595#issuecomment-898098453 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and tak

[GitHub] [airflow] github-actions[bot] commented on pull request #17598: Add more ``project_urls`` for PyPI

2021-08-12 Thread GitBox
github-actions[bot] commented on pull request #17598: URL: https://github.com/apache/airflow/pull/17598#issuecomment-898097947 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and tak

[GitHub] [airflow] github-actions[bot] commented on pull request #17596: Bump `mysql-connector-python` to latest version

2021-08-12 Thread GitBox
github-actions[bot] commented on pull request #17596: URL: https://github.com/apache/airflow/pull/17596#issuecomment-898094315 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and tak

[GitHub] [airflow] BenjaminNMitchell commented on issue #15536: Get rid of state in Apache Beam provider hook

2021-08-12 Thread GitBox
BenjaminNMitchell commented on issue #15536: URL: https://github.com/apache/airflow/issues/15536#issuecomment-898089706 Hey looks like this issue is open still, I can take a crack at it (First PR) -- This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [airflow] kaxil opened a new pull request #17598: Add more ``project_urls`` for PyPI

2021-08-12 Thread GitBox
kaxil opened a new pull request #17598: URL: https://github.com/apache/airflow/pull/17598 This adds more of our urls for display on PyPI similar to ![image](https://user-images.githubusercontent.com/8811558/129288728-1d6e2365-0bba-436f-a822-b2afb3b06369.png) ---

[GitHub] [airflow] andrewgodwin commented on pull request #17565: Add Triggerer warning banner in UI

2021-08-12 Thread GitBox
andrewgodwin commented on pull request #17565: URL: https://github.com/apache/airflow/pull/17565#issuecomment-898073795 It is not _mandatory_ - you only need to run it if you plan to use Deferrable Operators. That's why this PR only shows the warning if it's not running _and_ you have trig

[GitHub] [airflow] Sonins edited a comment on pull request #17428: Fix elasticsearch-secret template port default function

2021-08-12 Thread GitBox
Sonins edited a comment on pull request #17428: URL: https://github.com/apache/airflow/pull/17428#issuecomment-898034985 Thanks for your suggest, @jedcunningham. The reason of static-check failure was formatting problem. -- This is an automated message from the Apache Git Service. To res

[GitHub] [airflow] kaxil merged pull request #17501: Simplify 404 page

2021-08-12 Thread GitBox
kaxil merged pull request #17501: URL: https://github.com/apache/airflow/pull/17501 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[airflow] branch main updated (7b4ce7b -> 2092988)

2021-08-12 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 7b4ce7b Run more than just basic checks on ``.pre-commit-config.yaml`` change (#17590) add 2092988 Simplify

[GitHub] [airflow] kaxil closed issue #10549: option to disable "lots of circles" in error page

2021-08-12 Thread GitBox
kaxil closed issue #10549: URL: https://github.com/apache/airflow/issues/10549 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[GitHub] [airflow] VLADPOLUNIN commented on issue #17582: DAG trigger with config params visualisation with proper deserialisation

2021-08-12 Thread GitBox
VLADPOLUNIN commented on issue #17582: URL: https://github.com/apache/airflow/issues/17582#issuecomment-898070411 > Thanks for opening your first issue here! Be sure to follow the issue template! > Hi -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] VLADPOLUNIN commented on issue #17582: DAG trigger with config params visualisation with proper deserialisation

2021-08-12 Thread GitBox
VLADPOLUNIN commented on issue #17582: URL: https://github.com/apache/airflow/issues/17582#issuecomment-898069899 Спасибо -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [airflow] kaxil opened a new pull request #17597: Use built-in ``cached_property`` on Python 3.8 for Asana provider

2021-08-12 Thread GitBox
kaxil opened a new pull request #17597: URL: https://github.com/apache/airflow/pull/17597 Functionality is the same, this just removes one dep for Py 3.8+ --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airfl

[GitHub] [airflow] potiuk commented on pull request #17591: Use gunicorn to serve logs generated by worker

2021-08-12 Thread GitBox
potiuk commented on pull request #17591: URL: https://github.com/apache/airflow/pull/17591#issuecomment-898066957 > Can you explain a bit more about this change, why do we need it? Yeah. Agree with @kaxil I figured it is after seeing this slack conversation: https://apache-airflow.

[GitHub] [airflow] kaxil opened a new pull request #17596: Bump `mysql-connector-python` to latest version

2021-08-12 Thread GitBox
kaxil opened a new pull request #17596: URL: https://github.com/apache/airflow/pull/17596 mysql-connector-python 8.0.26 is available and there is no reason ti limit the minor and patch versions for it. --- **^ Add meaningful description above** Read the **[Pull Requ

[GitHub] [airflow] kaxil opened a new pull request #17595: Remove redundant note on HTTP Provider

2021-08-12 Thread GitBox
kaxil opened a new pull request #17595: URL: https://github.com/apache/airflow/pull/17595 Since https://github.com/apache/airflow/pull/16974 we have switched back to including HTTP provider and this comment now is not correct. --- **^ Add meaningful description above**

[GitHub] [airflow] kaxil opened a new pull request #17594: Remove redundant ``numpy`` dependency

2021-08-12 Thread GitBox
kaxil opened a new pull request #17594: URL: https://github.com/apache/airflow/pull/17594 Missed removing ``numpy`` from `setup.cfg` in https://github.com/apache/airflow/pull/17575. It was only added in setup.cfg in https://github.com/apache/airflow/pull/15209/files#diff-380c6a8ebbbce17d55

[GitHub] [airflow] kaxil opened a new pull request #17593: Remove upper-limit on ``tenacity``

2021-08-12 Thread GitBox
kaxil opened a new pull request #17593: URL: https://github.com/apache/airflow/pull/17593 The latest version of tenacity (8.0.1) looks compatible with Airflow. --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/

[GitHub] [airflow] kaxil edited a comment on pull request #17565: Add Triggerer warning banner in UI

2021-08-12 Thread GitBox
kaxil edited a comment on pull request #17565: URL: https://github.com/apache/airflow/pull/17565#issuecomment-898057148 > I guess "Triggerer" is now mandatory component, that should always be running? > > If that's the case we should also add "triggerer" as another tmux screen in `s

[GitHub] [airflow] kaxil commented on pull request #17565: Add Triggerer warning banner in UI

2021-08-12 Thread GitBox
kaxil commented on pull request #17565: URL: https://github.com/apache/airflow/pull/17565#issuecomment-898057148 > I guess "Triggerer" is now mandatory component, that should always be running? > > If that's the case we should also add "triggerer" as another tmux screen in `start-ai

[airflow] branch main updated (60ddcd1 -> 7b4ce7b)

2021-08-12 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 60ddcd1 Rescue if a DagRun's DAG was removed from db (#17544) add 7b4ce7b Run more than just basic checks on `

[GitHub] [airflow] potiuk merged pull request #17590: Run more than just basic checks on ``.pre-commit-config.yaml`` change

2021-08-12 Thread GitBox
potiuk merged pull request #17590: URL: https://github.com/apache/airflow/pull/17590 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [airflow] potiuk commented on pull request #17565: Add Triggerer warning banner in UI

2021-08-12 Thread GitBox
potiuk commented on pull request #17565: URL: https://github.com/apache/airflow/pull/17565#issuecomment-898056168 I guess "Triggerer" is now mandatory component, that should always be running? If that's the case we should also add "triggerer" as another tmux screen in `start-airflo

[GitHub] [airflow] potiuk commented on issue #17219: sqlite3.OperationalError: no such column: variable.description

2021-08-12 Thread GitBox
potiuk commented on issue #17219: URL: https://github.com/apache/airflow/issues/17219#issuecomment-898054605 > It is happening also on docker container from image: airflow 2.1.2, which I try to run with default sqlite db of airflow. I just run the airflow db init, airflow scheduler and air

[GitHub] [airflow] github-actions[bot] commented on pull request #12925: [Loki log handler] - Integration with Grafana Loki

2021-08-12 Thread GitBox
github-actions[bot] commented on pull request #12925: URL: https://github.com/apache/airflow/pull/12925#issuecomment-898053846 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank y

[GitHub] [airflow] github-actions[bot] commented on issue #16344: Tried to upgrade to Airflow 2.1.0

2021-08-12 Thread GitBox
github-actions[bot] commented on issue #16344: URL: https://github.com/apache/airflow/issues/16344#issuecomment-898053797 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] github-actions[bot] closed issue #16344: Tried to upgrade to Airflow 2.1.0

2021-08-12 Thread GitBox
github-actions[bot] closed issue #16344: URL: https://github.com/apache/airflow/issues/16344 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commi

[GitHub] [airflow] potiuk commented on pull request #17561: Simplify bug report template

2021-08-12 Thread GitBox
potiuk commented on pull request #17561: URL: https://github.com/apache/airflow/pull/17561#issuecomment-898050004 Applied comments :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] dinigo commented on pull request #17592: Support for passing arguments to SqlSensor underlying hooks

2021-08-12 Thread GitBox
dinigo commented on pull request #17592: URL: https://github.com/apache/airflow/pull/17592#issuecomment-898049600 `mypy` pre-commit hook is having some issue when trying to pull airflow image. I don't know why because breeze works fine. I just disabled it for this commit to be able to pre-

[GitHub] [airflow] dinigo opened a new pull request #17592: Support for passing arguments to SqlSensor underlying hooks

2021-08-12 Thread GitBox
dinigo opened a new pull request #17592: URL: https://github.com/apache/airflow/pull/17592 closes: #13750 related: #17315 `SqlSensor` relies on underlying hooks that are automatically injected (DI) depending on the connection type provided to the `SqlSensor`. However, from time t

[GitHub] [airflow] potiuk commented on pull request #17561: Simplify bug report template

2021-08-12 Thread GitBox
potiuk commented on pull request #17561: URL: https://github.com/apache/airflow/pull/17561#issuecomment-898047868 > LGTM. I wonder if we should add a “are you interested in submitting a PR to fix this” question like we do in the feature request template. I’ve been in many situations the re

[GitHub] [airflow] potiuk edited a comment on issue #17584: Replace constraints file requirement with `pyproject.toml` version rules

2021-08-12 Thread GitBox
potiuk edited a comment on issue #17584: URL: https://github.com/apache/airflow/issues/17584#issuecomment-898045025 Yeah. Constraints are mechanism which is applied at install time only (and they are not persisted after airflow is installed), there are no mechanism in pyproject.toml that c

[airflow] branch main updated (e69c6a7 -> 60ddcd1)

2021-08-12 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from e69c6a7 fix: filter condition of TaskInstance does not work #17535 (#17548) add 60ddcd1 Rescue if a DagRun'

[GitHub] [airflow] kaxil merged pull request #17544: Rescue if a DagRun's DAG was removed from db

2021-08-12 Thread GitBox
kaxil merged pull request #17544: URL: https://github.com/apache/airflow/pull/17544 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] kaxil closed issue #17442: Deleted DAG raises SerializedDagNotFound exception when accessing webserver

2021-08-12 Thread GitBox
kaxil closed issue #17442: URL: https://github.com/apache/airflow/issues/17442 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[GitHub] [airflow] potiuk closed issue #17584: Replace constraints file requirement with `pyproject.toml` version rules

2021-08-12 Thread GitBox
potiuk closed issue #17584: URL: https://github.com/apache/airflow/issues/17584 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[GitHub] [airflow] potiuk commented on issue #17584: Replace constraints file requirement with `pyproject.toml` version rules

2021-08-12 Thread GitBox
potiuk commented on issue #17584: URL: https://github.com/apache/airflow/issues/17584#issuecomment-898045025 Yeah. Constraints are mechanism which is applied at install time only, there are no mechanism in pyproject.toml that can provide anything like that. The reasons why we are using con

[GitHub] [airflow] kaxil merged pull request #17548: fix: filter condition of taskinstance does not work #17535

2021-08-12 Thread GitBox
kaxil merged pull request #17548: URL: https://github.com/apache/airflow/pull/17548 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] kaxil closed issue #17535: the filter condition of taskinstance does not work

2021-08-12 Thread GitBox
kaxil closed issue #17535: URL: https://github.com/apache/airflow/issues/17535 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[airflow] branch main updated: fix: filter condition of TaskInstance does not work #17535 (#17548)

2021-08-12 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new e69c6a7 fix: filter condition of TaskInstance d

[airflow] branch main updated: Document overriding ``XCom.clear`` for data lifecycle management (#17589)

2021-08-12 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 113bfdf Document overriding ``XCom.clear`` for

[GitHub] [airflow] kaxil merged pull request #17589: Document overriding ``XCom.clear`` for data lifecycle management

2021-08-12 Thread GitBox
kaxil merged pull request #17589: URL: https://github.com/apache/airflow/pull/17589 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] mik-laj commented on a change in pull request #17591: Use gunicorn to serve logs generated by worker

2021-08-12 Thread GitBox
mik-laj commented on a change in pull request #17591: URL: https://github.com/apache/airflow/pull/17591#discussion_r688148321 ## File path: airflow/utils/serve_logs.py ## @@ -19,15 +19,16 @@ import os import time +import gunicorn.app.base from flask import Flask, abort, re

[GitHub] [airflow] github-actions[bot] commented on pull request #17589: Document overriding ``XCom.clear`` for data lifecycle management

2021-08-12 Thread GitBox
github-actions[bot] commented on pull request #17589: URL: https://github.com/apache/airflow/pull/17589#issuecomment-898039736 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide

[GitHub] [airflow] mik-laj commented on a change in pull request #17591: Use gunicorn to serve logs generated by worker

2021-08-12 Thread GitBox
mik-laj commented on a change in pull request #17591: URL: https://github.com/apache/airflow/pull/17591#discussion_r688147883 ## File path: airflow/utils/serve_logs.py ## @@ -19,15 +19,16 @@ import os import time +import gunicorn.app.base from flask import Flask, abort, re

[GitHub] [airflow] mik-laj opened a new pull request #17591: Use gunicorn to serve logs generated by worker

2021-08-12 Thread GitBox
mik-laj opened a new pull request #17591: URL: https://github.com/apache/airflow/pull/17591 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more inf

[GitHub] [airflow] Sonins commented on pull request #17428: Fix elasticsearch-secret template port default function

2021-08-12 Thread GitBox
Sonins commented on pull request #17428: URL: https://github.com/apache/airflow/pull/17428#issuecomment-898034985 Thanks for your suggest, @jedcunningham. Static-check failure is because of formatting problem. -- This is an automated message from the Apache Git Service. To respond to the

[airflow-ci-infra] 01/01: Merge pull request #37 from apache/disable-packer-role

2021-08-12 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-ci-infra.git commit 006f8b63f9f7d551cdf1015f8b768b1c4c86a0be Merge: 204fefc c42270b Author: Jarek Potiuk AuthorDate: Fri Aug 13 01:1

[airflow-ci-infra] branch main updated (204fefc -> 006f8b6)

2021-08-12 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow-ci-infra.git. from 204fefc Update runner version add 2939550 Remove unnecessary packer role setting add c42270b Upd

[GitHub] [airflow-ci-infra] potiuk merged pull request #37: Remove unnecessary packer role setting

2021-08-12 Thread GitBox
potiuk merged pull request #37: URL: https://github.com/apache/airflow-ci-infra/pull/37 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-un

[airflow] branch main updated (2c26b15 -> 8b03d9d)

2021-08-12 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 2c26b15 Make `pandas` an optional core dependency (#17575) add 8b03d9d Fixed long delays in the Temporal tri

[GitHub] [airflow] kaxil merged pull request #17564: Fixed long delays never returning in DateTimeTrigger

2021-08-12 Thread GitBox
kaxil merged pull request #17564: URL: https://github.com/apache/airflow/pull/17564 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[airflow] branch main updated: Make `pandas` an optional core dependency (#17575)

2021-08-12 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 2c26b15 Make `pandas` an optional core dependen

[GitHub] [airflow] kaxil closed issue #12500: Investigate removing pandas dependency from Core Airflow

2021-08-12 Thread GitBox
kaxil closed issue #12500: URL: https://github.com/apache/airflow/issues/12500 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[GitHub] [airflow] kaxil merged pull request #17575: Make `pandas` an optional core dependency

2021-08-12 Thread GitBox
kaxil merged pull request #17575: URL: https://github.com/apache/airflow/pull/17575 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[airflow-ci-infra] branch disable-packer-role updated (2939550 -> c42270b)

2021-08-12 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch disable-packer-role in repository https://gitbox.apache.org/repos/asf/airflow-ci-infra.git. from 2939550 Remove unnecessary packer role setting add c42270b Update github-runner-ami/pac

[GitHub] [airflow] potiuk commented on pull request #17576: Add pre/post execution hooks

2021-08-12 Thread GitBox
potiuk commented on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-898029293 LGTM - but serialisation needs to be updated to skip those new fields (tests are failing). -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [airflow] potiuk commented on pull request #17576: Add pre/post execution hooks

2021-08-12 Thread GitBox
potiuk commented on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-898028425 > Is the goal of this PR to replace & generalize this use case or the real issue you are trying to solve is something else ? Something completely different. Pre/postopera

[GitHub] [airflow] potiuk commented on pull request #17578: Improve validation of Group id

2021-08-12 Thread GitBox
potiuk commented on pull request #17578: URL: https://github.com/apache/airflow/pull/17578#issuecomment-898022942 I simipliifed it even more. The return bool value from both "validate" commands were never used and False was never returned, so I removed them -- This is an automated messag

[airflow-site] branch gh-pages updated: Deploying to gh-pages from @ 62a01511ee7fe567ed7be9b12e91b49db442b9a3 🚀

2021-08-12 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch gh-pages in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/gh-pages by this push: new 6238718 Deploying to gh-pages fro

[GitHub] [airflow-site] kaxil merged pull request #465: Remove temporary banner promoting Airflow Summit

2021-08-12 Thread GitBox
kaxil merged pull request #465: URL: https://github.com/apache/airflow-site/pull/465 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[airflow-site] branch main updated: Revert "Add temporary banner to promote Airflow Summit (#403)" (#465)

2021-08-12 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/main by this push: new 62a0151 Revert "Add temporary banner to pr

[GitHub] [airflow-site] ryanahamilton opened a new pull request #465: Remove temporary banner promoting Airflow Summit

2021-08-12 Thread GitBox
ryanahamilton opened a new pull request #465: URL: https://github.com/apache/airflow-site/pull/465 This reverts commit 3cc2089e59754b4c51a6a5b3dd93b2286ae85dfb introduced in #403. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [airflow] kaxil opened a new pull request #17590: Run more than just basic checks on ``.pre-commit-config.yaml`` change

2021-08-12 Thread GitBox
kaxil opened a new pull request #17590: URL: https://github.com/apache/airflow/pull/17590 https://github.com/apache/airflow/pull/17530 only run basic checks and skipped mypy, black etc which can cause failing main branch. --- **^ Add meaningful description above** R

[GitHub] [airflow] ShakaibKhan commented on issue #17476: Sensitive variables don't get masked when rendered with airflow tasks test

2021-08-12 Thread GitBox
ShakaibKhan commented on issue #17476: URL: https://github.com/apache/airflow/issues/17476#issuecomment-897996155 I can taking a look into this. Will try to reproduce. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [airflow] kaxil opened a new pull request #17589: Document overriding XCom.clear for data lifecycle management

2021-08-12 Thread GitBox
kaxil opened a new pull request #17589: URL: https://github.com/apache/airflow/pull/17589 This was added in https://github.com/apache/airflow/pull/17405 but was not documented --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://g

[GitHub] [airflow] repocho commented on pull request #17537: Extend init_containers defined in pod_override

2021-08-12 Thread GitBox
repocho commented on pull request #17537: URL: https://github.com/apache/airflow/pull/17537#issuecomment-897993920 Thanks @jedcunningham, I have merged your suggestions and launched the tests again with success. ``` tests/kubernetes/test_pod_generator.py::TestPodGenerator::test_reco

[GitHub] [airflow] jedcunningham commented on a change in pull request #17537: Extend init_containers defined in pod_override

2021-08-12 Thread GitBox
jedcunningham commented on a change in pull request #17537: URL: https://github.com/apache/airflow/pull/17537#discussion_r688107979 ## File path: tests/kubernetes/test_pod_generator.py ## @@ -631,6 +631,15 @@ def test_reconcile_specs(self): client_spec.active_deadline_

[GitHub] [airflow] jedcunningham commented on a change in pull request #17561: Simplify bug report template

2021-08-12 Thread GitBox
jedcunningham commented on a change in pull request #17561: URL: https://github.com/apache/airflow/pull/17561#discussion_r688103335 ## File path: .github/ISSUE_TEMPLATE/bug_report.md ## @@ -8,89 +8,48 @@ assignees: '' --- - - **Apache Airflow version**: -**Apache Airf

[airflow] branch main updated: Doc: Fix docstrings for ``MongoToS3Operator`` (#17588)

2021-08-12 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new e7eeaa6 Doc: Fix docstrings for ``MongoToS3Oper

[GitHub] [airflow] kaxil merged pull request #17588: Doc: Fix docstrings for ``MongoToS3Operator``

2021-08-12 Thread GitBox
kaxil merged pull request #17588: URL: https://github.com/apache/airflow/pull/17588 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] jedcunningham commented on a change in pull request #17578: Improve validation of Group id

2021-08-12 Thread GitBox
jedcunningham commented on a change in pull request #17578: URL: https://github.com/apache/airflow/pull/17578#discussion_r688087786 ## File path: airflow/utils/helpers.py ## @@ -56,6 +57,21 @@ def validate_key(k: str, max_length: int = 250) -> bool: return True +de

[GitHub] [airflow] github-actions[bot] commented on pull request #17548: fix: filter condition of taskinstance does not work #17535

2021-08-12 Thread GitBox
github-actions[bot] commented on pull request #17548: URL: https://github.com/apache/airflow/pull/17548#issuecomment-897975388 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not m

[GitHub] [airflow] kaxil closed pull request #17548: fix: filter condition of taskinstance does not work #17535

2021-08-12 Thread GitBox
kaxil closed pull request #17548: URL: https://github.com/apache/airflow/pull/17548 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] kaxil commented on issue #17583: Helm Chart Doc Links Broken

2021-08-12 Thread GitBox
kaxil commented on issue #17583: URL: https://github.com/apache/airflow/issues/17583#issuecomment-897973647 https://github.com/apache/airflow/commit/3650448301d3b2a31a4996e035f1b325148c8639 should fix it too I think -- This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] barun-mazumdar edited a comment on issue #17219: sqlite3.OperationalError: no such column: variable.description

2021-08-12 Thread GitBox
barun-mazumdar edited a comment on issue #17219: URL: https://github.com/apache/airflow/issues/17219#issuecomment-897936597 It is happening also on docker container from image: airflow 2.1.2, which I try to run with default sqlite db of airflow. I just run the airflow db init, airflow sche

[GitHub] [airflow] github-actions[bot] commented on pull request #17588: Doc: Fix docstrings for ``MongoToS3Operator``

2021-08-12 Thread GitBox
github-actions[bot] commented on pull request #17588: URL: https://github.com/apache/airflow/pull/17588#issuecomment-897968047 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not m

[GitHub] [airflow] github-actions[bot] commented on pull request #17564: Fixed long delays never returning in DateTimeTrigger

2021-08-12 Thread GitBox
github-actions[bot] commented on pull request #17564: URL: https://github.com/apache/airflow/pull/17564#issuecomment-897967887 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and tak

[GitHub] [airflow] kaxil opened a new pull request #17588: Doc: Fix docstrings for ``MongoToS3Operator``

2021-08-12 Thread GitBox
kaxil opened a new pull request #17588: URL: https://github.com/apache/airflow/pull/17588 The doc was missing closing parentheses and had markdown formatted in-line code-block instead of rst one --- **^ Add meaningful description above** Read the **[Pull Request Gu

[airflow] branch main updated (9875757 -> b9109f8)

2021-08-12 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 9875757 Add Mongo projections to hook and transfer (#17379) add b9109f8 Chart: Support ``extraContainers`` i

[GitHub] [airflow] kaxil merged pull request #17562: Chart: Support extraContainers in k8s workers

2021-08-12 Thread GitBox
kaxil merged pull request #17562: URL: https://github.com/apache/airflow/pull/17562 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] eladkal commented on issue #17555: Cannot enter in localhost:8080

2021-08-12 Thread GitBox
eladkal commented on issue #17555: URL: https://github.com/apache/airflow/issues/17555#issuecomment-897955206 Please use Stackoverflow / Slack for support. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] eladkal closed issue #17555: Cannot enter in localhost:8080

2021-08-12 Thread GitBox
eladkal closed issue #17555: URL: https://github.com/apache/airflow/issues/17555 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr.

[GitHub] [airflow] kaxil commented on pull request #17575: Make `pandas` an optional core dependency

2021-08-12 Thread GitBox
kaxil commented on pull request #17575: URL: https://github.com/apache/airflow/pull/17575#issuecomment-897945427 https://github.com/apache/airflow/pull/17575/commits/398ebfe0a7e36b8195801d4a3b79cf335facaae1 should make numpy optional as well -- This is an automated message from the Apac

[GitHub] [airflow] kaxil commented on a change in pull request #17575: Make `pandas` an optional core dependency

2021-08-12 Thread GitBox
kaxil commented on a change in pull request #17575: URL: https://github.com/apache/airflow/pull/17575#discussion_r688053575 ## File path: setup.py ## @@ -395,6 +395,11 @@ def write_version(filename: str = os.path.join(*[my_dir, "airflow", "git_version pagerduty = [ 'pdpy

[GitHub] [airflow] barun-mazumdar commented on issue #17219: sqlite3.OperationalError: no such column: variable.description

2021-08-12 Thread GitBox
barun-mazumdar commented on issue #17219: URL: https://github.com/apache/airflow/issues/17219#issuecomment-897936597 It is happening also on docker container from image: airflow 2.1.2, which I try to run with default sqlite db of airflow. I just run the airflow db init, airflow scheduler a

[GitHub] [airflow] barun-mazumdar removed a comment on issue #17219: sqlite3.OperationalError: no such column: variable.description

2021-08-12 Thread GitBox
barun-mazumdar removed a comment on issue #17219: URL: https://github.com/apache/airflow/issues/17219#issuecomment-897769421 It happening also on docker container from image: airflow 2.1.2, which I try to run with default sqlite db of airflow. I just run the airflow db init, airflow sched

[GitHub] [airflow] barun-mazumdar edited a comment on issue #17219: sqlite3.OperationalError: no such column: variable.description

2021-08-12 Thread GitBox
barun-mazumdar edited a comment on issue #17219: URL: https://github.com/apache/airflow/issues/17219#issuecomment-897769421 It happening also on docker container from image: airflow 2.1.2, which I try to run with default sqlite db of airflow. I just run the airflow db init, airflow schedu

[GitHub] [airflow] jedcunningham commented on pull request #15385: Added table to view providers in airflow ui under admin tab

2021-08-12 Thread GitBox
jedcunningham commented on pull request #15385: URL: https://github.com/apache/airflow/pull/15385#issuecomment-897927155 @ShakaibKhan, looks there is both a static check failure and an import error in your test. Can you take a look at those? Thanks. -- This is an automated message from t

  1   2   3   >