[GitHub] [airflow] uranusjr closed pull request #17414: Allow custom timetable as a DAG argument

2021-08-06 Thread GitBox
uranusjr closed pull request #17414: URL: https://github.com/apache/airflow/pull/17414 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #17480: Ask for provider versions in bug reports

2021-08-06 Thread GitBox
github-actions[bot] commented on pull request #17480: URL: https://github.com/apache/airflow/pull/17480#issuecomment-894604023 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide

[GitHub] [airflow] github-actions[bot] closed pull request #15195: Fix dag sort in dag stats

2021-08-06 Thread GitBox
github-actions[bot] closed pull request #15195: URL: https://github.com/apache/airflow/pull/15195 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #16446: Use resource and action names in test_security.py.

2021-08-06 Thread GitBox
github-actions[bot] commented on pull request #16446: URL: https://github.com/apache/airflow/pull/16446#issuecomment-894572692 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank

[GitHub] [airflow] github-actions[bot] closed pull request #16482: Solution proposal for #16481

2021-08-06 Thread GitBox
github-actions[bot] closed pull request #16482: URL: https://github.com/apache/airflow/pull/16482 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17481: Execution date is in future

2021-08-06 Thread GitBox
boring-cyborg[bot] commented on issue #17481: URL: https://github.com/apache/airflow/issues/17481#issuecomment-894570918 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] thaysa opened a new issue #17481: Execution date is in future

2021-08-06 Thread GitBox
thaysa opened a new issue #17481: URL: https://github.com/apache/airflow/issues/17481 **Apache Airflow version**: 2.1.2 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): 1.19.6 **Environment**: On-premise Cluster Official Docker

[GitHub] [airflow] jedcunningham opened a new pull request #17480: Ask for provider versions in bug reports

2021-08-06 Thread GitBox
jedcunningham opened a new pull request #17480: URL: https://github.com/apache/airflow/pull/17480 We get a lot of bug reports for providers, and it's rare that the versions being used are in the initial report. Let's ask for them. -- This is an automated message from the Apache Git

[GitHub] [airflow] jedcunningham commented on issue #17443: No link for kibana when using frontend configuration

2021-08-06 Thread GitBox
jedcunningham commented on issue #17443: URL: https://github.com/apache/airflow/issues/17443#issuecomment-894564611 Also make sure you are on version 2.0.1 or later of `apache-airflow-providers-elasticsearch` as it was broken in earlier versions. -- This is an automated message from the

[GitHub] [airflow] jedcunningham commented on pull request #17428: Fix elasticsearch-secret template port default function

2021-08-06 Thread GitBox
jedcunningham commented on pull request #17428: URL: https://github.com/apache/airflow/pull/17428#issuecomment-894562815 Hey @Sonins, what I meant was we need to write new tests to cover this change (well, and the whole elasticsearch secret). The tests in

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17479: Stopping worker leaves spark application behind when running in cluster mode

2021-08-06 Thread GitBox
boring-cyborg[bot] commented on issue #17479: URL: https://github.com/apache/airflow/issues/17479#issuecomment-894559447 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] santosh-d3vpl3x opened a new issue #17479: Stopping worker leaves spark application behind when running in cluster mode

2021-08-06 Thread GitBox
santosh-d3vpl3x opened a new issue #17479: URL: https://github.com/apache/airflow/issues/17479 **Apache Airflow version**: 2.1.2 and also previous versions **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): NA **Environment**: linux - **Cloud

[GitHub] [airflow] jedcunningham commented on a change in pull request #17477: Open relative extra links in place

2021-08-06 Thread GitBox
jedcunningham commented on a change in pull request #17477: URL: https://github.com/apache/airflow/pull/17477#discussion_r684539429 ## File path: airflow/www/static/js/dag.js ## @@ -190,6 +190,8 @@ export function callModal(t, d, extraLinks, tryNumbers, sd) {

[airflow] branch main updated: KEDA task count query should ignore k8s queue (#17433)

2021-08-06 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 3136f22 KEDA task count query should

[GitHub] [airflow] jedcunningham merged pull request #17433: KEDA task count query should ignore k8s queue

2021-08-06 Thread GitBox
jedcunningham merged pull request #17433: URL: https://github.com/apache/airflow/pull/17433 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] jedcunningham commented on issue #17453: SQLAlchemy constraint for apache-airflow-snowflake-provider installation

2021-08-06 Thread GitBox
jedcunningham commented on issue #17453: URL: https://github.com/apache/airflow/issues/17453#issuecomment-894554228 I think the right answer here is "upgrade pip so the new resolver is used". @potiuk, I'm really curious about the advice to use the constraints from main when

[GitHub] [airflow] jedcunningham commented on pull request #17452: Pin snowflake-sqlalchemy

2021-08-06 Thread GitBox
jedcunningham commented on pull request #17452: URL: https://github.com/apache/airflow/pull/17452#issuecomment-894542307 This ended up being an issue with the legacy pip resolver, so I don't think we actually need this after all. -- This is an automated message from the Apache Git

[GitHub] [airflow] jedcunningham closed pull request #17452: Pin snowflake-sqlalchemy

2021-08-06 Thread GitBox
jedcunningham closed pull request #17452: URL: https://github.com/apache/airflow/pull/17452 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] jedcunningham commented on issue #17453: SQLAlchemy constraint for apache-airflow-snowflake-provider installation

2021-08-06 Thread GitBox
jedcunningham commented on issue #17453: URL: https://github.com/apache/airflow/issues/17453#issuecomment-894536753 I think the difference comes down to what version of pip you have. pip 19.3.1 pulls down 1.3.1, while pip 21.1.2 and 21.2.3 pull down 1.2.5. -- This is an automated

[GitHub] [airflow] github-actions[bot] commented on pull request #17457: Disable Helm tests when branch is not `main`

2021-08-06 Thread GitBox
github-actions[bot] commented on pull request #17457: URL: https://github.com/apache/airflow/pull/17457#issuecomment-894526721 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17478: Feature Request: Provide a next run field in the DAG details page

2021-08-06 Thread GitBox
boring-cyborg[bot] commented on issue #17478: URL: https://github.com/apache/airflow/issues/17478#issuecomment-894518894 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] amommendes opened a new issue #17478: Feature Request: Provide a next run field in the DAG details page

2021-08-06 Thread GitBox
amommendes opened a new issue #17478: URL: https://github.com/apache/airflow/issues/17478 **Description** Provide a next run field in the DAG details page for scheduled dags **Use case / motivation** Schedules can be trick to get at a first glance (since it related to

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #17477: Open relative extra links in place

2021-08-06 Thread GitBox
boring-cyborg[bot] commented on pull request #17477: URL: https://github.com/apache/airflow/pull/17477#issuecomment-894513459 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] bradarndt opened a new pull request #17477: Open relative extra links in place

2021-08-06 Thread GitBox
bradarndt opened a new pull request #17477: URL: https://github.com/apache/airflow/pull/17477 This PR changes the existing behavior ["extra links" added to operators](https://github.com/apache/airflow/blob/main/docs/apache-airflow/howto/define_extra_link.rst) such that any _relative_

[GitHub] [airflow] frankcash edited a comment on issue #16544: Redshift postgres hook usage

2021-08-06 Thread GitBox
frankcash edited a comment on issue #16544: URL: https://github.com/apache/airflow/issues/16544#issuecomment-894504354 I'd be more than happy to grab this. Is it just to create a hook in the AWS provider along the lines of `RedshiftSqlHook` that essentially utilizes the `PostgresHook`

[GitHub] [airflow] frankcash commented on issue #16544: Redshift postgres hook usage

2021-08-06 Thread GitBox
frankcash commented on issue #16544: URL: https://github.com/apache/airflow/issues/16544#issuecomment-894504354 I'd be more than happy to grab this. Is it just to create a hook in the AWS provider along the lines of `RedshiftSqlHook` that essentially utilizes the PostgresHook -- This

[GitHub] [airflow] jedcunningham commented on a change in pull request #15389: AIP-40: Deferrable Tasks

2021-08-06 Thread GitBox
jedcunningham commented on a change in pull request #15389: URL: https://github.com/apache/airflow/pull/15389#discussion_r684460751 ## File path: airflow/jobs/scheduler_job.py ## @@ -1207,3 +1218,26 @@ def adopt_or_reset_orphaned_tasks(self, session: Session = None):

[GitHub] [airflow] wolfier edited a comment on issue #17453: SQLAlchemy constraint for apache-airflow-snowflake-provider installation

2021-08-06 Thread GitBox
wolfier edited a comment on issue #17453: URL: https://github.com/apache/airflow/issues/17453#issuecomment-894471816 interestingly, I was unable to replicate with OSS Airflow. The installation process is little different for my environment so I'll look into that. Here is how I

[GitHub] [airflow] wolfier commented on issue #17453: SQLAlchemy constraint for apache-airflow-snowflake-provider installation

2021-08-06 Thread GitBox
wolfier commented on issue #17453: URL: https://github.com/apache/airflow/issues/17453#issuecomment-894471816 interestingly, I was unable to replicate with OSS Airflow. The installation process is little different for my environment so I'll look into that. Here is how I tested the

[GitHub] [airflow] marclamberti opened a new issue #17476: Sensitive variables don't get masked when rendered with airflow tasks test

2021-08-06 Thread GitBox
marclamberti opened a new issue #17476: URL: https://github.com/apache/airflow/issues/17476 **Apache Airflow version**: 2.1.2 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): No **Environment**: - **Cloud provider or hardware

[GitHub] [airflow] potiuk closed issue #17475: Slack provider does not install HTTP provider dependency

2021-08-06 Thread GitBox
potiuk closed issue #17475: URL: https://github.com/apache/airflow/issues/17475 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #17475: Slack provider does not install HTTP provider dependency

2021-08-06 Thread GitBox
potiuk commented on issue #17475: URL: https://github.com/apache/airflow/issues/17475#issuecomment-894457906 Thanks for reporting it. Http provider used to be preinstalled in 2.0 and it had been disabled due.to licensing issues. It has been restored as preinstalled provider and will

[GitHub] [airflow] georborodin commented on a change in pull request #17426: Allow using default celery commands for custom Celery executors subclassed from existing

2021-08-06 Thread GitBox
georborodin commented on a change in pull request #17426: URL: https://github.com/apache/airflow/pull/17426#discussion_r684139638 ## File path: airflow/cli/cli_parser.py ## @@ -60,10 +62,17 @@ def _check_value(self, action, value): if action.dest == 'subcommand' and

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17475: Slack provider does not install HTTP provider dependency

2021-08-06 Thread GitBox
boring-cyborg[bot] commented on issue #17475: URL: https://github.com/apache/airflow/issues/17475#issuecomment-894438242 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] cdabella opened a new issue #17475: Slack provider does not install HTTP provider dependency

2021-08-06 Thread GitBox
cdabella opened a new issue #17475: URL: https://github.com/apache/airflow/issues/17475 **Apache Airflow version**: 2.1.1+astro.2 **Kubernetes version**: N/A **Environment**: astro CLI local dev environment Host - **Hardware configuration**: AMD Ryzen 9 3900X

[GitHub] [airflow] github-actions[bot] commented on pull request #17452: Pin snowflake-sqlalchemy

2021-08-06 Thread GitBox
github-actions[bot] commented on pull request #17452: URL: https://github.com/apache/airflow/pull/17452#issuecomment-894422732 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] enima2684 opened a new pull request #17474: Add support for configs, secrets, networks and replicas for DockerSwarmOperator

2021-08-06 Thread GitBox
enima2684 opened a new pull request #17474: URL: https://github.com/apache/airflow/pull/17474 This PR adds the following functionality to the DockerSwarmOperator : - support for setting secrets and configs exposed to the started service - support for specifying networks that can be

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #17474: Add support for configs, secrets, networks and replicas for DockerSwarmOperator

2021-08-06 Thread GitBox
boring-cyborg[bot] commented on pull request #17474: URL: https://github.com/apache/airflow/pull/17474#issuecomment-894389306 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] github-actions[bot] commented on pull request #17433: KEDA task count query should ignore k8s queue

2021-08-06 Thread GitBox
github-actions[bot] commented on pull request #17433: URL: https://github.com/apache/airflow/pull/17433#issuecomment-894383565 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] jedcunningham closed pull request #17433: KEDA task count query should ignore k8s queue

2021-08-06 Thread GitBox
jedcunningham closed pull request #17433: URL: https://github.com/apache/airflow/pull/17433 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] bbovenzi commented on issue #10549: option to disable "lots of circles" in error page

2021-08-06 Thread GitBox
bbovenzi commented on issue #10549: URL: https://github.com/apache/airflow/issues/10549#issuecomment-894346087 Alternatively, instead of adding _another_ config item. We could just get rid of the lots of circles. It doesn't really provide anything useful, as far as I'm aware. -- This

[GitHub] [airflow] JavierLopezT opened a new issue #17473: New view "Operator arguments" between "Task Instance Details" and "Rendered"

2021-08-06 Thread GitBox
JavierLopezT opened a new issue #17473: URL: https://github.com/apache/airflow/issues/17473 Hello. A lot of times, when I click on a task, I just want to see the operator arguments that can be manually passed, so Rendered view lacks information, because there are not non-renderable

[GitHub] [airflow] uranusjr closed pull request #17414: Allow custom timetable as a DAG argument

2021-08-06 Thread GitBox
uranusjr closed pull request #17414: URL: https://github.com/apache/airflow/pull/17414 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated (eb6af07 -> 82b876b)

2021-08-06 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from eb6af07 Add missing permissions to varimport (#17468) add 82b876b Add ephraimbuddy to INTHEWILD

[GitHub] [airflow] ephraimbuddy merged pull request #17472: Add ephraimbuddy to INTHEWILD

2021-08-06 Thread GitBox
ephraimbuddy merged pull request #17472: URL: https://github.com/apache/airflow/pull/17472 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ashb merged pull request #17468: Add missing permissions to varimport

2021-08-06 Thread GitBox
ashb merged pull request #17468: URL: https://github.com/apache/airflow/pull/17468 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ashb commented on pull request #17451: Add date format filters to Jinja environment

2021-08-06 Thread GitBox
ashb commented on pull request #17451: URL: https://github.com/apache/airflow/pull/17451#issuecomment-894334379 Hmmm all these failures _seem_ unrelated but I'm worried by just how many of them there are -- This is an automated message from the Apache Git Service. To respond to the

[airflow] branch main updated: Add missing permissions to varimport (#17468)

2021-08-06 Thread ash
This is an automated email from the ASF dual-hosted git repository. ash pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new eb6af07 Add missing permissions to varimport

[GitHub] [airflow] ephraimbuddy opened a new pull request #17472: Add ephraimbuddy to INTHEWILD

2021-08-06 Thread GitBox
ephraimbuddy opened a new pull request #17472: URL: https://github.com/apache/airflow/pull/17472 Adding myself to INTHEWILD --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] rahulraina7 commented on pull request #16012: Fixing Glue hooks/operators

2021-08-06 Thread GitBox
rahulraina7 commented on pull request #16012: URL: https://github.com/apache/airflow/pull/16012#issuecomment-894321200 > @rahulraina7 the glue tests are failing Fixed with the latest commit. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] eladkal commented on pull request #16012: Fixing Glue hooks/operators

2021-08-06 Thread GitBox
eladkal commented on pull request #16012: URL: https://github.com/apache/airflow/pull/16012#issuecomment-894308798 @rahulraina7 the glue tests are failing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] josh-fell commented on a change in pull request #16866: Remove default_args pattern + added get_current_context() use for Core Airflow example DAGs

2021-08-06 Thread GitBox
josh-fell commented on a change in pull request #16866: URL: https://github.com/apache/airflow/pull/16866#discussion_r684260804 ## File path: airflow/example_dags/example_xcom.py ## @@ -18,50 +18,61 @@ """Example DAG demonstrating the usage of XComs.""" from airflow import

[GitHub] [airflow] jedcunningham commented on pull request #17452: Pin snowflake-sqlalchemy

2021-08-06 Thread GitBox
jedcunningham commented on pull request #17452: URL: https://github.com/apache/airflow/pull/17452#issuecomment-894270773 Good call @potiuk, done. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] noelmcloughlin edited a comment on issue #16025: AirflowException: Celery command failed on host: [...]

2021-08-06 Thread GitBox
noelmcloughlin edited a comment on issue #16025: URL: https://github.com/apache/airflow/issues/16025#issuecomment-894139568 Update: My particular issue is fixed in https://github.com/apache/airflow/pull/16860 How can I fix this? I'm using Airflow 2.1.2 on CentOS7 in a federated

[GitHub] [airflow] noelmcloughlin edited a comment on issue #16025: AirflowException: Celery command failed on host: [...]

2021-08-06 Thread GitBox
noelmcloughlin edited a comment on issue #16025: URL: https://github.com/apache/airflow/issues/16025#issuecomment-894139568 UPDATE: fixed in https://github.com/apache/airflow/pull/16860 How can I fix this? I'm using Airflow 2.1.2 on CentOS7 in a federated topology and all jobs

[GitHub] [airflow] josh-fell commented on a change in pull request #16866: Remove default_args pattern + added get_current_context() use for Core Airflow example DAGs

2021-08-06 Thread GitBox
josh-fell commented on a change in pull request #16866: URL: https://github.com/apache/airflow/pull/16866#discussion_r684239242 ## File path: airflow/example_dags/tutorial_taskflow_api_etl_virtualenv.py ## @@ -19,24 +19,14 @@ # [START tutorial] # [START import_module]

[GitHub] [airflow] ashb commented on a change in pull request #16866: Remove default_args pattern + added get_current_context() use for Core Airflow example DAGs

2021-08-06 Thread GitBox
ashb commented on a change in pull request #16866: URL: https://github.com/apache/airflow/pull/16866#discussion_r684235887 ## File path: airflow/example_dags/example_xcom.py ## @@ -18,50 +18,61 @@ """Example DAG demonstrating the usage of XComs.""" from airflow import DAG

[GitHub] [airflow] ashb commented on a change in pull request #16866: Remove default_args pattern + added get_current_context() use for Core Airflow example DAGs

2021-08-06 Thread GitBox
ashb commented on a change in pull request #16866: URL: https://github.com/apache/airflow/pull/16866#discussion_r684234050 ## File path: airflow/example_dags/example_trigger_target_dag.py ## @@ -28,19 +28,18 @@ from airflow.utils.dates import days_ago -def

[airflow] branch main updated (bb52098 -> 5c0e98c)

2021-08-06 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from bb52098 Fix type annotations in OracleOperator, JdbcOperator, SqliteOperator (#17406) add 5c0e98c Adding

[GitHub] [airflow] eladkal merged pull request #17399: Adding JWT, IP filtering, and direct session login support for SalesforceHook

2021-08-06 Thread GitBox
eladkal merged pull request #17399: URL: https://github.com/apache/airflow/pull/17399 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] eladkal closed issue #17192: Adding additional login support for SalesforceHook

2021-08-06 Thread GitBox
eladkal closed issue #17192: URL: https://github.com/apache/airflow/issues/17192 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] andyalbert commented on issue #15888: Abort a DAG Run

2021-08-06 Thread GitBox
andyalbert commented on issue #15888: URL: https://github.com/apache/airflow/issues/15888#issuecomment-894244066 I'm new to this project, will try and pick it up -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] akihiro-inui opened a new issue #17470: Airflow scheduler does not start properly.

2021-08-06 Thread GitBox
akihiro-inui opened a new issue #17470: URL: https://github.com/apache/airflow/issues/17470 **Apache Airflow version**: apache/airflow:2.1.2-python3.8 **Environment**: Ubuntu 18.04 **What happened**: When launching Airflow scheduler together with other Airflow

[GitHub] [airflow] subkanthi commented on a change in pull request #17400: Example dag slackfile

2021-08-06 Thread GitBox
subkanthi commented on a change in pull request #17400: URL: https://github.com/apache/airflow/pull/17400#discussion_r684193248 ## File path: airflow/providers/slack/operators/slack.py ## @@ -195,49 +196,50 @@ class SlackAPIFileOperator(SlackAPIOperator): :type content:

[airflow] branch main updated (faf9f73 -> bb52098)

2021-08-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from faf9f73 Handle and log exceptions raised during task callback (#17347) add bb52098 Fix type annotations in

[GitHub] [airflow] potiuk merged pull request #17406: Fix type annotations in OracleOperator, JdbcOperator, SqliteOperator

2021-08-06 Thread GitBox
potiuk merged pull request #17406: URL: https://github.com/apache/airflow/pull/17406 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on a change in pull request #17423: Make schema in DBApiHook private

2021-08-06 Thread GitBox
potiuk commented on a change in pull request #17423: URL: https://github.com/apache/airflow/pull/17423#discussion_r684183034 ## File path: airflow/providers/postgres/hooks/postgres.py ## @@ -70,6 +70,7 @@ def __init__(self, *args, **kwargs) -> None:

[GitHub] [airflow] potiuk edited a comment on issue #17120: [Scheduler error] psycopg2.OperationalError: SSL SYSCALL error: Socket operation on non-socket

2021-08-06 Thread GitBox
potiuk edited a comment on issue #17120: URL: https://github.com/apache/airflow/issues/17120#issuecomment-894210585 As a workaround, you do not need to run airflow in Daemon mode. There is no need to run daemon mode in most cases. You can run airflow in a background using whatever

[GitHub] [airflow] subkanthi commented on a change in pull request #17400: Example dag slackfile

2021-08-06 Thread GitBox
subkanthi commented on a change in pull request #17400: URL: https://github.com/apache/airflow/pull/17400#discussion_r684179199 ## File path: airflow/providers/slack/operators/slack.py ## @@ -195,49 +196,50 @@ class SlackAPIFileOperator(SlackAPIOperator): :type content:

[GitHub] [airflow] gastonlau opened a new issue #17120: [Scheduler error] psycopg2.OperationalError: SSL SYSCALL error: Socket operation on non-socket

2021-08-06 Thread GitBox
gastonlau opened a new issue #17120: URL: https://github.com/apache/airflow/issues/17120 Hi Airflow Team, I am running the Airflow in an EC2 instance which is installed by conda-forge during the Code Deploy. After upgrading the Airflow version from 2.0.2 to >=2.1.0, I am facing

[GitHub] [airflow] potiuk commented on issue #17120: [Scheduler error] psycopg2.OperationalError: SSL SYSCALL error: Socket operation on non-socket

2021-08-06 Thread GitBox
potiuk commented on issue #17120: URL: https://github.com/apache/airflow/issues/17120#issuecomment-894210585 As a workaround, you do not need to run airflow in Daemon mode. There is no need to run -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17469: Label infront of TaskGroup breaks task dependencies

2021-08-06 Thread GitBox
boring-cyborg[bot] commented on issue #17469: URL: https://github.com/apache/airflow/issues/17469#issuecomment-894193557 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] cb149 opened a new issue #17469: Label infront of TaskGroup breaks task dependencies

2021-08-06 Thread GitBox
cb149 opened a new issue #17469: URL: https://github.com/apache/airflow/issues/17469 **Apache Airflow version**: 2.1.0 **What happened**: Using a Label infront of a TaskGroup breaks task dependencies, as tasks before the TaskGroup will now point to the last task in the

[GitHub] [airflow] rahulraina7 commented on pull request #16012: Fixing Glue hooks/operators

2021-08-06 Thread GitBox
rahulraina7 commented on pull request #16012: URL: https://github.com/apache/airflow/pull/16012#issuecomment-894187994 Updated tests. Please review @uranusjr , @o-nikolas -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] potiuk edited a comment on issue #17453: SQLAlchemy constraint for apache-airflow-snowflake-provider installation

2021-08-06 Thread GitBox
potiuk edited a comment on issue #17453: URL: https://github.com/apache/airflow/issues/17453#issuecomment-894184031 Also I am a bit surprised that this happened. By default, when `pip install ` is run and the installed version of dependency falls in the limits of the dependencies, it

[GitHub] [airflow] potiuk commented on issue #17453: SQLAlchemy constraint for apache-airflow-snowflake-provider installation

2021-08-06 Thread GitBox
potiuk commented on issue #17453: URL: https://github.com/apache/airflow/issues/17453#issuecomment-894184031 Also I am a bit surprised that this happened. By default, when `pip install ` is run and the installed version of dependency falls in the limits of the dependencies, it should NOT

[GitHub] [airflow] potiuk commented on issue #17453: SQLAlchemy constraint for apache-airflow-snowflake-provider installation

2021-08-06 Thread GitBox
potiuk commented on issue #17453: URL: https://github.com/apache/airflow/issues/17453#issuecomment-894182225 @wolfier - just a comment - while we can add it in snowflake (and @jedcunningham added it in #17452) for the future there is another way of installing the provider: You can install

[GitHub] [airflow] ecwootten commented on issue #12813: Attempting to read an xcom produced by KubernetesPodOperator results in UnicodeDecodeError

2021-08-06 Thread GitBox
ecwootten commented on issue #12813: URL: https://github.com/apache/airflow/issues/12813#issuecomment-894180554 I wonder if this might be a wider problem than just the KubernetesPod/Python operators. I have seen this problem on 1.10.12 with a custom operator (derived from BaseOperator) -

[GitHub] [airflow] georborodin commented on a change in pull request #17426: Allow using default celery commands for custom Celery executors subclassed from existing

2021-08-06 Thread GitBox
georborodin commented on a change in pull request #17426: URL: https://github.com/apache/airflow/pull/17426#discussion_r684139638 ## File path: airflow/cli/cli_parser.py ## @@ -60,10 +62,17 @@ def _check_value(self, action, value): if action.dest == 'subcommand' and

[GitHub] [airflow] github-actions[bot] commented on pull request #17468: Add missing permissions to varimport

2021-08-06 Thread GitBox
github-actions[bot] commented on pull request #17468: URL: https://github.com/apache/airflow/pull/17468#issuecomment-894178512 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] georborodin commented on a change in pull request #17426: Allow using default celery commands for custom Celery executors subclassed from existing

2021-08-06 Thread GitBox
georborodin commented on a change in pull request #17426: URL: https://github.com/apache/airflow/pull/17426#discussion_r684090726 ## File path: airflow/cli/cli_parser.py ## @@ -60,10 +62,17 @@ def _check_value(self, action, value): if action.dest == 'subcommand' and

[GitHub] [airflow] potiuk commented on pull request #17458: Install providers from sources in prod image only on main

2021-08-06 Thread GitBox
potiuk commented on pull request #17458: URL: https://github.com/apache/airflow/pull/17458#issuecomment-894177858 I'd love to get that it before I start holidays, to test the `v2-1-test` branch with 'released' providers . Need that one in main though :( -- This is an automated message

[GitHub] [airflow] potiuk commented on pull request #17329: Split sql statements in DbApi run

2021-08-06 Thread GitBox
potiuk commented on pull request #17329: URL: https://github.com/apache/airflow/pull/17329#issuecomment-894177284 Looks like all those errors are intermittent (And the rest LGTM) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] ashb opened a new pull request #17468: Add missing permissions to varimport

2021-08-06 Thread GitBox
ashb opened a new pull request #17468: URL: https://github.com/apache/airflow/pull/17468 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] georborodin commented on a change in pull request #17426: Allow using default celery commands for custom Celery executors subclassed from existing

2021-08-06 Thread GitBox
georborodin commented on a change in pull request #17426: URL: https://github.com/apache/airflow/pull/17426#discussion_r684139638 ## File path: airflow/cli/cli_parser.py ## @@ -60,10 +62,17 @@ def _check_value(self, action, value): if action.dest == 'subcommand' and

[GitHub] [airflow] georborodin commented on a change in pull request #17426: Allow using default celery commands for custom Celery executors subclassed from existing

2021-08-06 Thread GitBox
georborodin commented on a change in pull request #17426: URL: https://github.com/apache/airflow/pull/17426#discussion_r684139638 ## File path: airflow/cli/cli_parser.py ## @@ -60,10 +62,17 @@ def _check_value(self, action, value): if action.dest == 'subcommand' and

[GitHub] [airflow] georborodin commented on a change in pull request #17426: Allow using default celery commands for custom Celery executors subclassed from existing

2021-08-06 Thread GitBox
georborodin commented on a change in pull request #17426: URL: https://github.com/apache/airflow/pull/17426#discussion_r684139638 ## File path: airflow/cli/cli_parser.py ## @@ -60,10 +62,17 @@ def _check_value(self, action, value): if action.dest == 'subcommand' and

[airflow] branch main updated: Handle and log exceptions raised during task callback (#17347)

2021-08-06 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new faf9f73 Handle and log exceptions raised

[GitHub] [airflow] ephraimbuddy merged pull request #17347: Handle and log exceptions raised during task callback

2021-08-06 Thread GitBox
ephraimbuddy merged pull request #17347: URL: https://github.com/apache/airflow/pull/17347 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #17425: Use `dag_maker` fixture in models/test_taskinstance.py

2021-08-06 Thread GitBox
ephraimbuddy commented on a change in pull request #17425: URL: https://github.com/apache/airflow/pull/17425#discussion_r684131285 ## File path: tests/conftest.py ## @@ -480,6 +480,7 @@ def __call__(self, dag_id='test_dag', session=None, **kwargs):

[GitHub] [airflow] ashb commented on a change in pull request #17425: Use `dag_maker` fixture in models/test_taskinstance.py

2021-08-06 Thread GitBox
ashb commented on a change in pull request #17425: URL: https://github.com/apache/airflow/pull/17425#discussion_r684130921 ## File path: tests/conftest.py ## @@ -480,6 +480,7 @@ def __call__(self, dag_id='test_dag', session=None, **kwargs):

[GitHub] [airflow] noelmcloughlin commented on pull request #16860: Support DAGS folder being in different location on scheduler and runners

2021-08-06 Thread GitBox
noelmcloughlin commented on pull request #16860: URL: https://github.com/apache/airflow/pull/16860#issuecomment-894158190 Linking https://github.com/apache/airflow/issues/16025#issuecomment-894139568 -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] potiuk commented on a change in pull request #17426: Allow using default celery commands for custom Celery executors subclassed from existing

2021-08-06 Thread GitBox
potiuk commented on a change in pull request #17426: URL: https://github.com/apache/airflow/pull/17426#discussion_r684113177 ## File path: airflow/cli/cli_parser.py ## @@ -60,10 +62,17 @@ def _check_value(self, action, value): if action.dest == 'subcommand' and value

[GitHub] [airflow] potiuk edited a comment on issue #17463: 404 Exception when docker container

2021-08-06 Thread GitBox
potiuk edited a comment on issue #17463: URL: https://github.com/apache/airflow/issues/17463#issuecomment-894145891 This is a problem with your deployment. Something is killing your tasks (it's not airflow). You should look in logs from your deployment why Airlfow containers are killed.

[GitHub] [airflow] potiuk commented on issue #17463: 404 Exception when docker container

2021-08-06 Thread GitBox
potiuk commented on issue #17463: URL: https://github.com/apache/airflow/issues/17463#issuecomment-894145891 This is a problem with your deployment. Something is killing your tasks (it's not airflow). You should look in logs from your deployment why Airlfow containers are killed. Usually

[GitHub] [airflow] github-actions[bot] commented on pull request #17451: Add date format filters to Jinja environment

2021-08-06 Thread GitBox
github-actions[bot] commented on pull request #17451: URL: https://github.com/apache/airflow/pull/17451#issuecomment-894145912 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] potiuk closed issue #17463: 404 Exception when docker container

2021-08-06 Thread GitBox
potiuk closed issue #17463: URL: https://github.com/apache/airflow/issues/17463 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ashb commented on pull request #17451: Add date format filters to Jinja environment

2021-08-06 Thread GitBox
ashb commented on pull request #17451: URL: https://github.com/apache/airflow/pull/17451#issuecomment-894141873 :facepalm: Went the wrong way. Yes, will change to `nodash` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] noelmcloughlin edited a comment on issue #16025: AirflowException: Celery command failed on host: [...]

2021-08-06 Thread GitBox
noelmcloughlin edited a comment on issue #16025: URL: https://github.com/apache/airflow/issues/16025#issuecomment-894139568 How can I fix this? I'm using Airflow 2.1.2 on CentOS7 in a federated topology and all jobs failing. **Root cause is fact TASK args includes wrong

[GitHub] [airflow] noelmcloughlin edited a comment on issue #16025: AirflowException: Celery command failed on host: [...]

2021-08-06 Thread GitBox
noelmcloughlin edited a comment on issue #16025: URL: https://github.com/apache/airflow/issues/16025#issuecomment-894139568 How can I fix this? I'm using Airflow 2.1.2 on CentOS7 in a federated topology and all jobs failing. **Root cause is fact TASK args includes wrong

  1   2   >