[GitHub] [airflow] JavierLopezT commented on pull request #16264: Add flag to delete local logs after upload

2021-08-05 Thread GitBox
JavierLopezT commented on pull request #16264: URL: https://github.com/apache/airflow/pull/16264#issuecomment-893501062 Commenting -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] ephraimbuddy commented on issue #17395: DAG is executed twice on submit

2021-08-05 Thread GitBox
ephraimbuddy commented on issue #17395: URL: https://github.com/apache/airflow/issues/17395#issuecomment-893494138 You no longer need apply_default when defining custom operators. Can you take a look at this https://airflow.apache.org/docs/apache-airflow/stable/howto/custom-operator.html

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17447: Option to exclude default / hard-coded helm annotations for jobs and other relevant templates

2021-08-05 Thread GitBox
boring-cyborg[bot] commented on issue #17447: URL: https://github.com/apache/airflow/issues/17447#issuecomment-893493189 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] micke-a opened a new issue #17447: Option to exclude default / hard-coded helm annotations for jobs and other relevant templates

2021-08-05 Thread GitBox
micke-a opened a new issue #17447: URL: https://github.com/apache/airflow/issues/17447 **Description** Option to exclude default / hard-coded helm annotations for jobs and other relevant templates. **Use case / motivation** Ability to exclude default helm annotations

[GitHub] [airflow] eskarimov opened a new pull request #17446: Add support of `path` parameter for GCloud Storage Transfer Service operators

2021-08-05 Thread GitBox
eskarimov opened a new pull request #17446: URL: https://github.com/apache/airflow/pull/17446 Re-opened PR #17284 ### **Issue:** Currently Google Cloud Transfer Service operators `CloudDataTransferServiceGCSToGCSOperator` and `CloudDataTransferServiceS3ToGCSOperator` don't provide

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #17425: Use `dag_maker` fixture in models/test_taskinstance.py

2021-08-05 Thread GitBox
ephraimbuddy commented on a change in pull request #17425: URL: https://github.com/apache/airflow/pull/17425#discussion_r683485929 ## File path: tests/models/test_taskinstance.py ## @@ -2021,9 +1879,9 @@ def test_render_k8s_pod_yaml(self, pod_mutation_hook):

[GitHub] [airflow] eskarimov closed pull request #17284: Add support of `path` parameter for GCloud Storage Transfer Service operators

2021-08-05 Thread GitBox
eskarimov closed pull request #17284: URL: https://github.com/apache/airflow/pull/17284 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] eskarimov commented on pull request #17284: Add support of `path` parameter for GCloud Storage Transfer Service operators

2021-08-05 Thread GitBox
eskarimov commented on pull request #17284: URL: https://github.com/apache/airflow/pull/17284#issuecomment-893484385 Sorry, will re-open the PR, my mistake -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[airflow] branch main updated (9665652 -> 82bda99)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 9665652 Updating INTHEWILD.md (PEXA) (#17427) add 82bda99 Fix Google Cloud Operators docs (#17440) No new

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #17440: Fix Google Cloud Operators docs

2021-08-05 Thread GitBox
boring-cyborg[bot] commented on pull request #17440: URL: https://github.com/apache/airflow/pull/17440#issuecomment-893481071 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] potiuk merged pull request #17440: Fix Google Cloud Operators docs

2021-08-05 Thread GitBox
potiuk merged pull request #17440: URL: https://github.com/apache/airflow/pull/17440 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] wojsamjan opened a new pull request #17445: Add info log how to fix: More than one pod running with labels

2021-08-05 Thread GitBox
wojsamjan opened a new pull request #17445: URL: https://github.com/apache/airflow/pull/17445 Logs information how to fix issue with: "More than one pod running with labels" - using is_delete_operator_pod argument when creating new KubernetesPodOperator This is just a simple update

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #17425: Use `dag_maker` fixture in models/test_taskinstance.py

2021-08-05 Thread GitBox
ephraimbuddy commented on a change in pull request #17425: URL: https://github.com/apache/airflow/pull/17425#discussion_r683475029 ## File path: tests/models/test_taskinstance.py ## @@ -1969,9 +1836,9 @@ def test_get_rendered_template_fields(self):

[GitHub] [airflow] potiuk edited a comment on issue #17437: It's too slow to recognize new dag file when there is a log of dags files

2021-08-05 Thread GitBox
potiuk edited a comment on issue #17437: URL: https://github.com/apache/airflow/issues/17437#issuecomment-893473982 Nice. Very useful @huozhanfeng ! Thanks a lot for all the details! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] potiuk commented on issue #17437: It's too slow to recognize new dag file when there is a log of dags files

2021-08-05 Thread GitBox
potiuk commented on issue #17437: URL: https://github.com/apache/airflow/issues/17437#issuecomment-893473982 Nice. Very useful @huozhanfeng ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] huozhanfeng edited a comment on issue #17437: It's too slow to recognize new dag file when there is a log of dags files

2021-08-05 Thread GitBox
huozhanfeng edited a comment on issue #17437: URL: https://github.com/apache/airflow/issues/17437#issuecomment-893444227 > I think, before you start requesting new features, it is great to check if the existing features are not working well for you: > > 1. Did you try to configure

[GitHub] [airflow-site] christopherpetrino opened a new pull request #463: Change Seniorlink logo to svg from png

2021-08-05 Thread GitBox
christopherpetrino opened a new pull request #463: URL: https://github.com/apache/airflow-site/pull/463 @potiuk New PR changing the logo to svg -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow-site] christopherpetrino commented on pull request #462: Add Seniorlink to Use Cases

2021-08-05 Thread GitBox
christopherpetrino commented on pull request #462: URL: https://github.com/apache/airflow-site/pull/462#issuecomment-893456312 Thanks, Jarek! Tagging you in the new PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] ashb commented on issue #17437: It's too slow to recognize new dag file when there is a log of dags files

2021-08-05 Thread GitBox
ashb commented on issue #17437: URL: https://github.com/apache/airflow/issues/17437#issuecomment-893456208 I've put this against the 2.2 milestone -- no promise if we (the core team) will get in in for 2.2, but PRs greatly accepted and we're happy to help you get your POC PR ready too.

[GitHub] [airflow] huozhanfeng edited a comment on issue #17437: It's too slow to recognize new dag file when there is a log of dags files

2021-08-05 Thread GitBox
huozhanfeng edited a comment on issue #17437: URL: https://github.com/apache/airflow/issues/17437#issuecomment-893450577 > Good detailed follow up analysis, and yes, you have identified the key point they me files are only picked up when the queue is empty Haha, thank you. We have

[GitHub] [airflow] huozhanfeng edited a comment on issue #17437: It's too slow to recognize new dag file when there is a log of dags files

2021-08-05 Thread GitBox
huozhanfeng edited a comment on issue #17437: URL: https://github.com/apache/airflow/issues/17437#issuecomment-893450577 > Good detailed follow up analysis, and yes, you have identified the key point they me files are only picked up when the queue is empty Haha, thank you. We have

[GitHub] [airflow] huozhanfeng commented on issue #17437: It's too slow to recognize new dag file when there is a log of dags files

2021-08-05 Thread GitBox
huozhanfeng commented on issue #17437: URL: https://github.com/apache/airflow/issues/17437#issuecomment-893450577 > Good detailed follow up analysis, and yes, you have identified the key point they me files are only picked up when the queue is empty Haha, thank you. We have another

[GitHub] [airflow] ashb commented on issue #17437: It's too slow to recognize new dag file when there is a log of dags files

2021-08-05 Thread GitBox
ashb commented on issue #17437: URL: https://github.com/apache/airflow/issues/17437#issuecomment-893448027 Good detailed follow up analysis, and yes, you have identified the key point they me files are only picked up when the queue is empty -- This is an automated message from the

[GitHub] [airflow] huozhanfeng commented on issue #17437: It's too slow to recognize new dag file when there is a log of dags files

2021-08-05 Thread GitBox
huozhanfeng commented on issue #17437: URL: https://github.com/apache/airflow/issues/17437#issuecomment-893444227 > I think, before you start requesting new features, it is great to check if the existing features are not working well for you: > > 1. Did you try to configure multiple

[GitHub] [airflow] ephraimbuddy opened a new issue #17444: TestLocalTaskJob.test_task_sigkill_works_with_retries

2021-08-05 Thread GitBox
ephraimbuddy opened a new issue #17444: URL: https://github.com/apache/airflow/issues/17444 This test is flaky and fails sometimes ``` TestLocalTaskJob.test_task_sigkill_works_with_retries _ self = dag_maker = .DagFactory object at

[GitHub] [airflow] ashb commented on pull request #17329: Split sql statements in DbApi run

2021-08-05 Thread GitBox
ashb commented on pull request #17329: URL: https://github.com/apache/airflow/pull/17329#issuecomment-893415749 > > sqlparse is not a core dependency -- it needs adding. > > Hi @ashb, what do you mean with "it needs adding"? I added sqlparse to setup.cfg. We need to do anything

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17443: No link for kibana when using frontend configuration

2021-08-05 Thread GitBox
boring-cyborg[bot] commented on issue #17443: URL: https://github.com/apache/airflow/issues/17443#issuecomment-893414516 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] amiriry opened a new issue #17443: No link for kibana when using frontend configuration

2021-08-05 Thread GitBox
amiriry opened a new issue #17443: URL: https://github.com/apache/airflow/issues/17443 **Apache Airflow version**: 2.1.2 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): using docker-compose not kubernetes. **Environment**: - **Cloud

[GitHub] [airflow] georborodin opened a new issue #17442: Deleted DAG raises SerializedDagNotFound exception when accessing webserver

2021-08-05 Thread GitBox
georborodin opened a new issue #17442: URL: https://github.com/apache/airflow/issues/17442 **Apache Airflow version**: 2.1.2 **Environment**: - **Docker image**: official apache/airflow:2.1.2 extended with pip installed packages - **Executor**: CeleryExecutor -

[GitHub] [airflow] ashb commented on a change in pull request #16352: AIP-39: ``DagRun.data_interval_start`` and ``data_interval_end``

2021-08-05 Thread GitBox
ashb commented on a change in pull request #16352: URL: https://github.com/apache/airflow/pull/16352#discussion_r683390362 ## File path: docs/apache-airflow/macros-ref.rst ## @@ -35,28 +35,23 @@ in all templates =

[GitHub] [airflow] ashb commented on a change in pull request #16352: AIP-39: ``DagRun.data_interval_start`` and ``data_interval_end``

2021-08-05 Thread GitBox
ashb commented on a change in pull request #16352: URL: https://github.com/apache/airflow/pull/16352#discussion_r683389711 ## File path: docs/apache-airflow/macros-ref.rst ## @@ -35,28 +35,23 @@ in all templates =

[GitHub] [airflow] ashb commented on a change in pull request #16352: AIP-39: ``DagRun.data_interval_start`` and ``data_interval_end``

2021-08-05 Thread GitBox
ashb commented on a change in pull request #16352: URL: https://github.com/apache/airflow/pull/16352#discussion_r683364465 ## File path: docs/apache-airflow/macros-ref.rst ## @@ -83,6 +78,27 @@ VariableDescription

[GitHub] [airflow] dinigo commented on issue #13750: Support Standard SQL in BigQuery Sensor

2021-08-05 Thread GitBox
dinigo commented on issue #13750: URL: https://github.com/apache/airflow/issues/13750#issuecomment-893381710 Ok, that's another option. It was suggested here with an example piece of code https://github.com/apache/airflow/issues/17315 What do you think then? -- This is an

[GitHub] [airflow] ashb commented on a change in pull request #16352: AIP-39: ``DagRun.data_interval_start`` and ``data_interval_end``

2021-08-05 Thread GitBox
ashb commented on a change in pull request #16352: URL: https://github.com/apache/airflow/pull/16352#discussion_r683362607 ## File path: airflow/www/views.py ## @@ -1602,7 +1602,7 @@ def trigger(self, session=None): 'airflow/trigger.html', dag_id=dag_id,

[GitHub] [airflow] dinigo edited a comment on issue #13750: Support Standard SQL in BigQuery Sensor

2021-08-05 Thread GitBox
dinigo edited a comment on issue #13750: URL: https://github.com/apache/airflow/issues/13750#issuecomment-893381710 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] uranusjr commented on a change in pull request #16352: AIP-39: ``DagRun.data_interval_start`` and ``data_interval_end``

2021-08-05 Thread GitBox
uranusjr commented on a change in pull request #16352: URL: https://github.com/apache/airflow/pull/16352#discussion_r683384487 ## File path: docs/apache-airflow/macros-ref.rst ## @@ -35,28 +35,23 @@ in all templates =

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #17426: Allow using default celery commands for custom Celery executors subclassed from existing

2021-08-05 Thread GitBox
ephraimbuddy commented on a change in pull request #17426: URL: https://github.com/apache/airflow/pull/17426#discussion_r683184327 ## File path: airflow/cli/cli_parser.py ## @@ -60,10 +62,15 @@ def _check_value(self, action, value): if action.dest == 'subcommand' and

[GitHub] [airflow] ephraimbuddy closed pull request #17347: Handle and log exceptions raised during task callback

2021-08-05 Thread GitBox
ephraimbuddy closed pull request #17347: URL: https://github.com/apache/airflow/pull/17347 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow-client-python] er1shivam commented on issue #27: get_dag_details api is broken

2021-08-05 Thread GitBox
er1shivam commented on issue #27: URL: https://github.com/apache/airflow-client-python/issues/27#issuecomment-892786390 I am using this [DAG](https://airflow.apache.org/docs/apache-airflow/stable/tutorial.html#example-pipeline-definition) from the example on official Airflow website.

[GitHub] [airflow] ricardogaspar2 commented on issue #16618: Access specific values within an `XCom` value using Taskflow API

2021-08-05 Thread GitBox
ricardogaspar2 commented on issue #16618: URL: https://github.com/apache/airflow/issues/16618#issuecomment-892728928 > > It would also be great if there was a way of NOT creating the dependencies between tasks automatically. > > For cluster or job IDs (EMR, Databricks, etc) is very

[GitHub] [airflow] ashb commented on pull request #17405: Put the XCom.clear logic into XCom class to allow it hookable in custom XCom backend

2021-08-05 Thread GitBox
ashb commented on pull request #17405: URL: https://github.com/apache/airflow/pull/17405#issuecomment-892565477 > I was imaging adding more flexible to the interface for possible future usage We can add this in the future, but lets do that _when_ we have a usecase/need for it :)

[GitHub] [airflow] jedcunningham merged pull request #17420: Update emr.rst

2021-08-05 Thread GitBox
jedcunningham merged pull request #17420: URL: https://github.com/apache/airflow/pull/17420 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #17420: Update emr.rst

2021-08-05 Thread GitBox
boring-cyborg[bot] commented on pull request #17420: URL: https://github.com/apache/airflow/pull/17420#issuecomment-892683035 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] ashb commented on a change in pull request #17410: Improve diagnostics message when users have secret_key misconfigured

2021-08-05 Thread GitBox
ashb commented on a change in pull request #17410: URL: https://github.com/apache/airflow/pull/17410#discussion_r682526692 ## File path: airflow/utils/log/file_task_handler.py ## @@ -190,6 +191,15 @@ def _read(self, ti, try_number, metadata=None):

[GitHub] [airflow] georborodin edited a comment on pull request #17426: Allow using default celery commands for custom Celery executors subclassed from existing

2021-08-05 Thread GitBox
georborodin edited a comment on pull request #17426: URL: https://github.com/apache/airflow/pull/17426#issuecomment-893309025 @potiuk @ephraimbuddy I tried to merge your suggestions into one, please see ~~1921b98~~ 54ce5ff (used plain string in first commit, would've returned mro for str

[GitHub] [airflow] jedcunningham commented on a change in pull request #17420: Update emr.rst

2021-08-05 Thread GitBox
jedcunningham commented on a change in pull request #17420: URL: https://github.com/apache/airflow/pull/17420#discussion_r682926908 ## File path: docs/apache-airflow-providers-amazon/operators/emr.rst ## @@ -58,7 +58,7 @@ Create EMR Job Flow with automatic steps Purpose

[GitHub] [airflow] ashb commented on pull request #17341: Add ExecStop to systemd service files.

2021-08-05 Thread GitBox
ashb commented on pull request #17341: URL: https://github.com/apache/airflow/pull/17341#issuecomment-892574013 > To add to this, would it be a good idea to demonstrate use of multiple worker on same machine? Why would you want to do this? You can have one worker listen on multiple

[jira] [Commented] (AIRFLOW-4922) If a task crashes, host name is not committed to the database so logs aren't able to be seen in the UI

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393918#comment-17393918 ] ASF GitHub Bot commented on AIRFLOW-4922: - xuemengran commented on pull request #6722: URL:

[GitHub] [airflow] eladkal commented on a change in pull request #17400: Example dag slackfile

2021-08-05 Thread GitBox
eladkal commented on a change in pull request #17400: URL: https://github.com/apache/airflow/pull/17400#discussion_r683186470 ## File path: airflow/utils/log/file_task_handler.py ## @@ -187,10 +187,14 @@ def _read(self, ti, try_number, metadata=None):

[GitHub] [airflow] github-actions[bot] commented on pull request #17416: Remove CONTINUE_ON_PIP_CHECK_FAILURE parameter

2021-08-05 Thread GitBox
github-actions[bot] commented on pull request #17416: URL: https://github.com/apache/airflow/pull/17416#issuecomment-892654793 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] sighingnow commented on issue #14063: macos python3.8 AttributeError: Can't pickle local object 'CeleryExecutor.trigger_tasks..reset_signals'

2021-08-05 Thread GitBox
sighingnow commented on issue #14063: URL: https://github.com/apache/airflow/issues/14063#issuecomment-893286033 > I got the same problem too, is it an issue? > My machine: MacOs 11.3, python 3.8.7, mysql 8, airflow 2.1.0 It is no longer a problem on master. -- This is an

[GitHub] [airflow] xuemengran commented on pull request #6722: [AIRFLOW-4922]Fix task get log by Web UI

2021-08-05 Thread GitBox
xuemengran commented on pull request #6722: URL: https://github.com/apache/airflow/pull/6722#issuecomment-893100953 Hi, I am still seeing the issue in 2.1.1 version, my executor is celery -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] uranusjr commented on a change in pull request #17265: Use `dag_maker` fixture in test_scheduler_job.py

2021-08-05 Thread GitBox
uranusjr commented on a change in pull request #17265: URL: https://github.com/apache/airflow/pull/17265#discussion_r682623150 ## File path: tests/jobs/test_scheduler_job.py ## @@ -119,10 +119,18 @@ def clean_db(): # DO NOT try to run clear_db_serialized_dags() here -

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #17347: Handle and log exceptions raised during task callback

2021-08-05 Thread GitBox
ephraimbuddy commented on a change in pull request #17347: URL: https://github.com/apache/airflow/pull/17347#discussion_r682547231 ## File path: tests/models/test_taskinstance.py ## @@ -1743,6 +1743,32 @@ def on_execute_callable(context): ti.refresh_from_db()

[GitHub] [airflow] potiuk edited a comment on issue #16238: Airflow Tree View for larger dags

2021-08-05 Thread GitBox
potiuk edited a comment on issue #16238: URL: https://github.com/apache/airflow/issues/16238#issuecomment-893203966 See the milestone from merged PR - it's 2.1.1, so try this one -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] georborodin commented on pull request #17426: Allow using default celery commands for custom Celery executors subclassed from existing

2021-08-05 Thread GitBox
georborodin commented on pull request #17426: URL: https://github.com/apache/airflow/pull/17426#issuecomment-893309025 @potiuk @ephraimbuddy I tried to merge your suggestions into one, please see 1921b98 -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] sighingnow commented on pull request #17430: Respect the AIRFLOW__CORE__MP_START_METHOD config in CeleryExecutor.

2021-08-05 Thread GitBox
sighingnow commented on pull request #17430: URL: https://github.com/apache/airflow/pull/17430#issuecomment-893178342 Close as it is no longer a problem in the HEAD version. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] sudipto9 commented on issue #17120: [Scheduler error] psycopg2.OperationalError: SSL SYSCALL error: Socket operation on non-socket

2021-08-05 Thread GitBox
sudipto9 commented on issue #17120: URL: https://github.com/apache/airflow/issues/17120#issuecomment-893148745 @potiuk Without webserver and scheduler together, airflow is incomplete. When scheduler service starts when we start webserver. We can have a separate module also to restart the

[GitHub] [airflow] mongakshay edited a comment on issue #13542: Task stuck in "scheduled" or "queued" state, pool has all slots queued, nothing is executing

2021-08-05 Thread GitBox
mongakshay edited a comment on issue #13542: URL: https://github.com/apache/airflow/issues/13542#issuecomment-892630614 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] potiuk commented on issue #17373: Allow using default celery commands for custom Celery executors subclassed from existing

2021-08-05 Thread GitBox
potiuk commented on issue #17373: URL: https://github.com/apache/airflow/issues/17373#issuecomment-893223287 > @potiuk would you mind taking a look at my PR to see if I got it right? I feel that code might be a bit 'hacky' Not really. It's good. Small Nit :) -- This is an

[GitHub] [airflow] flolas commented on a change in pull request #17329: Split sql statements in DbApi run

2021-08-05 Thread GitBox
flolas commented on a change in pull request #17329: URL: https://github.com/apache/airflow/pull/17329#discussion_r683045221 ## File path: airflow/hooks/dbapi.py ## @@ -176,18 +178,29 @@ def run(self, sql, autocommit=False, parameters=None, handler=None): :param

[GitHub] [airflow] sudipto9 edited a comment on issue #17120: [Scheduler error] psycopg2.OperationalError: SSL SYSCALL error: Socket operation on non-socket

2021-08-05 Thread GitBox
sudipto9 edited a comment on issue #17120: URL: https://github.com/apache/airflow/issues/17120#issuecomment-893148745 @potiuk Without webserver and scheduler together, airflow is incomplete. When webserver service starts, we can start scheduler service as a integral part. We can have a

[GitHub] [airflow] saveriogzz commented on a change in pull request #15409: Support regex pattern in SFTPHOOK

2021-08-05 Thread GitBox
saveriogzz commented on a change in pull request #15409: URL: https://github.com/apache/airflow/pull/15409#discussion_r619141253 ## File path: airflow/providers/sftp/hooks/sftp.py ## @@ -166,16 +168,21 @@ def describe_directory(self, path: str) -> Dict[str, Dict[str, str]]:

[GitHub] [airflow-site] potiuk merged pull request #462: Add Seniorlink to Use Cases

2021-08-05 Thread GitBox
potiuk merged pull request #462: URL: https://github.com/apache/airflow-site/pull/462 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk merged pull request #17415: Optimize context sent for docker build

2021-08-05 Thread GitBox
potiuk merged pull request #17415: URL: https://github.com/apache/airflow/pull/17415 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #17419: Do not pull CI image for ownership fixing on first, fresh breeze run

2021-08-05 Thread GitBox
github-actions[bot] commented on pull request #17419: URL: https://github.com/apache/airflow/pull/17419#issuecomment-892910745 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] uranusjr merged pull request #17411: Proper warning message when recorded PID is different from current PID

2021-08-05 Thread GitBox
uranusjr merged pull request #17411: URL: https://github.com/apache/airflow/pull/17411 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] santosh-d3vpl3x closed pull request #17341: Add ExecStop to systemd service files.

2021-08-05 Thread GitBox
santosh-d3vpl3x closed pull request #17341: URL: https://github.com/apache/airflow/pull/17341 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk merged pull request #17412: Add timeout when asking whether to rebuild image

2021-08-05 Thread GitBox
potiuk merged pull request #17412: URL: https://github.com/apache/airflow/pull/17412 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17422: AttributeError: 'PostgresHook' object has no attribute 'schema'

2021-08-05 Thread GitBox
boring-cyborg[bot] commented on issue #17422: URL: https://github.com/apache/airflow/issues/17422#issuecomment-892783964 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] ephraimbuddy commented on pull request #15042: Add REST API auth flow for the new UI

2021-08-05 Thread GitBox
ephraimbuddy commented on pull request #15042: URL: https://github.com/apache/airflow/pull/15042#issuecomment-892595374 Thanks for the reviews, @msumit, I will revisit this and may have to open a new PR and address a lot of things -- This is an automated message from the Apache Git

[GitHub] [airflow] potiuk commented on pull request #17432: Fixes some static check errors

2021-08-05 Thread GitBox
potiuk commented on pull request #17432: URL: https://github.com/apache/airflow/pull/17432#issuecomment-893208649 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] potiuk closed pull request #17416: Remove CONTINUE_ON_PIP_CHECK_FAILURE parameter

2021-08-05 Thread GitBox
potiuk closed pull request #17416: URL: https://github.com/apache/airflow/pull/17416 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] yevsh edited a comment on issue #17395: DAG is executed twice on submit

2021-08-05 Thread GitBox
yevsh edited a comment on issue #17395: URL: https://github.com/apache/airflow/issues/17395#issuecomment-893270823 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] ashb commented on pull request #16860: Support DAGS folder being in different location on scheduler and runners

2021-08-05 Thread GitBox
ashb commented on pull request #16860: URL: https://github.com/apache/airflow/pull/16860#issuecomment-892628380 Looks like transient MSQQL errors :( ``` ERROR: for airflow Container "69eb70e8e951" is unhealthy. Encountered errors while bringing up the project. ``` --

[GitHub] [airflow] ephraimbuddy commented on pull request #17347: Handle and log exceptions raised during task callback

2021-08-05 Thread GitBox
ephraimbuddy commented on pull request #17347: URL: https://github.com/apache/airflow/pull/17347#issuecomment-892573706 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] potiuk commented on a change in pull request #17424: Fix failing static checks in main

2021-08-05 Thread GitBox
potiuk commented on a change in pull request #17424: URL: https://github.com/apache/airflow/pull/17424#discussion_r682970446 ## File path: airflow/utils/log/file_task_handler.py ## @@ -187,10 +187,14 @@ def _read(self, ti, try_number, metadata=None):

[GitHub] [airflow] potiuk merged pull request #17419: Do not pull CI image for ownership fixing on first, fresh breeze run

2021-08-05 Thread GitBox
potiuk merged pull request #17419: URL: https://github.com/apache/airflow/pull/17419 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ashb commented on a change in pull request #17405: Put the XCom.clear logic into XCom class to allow it hookable in custom XCom backend

2021-08-05 Thread GitBox
ashb commented on a change in pull request #17405: URL: https://github.com/apache/airflow/pull/17405#discussion_r682512524 ## File path: airflow/models/taskinstance.py ## @@ -656,11 +656,12 @@ def clear_xcom_data(self, session=None): :type session: Session

[GitHub] [airflow] txicos edited a comment on issue #17120: [Scheduler error] psycopg2.OperationalError: SSL SYSCALL error: Socket operation on non-socket

2021-08-05 Thread GitBox
txicos edited a comment on issue #17120: URL: https://github.com/apache/airflow/issues/17120#issuecomment-893024484 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow-site] potiuk commented on pull request #462: Add Seniorlink to Use Cases

2021-08-05 Thread GitBox
potiuk commented on pull request #462: URL: https://github.com/apache/airflow-site/pull/462#issuecomment-893306057 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] jedcunningham commented on pull request #17420: Update emr.rst

2021-08-05 Thread GitBox
jedcunningham commented on pull request #17420: URL: https://github.com/apache/airflow/pull/17420#issuecomment-893004278 Thanks @arvinder-mo! (Static check failure is unrelated) -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] potiuk merged pull request #17417: Increases timeout for helm chart builds

2021-08-05 Thread GitBox
potiuk merged pull request #17417: URL: https://github.com/apache/airflow/pull/17417 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk closed issue #17437: It's too slow to recognize new dag file when there is a log of dags files

2021-08-05 Thread GitBox
potiuk closed issue #17437: URL: https://github.com/apache/airflow/issues/17437 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] shlomi-viz commented on issue #17404: Path to dags folder in incorrect while using DagBag

2021-08-05 Thread GitBox
shlomi-viz commented on issue #17404: URL: https://github.com/apache/airflow/issues/17404#issuecomment-892516465 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] georborodin commented on issue #17373: Allow using default celery commands for custom Celery executors subclassed from existing

2021-08-05 Thread GitBox
georborodin commented on issue #17373: URL: https://github.com/apache/airflow/issues/17373#issuecomment-893122280 @potiuk would you mind taking a look at my PR to see if I got it right? I feel that code might be a bit 'hacky'  -- This is an automated message from the Apache Git

[GitHub] [airflow] github-actions[bot] commented on pull request #17411: Proper warning message when recorded PID is different from current PID

2021-08-05 Thread GitBox
github-actions[bot] commented on pull request #17411: URL: https://github.com/apache/airflow/pull/17411#issuecomment-892616319 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] potiuk commented on pull request #17329: Split sql statements in DbApi run

2021-08-05 Thread GitBox
potiuk commented on pull request #17329: URL: https://github.com/apache/airflow/pull/17329#issuecomment-893215329 > > sqlparse is not a core dependency -- it needs adding. > > Hi @ashb, what do you mean with "it needs adding"? I added sqlparse to setup.cfg. We need to do anything

[GitHub] [airflow] potiuk commented on a change in pull request #17423: Make schema in DBApiHook private

2021-08-05 Thread GitBox
potiuk commented on a change in pull request #17423: URL: https://github.com/apache/airflow/pull/17423#discussion_r682966113 ## File path: airflow/providers/postgres/hooks/postgres.py ## @@ -70,6 +70,7 @@ def __init__(self, *args, **kwargs) -> None:

[GitHub] [airflow] mik-laj commented on issue #17422: AttributeError: 'PostgresHook' object has no attribute 'schema'

2021-08-05 Thread GitBox
mik-laj commented on issue #17422: URL: https://github.com/apache/airflow/issues/17422#issuecomment-892910573 Can you provide output of airflow providers list command? I have the impression that the latest package requires Airflow 2.2. -- This is an automated message from the Apache Git

[GitHub] [airflow] cctvzd7 commented on issue #17370: Task set to be failed by scheduler directly, while all up streams success

2021-08-05 Thread GitBox
cctvzd7 commented on issue #17370: URL: https://github.com/apache/airflow/issues/17370#issuecomment-893113306 @jedcunningham @uranusjr Any ideas about this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] jedcunningham commented on pull request #17285: Add info log how to fix: More than one pod running with labels

2021-08-05 Thread GitBox
jedcunningham commented on pull request #17285: URL: https://github.com/apache/airflow/pull/17285#issuecomment-892834586 @wojsamjan, ah, gotcha. Can you open an issue for this? I think the right fix is to only attempt attaching to running pods, but I haven't thought it through completely.

[GitHub] [airflow] ephraimbuddy commented on issue #17394: WARNING - Recorded pid 4969 does not match the current pid 4969

2021-08-05 Thread GitBox
ephraimbuddy commented on issue #17394: URL: https://github.com/apache/airflow/issues/17394#issuecomment-892695780 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] potiuk commented on issue #17404: Path to dags folder in incorrect while using DagBag

2021-08-05 Thread GitBox
potiuk commented on issue #17404: URL: https://github.com/apache/airflow/issues/17404#issuecomment-892520910 Check your AIRFLOW_HOME settings. Just debug what are your settings when you run Test and fix it. Not sure how you are running yout tests and what settings you have but this is

[GitHub] [airflow] uranusjr commented on pull request #17436: Support fnmatch pattern in SFTP Hook and Sensor

2021-08-05 Thread GitBox
uranusjr commented on pull request #17436: URL: https://github.com/apache/airflow/pull/17436#issuecomment-893312844 I think my https://github.com/apache/airflow/pull/15409#discussion_r616309811 still applies. `fnmatch` is indeed a better solution, but we need to design the functions

[GitHub] [airflow] terryfugit commented on issue #17394: WARNING - Recorded pid 4969 does not match the current pid 4969

2021-08-05 Thread GitBox
terryfugit commented on issue #17394: URL: https://github.com/apache/airflow/issues/17394#issuecomment-892689988 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] github-actions[bot] commented on pull request #17427: Updating INTHEWILD.md

2021-08-05 Thread GitBox
github-actions[bot] commented on pull request #17427: URL: https://github.com/apache/airflow/pull/17427#issuecomment-893258628 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide

[GitHub] [airflow] jkmalek commented on pull request #11652: Support for sorting DAGs in the web UI

2021-08-05 Thread GitBox
jkmalek commented on pull request #11652: URL: https://github.com/apache/airflow/pull/11652#issuecomment-892689960 @jedcunningham rebased and fixed up where necessary; thanks for the heads-up on view tests! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] ephraimbuddy commented on issue #17370: Task set to be failed by scheduler directly, while all up streams success

2021-08-05 Thread GitBox
ephraimbuddy commented on issue #17370: URL: https://github.com/apache/airflow/issues/17370#issuecomment-893236021 > May be related with: #16625 If so, then it's resolved in https://github.com/apache/airflow/pull/16301 which will be released in 2.1.3 -- This is an automated

[GitHub] [airflow] potiuk merged pull request #17424: Fix failing static checks in main

2021-08-05 Thread GitBox
potiuk merged pull request #17424: URL: https://github.com/apache/airflow/pull/17424 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

<    1   2   3   4   >