[GitHub] [airflow] Draqun commented on pull request #29156: Add to provider.FTP possibility to use file-like objects.

2023-01-25 Thread via GitHub
Draqun commented on PR #29156: URL: https://github.com/apache/airflow/pull/29156#issuecomment-1404652289 The scenario is as follows: - a container is started using DockerOperator, where data is prepared for processing in the cloud (AWS and AZURE) - data after processing in the cloud

[GitHub] [airflow] wonhyeongseo opened a new pull request, #29176: fix: type annotation for `num_of_dpus` in GlueJobHook

2023-01-25 Thread via GitHub
wonhyeongseo opened a new pull request, #29176: URL: https://github.com/apache/airflow/pull/29176 closes: https://github.com/apache/airflow/issues/29091 Simple fix of type annotation for `num_of_dpus` according to [AWS Glue

[GitHub] [airflow] ephraimbuddy commented on pull request #28998: write to DB a user who triggered a dag via API endpoint request

2023-01-25 Thread via GitHub
ephraimbuddy commented on PR #28998: URL: https://github.com/apache/airflow/pull/28998#issuecomment-1404614517 > @ephraimbuddy Thanks for these inputs. I was actually looking at [cli_action_loggers.py](https://github.com/apache/airflow/blob/main/airflow/utils/cli_action_loggers.py). It

[GitHub] [airflow] wonhyeongseo commented on pull request #27841: fix: add pre-commit to ban urlparse

2023-01-25 Thread via GitHub
wonhyeongseo commented on PR #27841: URL: https://github.com/apache/airflow/pull/27841#issuecomment-1404614141 Hello @eladkal, hope you are doing well. Sorry for being so late and thank you for helping out. I installed WSL2(ubuntu) and configured the correct dev environment with guidance

[GitHub] [airflow] sudeepgupta90 commented on issue #19627: Providing a metadata secret conflicts with the use of pgbouncer

2023-01-25 Thread via GitHub
sudeepgupta90 commented on issue #19627: URL: https://github.com/apache/airflow/issues/19627#issuecomment-1404575271 @potiuk I have been thinking about this , and my own thoughts initially was to fix the issue which OP reported... **Why we should _not_ fix this in Airflow Helm

[GitHub] [airflow] maxnathaniel commented on issue #22408: Streamline trigger dag UX

2023-01-25 Thread via GitHub
maxnathaniel commented on issue #22408: URL: https://github.com/apache/airflow/issues/22408#issuecomment-1404551969 @bbovenzi ok great! Will take a look at that -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] boring-cyborg[bot] commented on issue #29175: Support for Redis Time series in Airflow common packages

2023-01-25 Thread boring-cyborg
boring-cyborg[bot] commented on issue #29175: URL: https://github.com/apache/airflow/issues/29175#issuecomment-1404530908 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] m2b opened a new issue, #29175: Support for Redis Time series in Airflow common packages

2023-01-25 Thread via GitHub
m2b opened a new issue, #29175: URL: https://github.com/apache/airflow/issues/29175 ### Description The current Redis API version is quite old. I need to implement a DAG for Timeseries data feature. Please upgrade to version that supports this. BTW, I was able to manually update

[GitHub] [airflow] sc-mitton commented on issue #28825: Bad request when triggering dag run with `note` in payload

2023-01-25 Thread via GitHub
sc-mitton commented on issue #28825: URL: https://github.com/apache/airflow/issues/28825#issuecomment-1404521932 Hi, I'm trying to become a new contributor to airflow and am looking for a good starter task to get my feet wet. I can't quite tell, but does this task still need someone to

[airflow] branch main updated: Bump ua-parser-js from 0.7.31 to 0.7.33 in /airflow/www (#29172)

2023-01-25 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 2e90c06c3e Bump ua-parser-js from 0.7.31 to

[GitHub] [airflow] bbovenzi merged pull request #29172: Bump ua-parser-js from 0.7.31 to 0.7.33 in /airflow/www

2023-01-25 Thread via GitHub
bbovenzi merged PR #29172: URL: https://github.com/apache/airflow/pull/29172 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] bbovenzi commented on issue #22408: Streamline trigger dag UX

2023-01-25 Thread via GitHub
bbovenzi commented on issue #22408: URL: https://github.com/apache/airflow/issues/22408#issuecomment-1404503695 @maxnathaniel We should be merging [this](https://github.com/apache/airflow/pull/27063) PR soon, so you could branch off of that and get started. I think the next useful step

[airflow] branch constraints-main updated: Updating constraints. Build id:

2023-01-25 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new ec22b0ae4b Updating

[GitHub] [airflow] josh-fell commented on a diff in pull request #29166: Correct tenant eval within async logic of DbtCloudHook

2023-01-25 Thread via GitHub
josh-fell commented on code in PR #29166: URL: https://github.com/apache/airflow/pull/29166#discussion_r1087126820 ## airflow/providers/dbt/cloud/hooks/dbt.py: ## @@ -181,33 +181,46 @@ def __init__(self, dbt_cloud_conn_id: str = default_conn_name, *args, **kwargs)

[GitHub] [airflow] hussein-awala opened a new pull request, #29174: [WIP] Deprecate dagrun `conf` and add `params` argument for the different APIs

2023-01-25 Thread via GitHub
hussein-awala opened a new pull request, #29174: URL: https://github.com/apache/airflow/pull/29174 closes: #29018 --- Deprecate dagrun `conf` argument and add `params` argument for the different Airflow APIs (UI, CLI, Python API, internal API and REST API), and add a check for

[GitHub] [airflow] josh-fell commented on pull request #29145: Attempt to fix integration with codecov

2023-01-25 Thread via GitHub
josh-fell commented on PR #29145: URL: https://github.com/apache/airflow/pull/29145#issuecomment-1404470908 > [2daf25b](https://github.com/apache/airflow/commit/2daf25bc08779a026cb88b6b8a93d29d5122d8ed):

[GitHub] [airflow] Taragolis commented on pull request #29145: Attempt to fix integration with codecov

2023-01-25 Thread via GitHub
Taragolis commented on PR #29145: URL: https://github.com/apache/airflow/pull/29145#issuecomment-1404468762 2daf25b:

[GitHub] [airflow] Taragolis commented on pull request #27947: refactored Amazon Redshift-data functionality into the hook

2023-01-25 Thread via GitHub
Taragolis commented on PR #27947: URL: https://github.com/apache/airflow/pull/27947#issuecomment-1404455178 Thin `boto3` client wrapper it is a Hook based on AwsBaseHook without extending positional and key-word arguments created. IMHO and personal thought: "The last think that we

[GitHub] [airflow] mrichman commented on a diff in pull request #28338: New AWS sensor — DynamoDBValueSensor

2023-01-25 Thread via GitHub
mrichman commented on code in PR #28338: URL: https://github.com/apache/airflow/pull/28338#discussion_r1087351017 ## airflow/providers/amazon/aws/example_dags/example_dynamodb_sensor.py: ## @@ -0,0 +1,44 @@ +# Licensed to the Apache Software Foundation (ASF) under one Review

[airflow] branch main updated (9b643c7201 -> 85415998cd)

2023-01-25 Thread onikolas
This is an automated email from the ASF dual-hosted git repository. onikolas pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 9b643c7201 Add AWS system test dashboard in Amazon provider package landing page and README (#29170) add

[GitHub] [airflow] o-nikolas merged pull request #29165: Sagemaker sys test: pull amazonlinux image from amazon instead of docker hub

2023-01-25 Thread via GitHub
o-nikolas merged PR #29165: URL: https://github.com/apache/airflow/pull/29165 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] jedcunningham commented on a diff in pull request #29058: Optionally export `airflow db clean` data to CSV files

2023-01-25 Thread via GitHub
jedcunningham commented on code in PR #29058: URL: https://github.com/apache/airflow/pull/29058#discussion_r1087310590 ## airflow/utils/db_cleanup.py: ## @@ -159,6 +170,14 @@ def _do_delete(*, query, orm_model, skip_archive, session): logger.debug("delete statement:\n%s",

[GitHub] [airflow] mrichman commented on pull request #28338: New AWS sensor — DynamoDBValueSensor

2023-01-25 Thread via GitHub
mrichman commented on PR #28338: URL: https://github.com/apache/airflow/pull/28338#issuecomment-1404388723 @o-nikolas Yes indeed, just haven't come up for air with all my new customers. It's definitely toward the top of my (ever growing) todo list. -- This is an automated message from

[GitHub] [airflow] github-actions[bot] commented on pull request #27522: Add example of dockerfile with creating new virtualenv

2023-01-25 Thread github-actions
github-actions[bot] commented on PR #27522: URL: https://github.com/apache/airflow/pull/27522#issuecomment-1404386889 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

[GitHub] [airflow] Taragolis commented on pull request #29145: Attempt to fix integration with codecov

2023-01-25 Thread via GitHub
Taragolis commented on PR #29145: URL: https://github.com/apache/airflow/pull/29145#issuecomment-1404377290 After reverting back and transfer huge payload (300+ MiB) codecov [fail again](https://app.codecov.io/github/apache/airflow/commit/44a21b80aee21f48739f5d285de676e1be036749)

[GitHub] [airflow] dstandish commented on a diff in pull request #29147: Rename most pod_id usage to pod_name in KubernetesExecutor

2023-01-25 Thread via GitHub
dstandish commented on code in PR #29147: URL: https://github.com/apache/airflow/pull/29147#discussion_r1087287016 ## airflow/executors/kubernetes_executor.py: ## @@ -353,12 +353,12 @@ def run_next(self, next_job: KubernetesJobType) -> None: self.run_pod_async(pod,

[GitHub] [airflow] dstandish commented on a diff in pull request #29058: Optionally export `airflow db clean` data to CSV files

2023-01-25 Thread via GitHub
dstandish commented on code in PR #29058: URL: https://github.com/apache/airflow/pull/29058#discussion_r1087278596 ## airflow/utils/db_cleanup.py: ## @@ -159,6 +170,14 @@ def _do_delete(*, query, orm_model, skip_archive, session): logger.debug("delete statement:\n%s",

[GitHub] [airflow] dstandish commented on a diff in pull request #29058: Optionally export `airflow db clean` data to CSV files

2023-01-25 Thread via GitHub
dstandish commented on code in PR #29058: URL: https://github.com/apache/airflow/pull/29058#discussion_r1087269922 ## airflow/cli/cli_parser.py: ## @@ -468,7 +468,18 @@ def string_lower_type(val): help="Don't preserve purged records in an archive table.",

[airflow] branch main updated (a6e21bc6ce -> 9b643c7201)

2023-01-25 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from a6e21bc6ce Unquarantine receive SIGTERM on Task Runner test (second attempt) (#29087) add 9b643c7201 Add AWS

[GitHub] [airflow] potiuk merged pull request #29170: Add AWS system test dashboard in Amazon provider package landing page and README

2023-01-25 Thread via GitHub
potiuk merged PR #29170: URL: https://github.com/apache/airflow/pull/29170 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch dependabot/npm_and_yarn/airflow/www/ua-parser-js-0.7.33 updated (c78422d731 -> 9e9ec3fefe)

2023-01-25 Thread taragolis
This is an automated email from the ASF dual-hosted git repository. taragolis pushed a change to branch dependabot/npm_and_yarn/airflow/www/ua-parser-js-0.7.33 in repository https://gitbox.apache.org/repos/asf/airflow.git discard c78422d731 Bump ua-parser-js from 0.7.31 to 0.7.33 in

[airflow] branch main updated (90ce88bf34 -> a6e21bc6ce)

2023-01-25 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 90ce88bf34 Set progress to auto (#29157) add a6e21bc6ce Unquarantine receive SIGTERM on Task Runner test (second

[GitHub] [airflow] potiuk closed issue #28658: Fix Quarantine tests

2023-01-25 Thread via GitHub
potiuk closed issue #28658: Fix Quarantine tests URL: https://github.com/apache/airflow/issues/28658 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk merged pull request #29087: Unquarantine receive SIGTERM on Task Runner test (second attempt)

2023-01-25 Thread via GitHub
potiuk merged PR #29087: URL: https://github.com/apache/airflow/pull/29087 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #29087: Unquarantine receive SIGTERM on Task Runner test (second attempt)

2023-01-25 Thread via GitHub
potiuk commented on PR #29087: URL: https://github.com/apache/airflow/pull/29087#issuecomment-1404326650 Looks good. merging. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] vandonr-amz commented on a diff in pull request #29053: introduce base class for EKS sensors

2023-01-25 Thread via GitHub
vandonr-amz commented on code in PR #29053: URL: https://github.com/apache/airflow/pull/29053#discussion_r1087255802 ## airflow/providers/amazon/aws/sensors/eks.py: ## @@ -57,7 +58,71 @@ ) -class EksClusterStateSensor(BaseSensorOperator): +class

[airflow] branch main updated: Set progress to auto (#29157)

2023-01-25 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 90ce88bf34 Set progress to auto (#29157)

[GitHub] [airflow] potiuk merged pull request #29157: Set Buildx build command progress to auto

2023-01-25 Thread via GitHub
potiuk merged PR #29157: URL: https://github.com/apache/airflow/pull/29157 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Add deferrable mode to DataprocCreateClusterOperator and DataprocUpdateClusterOperator (#28529)

2023-01-25 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 9fd80130e2 Add deferrable mode to

[GitHub] [airflow] potiuk merged pull request #28529: Add deferrable mode to DataprocCreateClusterOperator and

2023-01-25 Thread via GitHub
potiuk merged PR #28529: URL: https://github.com/apache/airflow/pull/28529 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #12598: Allow webserver to read pod logs directly

2023-01-25 Thread via GitHub
potiuk commented on PR #12598: URL: https://github.com/apache/airflow/pull/12598#issuecomment-1404291000 Looking at the dates., it looks like it's been merged before we produce Helm Chart release notes. Is there a particular need you miss it? BTW. If you think it's just "missing"

[airflow] branch main updated: Use `pod_name` when patching done KE pods (#29159)

2023-01-25 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new b8f15a98bf Use `pod_name` when patching

[GitHub] [airflow] jedcunningham merged pull request #29159: Use `pod_name` when patching done KE pods

2023-01-25 Thread via GitHub
jedcunningham merged PR #29159: URL: https://github.com/apache/airflow/pull/29159 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] Taragolis commented on a diff in pull request #29165: Sagemaker sys test: pull amazonlinux image from amazon instead of docker hub

2023-01-25 Thread via GitHub
Taragolis commented on code in PR #29165: URL: https://github.com/apache/airflow/pull/29165#discussion_r1087229408 ## tests/system/providers/amazon/aws/example_sagemaker.py: ## @@ -161,8 +161,12 @@ def _build_and_upload_docker_image(preprocess_script, repository_uri):

[GitHub] [airflow] vandonr-amz commented on a diff in pull request #29165: Sagemaker sys test: pull amazonlinux image from amazon instead of docker hub

2023-01-25 Thread via GitHub
vandonr-amz commented on code in PR #29165: URL: https://github.com/apache/airflow/pull/29165#discussion_r1087227395 ## tests/system/providers/amazon/aws/example_sagemaker.py: ## @@ -176,8 +177,8 @@ def _build_and_upload_docker_image(preprocess_script, repository_uri):

[GitHub] [airflow] potiuk closed issue #29149: Parameter for disabling scheduling

2023-01-25 Thread via GitHub
potiuk closed issue #29149: Parameter for disabling scheduling URL: https://github.com/apache/airflow/issues/29149 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] potiuk commented on issue #29149: Parameter for disabling scheduling

2023-01-25 Thread via GitHub
potiuk commented on issue #29149: URL: https://github.com/apache/airflow/issues/29149#issuecomment-1404282832 Additionally - why you do not want to disable scheduler? Seems like a reasonable "parameter" of your disaster recovery scenario where you would not start a scheduler, but

[GitHub] [airflow] vandonr-amz commented on a diff in pull request #29165: Sagemaker sys test: pull amazonlinux image from amazon instead of docker hub

2023-01-25 Thread via GitHub
vandonr-amz commented on code in PR #29165: URL: https://github.com/apache/airflow/pull/29165#discussion_r1087217539 ## tests/system/providers/amazon/aws/example_sagemaker.py: ## @@ -161,8 +161,12 @@ def _build_and_upload_docker_image(preprocess_script, repository_uri):

[GitHub] [airflow] ferruzzi commented on a diff in pull request #29168: AWS Neptune: Operators for StartDB and StopDB cluster

2023-01-25 Thread via GitHub
ferruzzi commented on code in PR #29168: URL: https://github.com/apache/airflow/pull/29168#discussion_r1087215660 ## airflow/providers/amazon/aws/hooks/neptune.py: ## @@ -0,0 +1,113 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[GitHub] [airflow] ferruzzi commented on a diff in pull request #29168: AWS Neptune: Operators for StartDB and StopDB cluster

2023-01-25 Thread via GitHub
ferruzzi commented on code in PR #29168: URL: https://github.com/apache/airflow/pull/29168#discussion_r1087215660 ## airflow/providers/amazon/aws/hooks/neptune.py: ## @@ -0,0 +1,113 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[airflow] branch dependabot/npm_and_yarn/airflow/www/ua-parser-js-0.7.33 created (now c78422d731)

2023-01-25 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/npm_and_yarn/airflow/www/ua-parser-js-0.7.33 in repository https://gitbox.apache.org/repos/asf/airflow.git at c78422d731 Bump ua-parser-js from 0.7.31 to 0.7.33 in

[GitHub] [airflow] dependabot[bot] opened a new pull request, #29172: Bump ua-parser-js from 0.7.31 to 0.7.33 in /airflow/www

2023-01-25 Thread dependabot
dependabot[bot] opened a new pull request, #29172: URL: https://github.com/apache/airflow/pull/29172 Bumps [ua-parser-js](https://github.com/faisalman/ua-parser-js) from 0.7.31 to 0.7.33. Changelog Sourced from

[GitHub] [airflow] Taragolis commented on pull request #29145: Attempt to fix integration with codecov

2023-01-25 Thread via GitHub
Taragolis commented on PR #29145: URL: https://github.com/apache/airflow/pull/29145#issuecomment-1404263289    https://app.codecov.io/gh/apache/airflow/commit/b9ff68189c1873bfb748ea6e02886ac345dbfbb9/tree Oh something really changed -- This is an automated message from

[GitHub] [airflow] Taragolis commented on pull request #29145: Attempt to fix integration with codecov

2023-01-25 Thread via GitHub
Taragolis commented on PR #29145: URL: https://github.com/apache/airflow/pull/29145#issuecomment-1404256287 If we struggling with codecov could we potentially use another service which provided same? --- 藍 藍 藍 > I am tempted to make this comment in our CI.yml > >

[GitHub] [airflow] potiuk commented on issue #22408: Streamline trigger dag UX

2023-01-25 Thread via GitHub
potiuk commented on issue #22408: URL: https://github.com/apache/airflow/issues/22408#issuecomment-1404256112 Assigned you @maxnathaniel. I think checking it should be the first thing to do and if you find it's fixed, making a comment about it would be useful as well, so that we can close

[airflow] branch main updated (02bebf897b -> cebeb68d8b)

2023-01-25 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 02bebf897b Add deferrable mode to MLEngineStartTrainingJobOperator (#27405) add cebeb68d8b Add release flag to

[GitHub] [airflow] potiuk merged pull request #28952: Rename Breeze `generate-issue-content`

2023-01-25 Thread via GitHub
potiuk merged PR #28952: URL: https://github.com/apache/airflow/pull/28952 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #29139: Deletion of schema, login, password, port

2023-01-25 Thread via GitHub
potiuk commented on PR #29139: URL: https://github.com/apache/airflow/pull/29139#issuecomment-1404251970 > Sqlite Connection doc Agree with @josh-fell - @atharvmishra1999 - It would be better to have it as part of the same PR actually. Could you please do it as well? -- This is an

[GitHub] [airflow] josh-fell commented on pull request #29145: Attempt to fix integration with codecov

2023-01-25 Thread via GitHub
josh-fell commented on PR #29145: URL: https://github.com/apache/airflow/pull/29145#issuecomment-1404251076 I think it would be beneficial for maintainers at least directionally as you mentioned. That's why I was looking at it initially. Also, perhaps it's could be a non-failing CI

[GitHub] [airflow] potiuk commented on issue #29150: trigger process missing from Airflow docker docs

2023-01-25 Thread via GitHub
potiuk commented on issue #29150: URL: https://github.com/apache/airflow/issues/29150#issuecomment-1404249160 feel free to add it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[airflow] branch main updated (29a26a810e -> 02bebf897b)

2023-01-25 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 29a26a810e Migrate DagFileProcessorManager._deactivate_stale_dags to Internal API (#28476) add 02bebf897b Add

[GitHub] [airflow] potiuk merged pull request #27405: Add deferrable mode to MLEngineStartTrainingJobOperator

2023-01-25 Thread via GitHub
potiuk merged PR #27405: URL: https://github.com/apache/airflow/pull/27405 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] Taragolis commented on issue #29167: Airflow webserver emits malformed HTTP Response Status Line when endpoint/resource is not found

2023-01-25 Thread via GitHub
Taragolis commented on issue #29167: URL: https://github.com/apache/airflow/issues/29167#issuecomment-1404248242 I guess something wrong with your locale, try to set to UTF-8 instead of C on both client and airflow server -- This is an automated message from the Apache Git Service. To

[airflow] branch main updated (c18dbe963a -> 29a26a810e)

2023-01-25 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from c18dbe963a fixed et.c type to etc. (#29163) add 29a26a810e Migrate DagFileProcessorManager._deactivate_stale_dags

[GitHub] [airflow] potiuk closed issue #28270: AIP-44 Migrate DagFileProcessorManager._deactivate_stale_dags to Internal API

2023-01-25 Thread via GitHub
potiuk closed issue #28270: AIP-44 Migrate DagFileProcessorManager._deactivate_stale_dags to Internal API URL: https://github.com/apache/airflow/issues/28270 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] potiuk merged pull request #28476: Migrate DagFileProcessorManager._deactivate_stale_dags to Internal API

2023-01-25 Thread via GitHub
potiuk merged PR #28476: URL: https://github.com/apache/airflow/pull/28476 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] Taragolis commented on issue #29167: Airflow webserver emits malformed HTTP Response Status Line when endpoint/resource is not found

2023-01-25 Thread via GitHub
Taragolis commented on issue #29167: URL: https://github.com/apache/airflow/issues/29167#issuecomment-1404244117 Unable reproduce in 2.3.2: `breeze start-airflow --db-reset --use-airflow-version 2.3.2` curl --- ```console ❯ curl -v http://localhost:28080/health *

[GitHub] [airflow] potiuk commented on pull request #29171: Added Snowflake provider to the Docker image

2023-01-25 Thread via GitHub
potiuk commented on PR #29171: URL: https://github.com/apache/airflow/pull/29171#issuecomment-1404243258 I think static checks will fail and some fixes will need to be applied: Specifically https://airflow.apache.org/docs/docker-stack/build-arg-ref.html should be updated Also

[GitHub] [airflow] potiuk commented on pull request #29145: Attempt to fix integration with codecov

2023-01-25 Thread via GitHub
potiuk commented on PR #29145: URL: https://github.com/apache/airflow/pull/29145#issuecomment-1404239480 I think it's about 10th attempt I remember to fix the codecov support :D. I am tempted to make this comment in our CI.yml ``` # For those who notice that our code

[GitHub] [airflow] josh-fell commented on pull request #29145: Attempt to fix integration with codecov

2023-01-25 Thread via GitHub
josh-fell commented on PR #29145: URL: https://github.com/apache/airflow/pull/29145#issuecomment-1404233872 >I don't know but are we change branch in he UI? I assume we don't have privs. But the last reports sent to codecov aligns pretty well with the `master` -> `main` switch. --

[GitHub] [airflow] francescomucio opened a new pull request, #29171: Added Snowflake provider to the Docker image

2023-01-25 Thread via GitHub
francescomucio opened a new pull request, #29171: URL: https://github.com/apache/airflow/pull/29171 The Snowflake database is quite popular and it makes sense to have its provider already available in the standard Docker image. -- This is an automated message from the Apache Git

[GitHub] [airflow] vincbeck commented on pull request #28900: [WIP] Convert DagFileProcessor.execute_callbacks to Internal API

2023-01-25 Thread via GitHub
vincbeck commented on PR #28900: URL: https://github.com/apache/airflow/pull/28900#issuecomment-140419 @mhenc and @potiuk whenever you get a chance if you can take a look and give your thoughts please :) There is a lot of moving and refactoring code here so I'll definitely need your

[GitHub] [airflow] vincbeck commented on pull request #29170: Add AWS system test dashboard in Amazon provider package landing page and README

2023-01-25 Thread via GitHub
vincbeck commented on PR #29170: URL: https://github.com/apache/airflow/pull/29170#issuecomment-1404192030 I had to tweak it a bit to pass the test

[GitHub] [airflow] Taragolis commented on pull request #29145: wip: Attempt to fix integration with codecov

2023-01-25 Thread via GitHub
Taragolis commented on PR #29145: URL: https://github.com/apache/airflow/pull/29145#issuecomment-1404177155 > Funny, I was also looking at this over the weekend. A few things are going on, and it seems like we've had the codecov battle before. I think I've also hear in Slack about

[GitHub] [airflow] josh-fell commented on a diff in pull request #29166: Correct tenant eval within async logic of DbtCloudHook

2023-01-25 Thread via GitHub
josh-fell commented on code in PR #29166: URL: https://github.com/apache/airflow/pull/29166#discussion_r1087126820 ## airflow/providers/dbt/cloud/hooks/dbt.py: ## @@ -181,33 +181,46 @@ def __init__(self, dbt_cloud_conn_id: str = default_conn_name, *args, **kwargs)

[GitHub] [airflow] josh-fell commented on a diff in pull request #29166: Correct tenant eval within async logic of DbtCloudHook

2023-01-25 Thread via GitHub
josh-fell commented on code in PR #29166: URL: https://github.com/apache/airflow/pull/29166#discussion_r1087126470 ## airflow/providers/dbt/cloud/hooks/dbt.py: ## @@ -181,33 +181,46 @@ def __init__(self, dbt_cloud_conn_id: str = default_conn_name, *args, **kwargs)

[GitHub] [airflow] vincbeck commented on a diff in pull request #29168: AWS Neptune: Operators for StartDB and StopDB cluster

2023-01-25 Thread via GitHub
vincbeck commented on code in PR #29168: URL: https://github.com/apache/airflow/pull/29168#discussion_r1087122269 ## airflow/providers/amazon/aws/hooks/neptune.py: ## @@ -0,0 +1,113 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[GitHub] [airflow] loulsb commented on pull request #29116: Add colors in help outputs of Airfow CLI commands #28789

2023-01-25 Thread via GitHub
loulsb commented on PR #29116: URL: https://github.com/apache/airflow/pull/29116#issuecomment-1404166547 I finally figured out the type error and fixed it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] ferruzzi commented on a diff in pull request #29168: AWS Neptune: Operators for StartDB and StopDB cluster

2023-01-25 Thread via GitHub
ferruzzi commented on code in PR #29168: URL: https://github.com/apache/airflow/pull/29168#discussion_r1087117514 ## airflow/providers/amazon/aws/hooks/neptune.py: ## @@ -0,0 +1,113 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[GitHub] [airflow] ferruzzi commented on a diff in pull request #29168: AWS Neptune: Operators for StartDB and StopDB cluster

2023-01-25 Thread via GitHub
ferruzzi commented on code in PR #29168: URL: https://github.com/apache/airflow/pull/29168#discussion_r1087115190 ## airflow/providers/amazon/aws/hooks/neptune.py: ## @@ -0,0 +1,113 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[GitHub] [airflow] kolfild26 commented on pull request #28998: write to DB a user who triggered a dag via API endpoint request

2023-01-25 Thread via GitHub
kolfild26 commented on PR #28998: URL: https://github.com/apache/airflow/pull/28998#issuecomment-1404158145 @ephraimbuddy Thanks for these inputs. I was actually looking at [cli_action_loggers.py](https://github.com/apache/airflow/blob/main/airflow/utils/cli_action_loggers.py). It

[GitHub] [airflow] Taragolis commented on a diff in pull request #29165: Sagemaker sys test: pull amazonlinux image from amazon instead of docker hub

2023-01-25 Thread via GitHub
Taragolis commented on code in PR #29165: URL: https://github.com/apache/airflow/pull/29165#discussion_r1087112396 ## tests/system/providers/amazon/aws/example_sagemaker.py: ## @@ -161,8 +161,12 @@ def _build_and_upload_docker_image(preprocess_script, repository_uri):

[GitHub] [airflow] Taragolis commented on a diff in pull request #29165: Sagemaker sys test: pull amazonlinux image from amazon instead of docker hub

2023-01-25 Thread via GitHub
Taragolis commented on code in PR #29165: URL: https://github.com/apache/airflow/pull/29165#discussion_r1087110875 ## tests/system/providers/amazon/aws/example_sagemaker.py: ## @@ -161,8 +161,12 @@ def _build_and_upload_docker_image(preprocess_script, repository_uri):

[GitHub] [airflow] Taragolis commented on a diff in pull request #29168: AWS Neptune: Operators for StartDB and StopDB cluster

2023-01-25 Thread via GitHub
Taragolis commented on code in PR #29168: URL: https://github.com/apache/airflow/pull/29168#discussion_r1087109575 ## airflow/providers/amazon/aws/hooks/neptune.py: ## @@ -0,0 +1,113 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[GitHub] [airflow] vincbeck commented on a diff in pull request #29168: AWS Neptune: Operators for StartDB and StopDB cluster

2023-01-25 Thread via GitHub
vincbeck commented on code in PR #29168: URL: https://github.com/apache/airflow/pull/29168#discussion_r1087100539 ## airflow/providers/amazon/aws/operators/neptune.py: ## @@ -0,0 +1,152 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[GitHub] [airflow] vincbeck commented on a diff in pull request #29168: AWS Neptune: Operators for StartDB and StopDB cluster

2023-01-25 Thread via GitHub
vincbeck commented on code in PR #29168: URL: https://github.com/apache/airflow/pull/29168#discussion_r1087100539 ## airflow/providers/amazon/aws/operators/neptune.py: ## @@ -0,0 +1,152 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[GitHub] [airflow] Taragolis commented on a diff in pull request #29168: AWS Neptune: Operators for StartDB and StopDB cluster

2023-01-25 Thread via GitHub
Taragolis commented on code in PR #29168: URL: https://github.com/apache/airflow/pull/29168#discussion_r1087077136 ## airflow/providers/amazon/aws/operators/neptune.py: ## @@ -0,0 +1,152 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[GitHub] [airflow] Taragolis commented on a diff in pull request #29165: Sagemaker sys test: pull amazonlinux image from amazon instead of docker hub

2023-01-25 Thread via GitHub
Taragolis commented on code in PR #29165: URL: https://github.com/apache/airflow/pull/29165#discussion_r1087106858 ## tests/system/providers/amazon/aws/example_sagemaker.py: ## @@ -161,8 +161,12 @@ def _build_and_upload_docker_image(preprocess_script, repository_uri):

[GitHub] [airflow] vandonr-amz commented on a diff in pull request #29165: Sagemaker sys test: pull amazonlinux image from amazon instead of docker hub

2023-01-25 Thread via GitHub
vandonr-amz commented on code in PR #29165: URL: https://github.com/apache/airflow/pull/29165#discussion_r1087104394 ## tests/system/providers/amazon/aws/example_sagemaker.py: ## @@ -161,8 +161,12 @@ def _build_and_upload_docker_image(preprocess_script, repository_uri):

[GitHub] [airflow] swapz-z commented on a diff in pull request #29168: AWS Neptune: Operators for StartDB and StopDB cluster

2023-01-25 Thread via GitHub
swapz-z commented on code in PR #29168: URL: https://github.com/apache/airflow/pull/29168#discussion_r1087102490 ## airflow/providers/amazon/aws/hooks/neptune.py: ## @@ -0,0 +1,113 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[GitHub] [airflow] Taragolis commented on pull request #29144: rewrite invoke lamba operator tests

2023-01-25 Thread via GitHub
Taragolis commented on PR #29144: URL: https://github.com/apache/airflow/pull/29144#issuecomment-1404142990 I think more time spending for create Lambda environment. Potentially we could move this kind of tests which required a lot of time for execution to the

[GitHub] [airflow] ephraimbuddy opened a new pull request, #29169: Remove misleading docstring on dagrun_timeout

2023-01-25 Thread via GitHub
ephraimbuddy opened a new pull request, #29169: URL: https://github.com/apache/airflow/pull/29169 This docstring is no longer correct (since 2.0) and should be removed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[airflow] branch main updated (b314db9880 -> c18dbe963a)

2023-01-25 Thread joshfell
This is an automated email from the ASF dual-hosted git repository. joshfell pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from b314db9880 Update broken link for VS Code Quick Start guide (#29154) add c18dbe963a fixed et.c type to etc.

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #29163: fixed et.c typo to etc.

2023-01-25 Thread boring-cyborg
boring-cyborg[bot] commented on PR #29163: URL: https://github.com/apache/airflow/pull/29163#issuecomment-1404138603 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] josh-fell merged pull request #29163: fixed et.c typo to etc.

2023-01-25 Thread via GitHub
josh-fell merged PR #29163: URL: https://github.com/apache/airflow/pull/29163 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] Taragolis commented on a diff in pull request #29168: AWS Neptune: Operators for StartDB and StopDB cluster

2023-01-25 Thread via GitHub
Taragolis commented on code in PR #29168: URL: https://github.com/apache/airflow/pull/29168#discussion_r1087077136 ## airflow/providers/amazon/aws/operators/neptune.py: ## @@ -0,0 +1,152 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[GitHub] [airflow] vandonr-amz commented on a diff in pull request #29165: Sagemaker sys test: pull amazonlinux image from amazon instead of docker hub

2023-01-25 Thread via GitHub
vandonr-amz commented on code in PR #29165: URL: https://github.com/apache/airflow/pull/29165#discussion_r1087091128 ## tests/system/providers/amazon/aws/example_sagemaker.py: ## @@ -161,8 +161,12 @@ def _build_and_upload_docker_image(preprocess_script, repository_uri):

[GitHub] [airflow] swapz-z commented on issue #28289: Add AWS Neptune hook and operators

2023-01-25 Thread via GitHub
swapz-z commented on issue #28289: URL: https://github.com/apache/airflow/issues/28289#issuecomment-1404127483 Thanks for the patience @shubham22 @o-nikolas I am finished with the implementation. However, for writing tests for operators, I am not sure, how to proceed with the

[GitHub] [airflow] o-nikolas commented on pull request #27583: enable https requests with ssl verification

2023-01-25 Thread via GitHub
o-nikolas commented on PR #27583: URL: https://github.com/apache/airflow/pull/27583#issuecomment-1404110365 Closing this PR as stale, we can re-open if the original author has time to get back to this one. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] o-nikolas closed pull request #27583: enable https requests with ssl verification

2023-01-25 Thread via GitHub
o-nikolas closed pull request #27583: enable https requests with ssl verification URL: https://github.com/apache/airflow/pull/27583 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

  1   2   >