This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new e1a14ae9ee Fix false-positive spellcheck failure (#
potiuk merged PR #29190:
URL: https://github.com/apache/airflow/pull/29190
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflow.a
wonhyeongseo commented on PR #29176:
URL: https://github.com/apache/airflow/pull/29176#issuecomment-1405968684
![image](https://user-images.githubusercontent.com/29195190/215002637-9640348f-8c43-4138-898b-0376b264a8c6.png)
Updated as you suggested, @Taragolis! Thank you so much for guidin
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch constraints-main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/constraints-main by this push:
new 03266f3e01 Updating con
o-nikolas commented on code in PR #29190:
URL: https://github.com/apache/airflow/pull/29190#discussion_r1088465313
##
airflow/providers/amazon/aws/utils/tags.py:
##
@@ -24,7 +24,7 @@ def format_tags(source: Any, *, key_label: str = "Key",
value_label: str = "Valu
If given
github-actions[bot] commented on PR #28291:
URL: https://github.com/apache/airflow/pull/28291#issuecomment-1405841723
This pull request has been automatically marked as stale because it has not
had recent activity. It will be closed in 5 days if no further activity occurs.
Thank you for you
github-actions[bot] commented on PR #28292:
URL: https://github.com/apache/airflow/pull/28292#issuecomment-1405841691
This pull request has been automatically marked as stale because it has not
had recent activity. It will be closed in 5 days if no further activity occurs.
Thank you for you
Taragolis opened a new pull request, #29190:
URL: https://github.com/apache/airflow/pull/29190
Annoying error in local AWS Documentation build
```console
❯ breeze build-docs --package-filter apache-airflow-providers-amazon
== apache-airflow-provid
snjypl commented on PR #29188:
URL: https://github.com/apache/airflow/pull/29188#issuecomment-1405824206
i tried the below code to check the serialization/deserialization:
```
from airflow.models.dagbag import DagBag
from airflow.serialization.serialized_objects import
BaseSeriali
snjypl commented on PR #29188:
URL: https://github.com/apache/airflow/pull/29188#issuecomment-1405818900
Hi Team @potiuk @mhenc @mhenc
this task appears to be more complex than i expected. i went through the
[AIP 44,
](https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-44+Ai
This is an automated email from the ASF dual-hosted git repository.
onikolas pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new e588c4a5d0 mark DBs created during RDS system tes
o-nikolas merged PR #29187:
URL: https://github.com/apache/airflow/pull/29187
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflo
snjypl opened a new pull request, #29188:
URL: https://github.com/apache/airflow/pull/29188
Fixes: [#28615](https://github.com/apache/airflow/issues/28615)
---
**^ Add meaningful description above**
Read the **[Pull Request
Guidelines](https://github.com/apache/airflow/b
potiuk commented on PR #29171:
URL: https://github.com/apache/airflow/pull/29171#issuecomment-1405787133
> I am not sure how to fix static check that is requiring to regenerate the
image with `breeze`.
The message printed is:
```
Image generation is needed. Please run this c
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new c231f1174d Fix asset compilation in start-airflow (
potiuk merged PR #29185:
URL: https://github.com/apache/airflow/pull/29185
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflow.a
francescomucio commented on PR #29171:
URL: https://github.com/apache/airflow/pull/29171#issuecomment-1405760030
I am not sure how to fix static check that is requiring to regenerate the
image with `breeze`.
--
This is an automated message from the Apache Git Service.
To respond to the m
potiuk commented on PR #28444:
URL: https://github.com/apache/airflow/pull/28444#issuecomment-1405760068
> Hi, when will this be released? It is not in apache-airflow[gcp]==2.5.1.
Why do you think so ?
--
This is an automated message from the Apache Git Service.
To respond t
vandonr-amz opened a new pull request, #29187:
URL: https://github.com/apache/airflow/pull/29187
there is a security risk with having DBs publicly accessible, even if it's
for a short time span and they are deleted afterwards.
ran the tests on my machine, and they still pass with this
This is an automated email from the ASF dual-hosted git repository.
eladkal pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
from 2493476a7e introduce base class for EKS sensors (#29053)
add 58d1fff27f Also remove mypy cache when stopping bree
eladkal merged PR #29184:
URL: https://github.com/apache/airflow/pull/29184
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflow.
This is an automated email from the ASF dual-hosted git repository.
onikolas pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
from 5f8ceb2ff3 shorten poke intervals on systems tests (#29183)
add 2493476a7e introduce base class for EKS sensors
o-nikolas merged PR #29053:
URL: https://github.com/apache/airflow/pull/29053
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflo
o-nikolas commented on issue #28289:
URL: https://github.com/apache/airflow/issues/28289#issuecomment-1405698042
> Thanks for the patience @shubham22 @o-nikolas
>
> I am finished with the implementation. However, for writing tests for
operators, I am not sure, how to proceed with the
This is an automated email from the ASF dual-hosted git repository.
onikolas pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 5f8ceb2ff3 shorten poke intervals on systems test
o-nikolas merged PR #29183:
URL: https://github.com/apache/airflow/pull/29183
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflo
syun64 commented on PR #8545:
URL: https://github.com/apache/airflow/pull/8545#issuecomment-1405683118
@auvipy are you currently working on this PR? If not, I'm happy to take the
ideas and open up a new one that's works out of the
DagFileProcessor/DagFileProcessingManager
--
This is an a
Taragolis commented on issue #29177:
URL: https://github.com/apache/airflow/issues/29177#issuecomment-1405669839
More constructive discussions usually happen in the PR! Looking forward to
your Pull Request 🥳
BTW, you could create PR without creating issue there is no restriction for
jens-scheffler-bosch commented on PR #27063:
URL: https://github.com/apache/airflow/pull/27063#issuecomment-1405665838
Hi @ashb && @bbovenzi applied feedback, resolved merge conflict, added
screen snippets, reverted part 2 of AIP-50 - ready for next stage of review!
--
This is an automate
jens-scheffler-bosch commented on code in PR #27063:
URL: https://github.com/apache/airflow/pull/27063#discussion_r1088336825
##
airflow/www/templates/airflow/trigger.html:
##
@@ -27,11 +27,93 @@
{% endblock %}
+{% macro form_element(form_key, form_details) %}
+
+
+
potiuk commented on PR #29185:
URL: https://github.com/apache/airflow/pull/29185#issuecomment-1405661526
After this one is merged, errors in asset compilation in start-airflow will
be visible like that:
https://user-images.githubusercontent.com/595491/214951998-06b4ffac-97e4-4592-b703
Taragolis commented on PR #29176:
URL: https://github.com/apache/airflow/pull/29176#issuecomment-1405659794
🤣 `mypy` became crazy when tried to make static check against condition in
Hook
https://github.com/apache/airflow/blob/c4c14c07a99b1554346a426aa947e68eb52ce31e/airflow/provider
potiuk opened a new pull request, #29185:
URL: https://github.com/apache/airflow/pull/29185
The recent change #29080 introduced missing black import in the pre-commit
that run the compilation. The compilation happened in the background thread and
it's ouptut was only visible in the asset_co
Taragolis commented on PR #28459:
URL: https://github.com/apache/airflow/pull/28459#issuecomment-1405644763
👀 😢 👀
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubs
jens-scheffler-bosch commented on code in PR #27063:
URL: https://github.com/apache/airflow/pull/27063#discussion_r1088325402
##
airflow/www/templates/airflow/trigger.html:
##
@@ -27,11 +27,93 @@
{% endblock %}
+{% macro form_element(form_key, form_details) %}
+
+
+
jens-scheffler-bosch commented on code in PR #27063:
URL: https://github.com/apache/airflow/pull/27063#discussion_r1088324192
##
airflow/www/static/js/trigger.js:
##
@@ -19,33 +19,190 @@
/* global document, CodeMirror, window */
-const textArea = document.getElementById('js
jens-scheffler-bosch commented on code in PR #27063:
URL: https://github.com/apache/airflow/pull/27063#discussion_r1088323671
##
airflow/www/static/js/trigger.js:
##
@@ -19,33 +19,190 @@
/* global document, CodeMirror, window */
-const textArea = document.getElementById('js
jens-scheffler-bosch commented on code in PR #27063:
URL: https://github.com/apache/airflow/pull/27063#discussion_r1088323111
##
airflow/example_dags/example_params_ui_tutorial.py:
##
@@ -0,0 +1,234 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more c
jens-scheffler-bosch commented on code in PR #27063:
URL: https://github.com/apache/airflow/pull/27063#discussion_r1088321851
##
airflow/config_templates/config.yml:
##
@@ -1529,6 +1529,19 @@ webserver:
type: boolean
example: ~
default: "False"
+trigger_
potiuk opened a new pull request, #29184:
URL: https://github.com/apache/airflow/pull/29184
When Breeze is stoped, by default all volumes created are removed, unless
you specify `--preserve-volumes`. The "mypy-cache-volume" was not removed
because it is not created by docker-compose.
potiuk commented on PR #29184:
URL: https://github.com/apache/airflow/pull/29184#issuecomment-1405602489
cc: @ferruzzi @vincbeck
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comm
vincbeck commented on code in PR #29183:
URL: https://github.com/apache/airflow/pull/29183#discussion_r1088278788
##
tests/system/providers/amazon/aws/example_athena.py:
##
@@ -117,6 +119,7 @@ def read_results_from_s3(bucket_name, query_execution_id):
query=query_read_t
vandonr-amz opened a new pull request, #29183:
URL: https://github.com/apache/airflow/pull/29183
since https://github.com/apache/airflow/pull/28528 was merged, we respect
the polling times instead of pinging the API constantly. This means that some
tests that have sensors that used to wait
dstandish commented on PR #27758:
URL: https://github.com/apache/airflow/pull/27758#issuecomment-1405520466
added docs
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
vchiapaikeo commented on PR #28942:
URL: https://github.com/apache/airflow/pull/28942#issuecomment-1405481755
Hey @uranusjr , anything else I can do here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above t
dstandish commented on code in PR #29058:
URL: https://github.com/apache/airflow/pull/29058#discussion_r1088184702
##
airflow/utils/db_cleanup.py:
##
@@ -159,6 +170,14 @@ def _do_delete(*, query, orm_model, skip_archive, session):
logger.debug("delete statement:\n%s", delet
pankajastro commented on code in PR #29136:
URL: https://github.com/apache/airflow/pull/29136#discussion_r1088184228
##
airflow/providers/google/cloud/hooks/dataproc.py:
##
@@ -985,6 +985,68 @@ def list_batches(
)
return result
+@GoogleBaseHook.fallback_t
dstandish commented on code in PR #29058:
URL: https://github.com/apache/airflow/pull/29058#discussion_r1088179007
##
airflow/utils/db_cleanup.py:
##
@@ -159,6 +170,14 @@ def _do_delete(*, query, orm_model, skip_archive, session):
logger.debug("delete statement:\n%s", delet
eladkal commented on issue #26207:
URL: https://github.com/apache/airflow/issues/26207#issuecomment-1405320842
Duplicate of https://github.com/apache/airflow/issues/28045
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
eladkal closed issue #26207: update google-video-intelligence dependency in
google provider
URL: https://github.com/apache/airflow/issues/26207
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp
eladkal commented on issue #28045:
URL: https://github.com/apache/airflow/issues/28045#issuecomment-1405318675
PRs are welcome
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment
grimwm commented on PR #28444:
URL: https://github.com/apache/airflow/pull/28444#issuecomment-1405298383
Hi, when will this be released? It is not in 2.5.1.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
jonheysek commented on issue #28045:
URL: https://github.com/apache/airflow/issues/28045#issuecomment-1405271309
Looks like DV360 v1.1 API will be fully sunsetted on Feb 28, 2022, at which
point
the current, stable GoogleDisplayVideo360 operators won't work.
https://ads-developer
kolfild26 commented on PR #28998:
URL: https://github.com/apache/airflow/pull/28998#issuecomment-1405236443
> We also need a test
Ok, will update once it's done.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use t
tqtensor opened a new pull request, #29181:
URL: https://github.com/apache/airflow/pull/29181
motivation: allowing users to specify the type of VM machine in the
`secondary_worker_config`, according to the enum definition from Google's
[Dataproc Python
client](https://github.com/googleapis
This is an automated email from the ASF dual-hosted git repository.
eladkal pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new c4e10ac9e7 improve README_RELEASE_PROVIDER_PACKAGE
eladkal merged PR #29180:
URL: https://github.com/apache/airflow/pull/29180
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflow.
potiuk commented on PR #29171:
URL: https://github.com/apache/airflow/pull/29171#issuecomment-1405187009
Some failures to fix.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment
eladkal opened a new pull request, #29180:
URL: https://github.com/apache/airflow/pull/29180
---
**^ Add meaningful description above**
Read the **[Pull Request
Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)**
for more inf
eladkal commented on issue #29103:
URL: https://github.com/apache/airflow/issues/29103#issuecomment-1405134915
Thank you everyone.
Providers are released
I invite everyone to help improve providers for the next release, a list of
open bugs can be found
[here](https://github.com/apache
eladkal closed issue #29103: Status of testing Providers that were prepared on
January 23, 2023
URL: https://github.com/apache/airflow/issues/29103
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to th
This is an automated email from the ASF dual-hosted git repository.
eladkal pushed a change to annotated tag providers-papermill/3.1.1
in repository https://gitbox.apache.org/repos/asf/airflow.git
*** WARNING: tag providers-papermill/3.1.1 was modified! ***
from dd6cef7889 (commit)
to
This is an automated email from the ASF dual-hosted git repository.
eladkal pushed a change to annotated tag providers-docker/3.5.0
in repository https://gitbox.apache.org/repos/asf/airflow.git
*** WARNING: tag providers-docker/3.5.0 was modified! ***
from dd6cef7889 (commit)
to adc17
This is an automated email from the ASF dual-hosted git repository.
eladkal pushed a change to annotated tag providers-apache-cassandra/3.1.1
in repository https://gitbox.apache.org/repos/asf/airflow.git
*** WARNING: tag providers-apache-cassandra/3.1.1 was modified! ***
from dd6cef7889 (co
eladkal merged PR #728:
URL: https://github.com/apache/airflow-site/pull/728
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflow
Author: eladkal
Date: Thu Jan 26 14:40:29 2023
New Revision: 59596
Log:
Release Airflow Providers on 2023-01-26
Added:
release/airflow/providers/apache-airflow-providers-apache-cassandra-3.1.1.tar.gz
- copied unchanged from r59595,
dev/airflow/providers/apache-airflow-providers-apache
ephraimbuddy commented on code in PR #29058:
URL: https://github.com/apache/airflow/pull/29058#discussion_r1087901858
##
airflow/utils/db_cleanup.py:
##
@@ -159,6 +170,14 @@ def _do_delete(*, query, orm_model, skip_archive, session):
logger.debug("delete statement:\n%s", de
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch gh-pages
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
The following commit(s) were added to refs/heads/gh-pages by this push:
new 611afc7828 Deploying to gh-pages f
This is an automated email from the ASF dual-hosted git repository.
joshfell pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
The following commit(s) were added to refs/heads/main by this push:
new 4384d31521 Add SAS provider to Ecosystem pag
josh-fell merged PR #730:
URL: https://github.com/apache/airflow-site/pull/730
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airfl
Taragolis commented on code in PR #29145:
URL: https://github.com/apache/airflow/pull/29145#discussion_r1087884202
##
.coveragerc:
##
@@ -16,14 +16,25 @@
# specific language governing permissions and limitations
# under the License.
-[report]
+[run]
+branch = True
+relative_
Taragolis commented on code in PR #29145:
URL: https://github.com/apache/airflow/pull/29145#discussion_r1087884202
##
.coveragerc:
##
@@ -16,14 +16,25 @@
# specific language governing permissions and limitations
# under the License.
-[report]
+[run]
+branch = True
+relative_
AndrewShakinovsky-SAS opened a new pull request, #730:
URL: https://github.com/apache/airflow-site/pull/730
Hi, please consider adding a link to our 3rd party Airflow provider.
Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log
eladkal commented on issue #26494:
URL: https://github.com/apache/airflow/issues/26494#issuecomment-1404993715
@jtvmatos I think it's better to open a draft PR and discuss code changes
over the PR
--
This is an automated message from the Apache Git Service.
To respond to the message, plea
wonhyeongseo commented on PR #29176:
URL: https://github.com/apache/airflow/pull/29176#issuecomment-1404906831
Ok @Taragolis. Adding in `float` instead of replacing `int` for backward
compatability. I checked the files for `num_of_dpus`, and the modified two
files are all there is. May you
eladkal commented on issue #29153:
URL: https://github.com/apache/airflow/issues/29153#issuecomment-1404874868
The project doesn't not require summiting Github issue for PRs so if you
open a PR you can have all the information there. there is no need to also open
issue.
--
This is an aut
eladkal commented on code in PR #29145:
URL: https://github.com/apache/airflow/pull/29145#discussion_r1087713721
##
.coveragerc:
##
@@ -16,14 +16,25 @@
# specific language governing permissions and limitations
# under the License.
-[report]
+[run]
+branch = True
+relative_fi
manugarri opened a new issue, #29178:
URL: https://github.com/apache/airflow/issues/29178
### Description
I have noticed that for some commands, there is an option to get the output
in json or yaml (as described in this PR from 2020
https://github.com/apache/airflow/issues/12699).
Taragolis commented on PR #29156:
URL: https://github.com/apache/airflow/pull/29156#issuecomment-1404751961
> The proposed fix solves my problem.
And looks like might add problems for others. See [Best Practices -> Top
level Python
Code](https://airflow.apache.org/docs/apache-airflow
Taragolis commented on PR #29176:
URL: https://github.com/apache/airflow/pull/29176#issuecomment-1404718315
Yeah, statics check failed:
```console
airflow/providers/amazon/aws/hooks/glue.py:97: error: Incompatible types in
assignment (expression has type "float", variable has typ
potiuk commented on code in PR #29147:
URL: https://github.com/apache/airflow/pull/29147#discussion_r1087574419
##
airflow/executors/kubernetes_executor.py:
##
@@ -353,12 +353,12 @@ def run_next(self, next_job: KubernetesJobType) -> None:
self.run_pod_async(pod, **self.
boring-cyborg[bot] commented on issue #29177:
URL: https://github.com/apache/airflow/issues/29177#issuecomment-1404686007
Thanks for opening your first issue here! Be sure to follow the issue
template!
--
This is an automated message from the Apache Git Service.
To respond to the mess
sirVir opened a new issue, #29177:
URL: https://github.com/apache/airflow/issues/29177
### Apache Airflow Provider(s)
http
### Versions of Apache Airflow Providers
apache-airflow-providers-http==4.1.1
### Apache Airflow version
2.5.0
### Operating Sys
kuikeelc commented on PR #26993:
URL: https://github.com/apache/airflow/pull/26993#issuecomment-1404685906
@bbovenzi That is correct. We have an off-by-1 issue. It is the same issue
with every task. There is no operator in particular that has this bug. I use
the remote_logging option. The l
Taragolis commented on PR #29176:
URL: https://github.com/apache/airflow/pull/29176#issuecomment-1404683241
You also need to change in Operator (potentially in other places)
https://github.com/apache/airflow/blob/2e90c06c3eaf6a8cd0d7f4055274834158879440/airflow/providers/amazon/aws/op
francescomucio commented on PR #29171:
URL: https://github.com/apache/airflow/pull/29171#issuecomment-1404674067
I did the changes in the doc files
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to g
86 matches
Mail list logo