Aakcht commented on issue #32096:
URL: https://github.com/apache/airflow/issues/32096#issuecomment-1604446352
Tested #31865 - all good.
As for #30990 looks like it got mixed up with #30773 and the
extraVolumeMounts of dagprocessor wait for migrations init container are not
templated
potiuk commented on PR #32098:
URL: https://github.com/apache/airflow/pull/32098#issuecomment-1604443661
For a bit more visual way.
This is what github policy will have:
Author: eladkal
Date: Fri Jun 23 15:25:50 2023
New Revision: 62603
Log:
Release Airflow Providers on 2023-06-23
Added:
release/airflow/providers/apache-airflow-providers-airbyte-3.3.1.tar.gz
- copied unchanged from r62602,
Aakcht opened a new pull request, #32100:
URL: https://github.com/apache/airflow/pull/32100
Looks like #30990 got a bit mixed up with #30773 and the extraVolumeMounts
of dagprocessor wait for migrations init container are not templated, while
other extraVolumeMounts are templated.
Francesko90 commented on PR #31868:
URL: https://github.com/apache/airflow/pull/31868#issuecomment-1604437862
I updated `values.yaml` and `files/pod-template-file.kubernetes-helm-yaml.`
I created unit test but I'm not sure that it is correct, let me know if
there are any problem,
--
utkarsharma2 commented on code in PR #31887:
URL: https://github.com/apache/airflow/pull/31887#discussion_r1239950506
##
tests/dag_processing/test_processor.py:
##
@@ -124,6 +124,13 @@ def test_dag_file_processor_sla_miss_callback(self,
mock_get_dagbag, create_dumm
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new b156db3a70 Adding `src_fmt_configs` to the list of
potiuk merged PR #32097:
URL: https://github.com/apache/airflow/pull/32097
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
potiuk commented on code in PR #32052:
URL: https://github.com/apache/airflow/pull/32052#discussion_r1239937658
##
airflow/www/static/js/connection_form.js:
##
@@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) {
*/
function handleTestConnection(connectionType,
potiuk commented on code in PR #32052:
URL: https://github.com/apache/airflow/pull/32052#discussion_r1239937658
##
airflow/www/static/js/connection_form.js:
##
@@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) {
*/
function handleTestConnection(connectionType,
melugoyal commented on issue #32030:
URL: https://github.com/apache/airflow/issues/32030#issuecomment-1604411678
validated #31659, looks good
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
utkarsharma2 commented on code in PR #31887:
URL: https://github.com/apache/airflow/pull/31887#discussion_r1239931336
##
tests/dag_processing/test_processor.py:
##
@@ -124,6 +124,13 @@ def test_dag_file_processor_sla_miss_callback(self,
mock_get_dagbag, create_dumm
HaeSe0ng commented on PR #32070:
URL: https://github.com/apache/airflow/pull/32070#issuecomment-1604406959
Oh, I see. I'll keep watching the announcements. Thanks for letting me know.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
enrique-ayala commented on issue #31856:
URL: https://github.com/apache/airflow/issues/31856#issuecomment-1604395039
Hi @utkarsharma2 thanks for checking, here more details:
```
Apache Airflow
version| 2.4.3
executor | CeleryExecutor
ephraimbuddy commented on code in PR #31887:
URL: https://github.com/apache/airflow/pull/31887#discussion_r1239918442
##
tests/dag_processing/test_processor.py:
##
@@ -124,6 +124,13 @@ def test_dag_file_processor_sla_miss_callback(self,
mock_get_dagbag, create_dumm
potiuk commented on PR #32070:
URL: https://github.com/apache/airflow/pull/32070#issuecomment-1604391577
Srsly. Watch the announcements, and release notes if you want to know when
it is released. In case of providers we determine the version and timing
**Just** before releasing them -
potiuk commented on PR #32070:
URL: https://github.com/apache/airflow/pull/32070#issuecomment-1604388748
For providers it is always it's 'next' and 'when ready'
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
potiuk commented on PR #31920:
URL: https://github.com/apache/airflow/pull/31920#issuecomment-1604386631
> @potiuk The CI job `provider package wheel (verify)` is still failing :
>
> ```shell
> fatal: bad revision
'apache-https-for-providers/main...providers-elasticsearch/4.5.1'
Lee-W commented on code in PR #32029:
URL: https://github.com/apache/airflow/pull/32029#discussion_r1239901421
##
airflow/providers/amazon/aws/sensors/emr.py:
##
@@ -424,12 +431,16 @@ def __init__(
job_flow_id: str,
target_states: Iterable[str] | None = None,
Lee-W commented on code in PR #32029:
URL: https://github.com/apache/airflow/pull/32029#discussion_r1239899387
##
airflow/providers/amazon/aws/triggers/emr.py:
##
@@ -317,3 +317,72 @@ async def run(self) -> AsyncIterator[TriggerEvent]:
await
Adaverse commented on code in PR #32089:
URL: https://github.com/apache/airflow/pull/32089#discussion_r1239898290
##
airflow/providers/vertica/hooks/vertica.py:
##
@@ -45,6 +45,51 @@ def get_conn(self) -> connect:
conn_config["port"] = 5433
else:
Adaverse commented on code in PR #32089:
URL: https://github.com/apache/airflow/pull/32089#discussion_r1239894089
##
airflow/providers/vertica/hooks/vertica.py:
##
@@ -45,6 +45,51 @@ def get_conn(self) -> connect:
conn_config["port"] = 5433
else:
ephraimbuddy opened a new pull request, #32099:
URL: https://github.com/apache/airflow/pull/32099
This commit adds support for the setting of task dependencies w.r.t
setup/teardown tasks even when the tasks are called outside the setup/teardown
context manager. Previously, the dependencies
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch constraints-main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/constraints-main by this push:
new dae40aeca6 Updating
potiuk opened a new pull request, #32098:
URL: https://github.com/apache/airflow/pull/32098
This change updates the security model of Airflow to better explain what are
the capabilities of various kinds of users in Airflow deployments and give both
users and security researchers a way to
jedcunningham commented on code in PR #32052:
URL: https://github.com/apache/airflow/pull/32052#discussion_r1239847571
##
airflow/www/static/js/connection_form.js:
##
@@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) {
*/
function
utkarsharma2 commented on code in PR #31887:
URL: https://github.com/apache/airflow/pull/31887#discussion_r1239844698
##
airflow/utils/context.py:
##
@@ -88,6 +88,10 @@
"var",
"yesterday_ds",
"yesterday_ds_nodash",
+"task_list",
+"blocking_task_list",
+
utkarsharma2 commented on code in PR #31887:
URL: https://github.com/apache/airflow/pull/31887#discussion_r1239844077
##
airflow/notifications/basenotifier.py:
##
@@ -79,15 +79,30 @@ def notify(self, context: Context) -> None:
"""
...
-def __call__(self,
nathadfield opened a new pull request, #32097:
URL: https://github.com/apache/airflow/pull/32097
We have scenarios where we need to use Jinja templating on `src_fmt_configs`
and currently have to create our own version of `GCSToBigQueryOperator` to
achieve this.
--
This is an automated
jedcunningham opened a new issue, #32096:
URL: https://github.com/apache/airflow/issues/32096
### Body
We are kindly requesting that contributors to [Apache Airflow Helm Chart
1.10.0rc1](https://dist.apache.org/repos/dist/dev/airflow/helm-chart/1.10.0rc1)
help test the RC.
pankajkoti commented on code in PR #32052:
URL: https://github.com/apache/airflow/pull/32052#discussion_r1239827440
##
airflow/www/static/js/connection_form.js:
##
@@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) {
*/
function
pankajkoti commented on code in PR #32052:
URL: https://github.com/apache/airflow/pull/32052#discussion_r1239827440
##
airflow/www/static/js/connection_form.js:
##
@@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) {
*/
function
This is an automated email from the ASF dual-hosted git repository.
jedcunningham pushed a change to annotated tag helm-chart/1.10.0rc1
in repository https://gitbox.apache.org/repos/asf/airflow.git
*** WARNING: tag helm-chart/1.10.0rc1 was modified! ***
from 913eff6759 (commit)
to
Author: jedcunningham
Date: Fri Jun 23 13:31:44 2023
New Revision: 62600
Log:
Remove old Helm Chart release: 1.9.0rc1
Removed:
dev/airflow/helm-chart/1.9.0rc1/
Author: jedcunningham
Date: Fri Jun 23 13:30:41 2023
New Revision: 62599
Log:
Add artifacts for Helm Chart 1.10.0rc1
Added:
dev/airflow/helm-chart/1.10.0rc1/
dev/airflow/helm-chart/1.10.0rc1/airflow-1.10.0.tgz (with props)
dev/airflow/helm-chart/1.10.0rc1/airflow-1.10.0.tgz.asc
pankajkoti commented on code in PR #32052:
URL: https://github.com/apache/airflow/pull/32052#discussion_r1239822050
##
airflow/www/static/js/connection_form.js:
##
@@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) {
*/
function
nathadfield opened a new pull request, #32095:
URL: https://github.com/apache/airflow/pull/32095
closes: #32093
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To
boxysean opened a new issue, #32094:
URL: https://github.com/apache/airflow/issues/32094
### Description
I would kindly request to add the URI to dbt Cloud Job in Airflow logs after
DbtCloudRunJobOperator is triggered, to make it easy for Airflow operators to
see the dbt Cloud job
This is an automated email from the ASF dual-hosted git repository.
jedcunningham pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new dfd827e447 Release notes for helm chart
jedcunningham merged PR #31771:
URL: https://github.com/apache/airflow/pull/31771
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
jedcunningham commented on code in PR #32052:
URL: https://github.com/apache/airflow/pull/32052#discussion_r1239804895
##
airflow/www/static/js/connection_form.js:
##
@@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) {
*/
function
flinz commented on issue #30883:
URL: https://github.com/apache/airflow/issues/30883#issuecomment-1604262465
Can confirm this still exists in 2.6.0 and I independently hit this using:
```python
import time
from datetime import datetime
from airflow import DAG
from
ChaotX commented on PR #31010:
URL: https://github.com/apache/airflow/pull/31010#issuecomment-1604252459
@sunank200 Can you please help adding these test to your contribution? I had
no time to figure out how to change the test env to 3.8+ python.
--
This is an automated message from the
darkag commented on code in PR #32089:
URL: https://github.com/apache/airflow/pull/32089#discussion_r1239780811
##
airflow/providers/vertica/hooks/vertica.py:
##
@@ -45,6 +45,51 @@ def get_conn(self) -> connect:
conn_config["port"] = 5433
else:
darkag commented on code in PR #32089:
URL: https://github.com/apache/airflow/pull/32089#discussion_r1239778451
##
airflow/providers/vertica/hooks/vertica.py:
##
@@ -45,6 +45,51 @@ def get_conn(self) -> connect:
conn_config["port"] = 5433
else:
nathadfield opened a new issue, #32093:
URL: https://github.com/apache/airflow/issues/32093
### Apache Airflow version
2.6.2
### What happened
When using the `GCSToBigQueryOperator` in deferrable mode with an
impersonation_chain service account which has a default
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch constraints-main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/constraints-main by this push:
new b4c88cbc01 Updating
tomrutter opened a new pull request, #32092:
URL: https://github.com/apache/airflow/pull/32092
Updates to triggerer job to improve robustness.
Context:
Triggerer runs two threads, one synchronous and one asynchronous. The
synchronous thread handles db updates, and the asynchronous
boring-cyborg[bot] commented on PR #32092:
URL: https://github.com/apache/airflow/pull/32092#issuecomment-1604133897
Congratulations on your first Pull Request and welcome to the Apache Airflow
community! If you have any issues or are unsure about any anything please check
our Contribution
tomrutter opened a new issue, #32091:
URL: https://github.com/apache/airflow/issues/32091
### Apache Airflow version
2.6.2
### What happened
We are running a dag with many deferrable tasks using a custom trigger that
waits for an Azure Batch task to complete. When many
potiuk commented on code in PR #32052:
URL: https://github.com/apache/airflow/pull/32052#discussion_r1239687219
##
airflow/www/static/js/connection_form.js:
##
@@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) {
*/
function handleTestConnection(connectionType,
potiuk commented on code in PR #32052:
URL: https://github.com/apache/airflow/pull/32052#discussion_r1239681677
##
airflow/www/static/js/connection_form.js:
##
@@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) {
*/
function handleTestConnection(connectionType,
potiuk commented on code in PR #32052:
URL: https://github.com/apache/airflow/pull/32052#discussion_r1239681677
##
airflow/www/static/js/connection_form.js:
##
@@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) {
*/
function handleTestConnection(connectionType,
This is an automated email from the ASF dual-hosted git repository.
eladkal pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new fa07812d10 doc: fix Google authorization token
boring-cyborg[bot] commented on PR #31893:
URL: https://github.com/apache/airflow/pull/31893#issuecomment-1604067020
Awesome work, congrats on your first merged pull request! You are invited to
check our [Issue Tracker](https://github.com/apache/airflow/issues) for
additional
eladkal merged PR #31893:
URL: https://github.com/apache/airflow/pull/31893
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
pankajastro commented on code in PR #32029:
URL: https://github.com/apache/airflow/pull/32029#discussion_r1239642693
##
airflow/providers/amazon/aws/sensors/emr.py:
##
@@ -424,12 +431,16 @@ def __init__(
job_flow_id: str,
target_states: Iterable[str] | None =
pankajastro commented on code in PR #32029:
URL: https://github.com/apache/airflow/pull/32029#discussion_r1239641163
##
airflow/providers/amazon/aws/triggers/emr.py:
##
@@ -317,3 +317,72 @@ async def run(self) -> AsyncIterator[TriggerEvent]:
await
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new ca13c7b77e Update comment for editable installs
potiuk merged PR #32090:
URL: https://github.com/apache/airflow/pull/32090
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 3bfc0817ec Fix "operators_and_hooks_ref.py" to
boring-cyborg[bot] commented on PR #32085:
URL: https://github.com/apache/airflow/pull/32085#issuecomment-1604053979
Awesome work, congrats on your first merged pull request! You are invited to
check our [Issue Tracker](https://github.com/apache/airflow/issues) for
additional
potiuk commented on PR #32085:
URL: https://github.com/apache/airflow/pull/32085#issuecomment-1604053680
Cc: @eladkal -> you might want to cherry-pick (or manually modify) that one
and regenerate the provider documentation before merging it today.
--
This is an automated message from the
potiuk merged PR #32085:
URL: https://github.com/apache/airflow/pull/32085
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
Adaverse commented on code in PR #32089:
URL: https://github.com/apache/airflow/pull/32089#discussion_r1239630460
##
airflow/providers/vertica/hooks/vertica.py:
##
@@ -45,6 +45,51 @@ def get_conn(self) -> connect:
conn_config["port"] = 5433
else:
pankajkoti opened a new pull request, #32090:
URL: https://github.com/apache/airflow/pull/32090
Editable installs are currently broken using setuptools 64.0.0 and above.
Update comment describing the same and mention workarounds.
---
**^ Add meaningful description
Adaverse commented on code in PR #32089:
URL: https://github.com/apache/airflow/pull/32089#discussion_r1239630460
##
airflow/providers/vertica/hooks/vertica.py:
##
@@ -45,6 +45,51 @@ def get_conn(self) -> connect:
conn_config["port"] = 5433
else:
Lee-W commented on code in PR #32029:
URL: https://github.com/apache/airflow/pull/32029#discussion_r1239621504
##
airflow/providers/amazon/aws/sensors/emr.py:
##
@@ -424,12 +431,16 @@ def __init__(
job_flow_id: str,
target_states: Iterable[str] | None = None,
Adaverse commented on code in PR #32089:
URL: https://github.com/apache/airflow/pull/32089#discussion_r1239623477
##
airflow/providers/vertica/hooks/vertica.py:
##
@@ -45,6 +45,51 @@ def get_conn(self) -> connect:
conn_config["port"] = 5433
else:
potiuk commented on PR #29465:
URL: https://github.com/apache/airflow/pull/29465#issuecomment-1604017790
We have an issue about it https://github.com/apache/airflow/issues/30764
already and yeah. I think it needs a bit closer look. I think it might be quite
tricky to solve - our setup.py
boring-cyborg[bot] commented on PR #32089:
URL: https://github.com/apache/airflow/pull/32089#issuecomment-1603991143
Congratulations on your first Pull Request and welcome to the Apache Airflow
community! If you have any issues or are unsure about any anything please check
our Contribution
darkag opened a new pull request, #32089:
URL: https://github.com/apache/airflow/pull/32089
Give the possibility to pass vertica connection parameters using extra.
Especially it gives the possibility to enable load balancing (Vertica requires
that load balancing is enabled client and
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 42c409dc43 Open links in new tab that take us away
potiuk merged PR #32088:
URL: https://github.com/apache/airflow/pull/32088
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
pankajkoti opened a new pull request, #32088:
URL: https://github.com/apache/airflow/pull/32088
I am observing that clicking on the "Click here" links take us
away from Airflow UI to the docs domain and I need to press
on back button in the browser to get back to Airflow UI. Ideally,
HaeSe0ng commented on PR #32070:
URL: https://github.com/apache/airflow/pull/32070#issuecomment-1603932631
Thank you for the reviews. May I know what version would include this PR and
when would it be released?
--
This is an automated message from the Apache Git Service.
To respond to
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 3ead4aa610 Remove casting of forward_credentials
potiuk merged PR #32087:
URL: https://github.com/apache/airflow/pull/32087
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
potiuk commented on PR #32087:
URL: https://github.com/apache/airflow/pull/32087#issuecomment-1603910093
cc: @vandonr-amz
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
potiuk opened a new pull request, #32087:
URL: https://github.com/apache/airflow/pull/32087
The forward-credentials flag was supposed to be disabled when you run
start-airflow and shell commands. However the flag boolean value has been
casted to str so False became "False" and
This is an automated email from the ASF dual-hosted git repository.
pierrejeambrun pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 116e607ddc Use re2 for matching untrusted
pierrejeambrun merged PR #32060:
URL: https://github.com/apache/airflow/pull/32060
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
Owen-CH-Leung commented on PR #31920:
URL: https://github.com/apache/airflow/pull/31920#issuecomment-1603877801
@potiuk The CI job `provider package wheel (verify)` is still failing :
```Command to run: 'git log --pretty=format:%H %h %cd %s --date=short
gartyanip commented on issue #32084:
URL: https://github.com/apache/airflow/issues/32084#issuecomment-1603855805
thank you
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
boring-cyborg[bot] commented on PR #32085:
URL: https://github.com/apache/airflow/pull/32085#issuecomment-1603852036
Congratulations on your first Pull Request and welcome to the Apache Airflow
community! If you have any issues or are unsure about any anything please check
our Contribution
suzuryo97 opened a new pull request, #32085:
URL: https://github.com/apache/airflow/pull/32085
In the "Operators_and_hooks_ref.py" code, "sensors" has been replaced with
"hooks".
As a result, the "Sensors" items are not displayed on the [AWS "Operators
and hooks"
Owen-CH-Leung commented on PR #31920:
URL: https://github.com/apache/airflow/pull/31920#issuecomment-1603763991
@potiuk looks like multiple CI jobs fail at the `docker pull`...maybe a
rerun would fix them
--
This is an automated message from the Apache Git Service.
To respond to the
boring-cyborg[bot] commented on issue #32084:
URL: https://github.com/apache/airflow/issues/32084#issuecomment-1603752959
Thanks for opening your first issue here! Be sure to follow the issue
template! If you are willing to raise PR to address this issue please do so, no
need to wait for
vrumjantsev opened a new issue, #32084:
URL: https://github.com/apache/airflow/issues/32084
### Apache Airflow version
2.6.2
### What happened
I'm running airflow 2.6.2 installed in GKE private cluster, deployed via
official helm chart 1.9.0
Aifflow image also
Adaverse commented on PR #32082:
URL: https://github.com/apache/airflow/pull/32082#issuecomment-1603731755
cc @phanikumv
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
101 - 190 of 190 matches
Mail list logo
