brienzb opened a new pull request, #36121:
URL: https://github.com/apache/airflow/pull/36121
Since Slack provider 8.0 version and later, parameter `token` has been
deleted.
Related commit:
https://github.com/apache/airflow/commit/ed6a4fd1162407a2007d949765eab5749af1c3ac
boring-cyborg[bot] commented on PR #36121:
URL: https://github.com/apache/airflow/pull/36121#issuecomment-1846767525
Congratulations on your first Pull Request and welcome to the Apache Airflow
community! If you have any issues or are unsure about any anything please check
our Contribution
moiseenkov opened a new pull request, #36122:
URL: https://github.com/apache/airflow/pull/36122
Implement deferrable mode for BeamRunJavaPipelineOperator
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
eladkal closed issue #35149: make a trigger_rule for one upstream failed but
wait the whole upstream tasks to finish
URL: https://github.com/apache/airflow/issues/35149
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
boring-cyborg[bot] commented on PR #36121:
URL: https://github.com/apache/airflow/pull/36121#issuecomment-1846857337
Awesome work, congrats on your first merged pull request! You are invited to
check our [Issue Tracker](https://github.com/apache/airflow/issues) for
additional contributions.
hussein-awala merged PR #36121:
URL: https://github.com/apache/airflow/pull/36121
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@ai
This is an automated email from the ASF dual-hosted git repository.
husseinawala pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 4824ca7c5a Slack: Remove parameter `token` in
hussein-awala commented on PR #36121:
URL: https://github.com/apache/airflow/pull/36121#issuecomment-1846857885
Congrats on your first commit 🎉
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to th
bolkedebruin commented on PR #22253:
URL: https://github.com/apache/airflow/pull/22253#issuecomment-1846898571
ping @hamedhsn , would love to have this in after all the work you did.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to Gi
potiuk opened a new pull request, #36123:
URL: https://github.com/apache/airflow/pull/36123
We are changing the whole mechanism in #36094 but since it might take a bit
to review, this is a quick fix to fix --use-airflow-version pointing to
specific airflow version.
potiuk commented on PR #36123:
URL: https://github.com/apache/airflow/pull/36123#issuecomment-1846902824
cc: @kacpermuda
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To
utkarsharma2 commented on code in PR #35919:
URL: https://github.com/apache/airflow/pull/35919#discussion_r1420221714
##
airflow/providers/weaviate/hooks/weaviate.py:
##
@@ -133,20 +140,201 @@ def create_class(self, class_json: dict[str, Any]) ->
None:
client = self.co
utkarsharma2 commented on code in PR #35919:
URL: https://github.com/apache/airflow/pull/35919#discussion_r1420221714
##
airflow/providers/weaviate/hooks/weaviate.py:
##
@@ -133,20 +140,201 @@ def create_class(self, class_json: dict[str, Any]) ->
None:
client = self.co
ephraimbuddy commented on code in PR #35919:
URL: https://github.com/apache/airflow/pull/35919#discussion_r1420230202
##
airflow/providers/weaviate/hooks/weaviate.py:
##
@@ -133,20 +140,201 @@ def create_class(self, class_json: dict[str, Any]) ->
None:
client = self.co
bolkedebruin commented on code in PR #35867:
URL: https://github.com/apache/airflow/pull/35867#discussion_r1420235222
##
airflow/serialization/serde.py:
##
@@ -83,6 +91,81 @@ def decode(d: dict[str, Any]) -> tuple[str, int, Any]:
return classname, version, data
+def enc
bolkedebruin commented on code in PR #35820:
URL: https://github.com/apache/airflow/pull/35820#discussion_r1420237930
##
airflow/io/store/__init__.py:
##
@@ -134,6 +146,6 @@ def attach(
if store := _STORE_CACHE.get(alias):
return store
-_STORE_CACHE[a
bolkedebruin commented on code in PR #35820:
URL: https://github.com/apache/airflow/pull/35820#discussion_r1420242140
##
airflow/io/__init__.py:
##
@@ -32,21 +32,25 @@
if TYPE_CHECKING:
from fsspec import AbstractFileSystem
+from airflow.io.typedef import Properties
utkarsharma2 commented on code in PR #35919:
URL: https://github.com/apache/airflow/pull/35919#discussion_r1420254907
##
airflow/providers/weaviate/hooks/weaviate.py:
##
@@ -133,20 +140,201 @@ def create_class(self, class_json: dict[str, Any]) ->
None:
client = self.co
utkarsharma2 commented on code in PR #36085:
URL: https://github.com/apache/airflow/pull/36085#discussion_r1420266560
##
airflow/providers/weaviate/hooks/weaviate.py:
##
@@ -17,10 +17,14 @@
from __future__ import annotations
+import contextlib
+import json
import warnings
utkarsharma2 commented on code in PR #36085:
URL: https://github.com/apache/airflow/pull/36085#discussion_r1420266830
##
airflow/providers/weaviate/hooks/weaviate.py:
##
@@ -30,7 +34,7 @@
from airflow.hooks.base import BaseHook
if TYPE_CHECKING:
-from typing import Any
+
utkarsharma2 commented on code in PR #36085:
URL: https://github.com/apache/airflow/pull/36085#discussion_r1420282153
##
airflow/providers/weaviate/hooks/weaviate.py:
##
@@ -144,22 +148,63 @@ def create_schema(self, schema_json: dict[str, Any]) ->
None:
client = self.c
utkarsharma2 commented on code in PR #35919:
URL: https://github.com/apache/airflow/pull/35919#discussion_r1420287186
##
airflow/providers/weaviate/hooks/weaviate.py:
##
@@ -119,38 +125,204 @@ def test_connection(self) -> tuple[bool, str]:
self.log.error("Error test
utkarsharma2 commented on code in PR #35919:
URL: https://github.com/apache/airflow/pull/35919#discussion_r1420288687
##
airflow/providers/weaviate/hooks/weaviate.py:
##
@@ -17,15 +17,20 @@
from __future__ import annotations
+import json
import warnings
from functools imp
rohith-sagar opened a new pull request, #36124:
URL: https://github.com/apache/airflow/pull/36124
---
**^ Add meaningful description above**
Read the **[Pull Request
Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidel
boring-cyborg[bot] commented on PR #36124:
URL: https://github.com/apache/airflow/pull/36124#issuecomment-1846982967
Congratulations on your first Pull Request and welcome to the Apache Airflow
community! If you have any issues or are unsure about any anything please check
our Contribution
rohith-sagar closed pull request #36124: Added Yeedu Operator
URL: https://github.com/apache/airflow/pull/36124
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe,
rohith-sagar opened a new pull request, #36125:
URL: https://github.com/apache/airflow/pull/36125
Adding Yeedu Operator
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To u
rohith-sagar closed pull request #36125: Added Yeedu Operator
URL: https://github.com/apache/airflow/pull/36125
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe,
tirkarthi commented on issue #33647:
URL: https://github.com/apache/airflow/issues/33647#issuecomment-1846989815
@shubhransh-eb Can you please add the previous version of Airflow where it
worked fine? We upgraded from Airflow 2.3.4 to 2.7.2. We are also using mysql 8
and faced the query tak
pankajastro commented on PR #34919:
URL: https://github.com/apache/airflow/pull/34919#issuecomment-1846993082
Hey @atrbgithub looks like `GCSObjectsWithPrefixExistenceSensor` is broken
after this PR change I just did a quick run and got the below error.
**Sensor**
```
gcs_obje
rohith-sagar opened a new pull request, #36126:
URL: https://github.com/apache/airflow/pull/36126
Adding Yeedu Provider to the airflow.
---
Read the **[Pull Request
Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)
utkarsharma2 merged PR #36085:
URL: https://github.com/apache/airflow/pull/36085
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@air
This is an automated email from the ASF dual-hosted git repository.
utkarsharma pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new a8333b778a Add retry mechanism and dataframe s
bolkedebruin commented on PR #36065:
URL: https://github.com/apache/airflow/pull/36065#issuecomment-1847030990
I'd really prefer https://github.com/apache/airflow/pull/35820 to be in, as
otherwise we would have to deal with backwards compatibility
--
This is an automated message from the
This is an automated email from the ASF dual-hosted git repository.
ephraimanierobi pushed a commit to branch airflow_280blog
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
commit 26bcd3bbd2707902c8272fa9f21031a7f2e53b89
Author: Ephraim Anierobi
AuthorDate: Fri Dec 8 12:50:51
This is an automated email from the ASF dual-hosted git repository.
ephraimanierobi pushed a change to branch airflow_280blog
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
at 26bcd3bbd2 Airflow 2.8.0 blog post
This branch includes the following new commits:
new
ephraimbuddy opened a new pull request, #906:
URL: https://github.com/apache/airflow-site/pull/906
(no comment)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscri
This is an automated email from the ASF dual-hosted git repository.
bolke pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new aba58adb83 Allow storage options to be passed (#3582
bolkedebruin commented on PR #35820:
URL: https://github.com/apache/airflow/pull/35820#issuecomment-1847095296
Merging this - if we want to adjust the typing and split the attach function
we can do that in the follow ups.
--
This is an automated message from the Apache Git Service.
To res
bolkedebruin merged PR #35820:
URL: https://github.com/apache/airflow/pull/35820
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@air
potiuk merged PR #36123:
URL: https://github.com/apache/airflow/pull/36123
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflow.a
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
from aba58adb83 Allow storage options to be passed (#35820)
add 73abe322ec Fix case where `--use-constraints-version VE
stavdav143 opened a new pull request, #36127:
URL: https://github.com/apache/airflow/pull/36127
Dear @eladkal, @potiuk
I found a small bug while checking the release of the provider.
I opened a PR here.
Let me know if I can assist you more in merging.
Thanks for your understa
stavdav143 commented on PR #35677:
URL: https://github.com/apache/airflow/pull/35677#issuecomment-1847326195
Dear @eladkal, @potiuk
After your email for testing, I found a small bug.
I opened this PR here: https://github.com/apache/airflow/pull/36127
--
This is an automated m
eladkal commented on PR #36113:
URL: https://github.com/apache/airflow/pull/36113#issuecomment-1847361108
> Instead of using `SQLExecuteQueryOperator`, use AWS provided operator
`RedshiftDataOperator` to run SQL queries in a Redshift cluster.
>
> **^ Add meaningful description above**
hamedhsn commented on PR #22253:
URL: https://github.com/apache/airflow/pull/22253#issuecomment-1847371472
@bolkedebruin Sorry was sick for the last few days, I will finish the
documentation soon.
will ping you when it is ready
--
This is an automated message from the Apache Git Servi
vincbeck commented on PR #36113:
URL: https://github.com/apache/airflow/pull/36113#issuecomment-1847405897
> > Instead of using `SQLExecuteQueryOperator`, use AWS provided operator
`RedshiftDataOperator` to run SQL queries in a Redshift cluster.
>
> If both options work maybe we shoul
vincbeck commented on PR #36113:
URL: https://github.com/apache/airflow/pull/36113#issuecomment-1847407215
> > Instead of using `SQLExecuteQueryOperator`, use AWS provided operator
`RedshiftDataOperator` to run SQL queries in a Redshift cluster.
>
> If both options work maybe we shoul
gbonazzoli opened a new issue, #36128:
URL: https://github.com/apache/airflow/issues/36128
### Description
Actually (Airflow 2.7.3) the cli command `airflow roles export` does only
export custom roles but without specifing the related permission, so it is
quite useless as a mean to b
eladkal commented on PR #36113:
URL: https://github.com/apache/airflow/pull/36113#issuecomment-1847476142
Cool. We already have that mentioned in
https://airflow.apache.org/docs/apache-airflow-providers-amazon/stable/operators/redshift/index.html
--
This is an automated message from th
eladkal merged PR #36113:
URL: https://github.com/apache/airflow/pull/36113
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflow.
This is an automated email from the ASF dual-hosted git repository.
eladkal pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 2c251a0a18 Use redshift-data operators instead of
potiuk commented on PR #36094:
URL: https://github.com/apache/airflow/pull/36094#issuecomment-1847526986
Still a few nits but I am getting really close
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to g
potiuk commented on PR #36127:
URL: https://github.com/apache/airflow/pull/36127#issuecomment-1847545804
What is the effect of it (i.e. is it catastrophic for users?
We have two options - remove docker provider from RC1 and do RC2 with it or
release it and make an ad-hoc release afte
atrbgithub commented on issue #36117:
URL: https://github.com/apache/airflow/issues/36117#issuecomment-1847548472
An issue has been raised with https://github.com/apache/airflow/pull/34919
Unfortunately it looks like it has broken
`GCSObjectsWithPrefixExistenceSensor`.
--
This is
atrbgithub commented on PR #34919:
URL: https://github.com/apache/airflow/pull/34919#issuecomment-1847615888
@pankajastro thanks for raising, I have mentioned this
[here](https://github.com/apache/airflow/issues/36117#issuecomment-1847548472)
and asked for the change not to be merged in.
potiuk opened a new pull request, #36129:
URL: https://github.com/apache/airflow/pull/36129
This allows to tests the scripts that require --mount-sources remove but you
run some scripts inside the container (for example this was the case when
modifying installation of airflow and providers
potiuk commented on PR #36094:
URL: https://github.com/apache/airflow/pull/36094#issuecomment-1847628929
We will also need to merge this one
https://github.com/apache/airflow/pull/36129 - before, so that users will not
have to rebuild image in order to use the new `--use-airflow-version` co
potiuk merged PR #36129:
URL: https://github.com/apache/airflow/pull/36129
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflow.a
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 67453a69ed Add `scripts\in_container` folder when a
stavdav143 commented on PR #36127:
URL: https://github.com/apache/airflow/pull/36127#issuecomment-1847657253
Yeah so what happens is we stream each log line twice as "last_line_logged"
was not being updated.
On you to decide how to proceed to avoid also additional efforts by
potiuk commented on PR #36127:
URL: https://github.com/apache/airflow/pull/36127#issuecomment-1847658802
I think it's important-enough to RC2 - but it's @eladkal 's decision (Elad
is release manager)
--
This is an automated message from the Apache Git Service.
To respond to the message, p
syedahsn commented on PR #34966:
URL: https://github.com/apache/airflow/pull/34966#issuecomment-1847661038
We can close this PR now that #36079 has been merged.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL a
vincbeck closed pull request #34966: Fix error handling in
EksCreateClusterOperator in deferrable mode
URL: https://github.com/apache/airflow/pull/34966
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
error418 commented on issue #35297:
URL: https://github.com/apache/airflow/issues/35297#issuecomment-1847681793
How do we move on from here now? I am ready to update the PR with changes to
make this happen.
Following questions are imho a good starting point:
* What purpose has the
atrbgithub opened a new pull request, #36130:
URL: https://github.com/apache/airflow/pull/36130
This fixes the issue raised
[here](https://github.com/apache/airflow/pull/34919#issuecomment-1846993082)
against https://github.com/apache/airflow/pull/34919
When testing locally the list
atrbgithub commented on PR #34919:
URL: https://github.com/apache/airflow/pull/34919#issuecomment-1847685018
@pankajastro I've raised a PR to fix this
https://github.com/apache/airflow/pull/36130
Would you be able to retest?
--
This is an automated message from the Apache Git Servi
atrbgithub commented on PR #36130:
URL: https://github.com/apache/airflow/pull/36130#issuecomment-1847691555
@eladkal @shahar1 Would you be able to take a look at this if you get a
chance?
Without this, https://github.com/apache/airflow/pull/34919 should not be
released (https://gith
shahar1 commented on PR #36130:
URL: https://github.com/apache/airflow/pull/36130#issuecomment-1847709408
Good catch!
If it's not too hard, could you try adding tests for both conditions? (e.g.,
by patching `builtins.list` function)
I wouldn't be too strict about it - but if it's poss
potiuk opened a new pull request, #36131:
URL: https://github.com/apache/airflow/pull/36131
So far we executed commands in CI image in breeze in two ways:
* entering the shell (which runs docker-compose under the hood)
* running `docker run` with the CI image
This requires ra
potiuk commented on PR #36094:
URL: https://github.com/apache/airflow/pull/36094#issuecomment-1847758044
Finally !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsub
potiuk merged PR #36094:
URL: https://github.com/apache/airflow/pull/36094
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@airflow.a
potiuk commented on issue #35011:
URL: https://github.com/apache/airflow/issues/35011#issuecomment-1847915877
> Hello, I'm interested to know if there has been any progress with this
issue?
Generally if there is no comment/work/pr there is no progress. This is an
open-source project
potiuk commented on PR #35926:
URL: https://github.com/apache/airflow/pull/35926#issuecomment-1847948444
🤞
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe,
boring-cyborg[bot] commented on issue #36132:
URL: https://github.com/apache/airflow/issues/36132#issuecomment-1847984311
Thanks for opening your first issue here! Be sure to follow the issue
template! If you are willing to raise PR to address this issue please do so, no
need to wait for ap
guillaumeblaquiere opened a new issue, #36132:
URL: https://github.com/apache/airflow/issues/36132
### Description
The overrides parameter is not in the list of template field and it's
impossible to pass runtime values to Cloud Run (date start/end, custom dag
parameters,...)
#
guillaumeblaquiere opened a new pull request, #36133:
URL: https://github.com/apache/airflow/pull/36133
Close #36132
---
**^ Add meaningful description above**
Read the **[Pull Request
Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#p
boring-cyborg[bot] commented on PR #36133:
URL: https://github.com/apache/airflow/pull/36133#issuecomment-1847987609
Congratulations on your first Pull Request and welcome to the Apache Airflow
community! If you have any issues or are unsure about any anything please check
our Contribution
github-actions[bot] commented on issue #35637:
URL: https://github.com/apache/airflow/issues/35637#issuecomment-1847993629
This issue has been automatically marked as stale because it has been open
for 14 days with no response from the author. It will be closed in next 7 days
if no further
github-actions[bot] closed pull request #34379: Refactor use Path.touch to
create empty files
URL: https://github.com/apache/airflow/pull/34379
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp
github-actions[bot] closed pull request #34121: Refactor: Remove trailing
whitespace from strings
URL: https://github.com/apache/airflow/pull/34121
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to th
avkirilishin opened a new pull request, #36134:
URL: https://github.com/apache/airflow/pull/36134
closes: https://github.com/apache/airflow/issues/33948
Fixed the bug and added some more tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, p
RNHTTR commented on PR #34809:
URL: https://github.com/apache/airflow/pull/34809#issuecomment-1848203799
@lzdanski This is the spell check sphinx issue I was referring to.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and us
josh-fell opened a new pull request, #36135:
URL: https://github.com/apache/airflow/pull/36135
This operator link creates an ad hoc TaskInstance to build its output URL.
Generally we moved away from this approach starting with #21285.
This PR updates the operator link to use `TaskInst
buu-nguyen opened a new issue, #36136:
URL: https://github.com/apache/airflow/issues/36136
### Apache Airflow version
2.7.3
### What happened
I have encountered a bug where the `executor_config` for a task is lost when
the task is retried. This issue occurs when using th
github-actions[bot] commented on issue #20003:
URL: https://github.com/apache/airflow/issues/20003#issuecomment-1848272380
This issue has been closed because it has not received response from the
issue author.
--
This is an automated message from the Apache Git Service.
To respond to the
github-actions[bot] closed issue #20003: Trigger event payload mutually
incompatible with deferral kwargs
URL: https://github.com/apache/airflow/issues/20003
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above t
87 matches
Mail list logo