liuyonghengheng commented on a change in pull request #9149:
URL: https://github.com/apache/airflow/pull/9149#discussion_r453469609
##
File path: airflow/providers/apache/kylin/operators/kylin.py
##
@@ -0,0 +1,171 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under
[
https://issues.apache.org/jira/browse/AIRFLOW-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156521#comment-17156521
]
ASF GitHub Bot commented on AIRFLOW-7014:
-
liuyonghengheng commented on a chang
mik-laj merged pull request #9556:
URL: https://github.com/apache/airflow/pull/9556
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
mik-laj closed issue #9112:
URL: https://github.com/apache/airflow/issues/9112
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the s
boring-cyborg[bot] commented on pull request #9556:
URL: https://github.com/apache/airflow/pull/9556#issuecomment-657419912
Awesome work, congrats on your first merged pull request!
This is an automated message from the A
This is an automated email from the ASF dual-hosted git repository.
kamilbregula pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from d344048 Upgrade to latest isort (5.0.8) (#9782)
add 5ddbbf1 Add API Endpoint - DagRuns Batch (#9556)
N
mik-laj commented on pull request #9695:
URL: https://github.com/apache/airflow/pull/9695#issuecomment-657427305
How do you benefit from changing your environment configuration? I am
afraid that in a moment we will have in Helm copies of all options, but with a
different interface and wor
mik-laj merged pull request #9783:
URL: https://github.com/apache/airflow/pull/9783
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
This is an automated email from the ASF dual-hosted git repository.
kamilbregula pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 5ddbbf1 Add API Endpoint - DagRuns Batch (#9556)
add 2b12c30 Improve typing coverage in scheduler_job.p
zhbdesign opened a new issue #9789:
URL: https://github.com/apache/airflow/issues/9789
You need Python 3.5 or later to use mypy when installing version 1.10.11.
How to solve this problem?
This is an automated message from th
Datkros commented on pull request #9695:
URL: https://github.com/apache/airflow/pull/9695#issuecomment-657443814
> How do you benefit from changing your environment configuration? I am
afraid that in a moment we will have in Helm copies of all options, but with a
different interface and wo
ephraimbuddy opened a new pull request #272:
URL: https://github.com/apache/airflow-site/pull/272
My blogpost draft
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
marclamberti commented on pull request #9371:
URL: https://github.com/apache/airflow/pull/9371#issuecomment-657479582
@aneesh-joseph , quick question, in the documentation "If you are using the
KubernetesExecutor, Git-sync will run as an initContainer on your worker pods".
Does that mean t
marclamberti removed a comment on pull request #9371:
URL: https://github.com/apache/airflow/pull/9371#issuecomment-657479582
@aneesh-joseph , quick question, in the documentation "If you are using the
KubernetesExecutor, Git-sync will run as an initContainer on your worker pods".
Does tha
mahadirz commented on issue #9780:
URL: https://github.com/apache/airflow/issues/9780#issuecomment-657481244
> If you test it and see that it works can you let us know and close the
ticket please ?
Tested with `pip install pip apache-airflow-backport-providers-google` and
afterwards
Datkros commented on pull request #9695:
URL: https://github.com/apache/airflow/pull/9695#issuecomment-657491153
To clarify on the above, would this env be the entry source for any
configuration that needs to be passed to Airflow itself? (is this the
consensus?) As far as I understood, it
dephusluke commented on issue #8453:
URL: https://github.com/apache/airflow/issues/8453#issuecomment-657491551
@stijndehaes it seems that there are issues with your PR. You are changing
1480 files and over 500 commits.
This
kaxil merged pull request #9785:
URL: https://github.com/apache/airflow/pull/9785
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to th
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 2b12c30 Improve typing coverage in scheduler_job.py (#9783)
add 9850bae Enable pretty output in mypy (#978
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 2b12c30 Improve typing coverage in scheduler_job.py (#9783)
add 9850bae Enable pretty output in mypy (#978
FelixReuthlingerBMW opened a new issue #9790:
URL: https://github.com/apache/airflow/issues/9790
I am not sure whether to put this as a bug or feature request (depends on
how you see this).
As this might be completely independent from versions, os, k8s, ... I will
not add this detail he
boring-cyborg[bot] commented on issue #9790:
URL: https://github.com/apache/airflow/issues/9790#issuecomment-657510866
Thanks for opening your first issue here! Be sure to follow the issue
template!
This is an automated
mik-laj commented on issue #9790:
URL: https://github.com/apache/airflow/issues/9790#issuecomment-657513974
You need to set "replace_microseconds" parameter to "False" in body.
Unfortunately, this feaature is not documented, but we are working on a new API
that will not have this problem.
FelixReuthlingerBMW commented on issue #9790:
URL: https://github.com/apache/airflow/issues/9790#issuecomment-657516674
Thanks for the lighting-speed reaction ;)
Will try this out.
This is an automated message from the Apa
mik-laj commented on pull request #9695:
URL: https://github.com/apache/airflow/pull/9695#issuecomment-657516949
> we'd lose visibility on what's the current configuration running by just
looking at the source.
In Airflow 1.101.11, I Iadded new command - `airflow config`. Will this
mik-laj edited a comment on pull request #9695:
URL: https://github.com/apache/airflow/pull/9695#issuecomment-657516949
> we'd lose visibility on what's the current configuration running by just
looking at the source.
In Airflow 1.101.11, I added new command - `airflow config`. Will
[
https://issues.apache.org/jira/browse/AIRFLOW-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ash Berlin-Taylor resolved AIRFLOW-2047.
Fix Version/s: 1.10.11
Resolution: Fixed
1.10.11 changes the default API a
mik-laj commented on issue #9780:
URL: https://github.com/apache/airflow/issues/9780#issuecomment-657519552
> Do I need to modify my current DAG file in order for backport to work
(such import statements) or special commands to clear anything like database
and etc?
You must start us
stijndehaes commented on issue #8453:
URL: https://github.com/apache/airflow/issues/8453#issuecomment-657520708
@dephusluke I rebased when github had problems. Rebasing again looks to have
fixed it.
This is an automated mes
mik-laj merged pull request #9787:
URL: https://github.com/apache/airflow/pull/9787
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
This is an automated email from the ASF dual-hosted git repository.
kamilbregula pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 9850bae Enable pretty output in mypy (#9785)
add 514eb6d provide_session keep return type (#9787)
No n
mik-laj commented on issue #9781:
URL: https://github.com/apache/airflow/issues/9781#issuecomment-657555276
We should also release GKePodOperator, because it depends on cncf.kubernetes.
This is an automated message from the A
potiuk commented on issue #9781:
URL: https://github.com/apache/airflow/issues/9781#issuecomment-657563824
Yep. It's actually been released already, but does not work :(
This is an automated message from the Apache Git Servic
mik-laj commented on issue #9781:
URL: https://github.com/apache/airflow/issues/9781#issuecomment-657565133
Is it released?
https://github.com/apache/airflow/blob/master/backport_packages/refactor_backport_packages.py#L592
---
FelixReuthlingerBMW commented on issue #9790:
URL: https://github.com/apache/airflow/issues/9790#issuecomment-657580152
Probably this is not available with our version 1.10.10, could you please
check?
Using this additional parameter in the body caused permanently getting code
500.
---
potiuk commented on issue #9781:
URL: https://github.com/apache/airflow/issues/9781#issuecomment-657586432
@anitakar told that it was not working but I am not 100% sure if it was
missing in the package or not importable. Should be easy to check @mik-laj
--
potiuk commented on pull request #9785:
URL: https://github.com/apache/airflow/pull/9785#issuecomment-657586747
nice!
This is an automated message from the Apache Git Service.
To respond to the message, please log on to G
jhtimmins commented on issue #8112:
URL: https://github.com/apache/airflow/issues/8112#issuecomment-657589456
Some thoughts on this:
## Challenge
For the new API, we need to decide how to structure permissions for the API
and how they should integrate with the existing user permis
FelixReuthlingerBMW commented on issue #9790:
URL: https://github.com/apache/airflow/issues/9790#issuecomment-657589426
I sent a body like this:
{"conf":{...},"run_id":"2020-07-13T01:35:26_14e6b65e-d1c8-4452-bf21-2029e181354d","replace_microseconds":false}
Or should it be boolean insi
potiuk edited a comment on issue #9789:
URL: https://github.com/apache/airflow/issues/9789#issuecomment-657590804
It's expected. Why do you want to use mypy in 2.7 in Airflow?
MyPy is purely a development dependency and it's not installed with Airflow
when you install it without [d
potiuk commented on issue #9789:
URL: https://github.com/apache/airflow/issues/9789#issuecomment-657590804
It'sexpected. Why do you want to use mypy in 2.7 in Airflow?
MyPy is purely a development dependency and it's not installed with Airflow
when you install it without [devel] ex
potiuk closed issue #9789:
URL: https://github.com/apache/airflow/issues/9789
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp
mik-laj commented on issue #9790:
URL: https://github.com/apache/airflow/issues/9790#issuecomment-657599134
Can you try this command?
```
curl -v \
-X POST \
-H "Content-Type: application/json" \
'http://localhost:28080/api/experimental/dags/example_bash_operator/dag_run
mik-laj edited a comment on issue #9790:
URL: https://github.com/apache/airflow/issues/9790#issuecomment-657599134
Can you try this command?
```bash
curl -v \
-X POST \
-H "Content-Type: application/json" \
'http://localhost:28080/api/experimental/dags/example_bash_opera
jhtimmins commented on issue #8112:
URL: https://github.com/apache/airflow/issues/8112#issuecomment-657619808
@mik-laj Very curious about your thoughts
This is an automated message from the Apache Git Service.
To respond to t
ashb commented on issue #8112:
URL: https://github.com/apache/airflow/issues/8112#issuecomment-657629206
> ```
> @needs_permissions(['dag_edit', 'dag_run_edit', 'ti_edit'])
> def update_ti_view(request):
> ```
Should this maybe be `['dag_read', 'dag_run_read', 'ti_edit']`?
subkanthi commented on issue #8540:
URL: https://github.com/apache/airflow/issues/8540#issuecomment-657637072
@felipemoz for this task, were u thinking of using the Mlflow REST API to
create runs? I see it very similar to the databricks REST API to start jobs. Im
still trying to figure out
FelixReuthlingerBMW closed issue #9790:
URL: https://github.com/apache/airflow/issues/9790
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
FelixReuthlingerBMW commented on issue #9790:
URL: https://github.com/apache/airflow/issues/9790#issuecomment-657657215
Ok, this works perfect, thx a lot !! ;)
This is an automated message from the Apache Git Service.
To resp
potiuk commented on a change in pull request #9766:
URL: https://github.com/apache/airflow/pull/9766#discussion_r453779600
##
File path: docs/redirects.txt
##
@@ -0,0 +1,67 @@
+# Licensed to the Apache Software Foundation (ASF) under one
Review comment:
:heart:
---
potiuk merged pull request #9766:
URL: https://github.com/apache/airflow/pull/9766
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to t
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 514eb6d provide_session keep return type (#9787)
add 1ea7316 Refactor Google operators guides (#9766)
No new
houqp opened a new pull request #9791:
URL: https://github.com/apache/airflow/pull/9791
This is needed in order to type check DAGs in CI/CD pipeline
see: https://www.python.org/dev/peps/pep-0561/
---
Make sure to mark the boxes below before creating PR: [x]
- [x] Desc
potiuk opened a new pull request #9792:
URL: https://github.com/apache/airflow/pull/9792
---
Make sure to mark the boxes below before creating PR: [x]
- [x] Description above provides context of the change
- [x] Unit tests coverage for changes (not needed for documentation chang
houqp commented on pull request #9791:
URL: https://github.com/apache/airflow/pull/9791#issuecomment-657675298
@potiuk looks like the setup.py change is causing CI failures, before I dig
into this, just wanted to check with you to see if this error looks familiar to
you:
```
Fixi
potiuk commented on pull request #9791:
URL: https://github.com/apache/airflow/pull/9791#issuecomment-657676668
Yep. You need to do exactly what the message says :)
> When you update setup.py, you have to run
>
>breeze generate-requirements --python 3.6
turbaszek commented on pull request #9322:
URL: https://github.com/apache/airflow/pull/9322#issuecomment-657686797
I'm good! @mik-laj ?
This is an automated message from the Apache Git Service.
To respond to the message, plea
turbaszek merged pull request #9792:
URL: https://github.com/apache/airflow/pull/9792
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
This is an automated email from the ASF dual-hosted git repository.
turbaszek pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 1ea7316 Refactor Google operators guides (#9766)
add 56f7a2b Fix small errors in image building documentat
turbaszek commented on pull request #8849:
URL: https://github.com/apache/airflow/pull/8849#issuecomment-657689946
@mik-laj
This is an automated message from the Apache Git Service.
To respond to the message, please log
turbaszek commented on a change in pull request #8849:
URL: https://github.com/apache/airflow/pull/8849#discussion_r453811292
##
File path: tests/providers/google/cloud/transfers/test_local_to_gcs.py
##
@@ -42,15 +43,28 @@ def setUp(self):
'start_date': datetime.da
milton0825 merged pull request #9756:
URL: https://github.com/apache/airflow/pull/9756
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
This is an automated email from the ASF dual-hosted git repository.
milton0825 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 56f7a2b Fix small errors in image building documentation (#9792)
add 7f64f2d Backfill reset_dagruns set D
mik-laj closed issue #8137:
URL: https://github.com/apache/airflow/issues/8137
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the s
mik-laj merged pull request #9322:
URL: https://github.com/apache/airflow/pull/9322
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
This is an automated email from the ASF dual-hosted git repository.
kamilbregula pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 7f64f2d Backfill reset_dagruns set DagRun to NONE state (#9756)
add d31e8a3 Add DAG Source endpoint (#9
mik-laj commented on pull request #9322:
URL: https://github.com/apache/airflow/pull/9322#issuecomment-657701132
@TobKed What are your plans for the next contribution?
This is an automated message from the Apache Git Service.
mik-laj opened a new pull request #9793:
URL: https://github.com/apache/airflow/pull/9793
CC: @randr97
---
Make sure to mark the boxes below before creating PR: [x]
- [X] Description above provides context of the change
- [X] Unit tests coverage for changes (not needed f
mik-laj edited a comment on issue #9790:
URL: https://github.com/apache/airflow/issues/9790#issuecomment-657710481
@FelixReuthlingerBMW I created a PR with docs change. Can I ask for a review?
https://github.com/apache/airflow/pull/9793
--
mik-laj commented on issue #9790:
URL: https://github.com/apache/airflow/issues/9790#issuecomment-657710481
@FelixReuthlingerBMW Can I ask for a review?
https://github.com/apache/airflow/pull/9793
This is an automated mess
potiuk opened a new pull request #9794:
URL: https://github.com/apache/airflow/pull/9794
---
Make sure to mark the boxes below before creating PR: [x]
- [x] Description above provides context of the change
- [x] Unit tests coverage for changes (not needed for documentation chang
mik-laj commented on issue #9763:
URL: https://github.com/apache/airflow/issues/9763#issuecomment-657712114
I think we can do nothing to solve this ticket, so I close this ticket. We
have a simple workaround - upgrade to the new version of Airflow
-
mik-laj closed issue #9763:
URL: https://github.com/apache/airflow/issues/9763
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the s
jimmycfa opened a new issue #9795:
URL: https://github.com/apache/airflow/issues/9795
I ran into this Pitfall today from
https://cwiki.apache.org/confluence/display/AIRFLOW/Common+Pitfalls : "When
needing to change your start_date and schedule interval, change the name of the
dag" I origi
boring-cyborg[bot] commented on issue #9795:
URL: https://github.com/apache/airflow/issues/9795#issuecomment-657715391
Thanks for opening your first issue here! Be sure to follow the issue
template!
This is an automated
potiuk merged pull request #9794:
URL: https://github.com/apache/airflow/pull/9794
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to t
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from d31e8a3 Add DAG Source endpoint (#9322)
add 8f6b837 The group of embedded DAGs should be root to be OpenShift
mik-laj opened a new pull request #9796:
URL: https://github.com/apache/airflow/pull/9796
This index is a bit empty. We can add it in the future, if needed.
---
Make sure to mark the boxes below before creating PR: [x]
- [X] Description above provides context of the change
mik-laj commented on pull request #9698:
URL: https://github.com/apache/airflow/pull/9698#issuecomment-657758808
@manesioz Can you do a rebase?
This is an automated message from the Apache Git Service.
To respond to the messa
manesioz commented on pull request #9698:
URL: https://github.com/apache/airflow/pull/9698#issuecomment-657763623
@mik-laj Done!
This is an automated message from the Apache Git Service.
To respond to the message, please log
mik-laj merged pull request #9793:
URL: https://github.com/apache/airflow/pull/9793
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
This is an automated email from the ASF dual-hosted git repository.
kamilbregula pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 8f6b837 The group of embedded DAGs should be root to be OpenShift
compatible (#9794)
add 383b676 Add d
mik-laj opened a new pull request #9797:
URL: https://github.com/apache/airflow/pull/9797
This is less obvious than the previous solution, but I think it will make
writing documentation easier.
---
Make sure to mark the boxes below before creating PR: [x]
- [X] Description
turbaszek commented on a change in pull request #272:
URL: https://github.com/apache/airflow-site/pull/272#discussion_r453817450
##
File path: landing-pages/site/content/en/blog/apache-airflow-for-new-comers.md
##
@@ -0,0 +1,51 @@
+---
+title: "Apache Airflow For New Comers"
+l
jhtimmins commented on issue #8112:
URL: https://github.com/apache/airflow/issues/8112#issuecomment-657778391
@ash I think that's a good question. I can see the argument going either
way. Do you know if there's a standard here?
-
mik-laj commented on pull request #9698:
URL: https://github.com/apache/airflow/pull/9698#issuecomment-657778772
@menesioz Can you update path in *include directives?
```
/opt/airflow/docs/howto/operator/google/cloud/vision.rst:701: WARNING:
Include file
'/opt/airflow/docs/airflow/pr
turbaszek merged pull request #8849:
URL: https://github.com/apache/airflow/pull/8849
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
boring-cyborg[bot] commented on pull request #8849:
URL: https://github.com/apache/airflow/pull/8849#issuecomment-657779379
Awesome work, congrats on your first merged pull request!
This is an automated message from the A
turbaszek closed issue #8724:
URL: https://github.com/apache/airflow/issues/8724
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
This is an automated email from the ASF dual-hosted git repository.
turbaszek pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 383b676 Add docs for replace_microseconds parameters in trigger DAG
endpoint (#9793)
add 6892590 Add mult
mik-laj commented on issue #8112:
URL: https://github.com/apache/airflow/issues/8112#issuecomment-657787665
I think it's best if we reuse the existing operation ID defined in the API
to create permission, if possible.
```
get_config
get_connections
post_connection
delete
tooptoop4 closed issue #8526:
URL: https://github.com/apache/airflow/issues/8526
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
mik-laj merged pull request #9786:
URL: https://github.com/apache/airflow/pull/9786
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
This is an automated email from the ASF dual-hosted git repository.
kamilbregula pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 6892590 Add multiple file upload functionality to GCS hook (#8849)
add 553bb7a Keep functions signature
mik-laj commented on pull request #9786:
URL: https://github.com/apache/airflow/pull/9786#issuecomment-657790198
> Looks good! I'm surprised that pylint accepts single letter T variable
It does not accept. I added exclusion on each line. `# pylint:
disable=invalid-name` to use a comm
mik-laj merged pull request #9797:
URL: https://github.com/apache/airflow/pull/9797
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
This is an automated email from the ASF dual-hosted git repository.
kamilbregula pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 553bb7a Keep functions signatures in decorators (#9786)
add efe1bdd Use paths relative to root docs dir
mik-laj commented on a change in pull request #9698:
URL: https://github.com/apache/airflow/pull/9698#discussion_r453930297
##
File path: docs/howto/operator/google/cloud/vision.rst
##
@@ -683,6 +683,68 @@ More information
See `Google Cloud Vision ReferenceImage create documen
mik-laj commented on a change in pull request #9747:
URL: https://github.com/apache/airflow/pull/9747#discussion_r453932386
##
File path: docs/howto/connection/azure.rst
##
@@ -0,0 +1,72 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
Review comment:
vuppalli opened a new pull request #9798:
URL: https://github.com/apache/airflow/pull/9798
---
Created a guide for AI Platform (formerly known as ML Engine) operators
using [this example
DAG](https://github.com/apache/airflow/blob/master/airflow/providers/google/cloud/example_dags/e
1 - 100 of 217 matches
Mail list logo
