potiuk merged pull request #8216: Added
GoogleDisplayVideo360UploadLineItemsOperator
URL: https://github.com/apache/airflow/pull/8216
This is an automated message from the Apache Git Service.
To respond to the message, pleas
potiuk merged pull request #8145: Drop redundant project id null checks.
URL: https://github.com/apache/airflow/pull/8145
This is an automated message from the Apache Git Service.
To respond to the message, please log on to G
potiuk commented on issue #8145: Drop redundant project id null checks.
URL: https://github.com/apache/airflow/pull/8145#issuecomment-612794117
Thanks @jmcarp! Great change!
This is an automated message from the Apache Git Ser
potiuk commented on issue #8008: Custom Facebook Ads Operator
URL: https://github.com/apache/airflow/pull/8008#issuecomment-612794535
Hey @randr97 -> I'd love to merge this one. Can you please rebase and
regenerate the requirements?
potiuk merged pull request #7900: Convert properties with query to real methods
URL: https://github.com/apache/airflow/pull/7900
This is an automated message from the Apache Git Service.
To respond to the message, please log
randr97 commented on issue #8008: Custom Facebook Ads Operator
URL: https://github.com/apache/airflow/pull/8008#issuecomment-612806356
> Hey @randr97 -> I'd love to merge this one. Can you please rebase and
regenerate the requirements?
Sure thing, will do
---
BasPH edited a comment on issue #8266: Fix non updating DAG code by checking
against last modification time
URL: https://github.com/apache/airflow/pull/8266#issuecomment-612806547
> The reason we might want to make this number configurable is so that we
don't write to the table more often
BasPH commented on issue #8266: Fix non updating DAG code by checking against
last modification time
URL: https://github.com/apache/airflow/pull/8266#issuecomment-612806547
> The reason we might want to make this number configurable is so that we
don't write to the table more often than ne
potiuk opened a new pull request #8267: Less aggressive eager upgrade of
requirements
URL: https://github.com/apache/airflow/pull/8267
With this change requirements are only eagerly upgraded when
generating requirements when setup.py changes. They are also
eagerly upgraded when you ru
potiuk commented on issue #8008: Custom Facebook Ads Operator
URL: https://github.com/apache/airflow/pull/8008#issuecomment-612833979
I think there was a change in MyPy in the meantime and you will have to wait
until #8267 is merged (it fixes the problem) and rebase again I am afraid.
Sorr
stale[bot] commented on issue #7331: [AIRFLOW-6657] Deprecate BaseBranchOperator
URL: https://github.com/apache/airflow/pull/7331#issuecomment-612836459
This issue has been automatically marked as stale because it has not had
recent activity. It will be closed if no further activity occurs.
rcjsuen commented on issue #8171: Handle missing object in webserver
URL: https://github.com/apache/airflow/issues/8171#issuecomment-612843205
@mik-laj Hi, what is your expected fix for this issue? Are you looking for
something like this?
```
if dag is None:
response = jsonify(
[
https://issues.apache.org/jira/browse/AIRFLOW-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexandre Cazé reassigned AIRFLOW-4685:
---
Assignee: Alexandre Cazé
> Make airflow/www Pylint compatible
> --
kaxil commented on issue #8266: Fix non updating DAG code by checking against
last modification time
URL: https://github.com/apache/airflow/pull/8266#issuecomment-612857738
Yeah, I agree. Can you fix the static test please?
cc @anitakar Was there a reason for a 120s threshold? Just w
BasPH commented on issue #8266: Fix non updating DAG code by checking against
last modification time
URL: https://github.com/apache/airflow/pull/8266#issuecomment-612859408
Done. If there is a strong reason to only write after a certain interval, we
can make it configurable, but for now I
BasPH edited a comment on issue #8266: Fix non updating DAG code by checking
against last modification time
URL: https://github.com/apache/airflow/pull/8266#issuecomment-612859408
Done. If there is a strong reason to only write after a certain interval, we
can make it configurable, but for
kaxil commented on a change in pull request #8266: Fix non updating DAG code by
checking against last modification time
URL: https://github.com/apache/airflow/pull/8266#discussion_r407435121
##
File path: airflow/models/dagcode.py
##
@@ -124,15 +124,14 @@ def bulk_sync_to_
BasPH commented on a change in pull request #8266: Fix non updating DAG code by
checking against last modification time
URL: https://github.com/apache/airflow/pull/8266#discussion_r407435793
##
File path: airflow/models/dagcode.py
##
@@ -124,15 +124,14 @@ def bulk_sync_to_
codecov-io edited a comment on issue #8267: Less aggressive eager upgrade of
requirements
URL: https://github.com/apache/airflow/pull/8267#issuecomment-612863712
# [Codecov](https://codecov.io/gh/apache/airflow/pull/8267?src=pr&el=h1)
Report
> Merging
[#8267](https://codecov.io/gh/apac
codecov-io commented on issue #8267: Less aggressive eager upgrade of
requirements
URL: https://github.com/apache/airflow/pull/8267#issuecomment-612863712
# [Codecov](https://codecov.io/gh/apache/airflow/pull/8267?src=pr&el=h1)
Report
> Merging
[#8267](https://codecov.io/gh/apache/airf
codecov-io edited a comment on issue #8267: Less aggressive eager upgrade of
requirements
URL: https://github.com/apache/airflow/pull/8267#issuecomment-612863712
# [Codecov](https://codecov.io/gh/apache/airflow/pull/8267?src=pr&el=h1)
Report
> Merging
[#8267](https://codecov.io/gh/apac
[
https://issues.apache.org/jira/browse/AIRFLOW-4078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082248#comment-17082248
]
Cesar Mauricio commented on AIRFLOW-4078:
-
Hi [~pujitha.jaji28], as already men
waleedsamy commented on issue #8082: [AIRFLOW-4355] removed task should not
lead to dagrun success
URL: https://github.com/apache/airflow/pull/8082#issuecomment-612869509
1+
This is an automated message from the Apache Git Se
ramkrishnan8994 commented on issue #6337: [AIRFLOW-5659] - Add support for
ephemeral storage on KubernetesPodOp…
URL: https://github.com/apache/airflow/pull/6337#issuecomment-612870043
> > When will this be added to apache-airflow 1.10.10 pip package. Need this
ephemeral storage support in
stale[bot] commented on issue #6565: [AIRFLOW-5909] Enable mapping to BYTEs
type to sql_to_gcs operator
URL: https://github.com/apache/airflow/pull/6565#issuecomment-612870402
This issue has been automatically marked as stale because it has not had
recent activity. It will be closed if no
michaelosthege commented on issue #5519: [AIRFLOW-4543] Update slack operator
to support slackclient v2
URL: https://github.com/apache/airflow/pull/5519#issuecomment-612877033
With Python 2.x EOL and slackclient 1.x being deprecated for a while now,
can this issue be re-opened, @serkef ?
potiuk commented on issue #8005: Use annotated tags for releases?
URL: https://github.com/apache/airflow/issues/8005#issuecomment-612886244
I think we can discuss this as one of the possibilities to use when we
discuss how we approach 2.0 versioning and release. WDYT @ashb ?
--
potiuk commented on issue #8155: Fix tests and documentation for CLI
'connections add'
URL: https://github.com/apache/airflow/pull/8155#issuecomment-612887765
Nice! Thanks @mebelousov !
This is an automated message from the A
boring-cyborg[bot] commented on issue #8155: Fix tests and documentation for
CLI 'connections add'
URL: https://github.com/apache/airflow/pull/8155#issuecomment-612887862
Awesome work, congrats on your first merged pull request!
-
potiuk merged pull request #8155: Fix tests and documentation for CLI
'connections add'
URL: https://github.com/apache/airflow/pull/8155
This is an automated message from the Apache Git Service.
To respond to the message, pl
BasPH commented on issue #8244: Add Option for BashOperator to Set State to
SKIPPED
URL: https://github.com/apache/airflow/pull/8244#issuecomment-612891837
I can imagine this to be useful in certain conditions, but too specific as
it is right now. To make it useful for all Airflow operator
zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS
Glue Job Integration
URL: https://github.com/apache/airflow/pull/6007#discussion_r407476975
##
File path: airflow/providers/amazon/aws/operators/glue.py
##
@@ -0,0 +1,117 @@
+# -*- coding: utf-8
zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS
Glue Job Integration
URL: https://github.com/apache/airflow/pull/6007#discussion_r407476975
##
File path: airflow/providers/amazon/aws/operators/glue.py
##
@@ -0,0 +1,117 @@
+# -*- coding: utf-8
mik-laj commented on issue #8107: AIP-32 - Airflow REST API - High-level info
URL: https://github.com/apache/airflow/issues/8107#issuecomment-612925322
Continuation of the API discussion.
https://lists.apache.org/thread.html/re01055f493e93ba87dd01b98270446dfc4324adc0356c3a4eda34c4a%40%3Cdev
dferguson992 commented on issue #7407: [AIRFLOW-6786] Add KafkaConsumerHook,
KafkaProduerHook and KafkaSensor
URL: https://github.com/apache/airflow/pull/7407#issuecomment-612929452
> Hi, @dferguson992, I'm having similar needs related to airflow-kafka. May
I try to help you with this issu
mik-laj commented on issue #8213: Fix issue #8163 where gcp auth fails
URL: https://github.com/apache/airflow/pull/8213#issuecomment-612932944
@iamshwin Travis is working again. Can you fix errors?
This is an automated message
mik-laj edited a comment on issue #8213: Fix issue #8163 where gcp auth fails
URL: https://github.com/apache/airflow/pull/8213#issuecomment-612932944
@iamshwin Travis is working again. Can you fix errors, please?
This is an au
alexandraabbas commented on issue #8200: Create guide for BigQuery operators
URL: https://github.com/apache/airflow/issues/8200#issuecomment-612936209
@mik-laj Please, assign the ticket to me, thanks!
This is an automated mes
mik-laj commented on issue #8171: Handle missing object in webserver
URL: https://github.com/apache/airflow/issues/8171#issuecomment-612939805
It should be something similar. The most important thing is that no
mushrooms appear, but user-readable error messages.
For example:
When
boring-cyborg[bot] commented on issue #8268: Update the tree view of dag on
Concepts Last Run Only
URL: https://github.com/apache/airflow/pull/8268#issuecomment-612941573
Congratulations on your first Pull Request and welcome to the Apache Airflow
community! If you have any issues or are u
boittega opened a new pull request #8268: Update the tree view of dag on
Concepts Last Run Only
URL: https://github.com/apache/airflow/pull/8268
The tree view on Concepts -> Last Run Only documentation
(https://airflow.apache.org/docs/stable/concepts.html#latest-run-only) was
showing upsi
boittega commented on issue #8246: Docs: LatestOnlyOperator documentation is
misleading
URL: https://github.com/apache/airflow/issues/8246#issuecomment-612942051
The documentation has being updated fixing the confusions, the code in the
documentation is also out of date, the new dag has th
mik-laj commented on issue #8171: Handle missing object in webserver
URL: https://github.com/apache/airflow/issues/8171#issuecomment-612943432
For clarity. This contribution does not have to solve all problems in one
PR. I will be happy even if one problem is solved. And another person will
mik-laj edited a comment on issue #8171: Handle missing object in webserver
URL: https://github.com/apache/airflow/issues/8171#issuecomment-612943432
For clarity. This contribution does not have to solve all problems in one
PR. I will be happy even if one problem is solved. And another pers
[
https://issues.apache.org/jira/browse/AIRFLOW-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kamil Bregula reopened AIRFLOW-5308:
> Pass credentials object to pandas_gbq
> -
>
>
[
https://issues.apache.org/jira/browse/AIRFLOW-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kamil Bregula resolved AIRFLOW-5308.
Fix Version/s: 2.0.0
Resolution: Fixed
> Pass credentials object to pandas_gbq
> -
mik-laj commented on a change in pull request #8267: Less aggressive eager
upgrade of requirements
URL: https://github.com/apache/airflow/pull/8267#discussion_r407572370
##
File path: scripts/ci/in_container/run_generate_requirements.sh
##
@@ -23,6 +23,20 @@ HANDLERS="$( t
kaxil merged pull request #8266: Fix non updating DAG code by checking against
last modification time
URL: https://github.com/apache/airflow/pull/8266
This is an automated message from the Apache Git Service.
To respond to t
dimberman commented on issue #8265: Kubernetes on host
URL: https://github.com/apache/airflow/pull/8265#issuecomment-612978171
@potiuk is there a reason we're still defaulting to such an old k8s? We
should set it to at least 1.17 (unless that should be a separate PR).
-
BasPH closed issue #8249: DagCode is never updated
URL: https://github.com/apache/airflow/issues/8249
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
UR
BasPH commented on issue #8249: DagCode is never updated
URL: https://github.com/apache/airflow/issues/8249#issuecomment-612978648
Closed by https://github.com/apache/airflow/pull/8266
This is an automated message from the Apa
potiuk merged pull request #8267: Less aggressive eager upgrade of requirements
URL: https://github.com/apache/airflow/pull/8267
This is an automated message from the Apache Git Service.
To respond to the message, please log
potiuk commented on issue #8008: Custom Facebook Ads Operator
URL: https://github.com/apache/airflow/pull/8008#issuecomment-612984630
OK. You can rebase now - it should be fine :)
This is an automated message from the Apache G
ryanahamilton opened a new pull request #8269: [AIRFLOW-4357] Fix SVG tooltip
positioning with custom scripting
URL: https://github.com/apache/airflow/pull/8269
Resolves [AIRFLOW-4357](https://issues.apache.org/jira/browse/AIRFLOW-4357).
Tooltip positioning was not being calculated c
[
https://issues.apache.org/jira/browse/AIRFLOW-4357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082484#comment-17082484
]
ASF GitHub Bot commented on AIRFLOW-4357:
-
ryanahamilton commented on pull requ
mik-laj commented on issue #8265: Kubernetes on host
URL: https://github.com/apache/airflow/pull/8265#issuecomment-612989890
@dimberman Old release? Version 1.14 is the latest version of the stable
release channel on GKE. Version 1.15 is the latest version of the regular
release channel. I
mik-laj commented on issue #8265: Kubernetes on host
URL: https://github.com/apache/airflow/pull/8265#issuecomment-612993074
The following Kubernetes versions are currently available for new clusters
in Amazon EKS:
* 1.15.11
* 1.14.9
* 1.13.12
* 1.12.10
You can use the newer
mik-laj edited a comment on issue #8265: Kubernetes on host
URL: https://github.com/apache/airflow/pull/8265#issuecomment-612993074
The following Kubernetes versions are currently available for new clusters
in Amazon EKS:
* 1.15.11
* 1.14.9
* 1.13.12
* 1.12.10
You can use
mik-laj edited a comment on issue #8265: Kubernetes on host
URL: https://github.com/apache/airflow/pull/8265#issuecomment-612993074
The following Kubernetes versions are currently available for new clusters
in Amazon EKS:
* 1.15.11
* 1.14.9
* 1.13.12
* 1.12.10
https://doc
boring-cyborg[bot] commented on issue #8270: Provide official airflow chart
URL: https://github.com/apache/airflow/issues/8270#issuecomment-612998595
Thanks for opening your first issue here! Be sure to follow the issue
template!
---
eugene-chernyshenko opened a new issue #8270: Provide official airflow chart
URL: https://github.com/apache/airflow/issues/8270
Could you please provide official chart for your image.
The stable/airflow chart was created for image puckel/docker-airflow.
There are specific feat
mik-laj opened a new issue #8271: Add Jira/Github Issue to "CONTIRUBTE.rst"
URL: https://github.com/apache/airflow/issues/8271
**What you expected to happen**:
I would be happy if Jira and Github were added to the "How to communicate"
section of the CONTRIBUTING.rst file. They should
alexandrecaze commented on issue #8187: Extend elastic DAG with a binary tree,
grid, star
URL: https://github.com/apache/airflow/issues/8187#issuecomment-613007188
I am interested in taking this issue @mik-laj
This is an aut
mik-laj opened a new issue #8272: Cloud Life Sciences operators and hooks
URL: https://github.com/apache/airflow/issues/8272
**Description**
Hello,
Airflow has extensive support for [many GCP
services](https://airflow.readthedocs.io/en/latest/operators-and-hooks-ref.html#gcp-g
alexandrecaze commented on issue #8187: Extend elastic DAG with a binary tree,
grid, star
URL: https://github.com/apache/airflow/issues/8187#issuecomment-613020676
@mik-laj What do you mean by grids and stars shaped DAGs ?
Th
mik-laj commented on issue #8187: Extend elastic DAG with a binary tree, grid,
star
URL: https://github.com/apache/airflow/issues/8187#issuecomment-613023389
DAGs that look like the picture
:
),
potiuk commented on issue #8271: Add Jira/Github Issue to "CONTIRUBTE.rst"
URL: https://github.com/apache/airflow/issues/8271#issuecomment-613056212
Why not adding it @mik-laj ? Adding docs is easy :D
This is an automated mes
potiuk commented on issue #8265: Kubernetes on host
URL: https://github.com/apache/airflow/pull/8265#issuecomment-613056910
No reason whatsoever. Just carried from the past. Right now it's as easy as
modifying a few constants :)
-
khyurri opened a new pull request #8274: WIP: Fix issue #8237
URL: https://github.com/apache/airflow/pull/8274
---
Make sure to mark the boxes below before creating PR: [x]
- [x] Description above provides context of the change
- [ ] Unit tests coverage for changes (not needed f
boring-cyborg[bot] commented on issue #8274: WIP: Fix issue #8237
URL: https://github.com/apache/airflow/pull/8274#issuecomment-613057788
Congratulations on your first Pull Request and welcome to the Apache Airflow
community! If you have any issues or are unsure about any anything please ch
dimberman commented on a change in pull request #8219: Add migration waiting
script and log cleaner
URL: https://github.com/apache/airflow/pull/8219#discussion_r407677032
##
File path: airflow/include/airflow_migration_spinner.py
##
@@ -0,0 +1,50 @@
+import argparse
+impor
brandonwillard commented on issue #8146: [AIRFLOW-6780] Add option to use args
instead of command in K8s pod spec
URL: https://github.com/apache/airflow/pull/8146#issuecomment-613064411
I'm very confused by [this Travis EOF
error](https://travis-ci.org/github/apache/airflow/jobs/671105889#
brandonwillard commented on issue #8146: [AIRFLOW-6780] Add option to use args
instead of command in K8s pod spec
URL: https://github.com/apache/airflow/pull/8146#issuecomment-613066734
Also, I've looked into the K8s-related errors (e.g. [this
one](https://travis-ci.org/github/apache/airfl
Rested opened a new issue #8275: Environment variable ordering for refrencing
secrets with KubernetesPodOperator
URL: https://github.com/apache/airflow/issues/8275
**Apache Airflow version**: 1.10.9
**Kubernetes version (if you are using kubernetes)** (use `kubect
rcjsuen commented on issue #8270: Provide official airflow chart
URL: https://github.com/apache/airflow/issues/8270#issuecomment-613066953
@eugene-chernyshenko There is an [ongoing
discussion](https://lists.apache.org/thread.html/r55b09d63a809428c20ca3317801cad5a86ac939478e0dbd8e93f0fee%40
boring-cyborg[bot] commented on issue #8275: Environment variable ordering for
refrencing secrets with KubernetesPodOperator
URL: https://github.com/apache/airflow/issues/8275#issuecomment-613066988
Thanks for opening your first issue here! Be sure to follow the issue
template!
--
brandonwillard commented on a change in pull request #8150: [AIRFLOW-3126] Add
option to specify additional K8s volumes
URL: https://github.com/apache/airflow/pull/8150#discussion_r407683706
##
File path: airflow/config_templates/default_airflow.cfg
##
@@ -881,6 +881,15 @@
turbaszek commented on a change in pull request #8273: BigQueryCheckOperator
location fix
URL: https://github.com/apache/airflow/pull/8273#discussion_r407684951
##
File path: airflow/providers/google/cloud/hooks/bigquery.py
##
@@ -2442,10 +2442,17 @@ def next(self) -> Unio
boring-cyborg[bot] commented on issue #8276: [Airflow-6295] Create guide for
BigQuery operators
URL: https://github.com/apache/airflow/pull/8276#issuecomment-613069827
Congratulations on your first Pull Request and welcome to the Apache Airflow
community! If you have any issues or are unsu
alexandraabbas opened a new pull request #8276: [Airflow-6295] Create guide for
BigQuery operators
URL: https://github.com/apache/airflow/pull/8276
Fixes [AIRFLOW-6295](https://issues.apache.org/jira/browse/AIRFLOW-6295) /
issue [#8200](https://github.com/apache/airflow/issues/8200).
alexandraabbas commented on issue #8200: Create guide for BigQuery operators
URL: https://github.com/apache/airflow/issues/8200#issuecomment-613070341
@mik-laj This PR can be linked to this issue:
https://github.com/apache/airflow/pull/8276.
alexandrecaze opened a new pull request #8277: WIP : [AIRFLOW-8187] Extend
elastic DAG with a binary tree, grid, star
URL: https://github.com/apache/airflow/pull/8277
Add two shapes to the elastic DAG :
- BINARY_TREE
```
t0 -> t1 -> t3 -> t7
|\
boring-cyborg[bot] commented on issue #8277: WIP : [AIRFLOW-8187] Extend
elastic DAG with a binary tree, grid, star
URL: https://github.com/apache/airflow/pull/8277#issuecomment-613076568
Congratulations on your first Pull Request and welcome to the Apache Airflow
community! If you have an
alexandrecaze commented on issue #8277: WIP : [AIRFLOW-8187] Extend elastic DAG
with a binary tree, grid, star
URL: https://github.com/apache/airflow/pull/8277#issuecomment-613077136
@mik-laj This is a first attempt to tackle
https://github.com/apache/airflow/issues/8187
I did not add t
alexandrecaze edited a comment on issue #8277: WIP : [AIRFLOW-8187] Extend
elastic DAG with a binary tree, grid, star
URL: https://github.com/apache/airflow/pull/8277#issuecomment-613077136
@mik-laj This is a first attempt to tackle
https://github.com/apache/airflow/issues/8187
I did no
alexandrecaze edited a comment on issue #8277: WIP : [AIRFLOW-8187] Extend
elastic DAG with a binary tree, grid, star
URL: https://github.com/apache/airflow/pull/8277#issuecomment-613077136
@mik-laj This is a first attempt to tackle
https://github.com/apache/airflow/issues/8187
I did no
mik-laj opened a new issue #8278: Missing tests for some modules in providers
package
URL: https://github.com/apache/airflow/issues/8278
**Description**
We have a rule that every file in the `providers` directory should have.
This is true in many cases, but there are minor exception
boring-cyborg[bot] commented on issue #8279: Protect /rendered page from
invalid DAG ids (#8171)
URL: https://github.com/apache/airflow/pull/8279#issuecomment-613084935
Congratulations on your first Pull Request and welcome to the Apache Airflow
community! If you have any issues or are uns
rcjsuen opened a new pull request #8279: Protect /rendered page from invalid
DAG ids (#8171)
URL: https://github.com/apache/airflow/pull/8279
Redirects the user back to the main page if an invalid DAG id is provided to
the `/rendered` page instead of crashing to improve the overall user ex
mik-laj opened a new issue #8280: Missing example DAGs/system tests for Google
services
URL: https://github.com/apache/airflow/issues/8280
**Description**
Hello,
We have a rule that every GCP operators should have example DAGs. This is
true in many cases, but there are minor
mik-laj commented on issue #8271: Add Jira/Github Issue to "CONTIRUBTE.rst"
URL: https://github.com/apache/airflow/issues/8271#issuecomment-613097472
I didn't have time to deal with it at the moment. On the other hand, I
didn't want to miss it.
rcjsuen commented on issue #8171: Handle missing object in webserver
URL: https://github.com/apache/airflow/issues/8171#issuecomment-613098813
@mik-laj I have created #8279 which addresses a single endpoint for a start.
Please let me know what you think.
---
1 - 100 of 149 matches
Mail list logo
