Re: [PR] Temporarily comment-out publishing docs in canary runs [airflow]

2024-07-22 Thread via GitHub
potiuk commented on PR #40921: URL: https://github.com/apache/airflow/pull/40921#issuecomment-2242232241 > Should we create an issue to track this temporary act? Yeah. Why not. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] fix: soft_fail part 2 [airflow]

2024-07-22 Thread via GitHub
eladkal commented on code in PR #40923: URL: https://github.com/apache/airflow/pull/40923#discussion_r1686069602 ## airflow/exceptions.py: ## @@ -64,6 +64,10 @@ class AirflowSensorTimeout(AirflowException): """Raise when there is a timeout on sensor polling.""" +class A

Re: [PR] fix: soft_fail part 2 [airflow]

2024-07-22 Thread via GitHub
eladkal commented on code in PR #40923: URL: https://github.com/apache/airflow/pull/40923#discussion_r1686069602 ## airflow/exceptions.py: ## @@ -64,6 +64,10 @@ class AirflowSensorTimeout(AirflowException): """Raise when there is a timeout on sensor polling.""" +class A

[PR] fix: sensor - skip_policy [airflow]

2024-07-22 Thread via GitHub
raphaelauv opened a new pull request, #40924: URL: https://github.com/apache/airflow/pull/40924 fix: https://github.com/apache/airflow/pull/40915 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [PR] Temporarily comment-out publishing docs in canary runs [airflow]

2024-07-22 Thread via GitHub
potiuk commented on PR #40921: URL: https://github.com/apache/airflow/pull/40921#issuecomment-2242250574 https://github.com/apache/airflow/issues/40925 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] Qdrant Provider: Bump Qdrant client to latest [airflow]

2024-07-22 Thread via GitHub
potiuk merged PR #40831: URL: https://github.com/apache/airflow/pull/40831 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: chore: bump qdrant client deps (#40831)

2024-07-22 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 2561642497 chore: bump qdrant client deps (#40831)

Re: [PR] fix: never_fail in sensor [airflow]

2024-07-22 Thread via GitHub
Lee-W commented on PR #40915: URL: https://github.com/apache/airflow/pull/40915#issuecomment-2242280843 > yes I can introduce a skip_policy parameters and keep the other settings. Yes, this is something we could discuss whether we want to make it a new feature and I'm ok with it.

Re: [I] execution_timeout not enforced, task hangs up [airflow]

2024-07-22 Thread via GitHub
potiuk commented on issue #35474: URL: https://github.com/apache/airflow/issues/35474#issuecomment-2242284389 No. There is nothing against it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Bugfix for get_parsing_context() when ran with LocalExecutor [airflow]

2024-07-22 Thread via GitHub
potiuk commented on PR #40738: URL: https://github.com/apache/airflow/pull/40738#issuecomment-2242286334 @ErandM50 ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

Re: [PR] fix: never_fail in sensor [airflow]

2024-07-22 Thread via GitHub
raphaelauv commented on PR #40915: URL: https://github.com/apache/airflow/pull/40915#issuecomment-2242293932 before 2.7.1 soft_fail was not related to every exception. So it's a quit recent and breaking change that my PR isolated in `never_fail` parameter -- This is an automated message f

Re: [PR] Add start execution from triggerer support to dynamic task mapping [airflow]

2024-07-22 Thread via GitHub
Lee-W commented on PR #39912: URL: https://github.com/apache/airflow/pull/39912#issuecomment-2242307072 The latest comments from @uranusjr have been addressed. I'll go ahead and merge this one. -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] fix: never_fail in sensor [airflow]

2024-07-22 Thread via GitHub
Lee-W commented on PR #40915: URL: https://github.com/apache/airflow/pull/40915#issuecomment-2242331101 The reason why we made those changes was that the sensor did not do `soft_fail` states. I would also like to know what others think 🙂 Maybe we just misunderstood how it should work. --

(airflow) branch constraints-main updated: Updating constraints. Github run id:10036539279

2024-07-22 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 0c4e89cd18 Updating con

Re: [PR] Scheduling based on dataset aliases [airflow]

2024-07-22 Thread via GitHub
ephraimbuddy commented on code in PR #40693: URL: https://github.com/apache/airflow/pull/40693#discussion_r1686152287 ## airflow/migrations/versions/0150_2_10_0_dataset_alias_dataset.py: ## @@ -0,0 +1,68 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or m

Re: [PR] Scheduling based on dataset aliases [airflow]

2024-07-22 Thread via GitHub
ephraimbuddy commented on code in PR #40693: URL: https://github.com/apache/airflow/pull/40693#discussion_r1686166326 ## tests/models/test_dag.py: ## @@ -3024,6 +3024,54 @@ def test_dags_needing_dagruns_datasets(self, dag_maker, session): dag_models = query.all()

Re: [PR] AIP-64: Add REST API endpoints for TI try level details [airflow]

2024-07-22 Thread via GitHub
Lee-W commented on code in PR #40441: URL: https://github.com/apache/airflow/pull/40441#discussion_r1686161168 ## airflow/api_connexion/schemas/task_instance_schema.py: ## @@ -86,6 +87,38 @@ def get_attribute(self, obj, attr, default): return get_value(obj[0], attr, def

Re: [PR] Add start execution from triggerer support to dynamic task mapping [airflow]

2024-07-22 Thread via GitHub
Lee-W merged PR #39912: URL: https://github.com/apache/airflow/pull/39912 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.ap

(airflow) branch main updated: Add start execution from triggerer support to dynamic task mapping (#39912)

2024-07-22 Thread weilee
This is an automated email from the ASF dual-hosted git repository. weilee pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 85b2666eab Add start execution from triggerer suppo

Re: [PR] AIP-64: Add REST API endpoints for TI try level details [airflow]

2024-07-22 Thread via GitHub
ephraimbuddy commented on code in PR #40441: URL: https://github.com/apache/airflow/pull/40441#discussion_r1686189671 ## airflow/api_connexion/schemas/task_instance_schema.py: ## @@ -86,6 +87,38 @@ def get_attribute(self, obj, attr, default): return get_value(obj[0], at

Re: [PR] Log info about task instance clearing/marking as succcess/failure [airflow]

2024-07-22 Thread via GitHub
ephraimbuddy closed pull request #39440: Log info about task instance clearing/marking as succcess/failure URL: https://github.com/apache/airflow/pull/39440 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] Fix overriden base container name not used to fetch logs on KPO trigger_reentry [airflow]

2024-07-22 Thread via GitHub
hussein-awala commented on code in PR #40835: URL: https://github.com/apache/airflow/pull/40835#discussion_r1686189229 ## airflow/providers/cncf/kubernetes/operators/pod.py: ## @@ -353,9 +352,9 @@ def __init__( self.cluster_context = cluster_context self.reatta

Re: [PR] AIP-64: Add REST API endpoints for TI try level details [airflow]

2024-07-22 Thread via GitHub
Lee-W commented on code in PR #40441: URL: https://github.com/apache/airflow/pull/40441#discussion_r1686191430 ## airflow/api_connexion/schemas/task_instance_schema.py: ## @@ -86,6 +87,38 @@ def get_attribute(self, obj, attr, default): return get_value(obj[0], attr, def

Re: [PR] Fix dataset_with_extra_from_classic_operator example DAG [airflow]

2024-07-22 Thread via GitHub
Lee-W merged PR #40747: URL: https://github.com/apache/airflow/pull/40747 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.ap

(airflow) branch main updated (85b2666eab -> 05a5df86c9)

2024-07-22 Thread weilee
This is an automated email from the ASF dual-hosted git repository. weilee pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 85b2666eab Add start execution from triggerer support to dynamic task mapping (#39912) add 05a5df86c9 Fix dataset

Re: [PR] openlineage: Add AirflowDagRunFacet to dag runEvents [airflow]

2024-07-22 Thread via GitHub
kacpermuda commented on code in PR #40854: URL: https://github.com/apache/airflow/pull/40854#discussion_r1686194775 ## airflow/providers/openlineage/plugins/adapter.py: ## @@ -329,19 +330,26 @@ def dag_started( self, dag_run: DagRun, msg: str, -

Re: [PR] Ability to add custom facet in OpenLineage events [airflow]

2024-07-22 Thread via GitHub
JDarDagran commented on code in PR #38982: URL: https://github.com/apache/airflow/pull/38982#discussion_r1686210312 ## tests/providers/openlineage/utils/custom_facet_fixture.py: ## @@ -0,0 +1,87 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contribu

Re: [PR] AIP-62: add hook lineage collection support for S3Hook [airflow]

2024-07-22 Thread via GitHub
mobuchowski merged PR #40819: URL: https://github.com/apache/airflow/pull/40819 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airf

(airflow) branch main updated: openlineage: add support for hook lineage for S3Hook (#40819)

2024-07-22 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 0212f67192 openlineage: add support for hook l

(airflow) branch aip-62/object-storage updated (15f692031a -> ccdee06525)

2024-07-22 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a change to branch aip-62/object-storage in repository https://gitbox.apache.org/repos/asf/airflow.git discard 15f692031a openlineage: add support for hook lineage for Object Store omit 829bdd1bf0 openlin

Re: [PR] Sync v2-9-stable with v2-9-test to release python client v2.9.3 [airflow]

2024-07-22 Thread via GitHub
utkarsharma2 merged PR #40858: URL: https://github.com/apache/airflow/pull/40858 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

(airflow) branch v2-9-stable updated (81845de9d9 -> 1bf613e9c0)

2024-07-22 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a change to branch v2-9-stable in repository https://gitbox.apache.org/repos/asf/airflow.git from 81845de9d9 Fix typing issue with new version of types-docutils released` (#40727) add 9a4130b9da Fix

Re: [PR] openlineage: Add AirflowDagRunFacet to dag runEvents [airflow]

2024-07-22 Thread via GitHub
dolfinus commented on code in PR #40854: URL: https://github.com/apache/airflow/pull/40854#discussion_r1686240389 ## airflow/providers/openlineage/plugins/adapter.py: ## @@ -329,19 +330,26 @@ def dag_started( self, dag_run: DagRun, msg: str, -n

Re: [PR] Align timers and timing metrics (ms) across all metrics loggers [airflow]

2024-07-22 Thread via GitHub
dirrao commented on code in PR #39908: URL: https://github.com/apache/airflow/pull/39908#discussion_r1686243248 ## tests/_internals/forbidden_warnings.py: ## @@ -62,6 +62,11 @@ def pytest_itemcollected(self, item: pytest.Item): # Add marker at the beginning of the m

Re: [PR] openlineage: replace dt.now with airflow.utils.timezone.utcnow [airflow]

2024-07-22 Thread via GitHub
mobuchowski merged PR #40887: URL: https://github.com/apache/airflow/pull/40887 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airf

(airflow) branch main updated: openlineage: replace dt.now with airflow.utils.timezone.utcnow (#40887)

2024-07-22 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 12e17d1726 openlineage: replace dt.now with a

Re: [PR] openlineage: Add AirflowDagRunFacet to dag runEvents [airflow]

2024-07-22 Thread via GitHub
dolfinus commented on code in PR #40854: URL: https://github.com/apache/airflow/pull/40854#discussion_r1686247089 ## airflow/providers/openlineage/plugins/adapter.py: ## @@ -329,19 +330,26 @@ def dag_started( self, dag_run: DagRun, msg: str, -n

Re: [I] Status of testing of Apache Airflow Helm Chart 1.15.0rc1 [airflow]

2024-07-22 Thread via GitHub
VICIWUOHA commented on issue #40907: URL: https://github.com/apache/airflow/issues/40907#issuecomment-2242507049 Hi @jedcunningham , what are the steps in testing this ? any docs link -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[PR] uv version bump 0.2.27 [airflow]

2024-07-22 Thread via GitHub
dirrao opened a new pull request, #40927: URL: https://github.com/apache/airflow/pull/40927 uv version bump 0.2.27 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

[I] Error migrating database to Airflow version 2.9.3 [airflow]

2024-07-22 Thread via GitHub
robinaly opened a new issue, #40928: URL: https://github.com/apache/airflow/issues/40928 ### Apache Airflow version 2.9.3 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? When upgrading the database from 2.7.0 or 2.9.2 v

[PR] Fix indentation of scheduler_job_runner for standalone dag processor [airflow]

2024-07-22 Thread via GitHub
potiuk opened a new pull request, #40929: URL: https://github.com/apache/airflow/pull/40929 The indentation in #40802 has changed heartbeating to not work in case of standalone date processing. This PR fixes it back. --- **^ Add meaningful descrip

Re: [PR] Fix indentation of scheduler_job_runner for standalone dag processor [airflow]

2024-07-22 Thread via GitHub
potiuk commented on PR #40929: URL: https://github.com/apache/airflow/pull/40929#issuecomment-2242573882 cc @howardyoo -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] openlineage: migrate OpenLineage provider to V2 facets. [airflow]

2024-07-22 Thread via GitHub
kacpermuda commented on code in PR #39530: URL: https://github.com/apache/airflow/pull/39530#discussion_r1686256814 ## dev/breeze/tests/test_packages.py: ## @@ -236,6 +236,7 @@ def test_get_install_requirements(provider: str, version_suffix: str, expected: "apa

Re: [PR] Fix indentation of scheduler_job_runner for standalone dag processor [airflow]

2024-07-22 Thread via GitHub
potiuk commented on PR #40929: URL: https://github.com/apache/airflow/pull/40929#issuecomment-2242577166 (maybe you can also double check other identation changes @howardyoo in #40802 - just in case - I have not found any other, but this one shows that it could have happened. It's very easy

(airflow) branch v2-9-test updated: Update python client version in README (#39384)

2024-07-22 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a commit to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v2-9-test by this push: new 71475fa0ae Update python client vers

Re: [PR] AIP-64: Add REST API endpoints for TI try level details [airflow]

2024-07-22 Thread via GitHub
ephraimbuddy merged PR #40441: URL: https://github.com/apache/airflow/pull/40441 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

(airflow) branch main updated (12e17d1726 -> 8b111d14f1)

2024-07-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 12e17d1726 openlineage: replace dt.now with airflow.utils.timezone.utcnow (#40887) add 8b111d14f1 AIP-64

Re: [PR] Make standalone dag file processor works in DB isolation mode [airflow]

2024-07-22 Thread via GitHub
potiuk commented on PR #40916: URL: https://github.com/apache/airflow/pull/40916#issuecomment-2242585026 Should be merged after #40929 -> found it during testing standalone dag processor case. -- This is an automated message from the Apache Git Service. To respond to the message, please l

[PR] Sync v2-9-stable with v2-9-test to release python client v2.9.3 [airflow]

2024-07-22 Thread via GitHub
utkarsharma2 opened a new pull request, #40930: URL: https://github.com/apache/airflow/pull/40930 Cherrypicked missing PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] SnowflakeSqlApiOperator's Snowflake Legacy Url Authentication Issue [airflow]

2024-07-22 Thread via GitHub
shubham-arora-18 closed issue #40885: SnowflakeSqlApiOperator's Snowflake Legacy Url Authentication Issue URL: https://github.com/apache/airflow/issues/40885 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [I] SnowflakeSqlApiOperator's Snowflake Legacy Url Authentication Issue [airflow]

2024-07-22 Thread via GitHub
shubham-arora-18 commented on issue #40885: URL: https://github.com/apache/airflow/issues/40885#issuecomment-2242593699 > The Cloud Composer, AIrflow and snowflake versions seem outdated - have you tried upgrading each to the latest? Updating composer is a taxing task. No point in upg

Re: [PR] Sync v2-9-stable with v2-9-test to release python client v2.9.3 [airflow]

2024-07-22 Thread via GitHub
utkarsharma2 commented on PR #40930: URL: https://github.com/apache/airflow/pull/40930#issuecomment-2242603055 Hey @potiuk - On following the [release guide](https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PYTHON_CLIENT.md), when we running the command to generate the sdist a

Re: [PR] [AIP-62] Translate AIP-60 URI to OpenLineage [airflow]

2024-07-22 Thread via GitHub
kacpermuda commented on code in PR #40173: URL: https://github.com/apache/airflow/pull/40173#discussion_r1675472243 ## airflow/datasets/__init__.py: ## @@ -182,6 +190,28 @@ def __eq__(self, other: Any) -> bool: def __hash__(self) -> int: return hash(self.uri) +

Re: [PR] [AIP-62] Translate AIP-60 URI to OpenLineage [airflow]

2024-07-22 Thread via GitHub
kacpermuda commented on code in PR #40173: URL: https://github.com/apache/airflow/pull/40173#discussion_r1686326241 ## generated/provider_dependencies.json: ## @@ -404,6 +404,7 @@ "devel-deps": [], "plugins": [], "cross-providers-deps": [ + "common.compat",

Re: [I] duplicate key value violates unique constraint serialized_dag_pkey for dynamic dag generation [airflow]

2024-07-22 Thread via GitHub
millin commented on issue #40082: URL: https://github.com/apache/airflow/issues/40082#issuecomment-2242633106 @rafidka Hello! Could you please pay attention to this? We also encountered this problem after the update MWAA to 2.9.2. It looks like the last version's config changes may have

Re: [PR] Sync v2-9-stable with v2-9-test to release python client v2.9.3 [airflow]

2024-07-22 Thread via GitHub
potiuk commented on PR #40930: URL: https://github.com/apache/airflow/pull/40930#issuecomment-2242634415 Likely https://github.com/apache/airflow/pull/39181 - I think the breeze changes have not been cherry-picked in 2.9 branch for some time but this one should be easily manually applied.

Re: [PR] AIP-64: Update the log RESTAPI endpoint to include task try history [airflow]

2024-07-22 Thread via GitHub
phanikumv merged PR #40791: URL: https://github.com/apache/airflow/pull/40791 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

(airflow) branch main updated (8b111d14f1 -> 8c38a36219)

2024-07-22 Thread phanikumv
This is an automated email from the ASF dual-hosted git repository. phanikumv pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 8b111d14f1 AIP-64: Add REST API endpoints for TI try level details (#40441) add 8c38a36219 AIP-64: Update the

Re: [PR] Sync v2-9-stable with v2-9-test to release python client v2.9.3 [airflow]

2024-07-22 Thread via GitHub
utkarsharma2 commented on PR #40930: URL: https://github.com/apache/airflow/pull/40930#issuecomment-2242645298 > Likely #39181 - I think the breeze changes have not been cherry-picked in 2.9 branch for some time but this one should be easily manually applied. Yes, that worked for me.

(airflow) branch v2-9-test updated (71475fa0ae -> 43f5fe188e)

2024-07-22 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git from 71475fa0ae Update python client version in README (#39384) add 43f5fe188e Only replace "client" subdir w

Re: [PR] openlineage: Add AirflowDagRunFacet to dag runEvents [airflow]

2024-07-22 Thread via GitHub
mobuchowski commented on code in PR #40854: URL: https://github.com/apache/airflow/pull/40854#discussion_r1686369640 ## airflow/providers/openlineage/plugins/adapter.py: ## @@ -329,19 +330,26 @@ def dag_started( self, dag_run: DagRun, msg: str, -

Re: [PR] openlineage: Add AirflowDagRunFacet to dag runEvents [airflow]

2024-07-22 Thread via GitHub
mobuchowski commented on code in PR #40854: URL: https://github.com/apache/airflow/pull/40854#discussion_r1686370968 ## airflow/providers/openlineage/plugins/adapter.py: ## @@ -329,19 +330,26 @@ def dag_started( self, dag_run: DagRun, msg: str, -

Re: [PR] openlineage: Add AirflowDagRunFacet to dag runEvents [airflow]

2024-07-22 Thread via GitHub
mobuchowski commented on code in PR #40854: URL: https://github.com/apache/airflow/pull/40854#discussion_r1686370968 ## airflow/providers/openlineage/plugins/adapter.py: ## @@ -329,19 +330,26 @@ def dag_started( self, dag_run: DagRun, msg: str, -

Re: [PR] Datasets UI Improvements [airflow]

2024-07-22 Thread via GitHub
vatsrahul1001 commented on PR #40871: URL: https://github.com/apache/airflow/pull/40871#issuecomment-2242692250 @bbovenzi can we have a scroll in the list of cards showing dataset events extra? Also spacing between source and extras increases as we increase num of extra https://gith

Re: [PR] Datasets UI Improvements [airflow]

2024-07-22 Thread via GitHub
vatsrahul1001 commented on PR #40871: URL: https://github.com/apache/airflow/pull/40871#issuecomment-2242695379 @bbovenzi is it possible to provide DAG run id link in source and triggered https://github.com/user-attachments/assets/10fbbce4-4064-4651-a5d7-c44c510bfb22";> -- This is

Re: [PR] [AIP-62] Translate AIP-60 URI to OpenLineage [airflow]

2024-07-22 Thread via GitHub
potiuk commented on code in PR #40173: URL: https://github.com/apache/airflow/pull/40173#discussion_r1686379791 ## generated/provider_dependencies.json: ## @@ -404,6 +404,7 @@ "devel-deps": [], "plugins": [], "cross-providers-deps": [ + "common.compat", Revi

Re: [PR] uv version bump 0.2.27 [airflow]

2024-07-22 Thread via GitHub
potiuk merged PR #40927: URL: https://github.com/apache/airflow/pull/40927 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated (8c38a36219 -> 05c39b492f)

2024-07-22 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 8c38a36219 AIP-64: Update the log RESTAPI endpoint to include task try history (#40791) add 05c39b492f uv versio

Re: [PR] [AIP-62] Translate AIP-60 URI to OpenLineage [airflow]

2024-07-22 Thread via GitHub
mobuchowski commented on code in PR #40173: URL: https://github.com/apache/airflow/pull/40173#discussion_r1686384032 ## generated/provider_dependencies.json: ## @@ -404,6 +404,7 @@ "devel-deps": [], "plugins": [], "cross-providers-deps": [ + "common.compat",

Re: [PR] Ability to add custom facet in OpenLineage events [airflow]

2024-07-22 Thread via GitHub
mobuchowski merged PR #38982: URL: https://github.com/apache/airflow/pull/38982 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airf

Re: [PR] Ability to add custom facet in OpenLineage events [airflow]

2024-07-22 Thread via GitHub
boring-cyborg[bot] commented on PR #38982: URL: https://github.com/apache/airflow/pull/38982#issuecomment-2242711124 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional contributions.

(airflow) branch main updated: Ability to add custom facet in OpenLineage events (#38982)

2024-07-22 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new e30f8102b2 Ability to add custom facet in Open

Re: [PR] Ability to add custom facet in OpenLineage events [airflow]

2024-07-22 Thread via GitHub
mobuchowski commented on PR #38982: URL: https://github.com/apache/airflow/pull/38982#issuecomment-2242711641 Thanks @anandhimurali for implementing this feature 🚀 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

(airflow) branch v2-9-test updated (43f5fe188e -> 9aa67123fb)

2024-07-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git discard 43f5fe188e Only replace "client" subdir when copying sources to python client (#39181) add 9aa67123

Re: [PR] [AIP-62] Translate AIP-60 URI to OpenLineage [airflow]

2024-07-22 Thread via GitHub
potiuk commented on code in PR #40173: URL: https://github.com/apache/airflow/pull/40173#discussion_r1686410461 ## generated/provider_dependencies.json: ## @@ -404,6 +404,7 @@ "devel-deps": [], "plugins": [], "cross-providers-deps": [ + "common.compat", Revi

Re: [PR] [AIP-62] Translate AIP-60 URI to OpenLineage [airflow]

2024-07-22 Thread via GitHub
potiuk commented on code in PR #40173: URL: https://github.com/apache/airflow/pull/40173#discussion_r1686415207 ## generated/provider_dependencies.json: ## @@ -404,6 +404,7 @@ "devel-deps": [], "plugins": [], "cross-providers-deps": [ + "common.compat", Revi

Re: [PR] Scheduling based on dataset aliases [airflow]

2024-07-22 Thread via GitHub
Lee-W commented on PR #40693: URL: https://github.com/apache/airflow/pull/40693#issuecomment-2242759000 All the comments were addressed. Please let me know if anyone wants to take a deeper look. I'm planning on merging this one later today. -- This is an automated message from the Apache

Re: [PR] Sync v2-9-stable with v2-9-test to release python client v2.9.3 [airflow]

2024-07-22 Thread via GitHub
potiuk commented on PR #40930: URL: https://github.com/apache/airflow/pull/40930#issuecomment-2242765926 BTW. The jobs running here will not work - becuase our self-hosted runners stopped working and we have no way to fix it quickly. See https://github.com/apache/airflow/issues/40925

Re: [PR] Fix indentation of scheduler_job_runner for standalone dag processor [airflow]

2024-07-22 Thread via GitHub
howardyoo commented on PR #40929: URL: https://github.com/apache/airflow/pull/40929#issuecomment-2242772831 > (maybe you can also double check other identation changes @howardyoo in #40802 - just in case - I have not found any other, but this one shows that it could have happened. It's very

Re: [PR] Fix indentation of scheduler_job_runner for standalone dag processor [airflow]

2024-07-22 Thread via GitHub
potiuk commented on PR #40929: URL: https://github.com/apache/airflow/pull/40929#issuecomment-2242775929 > Ok, will check and let you know. Thank you :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

(airflow) branch v2-9-test updated (9aa67123fb -> 5c90bc5e0c)

2024-07-22 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git from 9aa67123fb Only replace "client" subdir when copying sources to python client (#39181) add bacd04319e T

Re: [PR] Sync v2-9-stable with v2-9-test to release python client v2.9.3 [airflow]

2024-07-22 Thread via GitHub
utkarsharma2 commented on PR #40930: URL: https://github.com/apache/airflow/pull/40930#issuecomment-2242796543 > BTW. The jobs running here will not work - becuase our self-hosted runners stopped working and we have no way to fix it quickly. > > See #40925 > > I think what you

Re: [PR] Sync v2-9-stable with v2-9-test to release python client v2.9.3 [airflow]

2024-07-22 Thread via GitHub
utkarsharma2 commented on PR #40930: URL: https://github.com/apache/airflow/pull/40930#issuecomment-2242804643 @potiuk cerry-picking those change are cause these [test](https://github.com/apache/airflow/actions/runs/10040436757/job/27746540918?pr=40930) to fail are there any other changes t

[I] Datetime params missing microseconds in Trigger DAG menu [airflow]

2024-07-22 Thread via GitHub
Nick-Nal opened a new issue, #40932: URL: https://github.com/apache/airflow/issues/40932 ### Apache Airflow version 2.9.3 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? Greetings I've stumbled upon a problem and inc

Re: [I] Datetime params missing microseconds in Trigger DAG menu [airflow]

2024-07-22 Thread via GitHub
boring-cyborg[bot] commented on issue #40932: URL: https://github.com/apache/airflow/issues/40932#issuecomment-2242811146 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

Re: [PR] Sync v2-9-stable with v2-9-test to release python client v2.9.3 [airflow]

2024-07-22 Thread via GitHub
potiuk commented on PR #40930: URL: https://github.com/apache/airflow/pull/40930#issuecomment-2242813945 No. Likely those are tests that have been changed in the meantime. Basically the change was to force `["ubuntu-22.04"]` where `["self-hosted", "Linux", "X64"]` were before (that was the

Re: [PR] Sync v2-9-stable with v2-9-test to release python client v2.9.3 [airflow]

2024-07-22 Thread via GitHub
potiuk commented on PR #40930: URL: https://github.com/apache/airflow/pull/40930#issuecomment-2242815850 But at least the tests are running now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

(airflow) branch v2-9-test updated (5c90bc5e0c -> 5692eedca2)

2024-07-22 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git from 5c90bc5e0c Temporarily comment-out publishing docs in canary runs (#40921) add 5692eedca2 Update breeze

Re: [PR] Sync v2-9-stable with v2-9-test to release python client v2.9.3 [airflow]

2024-07-22 Thread via GitHub
utkarsharma2 commented on PR #40930: URL: https://github.com/apache/airflow/pull/40930#issuecomment-2242840152 > But at least the tests are running now. @potiuk Yup, they are. They were stuck for a while I had no clue why. Thanks for pointing it out. :) I have added this [com

(airflow) branch v2-9-test updated (5692eedca2 -> 74be631801)

2024-07-22 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit 5692eedca2 Update breeze tests to use ubuntu-22.04 instead of self-hosted, Linux, X64 add 74be631801 Up

(airflow) branch v2-9-test updated (74be631801 -> 1377a5c7f5)

2024-07-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git discard 74be631801 Update breeze tests to use ubuntu-22.04 instead of self-hosted, Linux, X64 add 1377a5c7f

Re: [PR] fix: sensor - skip_policy [airflow]

2024-07-22 Thread via GitHub
raphaelauv commented on PR #40924: URL: https://github.com/apache/airflow/pull/40924#issuecomment-2242861441 @Lee-W @shahar1 @eladkal wdyt ? thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[PR] Validating provider documentation urls before displaying in views [airflow]

2024-07-22 Thread via GitHub
amoghrajesh opened a new pull request, #40933: URL: https://github.com/apache/airflow/pull/40933 Adding an extra layer of validation for the Project-URL that comes from installed providers --- **^ Add meaningful description above** Read the **[Pull Request G

(airflow) branch v2-9-test updated (1377a5c7f5 -> 70a928c1c2)

2024-07-22 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git discard 1377a5c7f5 Update breeze tests to use ubuntu-22.04 instead of self-hosted, Linux, X64 add 70a928c1c2 Up

[PR] Removing changelog:skip validation for helm chart issue generation [airflow]

2024-07-22 Thread via GitHub
amoghrajesh opened a new pull request, #40934: URL: https://github.com/apache/airflow/pull/40934 For helm chart issue generation, we shouldn't care about the `changelog:skip` label as its not applicable --- **^ Add meaningful description above** Read the **[P

Re: [I] On Airflow with Kubernetes Executor, sometime the Task keeps running even though the executor pod has failed and later it is cleaned up by Scheduler as Daemon task [airflow]

2024-07-22 Thread via GitHub
ahipp13 commented on issue #40888: URL: https://github.com/apache/airflow/issues/40888#issuecomment-2242946909 I am also seeing this issue as well, although with mine it has been mostly completed task that for some reason don't kill the pod and still show as "Running" in Kubernetes.

(airflow) branch constraints-2-9 updated: Updating constraints. Github run id:10041135863

2024-07-22 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-2-9 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-9 by this push: new b2bdeb601e Updating const

Re: [PR] openlineage: migrate OpenLineage provider to V2 facets. [airflow]

2024-07-22 Thread via GitHub
JDarDagran commented on code in PR #39530: URL: https://github.com/apache/airflow/pull/39530#discussion_r1686556372 ## airflow/providers/openlineage/extractors/base.py: ## @@ -17,27 +17,34 @@ from __future__ import annotations +import warnings from abc import ABC, abstract

Re: [PR] Scheduling based on dataset aliases [airflow]

2024-07-22 Thread via GitHub
Lee-W commented on code in PR #40693: URL: https://github.com/apache/airflow/pull/40693#discussion_r1686573184 ## airflow/migrations/versions/0150_2_10_0_dataset_alias_dataset.py: ## @@ -0,0 +1,68 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more con

Re: [PR] Scheduling based on dataset aliases [airflow]

2024-07-22 Thread via GitHub
phanikumv merged PR #40693: URL: https://github.com/apache/airflow/pull/40693 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

  1   2   3   >