Re: Call with Nielsen team demoing their DAG debugging feature

2024-06-08 Thread Pankaj Koti
Hello Jarek, Thanks for sharing this. I would like to join as well, please! On Sat, 8 Jun 2024, 14:33 Sumit Maheshwari, wrote: > Same, add me as well. Thanks!! > > On Sat, Jun 8, 2024 at 2:27 PM Kaxil Naik wrote: > > > Same, would love to join > > > > On Sat, 8 Jun 2024 at 09:19, Aritra Basu

Re: [VOTE] Airflow Providers prepared on May 30, 2024

2024-05-31 Thread Pankaj Koti
+1 (non-binding) Concurring with Wei! Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) On Fri, May 31, 2024 at 8:55 AM Wei Lee wrote: > +1 (non-binding) > > Tested my change

Re: [DISCUSS] indexes for API calls

2024-05-31 Thread Pankaj Koti
. Many of us (myself included) may have assumed from our university days, indexes are always created for foreign keys, but that's not always the case. :) Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard

Re: [VOTE] May 2024 PR of the Month

2024-05-28 Thread Pankaj Koti
Yes, indeed, all the nominations are excellent. Since I have only one vote, I give a +1 to #39336. Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) On Wed, May 29, 2024 at 12:18 AM Brent

Re: [VOTE] Proposal for adding Telemetry via Scarf

2024-05-08 Thread Pankaj Koti
+1 (binding) On Thu, 9 May 2024, 08:17 Wei Lee, wrote: > +1 non-binding > > Best, > Wei > > > On May 9, 2024, at 10:39 AM, Phani Kumar > wrote: > > > > +1 binding, looking forward to add Scarf > > > > On Thu, May 9, 2024 at 7:42 AM Kaxil Naik wrote: > > > >> Hi all, > >> > >> Discussion

Re: [RESULT][VOTE] Airflow Providers - release of May 1, 2024

2024-05-06 Thread Pankaj Koti
Okay, thanks for clarifying :) Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) On Mon, May 6, 2024 at 5:05 PM Elad Kalif wrote: > Yes, sorry. > copy paste typo > > On Mon,

Re: [RESULT][VOTE] Airflow Providers - release of May 1, 2024

2024-05-06 Thread Pankaj Koti
be just a typo in the email message. Can we please confirm? Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) On Mon, May 6, 2024 at 1:40 PM Elad Kalif wrote: > Hello, > > Apach

Re: [VOTE] Airflow Providers prepared on May 01, 2024

2024-05-06 Thread Pankaj Koti
-1 (non-binding) for the Google RC based on comment https://github.com/apache/airflow/issues/36090#issuecomment-2094972855 risking some PRs included in the Google RC. Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone

Re: [VOTE] Airflow Providers prepared on May 01, 2024

2024-05-03 Thread Pankaj Koti
+1 (non-binding) Tested my set of changes. Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) On Fri, May 3, 2024 at 4:25 PM Hussein Awala wrote: > +1 (binding) checked licen

Re: [VOTE] Release Apache Airflow Python Client 2.9.0 from 2.9.0rc1

2024-04-23 Thread Pankaj Koti
+1 (non-binding) Tested the RC client to do some basic functionalities like get DAGs, tasks for a DAG, trigger a DAG, get Airflow configuration. Everything went well! Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone

Re: [VOTE] Airflow Providers prepared on April 16, 2024

2024-04-17 Thread Pankaj Koti
+1 (non-binding) Concurring with Wei. Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) On Wed, Apr 17, 2024 at 9:01 AM Wei Lee wrote: > +1 (non-binding) > > I tested my chang

Re: [DISCUSS] Proposal for adding Telemetry via Scarf

2024-04-13 Thread Pankaj Koti
ftware > >> > > > development approach, since this will be the first time for us, as > >> > > Airflow > >> > > > PMC, to add such telemetry. This is of course just my opinion > >> though :) > >> > > > > >>

Re: [VOTE] Airflow Providers prepared on April 13, 2024

2024-04-13 Thread Pankaj Koti
-1 (non-binding) for the Databricks provider. We would need to also include PR https://github.com/apache/airflow/pull/38962 for the included PRs in the RC to work well. Also added a https://github.com/apache/airflow/issues/38997#issuecomment-2053904837 on the status issue. On Sun, 14 Apr 2024,

Re: [VOTE] Airflow Providers prepared on April 10, 2024

2024-04-11 Thread Pankaj Koti
+1 (non-binding) Verified my changes and our provider's example DAGs are running fine on the RCs. Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) On Thu, Apr 11, 2024 at 3:01 PM Jarek

Re: [ANNOUNCE] New committer: Wei Lee

2024-04-08 Thread Pankaj Koti
Many congratulations, Wei 拾 Very well done and well deserved!! On Mon, 8 Apr 2024, 14:19 Ash Berlin-Taylor, wrote: > The Project Management Committee (PMC) for Apache Airflow has invited Wei > Lee to become a committer and > we are pleased to announce that they have accepted. > > Wei has

Re: [DISCUSS] Consider disabling self-hosted runners for commiter PRs

2024-04-04 Thread Pankaj Koti
+1 from me to this idea. Sounds very reasonable to me. At times, my experience has been better with public runners instead of self-hosted runners :) And like already mentioned in the discussion, I think having the ability of a applying the label "use-self-hosted-runners" to be used for critical

Re: [VOTE] AIP-62 Getting Lineage from Hook Instrumentation

2024-04-04 Thread Pankaj Koti
+1 binding. Sounds exciting. Sorry I missed the discussion earlier. I have some questions but those are implementation related and I think the PRs will help me understand those :) Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra

Re: [DISCUSS] Proposal for adding Telemetry via Scarf

2024-04-03 Thread Pankaj Koti
/r06j306hldg03g2my1pd4nyjxg78b3h4), similarly about the DaskExecutor ( https://lists.apache.org/thread/ptwjf5g87lyl5476krt91bzfrm96pnb1), etc. Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) Phone: +91

Re: [DISCUSS] Applying D105 rule for our codebase ("undocumented magic methods") ?

2024-03-20 Thread Pankaj Koti
+1 to what Aritra is saying. Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) Phone: +91 9730079985 On Wed, Mar 20, 2024 at 12:05 PM Aritra Basu wrote: > I'm in general not a huge

Re: [VOTE] Airflow Providers prepared on February 19, 2024

2024-02-19 Thread Pankaj Koti
successful and failure scenario where tasks should be marked as success/failed correspondingly and should not be stuck, works as expected. Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) Phone: +91

Re: [VOTE] Airflow Providers prepared on February 17, 2024

2024-02-18 Thread Pankaj Koti
on-sql Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) Phone: +91 9730079985 On Sun, Feb 18, 2024 at 3:00 PM Andrey Anshin wrote: > +1 (binding) > > Verify signatures, checksums, fil

Re: [VOTE] Airflow Providers prepared on February 12, 2024

2024-02-14 Thread Pankaj Koti
RC based on the Amazon system tests. Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) Phone: +91 9730079985 On Wed, Feb 14, 2024 at 1:03 PM Elad Kalif wrote: > *Update:* Providers ama

Re: [VOTE] "Require conversation resolution" setting in PRs as permanent solution

2024-02-05 Thread Pankaj Koti
+1 (binding) Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) Phone: +91 9730079985 On Mon, Feb 5, 2024 at 8:05 PM Amogh Desai wrote: > +1 from me too based on my earlier poi

Re: [ANNOUNCE] Starting experimenting with "Require conversation resolution" setting

2024-01-31 Thread Pankaj Koti
+1 to keep this @Bolke de Bruin: I am just thinking more on your point and wondering that if someone has the intent to hide the conversation, they can anyway mark it as resolved irrespective of this configuration, no?

Re: [VOTE] Airflow Providers prepared on January 30, 2024

2024-01-31 Thread Pankaj Koti
+1 (non-binding) Tested required changes are in. Thank you so much Elad for the release efforts. Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) Phone: +91 9730079985 On Wed, Jan 31

Re: [VOTE] Airflow Providers prepared on January 22, 2024

2024-01-24 Thread Pankaj Koti
+1 (non-binding) On Wed, 24 Jan 2024, 13:48 rom sharon, wrote: > +1 non-binding > > ‫בתאריך יום ד׳, 24 בינו׳ 2024 ב-10:17 מאת ‪Rahul Vats‬‏ <‪ > rah.sharm...@gmail.com‬‏>:‬ > > > +1 non-binding > > > > Verified below providers with our example DAGS. > > > >-

Re: [VOTE] Release Airflow 2.8.1 from 2.8.1rc1

2024-01-18 Thread Pankaj Koti
+1 (non-binding) Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) Phone: +91 9730079985 On Fri, Jan 19, 2024 at 12:00 PM Ephraim Anierobi wrote: > Hi Bolke, > > I have included

Re: [ANNOUNCE] New PMC member: Andrey Anshin (taragolis)

2024-01-17 Thread Pankaj Koti
Many congratulations Andrey (taragolis :) ) Very very well deserved  Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) Phone: +91 9730079985 On Tue, Jan 16, 2024 at 11:03 PM Mehta

Re: [VOTE] Airflow Providers prepared on January 07, 2024

2024-01-08 Thread Pankaj Koti
+1 (non-binding) Concurring with Rahul and Wei! On Mon, 8 Jan 2024, 18:55 Rahul Vats, wrote: > +1 (non-binding) > > In addition to providers mentioned @Lee-W and also verified > apache-airflow-providers-mysql==5.5.1rc1. LGTM. > > Regards, > Rahul Vats > 9953794332 > > > On Mon, 8 Jan 2024 at

Re: [DISCUSSION] Enabling `pre-commit.ci` application for Airflow

2023-12-29 Thread Pankaj Koti
I very much like the concept. We have been using it actively for Astronomer code repositories for 1+ year already and it has helped us greatly (Thanks to Felix Uellendall for introducing this back then ) On Sat, 30 Dec 2023, 12:10 Jarek Potiuk, wrote: > FYI - Just now INFRA rejected the

Re: [DISCUSS] "Require conversation resolution" in our PRs before merge?

2023-12-19 Thread Pankaj Koti
I like the idea, at least double checking what the comments were is a good cause. +1 to incorporating this. On 2023/12/19 13:12:05 Jarek Potiuk wrote: > Hey everyone, > > TL;DR; I have a small proposal/discussion proposal to modify a bit the > branch protection rules for Airflow. Why don't we

Re: [VOTE] Release Airflow Python Client 2.8.0 from 2.8.0rc1

2023-12-19 Thread Pankaj Koti
+1 (non-binding) Installed the RC and was able to trigger a DAG successfully using the client. Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) Phone: +91 9730079985 On Tue, Dec 19, 2023

Re: [VOTE] Release Airflow 2.8.0 from 2.8.0rc4

2023-12-18 Thread Pankaj Koti
+1 (non-binding) On 2023/12/18 10:00:50 Rahul Vats wrote: > +1 (non-binding). I re-verified tests with rc4. > >- Verified that running our example DAGs did not reveal any regressions. >- Verified the addition of the task context logging feature, enabling >the forwarding of messages

Re: Making Listeners API non-experimental

2023-12-16 Thread Pankaj Koti
+1 Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) Phone: +91 9730079985 On Sat, Dec 16, 2023 at 4:30 PM Ephraim Anierobi wrote: > +1 > > On Sat, 16 Dec 2023 at 10:56, Am

Re: [VOTE] Release Airflow 2.8.0 from 2.8.0rc3

2023-12-14 Thread Pankaj Koti
+1 (non-binding) Concurring with Rahul On Fri, 15 Dec 2023, 11:01 Rahul Vats, wrote: > +1 (non-binding). > >- Verified that running our example DAGs did not reveal any regressions. >- Verified the addition of the task context logging feature, enabling >the forwarding of messages to

Re: [VOTE] Airflow Providers prepared on December 08, 2023

2023-12-10 Thread Pankaj Koti
+1 (non-binding) Tested my set of changes. Best regards, On Mon, Dec 11, 2023 at 9:57 AM Amogh Desai wrote: > +1 non binding for all the other providers other than Google and Docker. > > Thanks & Regards, > Amogh Desai > > On Sun, Dec 10, 2023 at 5:46 PM Jarek Potiuk wrote: > > > +1

Re: [ANNOUNCE] New committer: Utkarsh Sharma

2023-12-04 Thread Pankaj Koti
Great news, many congratulations Utkarsh 拾✌ On Tue, 5 Dec 2023, 00:53 Pierre Jeambrun, wrote: > Congratulations! > > Le lun. 4 déc. 2023 à 20:18, Andrey Anshin a > écrit : > > > Congrats!  > > > > > > > > > > On Mon, 4 Dec 2023 at 22:45, Amogh Desai > wrote: > > > > > This is fantastic!

Re: [VOTE] Airflow Providers prepared on November 24, 2023

2023-11-26 Thread Pankaj Koti
+1 (non-binding) Tested my set of changes, all work fine. Thank you for the release efforts! Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) Phone: +91 9730079985 On Sun, Nov 26, 2023

Re: [DISCUSS] Suspend/Remove Apache Scoop provider

2023-11-23 Thread Pankaj Koti
+1 Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) Phone: +91 9730079985 On Thu, Nov 23, 2023 at 9:55 PM utkarsh sharma wrote: > +1 > > On Thu, 23 Nov 2023 at 9:06 PM, Wei L

Re: [VOTE] Airflow Providers prepared on November 08, 2023

2023-11-10 Thread Pankaj Koti
completeness of these providers. Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) Phone: +91 9730079985 On Fri, Nov 10, 2023 at 5:53 PM Hussein Awala wrote: > +1 (binding) I chec

Re: [ANNOUNCE] New committer: Jens Scheffler

2023-11-08 Thread Pankaj Koti
Many congratulations, Jens!!   Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) Phone: +91 9730079985 On Wed, Nov 8, 2023 at 9:07 AM Aritra Basu wrote: > Congrats J

Re: [VOTE] Add providers for Pinecone, OpenAI & Cohere to enable first-class LLMOps

2023-10-25 Thread Pankaj Koti
+1 (binding) On Wed, 25 Oct 2023, 06:32 Andrey Anshin, wrote: > +1 binding > > > Best Wishes > *Andrey Anshin* > > > > On Wed, 25 Oct 2023 at 14:25, Kaxil Naik wrote: > > > Hello everyone, > > > > Following the discussion about adding five new providers, I am calling > for > > an official

Re: [DISCUSSION] Add 5 new Providers to enable first-class LLMOps

2023-10-24 Thread Pankaj Koti
Hi Andrey, We discussed internally (at Astronomer) regarding your suggestion on the PRs and we will incorporate the suggestion in our PRs to remove the callable approach and include examples in the docs to achieve the same using TaskFlow and using hook methods in those. Thank you for the

Re: [ANNOUNCE] Pankaj Koti and Amogh Desai as committers

2023-09-21 Thread Pankaj Koti
t; > > Congratulations @Pankaj and @Amogh :) > > > > Well deserved. > > > > > > > > -Rohith Sharma K S > > > > > > > > On Tue, 19 Sept 2023 at 10:17, Jarek Potiuk > wrote: > > > > > > > > > Hell

Re: [VOTE] Airflow Providers prepared on September 14, 2023

2023-09-14 Thread Pankaj Koti
s of the 3 providers ran fine. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Thu, Sep 14, 2023 at 10:05 PM Jarek Potiuk wrote: > +1 (binding): check

Re: [VOTE] Airflow Providers prepared on September 12, 2023

2023-09-13 Thread Pankaj Koti
+1 (non-binding) Our astronomer-providers (async) DBT DAG based on the provider RC2 ran fine. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Wed

Re: [VOTE] Airflow Providers prepared on September 08, 2023

2023-09-10 Thread Pankaj Koti
manager's decision on it. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Sun, Sep 10, 2023 at 8:02 PM Pankaj Koti wrote: > Hi, > >

Re: [VOTE] Airflow Providers prepared on September 08, 2023

2023-09-10 Thread Pankaj Koti
cross-provider dependency bumps during releases? Does it get handled automatically or do we need a manual minimum version dependency bump here in Google RC to contain common-sql>=1.7.2? Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian

Re: [DISCUSS] Executors docs should be published in Airflow core or providers?

2023-09-08 Thread Pankaj Koti
provider. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Fri, Sep 8, 2023 at 11:28 PM Hussein Awala wrote: > Since we moved the execut

Re: [VOTE] Release Airflow 2.7.1 from 2.7.1rc2

2023-09-04 Thread Pankaj Koti
+1 (non-binding) Checked that my set of changes are included and they work fine. Run a few example DAGs and they work fine too. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io

Re: [DISCUSS] Preventing users from misusing _PIP_ADDITIONAL_REQUIREMENTS ?

2023-08-29 Thread Pankaj Koti
I agree with Maciej's rationale here and inclined towards removing it straight away. Also, is it the case that users have discovered this flag themselves without us documenting it anywhere as a feature to use? *We have a leading underscore for the variable and it hints that it's for internal

Re: [VOTE] Airflow Providers prepared on August 26, 2023

2023-08-28 Thread Pankaj Koti
+1 (non-binding) Tested astronomer-providers with deferrable operators On Mon, 28 Aug 2023, 22:19 Vincent Beck, wrote: > +1 non binding. > > I tested my changes and it works as expected. I also run som testing DAGs > and everything looks good. I ran AWS system tests against Amazon provider >

Re: [VOTE] Drop MsSQL as supported backend

2023-08-28 Thread Pankaj Koti
+1 (non-binding) On Mon, 28 Aug 2023, 12:59 Hussein Awala, wrote: > +1 binding > > On Mon 28 Aug 2023 at 08:36, Jarek Potiuk wrote: > > > +1 from me > > > > On Mon, Aug 28, 2023 at 8:30 AM Elad Kalif wrote: > > > > > I would like to start a vote about Drop MsSQL as a supported backend. > > >

Re: [VOTE] Release Airflow 2.7.0 from 2.7.0rc2

2023-08-16 Thread Pankaj Koti
few DAGs with basic setup/teardown and seems to work well. Verified the recent fixes for dag_run.conf and it works fine after setting the needed env var AIRFLOW__WEBSERVER__SHOW_TRIGGER_FORM_IF_NO_PARAMS to True Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location:

Re: [VOTE] Restore dag_run.conf UI triggering option for 2.7.0

2023-08-12 Thread Pankaj Koti
in 2.7.0 (which means > preparing RC2). > > I am writing that in the name of the release-management "concilium": > Ephraim, Hussein, Elad, Jens, Pankaj Koti, Rahul Vats, myself > > We discussed it today at the #release-management channel about the problem > wit

Re: [VOTE] Release Airflow 2.7.0 from 2.7.0rc1

2023-08-11 Thread Pankaj Koti
+1 (non-binding) Ran the RC with breeze, ran some example DAGs. Tested my change in #32052, works as expected We also ran example DAGs for astronomer-providers including deferrable operators and they work fine. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location

Re: [VOTE] Airflow Providers prepared on August 11, 2023

2023-08-11 Thread Pankaj Koti
+1 (non-binding) Concur with Wei & Rahul. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Fri, Aug 11, 2023 at 5:45 PM Jarek Potiuk wrote:

Re: [VOTE] Airflow Providers prepared on August 09, 2023

2023-08-09 Thread Pankaj Koti
+1 (non-binding). I concur with Wei. Thank you Elad for your efforts with multiple rounds on this provider :) Also many thanks to Jarek, Hussein and Maciej for their suggestions and support on the PR while resolving this :) Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering

Re: [VOTE] Airflow Providers prepared on August 08, 2023

2023-08-08 Thread Pankaj Koti
, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Tue, Aug 8, 2023 at 11:06 PM Elad Kalif wrote: > Thank you Wei Lee, > > Can you please share a rep

Re: [VOTE] Airflow Providers prepared on August 05, 2023

2023-08-07 Thread Pankaj Koti
+1 (non-binding) Tested my set of changes. Verified they are included in the RCs, ran tests and ensured they work as expected. Thank you for including these. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST

Re: [RESULT][VOTE] PR of the Month for the Airflow Newsletter

2023-07-30 Thread Pankaj Koti
Great work, Wei! ! Congratulations, keep going!!  On Sat, 29 Jul 2023, 03:14 Briana Okyere, wrote: > Hey All, > > Thanks for your engagement with our PR of the Month Vote for the July > Newsletter. Lots of great PRs this month! > > The results are in at: > > >- *+6 to #31712 by @Lee-W:

Re: [VOTE] The daskexecutor, cncf.provider, celery providers in 2.7.0. as regular not-preinstalled providers

2023-07-29 Thread Pankaj Koti
[a] (non-binding) Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Sat, Jul 29, 2023 at 11:55 PM Jarek Potiuk wrote: > Hello everyone, > >

Re: [ANNOUNCE] New PMC member: Hussein Awala

2023-07-29 Thread Pankaj Koti
Many congratulations, Hussein    On Sat, 29 Jul 2023, 23:06 Amogh Desai, wrote: > Awesome news! Good going, Hussein! > > Congratulations  > > Thanks, > Amogh Desai > > On Sat, Jul 29, 2023, 23:04 Jarek Potiuk wrote: > > > Hello Airflow Community, > > > > I have the pleasure to announce

Re: [VOTE] Airflow Providers prepared on July 29, 2023

2023-07-29 Thread Pankaj Koti
-airflow-providers-google==10.5.0rc1 6. apache-airflow-providers-microsoft-azure==6.2.2rc1 7. apache-airflow-providers-sftp==4.5.0rc1 8. apache-airflow-providers-snowflake==4.4.0rc1 Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian

Re: [VOTE] PR of the Month for the Airflow Newsletter

2023-07-27 Thread Pankaj Koti
+1 for #32525. Seems like a great contribution for AIP-56. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Wed, Jul 26, 2023 at 11:35 PM Michael

Re: Allowing providers to load the respective default connections

2023-07-27 Thread Pankaj Koti
I like `db migrate` and would like to vote for it. It implies to apply all migrations including the initial (init) migrations similar to how projects like Django do. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time

Re: [DISCUSS] Breaking upgrades as (not?) breaking SemVer promise

2023-07-21 Thread Pankaj Koti
examples to reduce ambiguities where breaking upgrades are possible? Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Fri, Jul 21, 2023 at 2:48 PM

Re: Config as default value for deferrable may have surprising effect ?

2023-07-21 Thread Pankaj Koti
dence over default_deferral. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Fri, Jul 21, 2023 at 4:25 PM Wei Lee wrote: > Hi, > > Avoiding unexpec

Re: [VOTE] Make (soon coming) dask provider preinstalled

2023-07-21 Thread Pankaj Koti
help us here which mentions it to install the provider additionally in case they would like to continue using it. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91

Re: [VOTE] Airflow Providers prepared on July 17, 2023

2023-07-17 Thread Pankaj Koti
+1 (non-binding) Verified that remote logging using Elasticsearch works well with the changes in the RC. Thank you for the release efforts! Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k

Re: [VOTE] Airflow Providers prepared on July 12, 2023

2023-07-13 Thread Pankaj Koti
+1 (non-binding) Concurring with Wei Lee. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Thu, Jul 13, 2023 at 2:10 PM Wei Lee wrote: > +1 (

Re: [VOTE] Release Airflow 2.6.3 from 2.6.3rc1

2023-07-10 Thread Pankaj Koti
+1 (non-binding) Used this RC to start Airflow with breeze and ran a few example DAGs. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Mon, Jul 10

Re: [VOTE] Airflow Providers prepared on July 09, 2023

2023-07-10 Thread Pankaj Koti
+1 (non-binding) Our Amazon example DAGs ran fine with this RC. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Mon, Jul 10, 2023 at 1:08 AM

Re: [VOTE] Airflow Providers prepared on July 06, 2023

2023-07-07 Thread Pankaj Koti
*Change of vote: +1 (non-binding)* Since ES RC is being excluded I have no other reservations. Thank you Elad for all the efforts! Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k

Re: [VOTE] Airflow Providers prepared on July 06, 2023

2023-07-07 Thread Pankaj Koti
-providers-elasticsearch==4.5.1 Sorry again for the confusion. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Fri, Jul 7, 2023 at 2:16 PM Pankaj

Re: [VOTE] Airflow Providers prepared on July 06, 2023

2023-07-07 Thread Pankaj Koti
-providers-dbt-cloud - apache-airflow-providers-google - apache-airflow-providers-microsoft-azure - apache-airflow-providers-snowflake Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k

Re: [VOTE] Airflow Providers prepared on July 06, 2023

2023-07-07 Thread Pankaj Koti
I am facing trouble with using the ElasticSearch RC. The remote logging setup that used to work for me previously is no longer working with this change. I have reached out for help on the PR with comment https://github.com/apache/airflow/pull/31920#issuecomment-1623629476 Regards, Pankaj Koti

Re: [ANNOUNCE] New committer: Dennis Ferruzzi

2023-07-04 Thread Pankaj Koti
 Many congratulations Dennis !!  Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Tue, Jul 4, 2023 at 10:49 PM Hussein Awala wrote

Re: [VOTE] June 2023 PR of the Month

2023-06-29 Thread Pankaj Koti
Yes, +1 also from me for #31123. Thank you for the poll! On Thu, 29 Jun 2023, 18:59 Jarek Potiuk, wrote: > Big +1 for #31123 from me. > > On Thu, Jun 29, 2023 at 3:02 PM Brent Bovenzi > > wrote: > > > +1 for #31123 > > > > On Wed, Jun 28, 2023 at 4:39 PM Elad Kalif wrote: > > > > > My vote

Re: [ANNOUNCE] New committers: Vincent Beck, Phani Kumar, Maciej Obuchowski

2023-06-28 Thread Pankaj Koti
Amazing news at the start of the day! Very well deserved all of them, Vincent, Phani and Maciej!! Congratulations! Keep helping us and the community :) Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email

Re: [VOTE] Release Apache Airflow Helm Chart 1.10.0 based on 1.10.0rc1

2023-06-23 Thread Pankaj Koti
+1 (non-binding) Installed the RC on Docker Desktop's Kubernetes cluster and ran a few example DAGs successfully, tried to play around with few airflow config values using values.yaml and it all worked fine. On Sat, 24 Jun 2023, 00:35 Jarek Potiuk, wrote: > +1 (binding) -> tested sources (new

Re: [VOTE] Release Airflow Python Client 2.6.2 from 2.6.2rc2

2023-06-22 Thread Pankaj Koti
+1 (non-binding) Installed the RC and triggered an example DAG run. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Thu, Jun 22, 2023 at 1:49 AM

Re: [VOTE] Airflow Providers prepared on June 20, 2023

2023-06-21 Thread Pankaj Koti
flow-providers-cncf-kubernetes==7.1.0rc1* Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Wed, Jun 21, 2023 at 11:28 AM Wei Lee wrote: > +1 (non-

Re: [VOTE] AIP-56 Extensible user management

2023-06-20 Thread Pankaj Koti
+1 (non-binding) I have a question which I sent in the discussion email :) Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Tue, Jun 20, 2023 at 12

Re: AIP-56 Extensible user management

2023-06-20 Thread Pankaj Koti
AIP? Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Fri, Jun 16, 2023 at 10:21 PM Jed Cunningham wrote: > Sounds good to me. Hopefully we ca

Re: [VOTE] Release Airflow 2.6.2 from 2.6.2rc2

2023-06-15 Thread Pankaj Koti
+1 (non-binding) Tested my set of changes in the RC, ran a few example DAGs and concur with Phani that our integration DAGs are running fine. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k

Re: [DISCUSS] Maciej Obuchowski for committer?

2023-06-14 Thread Pankaj Koti
:) Hahah, yes, +1 (non-binding) He is super helpful and super responsive. Helped us tremendously getting onboarded with OpenLineage and resolve our queries and doubts very quickly. On Thu, 15 Jun 2023, 02:25 Jarek Potiuk, wrote: > Oh God. :) > > On Wed, Jun 14, 2023 at 10:54 PM Austin Bennett

Re: [VOTE] Release Airflow 2.6.2 from 2.6.2rc1

2023-06-13 Thread Pankaj Koti
+1 (non-binding) Tested my set of changes and additionally ran a few DAGs. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Tue, Jun 13, 2023 at 1

Re: [ANNOUNCE] New committer: Pankaj Singh

2023-06-12 Thread Pankaj Koti
Many congratulations, Pankaj!! 拾 On Tue, 13 Jun 2023, 05:38 Vikram Koka, wrote: > Awesome! Congratulations Pankaj Singh! > > > On Mon, Jun 12, 2023 at 3:37 PM Oliveira, Niko > > wrote: > > > Woo! Congrats Prankaj! > > > > > > From: Ankit Chaurasia > > Sent:

Re: Deferrable operators in system tests, how?

2023-06-07 Thread Pankaj Koti
+1 to both ideas. I have a stronger +1 to include the flag with breeze since triggerer is an Airflow component and breeze commands having support for it would be nice. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time

Re: [VOTE] May 2023 PR of the Month

2023-05-27 Thread Pankaj Koti
Yes, agreeing with all so far, I vote for #27264 too. On Sat, 27 May 2023, 02:58 Daniel Standish, wrote: > you can have any author you like, as long as it is potiuk > > https://github.com/apache/airflow/pull/27264 > > > On Fri, May 26, 2023 at 2:09 PM Hussein Awala wrote: > > > I join Bas and

Re: [VOTE] Airflow Providers prepared on May 24, 2023

2023-05-24 Thread Pankaj Koti
+1 (non-binding) Concurring with Wei. On Wed, 24 May 2023, 21:09 Wei Lee, wrote: > +1 (non-binding) > Test all the providers with example DAGs > > > On May 24, 2023, at 3:46 PM, Elad Kalif wrote: > > > > Hey all,I have just cut ad hoc wave Airflow Providers packages. This > > email is calling

Re: [VOTE] Release Airflow Python Client 2.6.1 from 2.6.1rc1

2023-05-22 Thread Pankaj Koti
+1 (non-binding) Verified that installing the package from the RC works well, triggered an example DAG using the client and saw that it worked fine. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email

Re: [VOTE] Airflow Providers prepared on May 19, 2023

2023-05-19 Thread Pankaj Koti
+1 (non-binding) Tested my set of changes in the Amazon provider RC2 https://pypi.org/project/apache-airflow-providers-amazon/8.1.0rc2/ Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k

Re: [VOTE] Airflow Providers prepared on May 16, 2023

2023-05-17 Thread Pankaj Koti
+1 (non-binding). Tested my set of changes in the Amazon RC. Thank you! Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian Standard Time (IST) Email: pankaj.k...@astronomer.io Mobile: +91 9730079985 On Wed, May 17, 2023 at 11:23

Re: [VOTE] Release Airflow 2.6.1 from 2.6.1rc3

2023-05-15 Thread Pankaj Koti
+1 (non-binding) I tested our example DAGs for asynchronous providers kept in astronomer-providers on this RC3, verified that the version works well and does not have a regression on our suite. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India

Re: [VOTE] Release Airflow 2.6.1 from 2.6.1rc2

2023-05-13 Thread Pankaj Koti
+1 non-binding I tested our example DAGs for asynchronous providers kept in astronomer-providers on the RC2 too, verified that the version works well and does not have a regression on our suite. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India

Re: [VOTE] Release Airflow 2.6.1 from 2.6.1rc1

2023-05-12 Thread Pankaj Koti
+1 non-binding I tested our example DAGs for asynchronous providers kept in astronomer-providers, verified that the version works well and does not have a regression on our suite. Regards, Pankaj Koti *Senior Software Engineer, *OSS Engineering Team. Location: Pune, India Timezone: Indian

Re: [VOTE] Release Airflow 2.6.0 from 2.6.0rc5

2023-04-29 Thread Pankaj Koti
+1 non-binding On Sun, 30 Apr 2023, 02:20 Hussein Awala, wrote: > +1 (non-binding) > > On Sat 29 Apr 2023 at 23:39, Bolke de Bruin wrote: > > > I think I found a critical bug in rc5 > > > > > > > > > > > > > > > > > > > > > > > > > > Just kidding :-) > > > > +1 binding > > Bolke > > > > Sent

Re: [VOTE] Release Airflow 2.6.0 from 2.6.0rc4

2023-04-28 Thread Pankaj Koti
+1 (non-binding) On Sat, 29 Apr 2023, 07:15 Vikram Koka, wrote: > +1 (non-binding) > > > On Fri, Apr 28, 2023 at 6:37 PM Kaxil Naik wrote: > > > +1 binding > > > > On Fri, 28 Apr 2023 at 14:54, Jed Cunningham > > wrote: > > > > > +1 (binding) > > > > > > Checked signatures, checksums,

  1   2   >