Just to break with the consensus: -1
Not because I don't think the provider would be useful or popular enough,
precisely the opposite, and I'd like to see more companies maintain and manage
their own providers and see an ecosystem of providers start to grow.
Cloudera def has the means and resources to maintain their own provider, and
the communication channels to let their users/customers know about its
existence. And I have no problem with linking to the provider from our docs
index.
In generaly I am slightly worried about the workload we as maintainers are
letting ourselves in for inthe long run with an ever growing number of
providers. Particularly one that needs paid-for accounts that we don't have
access to!
-ash
On Dec 4 2022, at 11:59 pm, Kaxil Naik <kaxiln...@gmail.com> wrote:
> +1 binding
>
>
> On Sat, 3 Dec 2022 at 15:14, Holden Karau <hol...@pigscanfly.ca
> (mailto:hol...@pigscanfly.ca)> wrote:
> > non-binding +1
> >
> > On Sat, Dec 3, 2022 at 3:55 AM Jarek Potiuk <ja...@potiuk.com
> > (mailto:ja...@potiuk.com)> wrote:
> > > I think cloudera is important player in our ecosystem and as long as
> > > it passes all the bars (i.e. 2.3.0+ compatibility and good
> > > non-conflicting dependencies, passing all the tests, I am +1.
> > >
> > > On Sat, Dec 3, 2022 at 12:51 PM Philippe Lanoe
> > > <pla...@cloudera.com.invalid> wrote:
> > > >
> > > > Hello,
> > > >
> > > > Correction: since it is a vote on code modification, all committers'
> > > > votes count, I was mistaken in my previous email (which mentioned only
> > > > PMC votes are binding), quite new in this process.
> > > > Please let me know if a discussion thread is preferred.
> > > >
> > > > Thanks,
> > > > Regards,
> > > > Philippe
> > > >
> > > > On Wed, Nov 30, 2022 at 5:34 PM Philippe Lanoe <pla...@cloudera.com
> > > > (mailto:pla...@cloudera.com)> wrote:
> > > >>
> > > >> Hello Airflow community!
> > > >>
> > > >> As requested in our PR, I would like to start a vote for adding a new
> > > >> provider (Cloudera). Please note that this vote is about the fact to
> > > >> add this new provider not about the code itself, which will be
> > > >> reviewed as part of the PR.
> > > >>
> > > >> We would like to contribute the Cloudera provider to allow data
> > > >> practitioners out-of-the-box interactions with a multi-function
> > > >> analytics and hybrid platform,
> > > >>
> > > >> Our first two Operators are CdeRunJobOperator, to run a CDE job (Spark
> > > >> or Airflow within the Cloudera Data Engineering service) and
> > > >> CdwExecuteQueryOperator, to execute a query on a managed CDW cluster
> > > >> (Hive / Impala within the Cloudera Data Warehousing service). It also
> > > >> comes with a Sensor for CDW, in order to wait on a Hive partition.
> > > >> We are also planning to contribute more in the future, as we develop
> > > >> operators for other Cloudera services in Cloudera Data Platform (CDP),
> > > >> like Cloudera Machine Learning and others, to cover the various needs
> > > >> of data practitioners across the entire data lifecycle.
> > > >>
> > > >> Our code has been already used for quite some time internally and we
> > > >> would like to contribute it to Airflow, to give a better experience
> > > >> for the users as it would be another system that users can reach
> > > >> seamlessly in their pipelines.
> > > >>
> > > >> Another important Note: Cloudera already filed a CCLA as mentioned in
> > > >> this thread, so I think we are OK on the Legal side.
> > > >>
> > > >> You can find the PR here:
> > > >> https://github.com/apache/airflow/pull/27866
> > > >>
> > > >> The voting will last for 6 days (until 6th of December 2022, 6pm UTC),
> > > >> and until at least 3 binding votes have been cast. I am sure about the
> > > >> timeframe which is needed for providers actually, please let me know
> > > >> if it is adequate.
> > > >>
> > > >> Please vote accordingly:
> > > >>
> > > >> [ ] + 1 approve
> > > >> [ ] + 0 no opinion
> > > >> [ ] - 1 disapprove with the reason
> > > >>
> > > >> Only votes from PMC members and committers are binding, but other
> > > >> members of the community are encouraged to check the AIP and vote with
> > > >> "(non-binding)".
> > > >>
> > > >> Thanks!
> > > >>
> > > >> Regards,
> > > >> Philippe
> > > >>
> > > >>
> >
> >
> >
> >
> > --
> > Twitter: https://twitter.com/holdenkarau
> >
> > Books (Learning Spark, High Performance Spark, etc.):
> > https://amzn.to/2MaRAG9 (https://amzn.to/2MaRAG9)
> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
> >
> >
> >
> >
> >
> >
> >
> >
> >
>
>
