RE: Re: [DICSUSS] Releasing Flink Opensearch Connector v1.0.0
Would be great to include 1.15 as well. +1 On 2022/12/16 10:49:56 Danny Cranmer wrote: > Hey, > > I agree it makes sense for this connector to have a dedicated repository. > > I can confirm that the connector does not compile against Flink 1.15 due to > missing test dependencies that were added in Flink 1.16. Also there are > dependency convergence issues. I will go ahead and create an RC1 today, if > people think we should fix for 1.15 people give a -1 vote. > > Thanks, > Danny > > On Thu, Dec 15, 2022 at 4:48 PM Andriy Redko wrote: > > > Thanks a lot Danny. The connector builds against 1.16 and 1.17 (snapshot) > > right now, I think we could explore 1.15 support. The Opensearch is backed > > by AWS as of today, right, but it is a community driven project under > > OpenSearch Project organization, so I would not tight it to AWS anyhow > > (and > > your are correct, it does not use any AWS SDKs). Hope it makes sense, > > thank > > you. > > > > Best Regards, > > Andriy Redko > > > > DC> Hey, > > > > DC> I will also volunteer to be release manager, since Martijn has been > > doing > > DC> all of them I am happy to take some of the work! > > > > DC> We launched the new flink-connector-dynamodb connector with support for > > DC> Flink 1.15. The versioning strategy says to support the latest 2 Flink > > DC> versions [1]. If this connector builds against both 1.15/1.16 we should > > DC> consider supporting both. > > > > DC> Given that Opensearch is AWS did we consider putting this in > > DC> flink-connector-aws? Since it does not use the AWS SDK it makes sense > > to > > DC> split, but wonder if this was already discussed? > > > > DC> Thanks, > > DC> Danny > > > > DC> [1] > > DC> > > https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development > > > > DC> On Thu, Dec 15, 2022 at 3:19 PM Martijn Visser < > > martijnvis...@apache.org> > > DC> wrote: > > > > >> Hi Andriy, > > >> > > >> +1 to release the first version. Happy to help with the release (feels > > like > > >> I'm doing nothing else anyway :D) > > >> > > >> I would indeed go for version 1.0.0 to start since it's a new connector. > > >> > > >> Cheers, > > >> > > >> Martijn > > >> > > >> On Thu, Dec 15, 2022 at 4:16 PM Andriy Redko wrote: > > >> > > >> > Hello All, > > >> > > > >> > I would like to start discussing the first release of the new Flink > > >> > Opensearch Connector [1] 1.0.0. As per the connector versioning > > strategy > > >> > [2] from the new flink-connector-opensearch repository [3]. As of > > today, > > >> > no outstanding issues are left for the first release to happen. > > >> > > > >> > I propose that we release 1.0.0 with support for Flink 1.16 > > (1.0.0-1.16). > > >> > Since this is a new connector (has never been part of the Flink > > >> > distribution), > > >> > it probably makes sense to start from version 1.0.0 but suggestions > > here > > >> > are > > >> > more than welcome. > > >> > > > >> > I would appreciate if PMC member volunteers to step in as the release > > >> > manager. > > >> > > > >> > [1] > > >> > > > >> > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-243%3A+Dedicated+Opensearch+connectors > > >> > [2] > > >> > > > >> > > https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development > > >> > [3] https://github.com/apache/flink-connector-opensearch > > >> > > > >> > Thanks! > > >> > > > >> > Best Regards, > > >> > Andriy Redko > > >> > > > >> > > > >> > > > >> > > > >> > > > > >
Re: [DICSUSS] Releasing Flink Opensearch Connector v1.0.0
Hey, I agree it makes sense for this connector to have a dedicated repository. I can confirm that the connector does not compile against Flink 1.15 due to missing test dependencies that were added in Flink 1.16. Also there are dependency convergence issues. I will go ahead and create an RC1 today, if people think we should fix for 1.15 people give a -1 vote. Thanks, Danny On Thu, Dec 15, 2022 at 4:48 PM Andriy Redko wrote: > Thanks a lot Danny. The connector builds against 1.16 and 1.17 (snapshot) > right now, I think we could explore 1.15 support. The Opensearch is backed > by AWS as of today, right, but it is a community driven project under > OpenSearch Project organization, so I would not tight it to AWS anyhow > (and > your are correct, it does not use any AWS SDKs). Hope it makes sense, > thank > you. > > Best Regards, > Andriy Redko > > DC> Hey, > > DC> I will also volunteer to be release manager, since Martijn has been > doing > DC> all of them I am happy to take some of the work! > > DC> We launched the new flink-connector-dynamodb connector with support for > DC> Flink 1.15. The versioning strategy says to support the latest 2 Flink > DC> versions [1]. If this connector builds against both 1.15/1.16 we should > DC> consider supporting both. > > DC> Given that Opensearch is AWS did we consider putting this in > DC> flink-connector-aws? Since it does not use the AWS SDK it makes sense > to > DC> split, but wonder if this was already discussed? > > DC> Thanks, > DC> Danny > > DC> [1] > DC> > https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development > > DC> On Thu, Dec 15, 2022 at 3:19 PM Martijn Visser < > martijnvis...@apache.org> > DC> wrote: > > >> Hi Andriy, > >> > >> +1 to release the first version. Happy to help with the release (feels > like > >> I'm doing nothing else anyway :D) > >> > >> I would indeed go for version 1.0.0 to start since it's a new connector. > >> > >> Cheers, > >> > >> Martijn > >> > >> On Thu, Dec 15, 2022 at 4:16 PM Andriy Redko wrote: > >> > >> > Hello All, > >> > > >> > I would like to start discussing the first release of the new Flink > >> > Opensearch Connector [1] 1.0.0. As per the connector versioning > strategy > >> > [2] from the new flink-connector-opensearch repository [3]. As of > today, > >> > no outstanding issues are left for the first release to happen. > >> > > >> > I propose that we release 1.0.0 with support for Flink 1.16 > (1.0.0-1.16). > >> > Since this is a new connector (has never been part of the Flink > >> > distribution), > >> > it probably makes sense to start from version 1.0.0 but suggestions > here > >> > are > >> > more than welcome. > >> > > >> > I would appreciate if PMC member volunteers to step in as the release > >> > manager. > >> > > >> > [1] > >> > > >> > https://cwiki.apache.org/confluence/display/FLINK/FLIP-243%3A+Dedicated+Opensearch+connectors > >> > [2] > >> > > >> > https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development > >> > [3] https://github.com/apache/flink-connector-opensearch > >> > > >> > Thanks! > >> > > >> > Best Regards, > >> > Andriy Redko > >> > > >> > > >> > > >> > > >> > >
Re: [DICSUSS] Releasing Flink Opensearch Connector v1.0.0
Thanks a lot Danny. The connector builds against 1.16 and 1.17 (snapshot) right now, I think we could explore 1.15 support. The Opensearch is backed by AWS as of today, right, but it is a community driven project under OpenSearch Project organization, so I would not tight it to AWS anyhow (and your are correct, it does not use any AWS SDKs). Hope it makes sense, thank you. Best Regards, Andriy Redko DC> Hey, DC> I will also volunteer to be release manager, since Martijn has been doing DC> all of them I am happy to take some of the work! DC> We launched the new flink-connector-dynamodb connector with support for DC> Flink 1.15. The versioning strategy says to support the latest 2 Flink DC> versions [1]. If this connector builds against both 1.15/1.16 we should DC> consider supporting both. DC> Given that Opensearch is AWS did we consider putting this in DC> flink-connector-aws? Since it does not use the AWS SDK it makes sense to DC> split, but wonder if this was already discussed? DC> Thanks, DC> Danny DC> [1] DC> https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development DC> On Thu, Dec 15, 2022 at 3:19 PM Martijn Visser DC> wrote: >> Hi Andriy, >> >> +1 to release the first version. Happy to help with the release (feels like >> I'm doing nothing else anyway :D) >> >> I would indeed go for version 1.0.0 to start since it's a new connector. >> >> Cheers, >> >> Martijn >> >> On Thu, Dec 15, 2022 at 4:16 PM Andriy Redko wrote: >> >> > Hello All, >> > >> > I would like to start discussing the first release of the new Flink >> > Opensearch Connector [1] 1.0.0. As per the connector versioning strategy >> > [2] from the new flink-connector-opensearch repository [3]. As of today, >> > no outstanding issues are left for the first release to happen. >> > >> > I propose that we release 1.0.0 with support for Flink 1.16 (1.0.0-1.16). >> > Since this is a new connector (has never been part of the Flink >> > distribution), >> > it probably makes sense to start from version 1.0.0 but suggestions here >> > are >> > more than welcome. >> > >> > I would appreciate if PMC member volunteers to step in as the release >> > manager. >> > >> > [1] >> > >> https://cwiki.apache.org/confluence/display/FLINK/FLIP-243%3A+Dedicated+Opensearch+connectors >> > [2] >> > >> https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development >> > [3] https://github.com/apache/flink-connector-opensearch >> > >> > Thanks! >> > >> > Best Regards, >> > Andriy Redko >> > >> > >> > >> > >>
Re: [DICSUSS] Releasing Flink Opensearch Connector v1.0.0
Hey, I will also volunteer to be release manager, since Martijn has been doing all of them I am happy to take some of the work! We launched the new flink-connector-dynamodb connector with support for Flink 1.15. The versioning strategy says to support the latest 2 Flink versions [1]. If this connector builds against both 1.15/1.16 we should consider supporting both. Given that Opensearch is AWS did we consider putting this in flink-connector-aws? Since it does not use the AWS SDK it makes sense to split, but wonder if this was already discussed? Thanks, Danny [1] https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development On Thu, Dec 15, 2022 at 3:19 PM Martijn Visser wrote: > Hi Andriy, > > +1 to release the first version. Happy to help with the release (feels like > I'm doing nothing else anyway :D) > > I would indeed go for version 1.0.0 to start since it's a new connector. > > Cheers, > > Martijn > > On Thu, Dec 15, 2022 at 4:16 PM Andriy Redko wrote: > > > Hello All, > > > > I would like to start discussing the first release of the new Flink > > Opensearch Connector [1] 1.0.0. As per the connector versioning strategy > > [2] from the new flink-connector-opensearch repository [3]. As of today, > > no outstanding issues are left for the first release to happen. > > > > I propose that we release 1.0.0 with support for Flink 1.16 (1.0.0-1.16). > > Since this is a new connector (has never been part of the Flink > > distribution), > > it probably makes sense to start from version 1.0.0 but suggestions here > > are > > more than welcome. > > > > I would appreciate if PMC member volunteers to step in as the release > > manager. > > > > [1] > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-243%3A+Dedicated+Opensearch+connectors > > [2] > > > https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development > > [3] https://github.com/apache/flink-connector-opensearch > > > > Thanks! > > > > Best Regards, > > Andriy Redko > > > > > > > > >
Re: [DICSUSS] Releasing Flink Opensearch Connector v1.0.0
Hi Andriy, +1 to release the first version. Happy to help with the release (feels like I'm doing nothing else anyway :D) I would indeed go for version 1.0.0 to start since it's a new connector. Cheers, Martijn On Thu, Dec 15, 2022 at 4:16 PM Andriy Redko wrote: > Hello All, > > I would like to start discussing the first release of the new Flink > Opensearch Connector [1] 1.0.0. As per the connector versioning strategy > [2] from the new flink-connector-opensearch repository [3]. As of today, > no outstanding issues are left for the first release to happen. > > I propose that we release 1.0.0 with support for Flink 1.16 (1.0.0-1.16). > Since this is a new connector (has never been part of the Flink > distribution), > it probably makes sense to start from version 1.0.0 but suggestions here > are > more than welcome. > > I would appreciate if PMC member volunteers to step in as the release > manager. > > [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-243%3A+Dedicated+Opensearch+connectors > [2] > https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development > [3] https://github.com/apache/flink-connector-opensearch > > Thanks! > > Best Regards, > Andriy Redko > > > >
