Hi Elkhan, Thanks for reaching out. However, this upgrade path isn't possible because the Elastic license for version 7.17 is not compatible with the Apache License. The only way that support for Elasticsearch 8 can be created is by moving away from the High Level REST Client (which has also been deprecated since 7.15) and moving to the new Java API.
The correct ticket to follow for Elasticsearch 8 support is https://issues.apache.org/jira/browse/FLINK-26088. If you can help out with this, it would be greatly appreciated. Best regards, Martijn On Fri, Oct 28, 2022 at 1:46 AM Elkhan Dadashov <elkhan.dadas...@gmail.com> wrote: > Hello all, > > Want to help upgrade the Flink ElasticSearch connector to 8.X.X version. > > `elasticsearch-7` connector uses ElasticSearch `7.10.2` version. > > > https://github.com/apache/flink-connector-elasticsearch/blob/main/flink-connector-elasticsearch7/pom.xml#L39 > > When the ElasticSearch server side is `8.X.X` then, `elasticsearch-7` > connector does not work. For Example for ElasticSearch `8.2.2` version on > the server side, the minimum required version on the `elasticsearch-7` > Flink connector side is `"minimum_wire_compatibility_version" : "7.17.0"`. > > As of today `elasticsearch-8` does not exist yet. [ Add Elasticsearch 8.0 > support Jira ticket |https://issues.apache.org/jira/browse/FLINK-26088 ] > > I'm proposing to do the upgrade in 2 phases: > > *Phase 1*: > > https://issues.apache.org/jira/browse/FLINK-29785 > > Phase 1 will require less time, and still unblock users to use Flink ES-7 > connector with ElasticSearch 8.X.X version on the server side. > > *Phase 2*: > > https://issues.apache.org/jira/browse/FLINK-26088 > > Will be glad to hear others' suggestions. > > Thank you. > > -- > > Elkhan >
