[
https://issues.apache.org/jira/browse/FLINK-11747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17426992#comment-17426992
]
zoucao commented on FLINK-11747:
--------------------------------
Hi all, it is good point to support sniffer in es connector for FlinkSQL and
FlinkJar. Now in our internal, we connect to es server driectly or using
routing, sometimes too many connections link to the same address, which cause
es server crash. I wonder why this issiue did not go ahead.
> Elasticsearch 6 connector - Expose RestHighLevelClient to allow for custom
> sniffing
> -----------------------------------------------------------------------------------
>
> Key: FLINK-11747
> URL: https://issues.apache.org/jira/browse/FLINK-11747
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / ElasticSearch
> Reporter: Samir Desai
> Priority: Minor
> Labels: auto-deprioritized-major, auto-unassigned,
> pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> In the Elasticsearch6 connector, the
> [RestClientFactory|https://github.com/apache/flink/blob/release-1.6/flink-connectors/flink-connector-elasticsearch6/src/main/java/org/apache/flink/streaming/connectors/elasticsearch6/RestClientFactory.java#L31]
> allows users to customize the {{RestClientBuilder}}. However, certain
> customizations like adding
> [Sniffing|https://www.elastic.co/guide/en/elasticsearch/client/java-rest/master/_usage.html]
>
> require access to the low-level rest client, which can be obtained through
> the high level rest client. The {{RestHighLevelClient}} is
> [instantiated|https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-elasticsearch6/src/main/java/org/apache/flink/streaming/connectors/elasticsearch6/Elasticsearch6ApiCallBridge.java#L75]
> in the api call bridge, and is never exposed to the user.
> To my knowledge, the current Elasticsearch6 connector does not utilize
> sniffing or provide a way to add it in. The Elasticsearch6 connector should
> expose some type of access to the RestHighLevelClient to allow for custom
> sniffing.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
