Sure, let me try out with more debug logs and get back to you
Regards
Bhaskar
On Fri, Dec 14, 2018 at 4:41 PM Tzu-Li (Gordon) Tai
wrote:
> Hi,
>
> (Removed dev@ from the mail thread)
>
> I took a look at the logs you provided, and it seems like the sink
> operators should have been properly tea
Hi,
(Removed dev@ from the mail thread)
I took a look at the logs you provided, and it seems like the sink operators
should have been properly tear-down, and therefore closing the
RestHighLevelClient used internally.
I’m at this point not really sure what else could have caused this besides a
Hi Gordon,
We are using flink cluster 1.6.1, elastic search connector version:
flink-connector-elasticsearch6_2.11
Attached the stack trace.
Following are the max open file descriptor limit of theTask manager
process and open connections to the elastic
search cluster
Regards
Bhaskar
*#lsof -p 620
Hi,
Besides the information that Chesnay requested, could you also provide a stack
trace of the exception that caused the job to terminate in the first place?
The Elasticsearch sink does indeed close the internally used Elasticsearch
client, which should in turn properly release all resources [
Specifically which connector are you using, and which Flink version?
On 12.12.2018 13:31, Vijay Bhaskar wrote:
Hi
We are using flink elastic sink which streams at the rate of 1000
events/sec, as described in
https://ci.apache.org/projects/flink/flink-docs-stable/dev/connectors/elasticsearch.ht
Hi Bhaskar,
I think Gordon might help you, I am pulling him into the discussion.
Best,
Andrey
> On 12 Dec 2018, at 13:31, Vijay Bhaskar wrote:
>
> Hi
> We are using flink elastic sink which streams at the rate of 1000 events/sec,
> as described in
> https://ci.apache.org/projects/flink/flink
Hi
We are using flink elastic sink which streams at the rate of 1000
events/sec, as described in
https://ci.apache.org/projects/flink/flink-docs-stable/dev/connectors/elasticsearch.html
.
We are observing connection leak of elastic connections. After few minutes
all the open connections are exceedi
