Hi Vijay, If you implement the SinkFunction yourself, you can share the OkHttpClient.Builder across all instances in the same taskmanager by using a static field and initializing it only once (ideally in RichSinkFunction#open).
On Tue, Oct 6, 2020 at 9:37 AM Aljoscha Krettek <aljos...@apache.org> wrote: > Hi, > > since I don't know the implementation of the Sink I can only guess. I > would say you get 82 * 300 connections because you will get 82 instances > of a sink operator and each of those would then have a connection pool > of 300 connections. The individual sink instances will (potentially) run > on different machines and not share the connection pool. > > Best, > Aljoscha > > On 05.10.20 22:28, Vijay Balakrishnan wrote: > > HI, > > Basic question on parallelism of operators and ConnectionPool to DB: > > Will this result in 82 * 300 connections to InfluxDB or just 300 > > connections to InfluxDB ? > > main() { > > sink = ....createInfluxMonitoringSink(..); > > keyStream.addSink(sink).addParallelism(82);//will this result in 82 * > 300 > > connections to InfluxDB or just 300 connections to InfluxDB ? > > } > > > > > > private ..... createInfluxMonitoringSink(...) { > > > > > > final OkHttpClient.Builder okHttpClientBuilder = new > > OkHttpClient.Builder() > > .readTimeout(timeout, TimeUnit.MILLISECONDS) > > .connectTimeout(timeout, TimeUnit.MILLISECONDS) > > .writeTimeout(timeout, TimeUnit.MILLISECONDS) > > .connectionPool(new ConnectionPool(300, 60, > > TimeUnit.SECONDS)); > > > > try (InfluxDB influxDB = InfluxDBFactory.connect > > (host, userName, pwd, okHttpClientBuilder)) { ......} > > > > } > > > > TIA, > > > > -- Arvid Heise | Senior Java Developer <https://www.ververica.com/> Follow us @VervericaData -- Join Flink Forward <https://flink-forward.org/> - The Apache Flink Conference Stream Processing | Event Driven | Real Time -- Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany -- Ververica GmbH Registered at Amtsgericht Charlottenburg: HRB 158244 B Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji (Toni) Cheng