wael shehata created FLINK-34663: ------------------------------------ Summary: flink-opensearch connector Unable to parse response body for Response Key: FLINK-34663 URL: https://issues.apache.org/jira/browse/FLINK-34663 Project: Flink Issue Type: Bug Components: Connectors / Opensearch Affects Versions: 1.18.1 Environment: Docker-Compose: Flink 1.18.1 - Java11 OpenSearch 2.12.0 Flink-Sql-Opensearch-connector (flink 1.18.1 → Os 1.3) Reporter: wael shehata
I`m trying to use flink-sql-opensearch connector to sink stream data to OpenSearch via Flink … After submitting the Job to Flink cluster successfully , the job runs normally for 30sec and create the index with data … then it fails with the following message: _*org.apache.flink.util.FlinkRuntimeException: Complete bulk has failed… Caused by: java.io.IOException: Unable to parse response body for Response*_ _*{requestLine=POST /_bulk?timeout=1m HTTP/1.1, host=[http://172.20.0.6:9200|http://172.20.0.6:9200/], response=HTTP/1.1 200 OK}*_ at org.opensearch.client.RestHighLevelClient$1.onSuccess(RestHighLevelClient.java:1942) at org.opensearch.client.RestClient$FailureTrackingResponseListener.onSuccess(RestClient.java:662) at org.opensearch.client.RestClient$1.completed(RestClient.java:396) at org.opensearch.client.RestClient$1.completed(RestClient.java:390) at org.apache.http.concurrent.BasicFuture.completed(BasicFuture.java:122) at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.responseCompleted(DefaultClientExchangeHandlerImpl.java:182) at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.processResponse(HttpAsyncRequestExecutor.java:448) at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.inputReady(HttpAsyncRequestExecutor.java:338) at org.apache.http.impl.nio.DefaultNHttpClientConnection.consumeInput(DefaultNHttpClientConnection.java:265) at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:87) at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:40) at org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:114) at org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor.java:162) at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:337) at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:315) at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:276) at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591) … 1 more *Caused by: java.lang.NullPointerException* *at java.base/java.util.Objects.requireNonNull(Unknown Source)* *at org.opensearch.action.DocWriteResponse.(DocWriteResponse.java:140)* *at org.opensearch.action.index.IndexResponse.(IndexResponse.java:67) …* It seems that this error is common but without any solution … the flink connector despite it was built for OpenSearch 1.3 , but it still working in sending and creating index to OpenSearch 2.12.0 … but this error persists with all OpenSearch versions greater than 1.13 … *Opensearch support reply was:* *"this is unexpected, could you please create an issue here [1], the issue is caused by _type property that has been removed in 2.x"* -- This message was sent by Atlassian Jira (v8.20.10#820010)