Jason Kania created FLINK-33111: ----------------------------------- Summary: Flink Pulsar Connector to Pulsar Client Version Mismatch Key: FLINK-33111 URL: https://issues.apache.org/jira/browse/FLINK-33111 Project: Flink Issue Type: Bug Components: Connectors / Pulsar Affects Versions: 1.17.1 Reporter: Jason Kania
In the documentation for the Flink Pulsar Connector, (https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/connectors/datastream/pulsar/) it indicates that 2.10.0 and above versions of the pulsar client are supported "You can use the connector with the Pulsar 2.10.0 or higher" and the pom file entry references the 4.0.0-1.17 version of the connector which points to the 2.11.0 version of the Pulsar client. However, when using Pulsar Client 2.10.4 or 2.10.5, the following error is generated: java.lang.NoSuchMethodError: 'org.apache.pulsar.client.api.ClientBuilder org.apache.pulsar.client.api.ClientBuilder.connectionMaxIdleSeconds(int)' at org.apache.flink.connector.pulsar.common.config.PulsarClientFactory.createClient(PulsarClientFactory.java:127) at org.apache.flink.connector.pulsar.source.reader.PulsarSourceReader.create(PulsarSourceReader.java:266) at org.apache.flink.connector.pulsar.source.PulsarSource.createReader(PulsarSource.java:137) at org.apache.flink.streaming.api.operators.SourceOperator.initReader(SourceOperator.java:312) at org.apache.flink.streaming.runtime.tasks.SourceOperatorStreamTask.init(SourceOperatorStreamTask.java:93) at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:699) at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:675) at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:952) at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:921) at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:745) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:562) at java.base/java.lang.Thread.run(Thread.java:829) The referenced method 'connectionMaxIdleSeconds' is only available in the Pulsar 2.11 client when looking at the source code. I am not sure whether the documentation is wrong and the Flink Pulsar Connector 2.11 is the intended Pulsar version. However, my understanding is that Pulsar 2.11 is targeted toward java 17. In the maven repository and would create the need for mixed Java 11 and Java 17 deployment. Documentation cleanup and a reference to the appropriate Java versions is needed. A fix to the 1.17.1 Flink pulsar connector may alternatively be required. -- This message was sent by Atlassian Jira (v8.20.10#820010)