Re: dependency error with latest Kafka connector

guenterh.lists Thu, 23 Nov 2023 05:55:18 -0800

Hi Danny

thanks for taking a look into it and for the hint.

Your assumption is correct - It compiles when the base connector isexcluded.


In sbt:

"org.apache.flink" % "flink-connector-kafka" % "3.0.1-1.18"exclude("org.apache.flink", "flink-connector-base"),


Günter


On 23.11.23 14:24, Danny Cranmer wrote:

Hey all,

I believe this is because of FLINK-30400. Looking at the pom I cannot see
any other dependencies that would cause a problem. To workaround this, can
you try to remove that dependency from your build?

<dependency>
     <groupId>org.apache.flink</groupId>
     <artifactId>flink-connector-kafka</artifactId>
     <version>3.0.1-1.18</version>
     <exclusions>
         <exclusion>
             <groupId>org.apache.flink</groupId>
             <artifactId>flink-connector-base</artifactId>
         </exclusion>
     </exclusions>
</dependency>


Alternatively you can add it in:

<dependency>
     <groupId>org.apache.flink</groupId>
     <artifactId>flink-connector-base</artifactId>
     <version>1.18.0</version>
</dependency>

Sorry I am not sure how to do this in Scala SBT.

Agree we should get this fixed and push a 3.0.2 Kafka connector.

Thanks,
Danny

[1] https://issues.apache.org/jira/browse/FLINK-30400

On Thu, Nov 23, 2023 at 12:39 PM Leonard Xu <xbjt...@gmail.com> wrote:

Hi, Gurnterh

It seems a bug for me that  3.0.1-1.18 flink Kafka connector use  flink
  1.17 dependency which lead to your issue.

I guess we need propose a new release for Kafka connector for fix this
issue.

CC: Gordan, Danny, Martijn

Best,
Leonard

2023年11月14日 下午6:53，Alexey Novakov via user <user@flink.apache.org> 写道：

Hi Günterh,

It looks like a problem with the Kafka connector release.
https://mvnrepository.com/artifact/org.apache.flink/flink-connector-kafka/3.0.1-1.18
Compile dependencies are still pointing to Flink 1.17.

Release person is already contacted about this or will be contacted soon.

Best regards,
Alexey

On Mon, Nov 13, 2023 at 10:42 PM guenterh.lists <guenterh.li...@bluewin.ch>
wrote:

Hello

I'm getting a dependency error when using the latest Kafka connector in
a Scala project.

Using the 1.17.1 Kafka connector compilation is ok.

With

"org.apache.flink" % "flink-connector-kafka" % "3.0.1-1.18"

I get
[error] (update) sbt.librarymanagement.ResolveException: Error
downloading org.apache.flink:flink-connector-base:
[error]   Not found
[error]   Not found
[error]   not found:

/home/swissbib/.ivy2/local/org.apache.flink/flink-connector-base/ivys/ivy.xml
[error]   not found:

https://repo1.maven.org/maven2/org/apache/flink/flink-connector-base//flink-connector-base-.pom

Seems Maven packaging is not correct.

My sbt build file:

ThisBuild / scalaVersion := "3.3.0"
val flinkVersion = "1.18.0"
val postgresVersion = "42.2.2"

lazy val root = (project in file(".")).settings(
    name := "flink-scala-proj",
    libraryDependencies ++= Seq(
      "org.flinkextended" %% "flink-scala-api" % "1.17.1_1.1.0",
      "org.apache.flink" % "flink-clients" % flinkVersion % Provided,
      "org.apache.flink" % "flink-connector-files" % flinkVersion %
Provided,

    "org.apache.flink" % "flink-connector-kafka" % "1.17.1",
    //"org.apache.flink" % "flink-connector-kafka" % "3.0.1-1.18",

    //"org.apache.flink" % "flink-connector-jdbc" % "3.1.1-1.17",
    //"org.postgresql" % "postgresql" % postgresVersion,
    "org.apache.flink" % "flink-connector-files" % flinkVersion % Provided,
    //"org.apache.flink" % "flink-connector-base" % flinkVersion % Provided
    )
)



Thanks!

--
Günter Hipler
https://openbiblio.social/@vog61
https://twitter.com/vog61

--
Günter Hipler
https://openbiblio.social/@vog61
https://twitter.com/vog61

Re: dependency error with latest Kafka connector

Reply via email to