[jira] [Created] (FLINK-31488) Dependency convergence failed due to dependency not being available
Matthias Pohl created FLINK-31488:
-
Summary: Dependency convergence failed due to dependency not being
available
Key: FLINK-31488
URL: https://issues.apache.org/jira/browse/FLINK-31488
Project: Flink
Issue Type: Bug
Components: Test Infrastructure
Affects Versions: 1.17.0
Reporter: Matthias Pohl
{code}
[ERROR] Rule 0: org.apache.maven.plugins.enforcer.DependencyConvergence failed
with message:
Could not build dependency tree Could not collect dependencies:
org.apache.flink:flink-end-to-end-tests-common-kafka:jar:1.17-SNAPSHOT
{code}
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=47163=logs=cc2c0b9a-de49-5517-79e5-b1df1cadc1e5=e46d8929-052e-573c-00f4-50453f4d6369=23815
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (FLINK-30794) Disable dependency convergence check for night connector builds
Martijn Visser created FLINK-30794: -- Summary: Disable dependency convergence check for night connector builds Key: FLINK-30794 URL: https://issues.apache.org/jira/browse/FLINK-30794 Project: Flink Issue Type: Technical Debt Components: Connectors / Common Reporter: Martijn Visser Assignee: Martijn Visser -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-30626) RabbitMQ connector has dependency convergence error for org.junit.jupiter:junit-jupiter
Martijn Visser created FLINK-30626: -- Summary: RabbitMQ connector has dependency convergence error for org.junit.jupiter:junit-jupiter Key: FLINK-30626 URL: https://issues.apache.org/jira/browse/FLINK-30626 Project: Flink Issue Type: Bug Components: Connectors/ RabbitMQ Affects Versions: rabbitmq-3.0.1 Reporter: Martijn Visser Assignee: Martijn Visser -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-29868) Dependency convergence error for org.osgi:org.osgi.core:jar
Nico Kruber created FLINK-29868:
---
Summary: Dependency convergence error for
org.osgi:org.osgi.core:jar
Key: FLINK-29868
URL: https://issues.apache.org/jira/browse/FLINK-29868
Project: Flink
Issue Type: Bug
Components: Build System, Table SQL / Runtime
Affects Versions: 1.17.0
Reporter: Nico Kruber
Fix For: 1.17.0
While working on FLINK-29867, the following new error is popping up while
running
{code}
./mvnw clean install -pl flink-dist -am -DskipTests
-Dflink.convergence.phase=install -Pcheck-convergence
{code}
(this is also done by CI which therefore fails)
{code}
[WARNING]
Dependency convergence error for org.osgi:org.osgi.core:jar:4.3.0:runtime paths
to dependency are:
+-org.apache.flink:flink-table-planner-loader-bundle:jar:1.17-SNAPSHOT
+-org.apache.flink:flink-table-planner_2.12:jar:1.17-SNAPSHOT:runtime
+-org.apache.flink:flink-table-api-java-bridge:jar:1.17-SNAPSHOT:runtime
+-org.apache.flink:flink-streaming-java:jar:1.17-SNAPSHOT:runtime
+-org.apache.flink:flink-runtime:jar:1.17-SNAPSHOT:runtime
+-org.xerial.snappy:snappy-java:jar:1.1.8.3:runtime
+-org.osgi:org.osgi.core:jar:4.3.0:runtime
and
+-org.apache.flink:flink-table-planner-loader-bundle:jar:1.17-SNAPSHOT
+-org.apache.flink:flink-table-planner_2.12:jar:1.17-SNAPSHOT:runtime
+-org.apache.flink:flink-scala_2.12:jar:1.17-SNAPSHOT:runtime
+-org.apache.flink:flink-core:jar:1.17-SNAPSHOT:runtime
+-org.apache.commons:commons-compress:jar:1.21:runtime
+-org.osgi:org.osgi.core:jar:6.0.0:runtime
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (FLINK-29441) Setup dependency convergence check
Danny Cranmer created FLINK-29441:
-
Summary: Setup dependency convergence check
Key: FLINK-29441
URL: https://issues.apache.org/jira/browse/FLINK-29441
Project: Flink
Issue Type: Sub-task
Reporter: Danny Cranmer
Following the Flink repo:
* Convergence should be disabled by default
* Enabled via {{-Pcheck-convergence}}
* Enabled on CI
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (FLINK-24358) flink-avro-glue-schema-registry fails compiling with dependency convergence
Xintong Song created FLINK-24358:
Summary: flink-avro-glue-schema-registry fails compiling with
dependency convergence
Key: FLINK-24358
URL: https://issues.apache.org/jira/browse/FLINK-24358
Project: Flink
Issue Type: Bug
Components: Build System
Affects Versions: 1.15.0
Reporter: Xintong Song
Fix For: 1.15.0
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24405=logs=ed6509f5-1153-558c-557a-5ee0afbcdf24=241b1e5e-1a8e-5e6a-469a-a9b8cad87065=13506
{code}
[WARNING]
Dependency convergence error for io.netty:netty-handler:4.1.63.Final paths to
dependency are:
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
+-software.amazon.glue:schema-registry-common:1.1.2
+-software.amazon.awssdk:glue:2.16.92
+-software.amazon.awssdk:netty-nio-client:2.16.92
+-io.netty:netty-codec-http:4.1.63.Final
+-io.netty:netty-handler:4.1.63.Final
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
+-software.amazon.glue:schema-registry-common:1.1.2
+-software.amazon.awssdk:glue:2.16.92
+-software.amazon.awssdk:netty-nio-client:2.16.92
+-io.netty:netty-codec-http2:4.1.63.Final
+-io.netty:netty-handler:4.1.63.Final
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
+-software.amazon.glue:schema-registry-common:1.1.2
+-software.amazon.awssdk:glue:2.16.92
+-software.amazon.awssdk:netty-nio-client:2.16.92
+-io.netty:netty-handler:4.1.63.Final
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
+-software.amazon.glue:schema-registry-common:1.1.2
+-software.amazon.awssdk:glue:2.16.92
+-software.amazon.awssdk:netty-nio-client:2.16.92
+-com.typesafe.netty:netty-reactive-streams-http:2.0.5
+-com.typesafe.netty:netty-reactive-streams:2.0.5
+-io.netty:netty-handler:4.1.52.Final
[WARNING]
Dependency convergence error for org.jetbrains.kotlin:kotlin-stdlib:1.3.50
paths to dependency are:
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
+-software.amazon.glue:schema-registry-serde:1.1.2
+-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39
+-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-scripting-compiler-impl-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-scripting-common:1.3.50
+-org.jetbrains.kotlin:kotlin-reflect:1.3.50
+-org.jetbrains.kotlin:kotlin-stdlib:1.3.50
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
+-software.amazon.glue:schema-registry-serde:1.1.2
+-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39
+-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-scripting-compiler-impl-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-scripting-common:1.3.50
+-org.jetbrains.kotlin:kotlin-stdlib:1.3.50
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
+-software.amazon.glue:schema-registry-serde:1.1.2
+-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39
+-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-scripting-compiler-impl-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-scripting-jvm:1.3.50
+-org.jetbrains.kotlin:kotlin-stdlib:1.3.50
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
+-software.amazon.glue:schema-registry-serde:1.1.2
+-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39
+-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-scripting-compiler-impl-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-stdlib:1.3.50
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
+-software.amazon.glue:schema-registry-serde:1.1.2
+-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39
+-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-scripting-compiler-impl-embeddable:1.3.50
+-org.jetbrains.kotlinx:kotlinx-coroutines-core:1.1.1
+-org.jetbrains.kotlin:kotlin-stdlib:1.3.20
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
+-software.amazon.glue:schema-registry-serde:1.1.2
+-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39
+-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-stdlib:1.3.50
[WARNING]
Dependency convergence error for io.netty:netty-codec-http:4.1.63.Final paths
to dependency are:
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
+-software.amazon.glue:schema-registry-common:1.1.2
[jira] [Created] (FLINK-20904) Maven enforce goal dependency-convergence failed on flink-avro-glue-schema-registry
Linyu Yao created FLINK-20904:
-
Summary: Maven enforce goal dependency-convergence failed on
flink-avro-glue-schema-registry
Key: FLINK-20904
URL: https://issues.apache.org/jira/browse/FLINK-20904
Project: Flink
Issue Type: New Feature
Components: Build System / CI
Affects Versions: 1.13.0
Reporter: Linyu Yao
I'm creating a pull request to add integration with AWS Glue Schema Registry,
more details of this new feature can be found here
https://issues.apache.org/jira/browse/FLINK-19667
The package can build successfully locally and pass end to end test. But the
new added module compiling failed in CI. See more
[https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=11770=logs=52b61abe-a3cc-5bde-cc35-1bbe89bb7df5=54421a62-0c80-5aad-3319-094ff69180bb]
How can replicate this issue on my local environment and fix it?
{code:java}
[INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (dependency-convergence) @
flink-avro-glue-schema-registry ---
[WARNING]
Dependency convergence error for software.amazon.awssdk:http-client-spi:2.15.32
paths to dependency are:
+-org.apache.flink:flink-avro-glue-schema-registry:1.13-SNAPSHOT
+-software.amazon.glue:schema-registry-serde:1.0.0
+-software.amazon.glue:schema-registry-common:1.0.0
+-software.amazon.awssdk:glue:2.15.32
+-software.amazon.awssdk:protocol-core:2.15.32
+-software.amazon.awssdk:http-client-spi:2.15.32
and
+-org.apache.flink:flink-avro-glue-schema-registry:1.13-SNAPSHOT
+-software.amazon.glue:schema-registry-serde:1.0.0
+-software.amazon.glue:schema-registry-common:1.0.0
+-software.amazon.awssdk:glue:2.15.32
+-software.amazon.awssdk:auth:2.15.32
+-software.amazon.awssdk:http-client-spi:2.15.32
and
+-org.apache.flink:flink-avro-glue-schema-registry:1.13-SNAPSHOT
+-software.amazon.glue:schema-registry-serde:1.0.0
+-software.amazon.glue:schema-registry-common:1.0.0
+-software.amazon.awssdk:glue:2.15.32
+-software.amazon.awssdk:http-client-spi:2.15.32
and
+-org.apache.flink:flink-avro-glue-schema-registry:1.13-SNAPSHOT
+-software.amazon.glue:schema-registry-serde:1.0.0
+-software.amazon.glue:schema-registry-common:1.0.0
+-software.amazon.awssdk:glue:2.15.32
+-software.amazon.awssdk:aws-core:2.15.32
+-software.amazon.awssdk:http-client-spi:2.15.32
and
+-org.apache.flink:flink-avro-glue-schema-registry:1.13-SNAPSHOT
+-software.amazon.glue:schema-registry-serde:1.0.0
+-software.amazon.glue:schema-registry-common:1.0.0
+-software.amazon.awssdk:glue:2.15.32
+-software.amazon.awssdk:apache-client:2.15.32
+-software.amazon.awssdk:http-client-spi:2.15.32
and
+-org.apache.flink:flink-avro-glue-schema-registry:1.13-SNAPSHOT
+-software.amazon.glue:schema-registry-serde:1.0.0
+-software.amazon.glue:schema-registry-common:1.0.0
+-software.amazon.awssdk:glue:2.15.32
+-software.amazon.awssdk:netty-nio-client:2.15.32
+-software.amazon.awssdk:http-client-spi:2.15.32
and
+-org.apache.flink:flink-avro-glue-schema-registry:1.13-SNAPSHOT
+-software.amazon.glue:schema-registry-serde:1.0.0
+-software.amazon.glue:schema-registry-common:1.0.0
+-software.amazon.awssdk:cloudwatch:2.15.30
+-software.amazon.awssdk:aws-query-protocol:2.15.30
+-software.amazon.awssdk:http-client-spi:2.15.30
...{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (FLINK-19298) Maven enforce goal dependency-convergence failed on flink-json
Jark Wu created FLINK-19298:
---
Summary: Maven enforce goal dependency-convergence failed on
flink-json
Key: FLINK-19298
URL: https://issues.apache.org/jira/browse/FLINK-19298
Project: Flink
Issue Type: Bug
Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
Affects Versions: 1.12.0
Reporter: Jark Wu
See more
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=6669=logs=c88eea3b-64a0-564d-0031-9fdcd7b8abee=9b1a0f88-517b-5893-fc93-76f4670982b4
{code}
+-org.codehaus.janino:janino:3.0.9
+-org.codehaus.janino:commons-compiler:3.0.9
and
+-org.apache.flink:flink-json:1.12-SNAPSHOT
+-org.apache.flink:flink-table-planner-blink_2.11:1.12-SNAPSHOT
+-org.apache.calcite:calcite-core:1.22.0
+-org.codehaus.janino:commons-compiler:3.0.11
and
+-org.apache.flink:flink-json:1.12-SNAPSHOT
+-org.apache.flink:flink-table-planner-blink_2.11:1.12-SNAPSHOT
+-org.codehaus.janino:commons-compiler:3.0.9
17:08:16.111 [WARNING]
Dependency convergence error for org.codehaus.janino:janino:3.0.9 paths to
dependency are:
+-org.apache.flink:flink-json:1.12-SNAPSHOT
+-org.apache.flink:flink-table-planner-blink_2.11:1.12-SNAPSHOT
+-org.codehaus.janino:janino:3.0.9
and
+-org.apache.flink:flink-json:1.12-SNAPSHOT
+-org.apache.flink:flink-table-planner-blink_2.11:1.12-SNAPSHOT
+-org.apache.flink:flink-table-runtime-blink_2.11:1.12-SNAPSHOT
+-org.codehaus.janino:janino:3.0.9
and
+-org.apache.flink:flink-json:1.12-SNAPSHOT
+-org.apache.flink:flink-table-planner-blink_2.11:1.12-SNAPSHOT
+-org.apache.calcite:calcite-core:1.22.0
+-org.codehaus.janino:janino:3.0.11
and
+-org.apache.flink:flink-json:1.12-SNAPSHOT
+-org.apache.flink:flink-table-planner-blink_2.11:1.12-SNAPSHOT
+-org.codehaus.janino:janino:3.0.9
17:08:16.112 [WARNING] Rule 0:
org.apache.maven.plugins.enforcer.DependencyConvergence failed with message:
Failed while enforcing releasability. See above detailed error message.
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (FLINK-10971) Dependency convergence issue when building flink-s3-fs-presto
Ufuk Celebi created FLINK-10971:
---
Summary: Dependency convergence issue when building
flink-s3-fs-presto
Key: FLINK-10971
URL: https://issues.apache.org/jira/browse/FLINK-10971
Project: Flink
Issue Type: Bug
Reporter: Ufuk Celebi
Trying to trigger a savepoint to S3 with a clean build of {{release-1.7.0-rc2}}
results in a {{java.lang.NoSuchMethodError:
org.apache.flink.fs.s3presto.shaded.com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V}}.
*Environment*
- Tag: {{release-1.7.0-rc2}}
- Build command: {{mvn clean package -DskipTests -Dcheckstyle.skip}}
- Maven version:
{code}
mvn -version
Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe;
2018-06-17T20:33:14+02:00)
Maven home: /usr/local/Cellar/maven/3.5.4/libexec
Java version: 1.8.0_192, vendor: Oracle Corporation, runtime:
/Library/Java/JavaVirtualMachines/jdk1.8.0_192.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.14.1", arch: "x86_64", family: "mac"
{code}
*Steps to reproduce*
{code}
cp opt/flink-s3-fs-presto-1.7.0.jar lib
bin/start-cluster.sh
bin/flink run examples/streaming/TopSpeedWindowing.jar
bin/flink savepoint db37f69f21cbe54e9bf6b7e259a9c09e
{code}
*Stacktrace*
{code}
The program finished with the following exception:
org.apache.flink.util.FlinkException: Triggering a savepoint for the job
db37f69f21cbe54e9bf6b7e259a9c09e failed.
at
org.apache.flink.client.cli.CliFrontend.triggerSavepoint(CliFrontend.java:723)
at
org.apache.flink.client.cli.CliFrontend.lambda$savepoint$9(CliFrontend.java:701)
at
org.apache.flink.client.cli.CliFrontend.runClusterAction(CliFrontend.java:985)
at
org.apache.flink.client.cli.CliFrontend.savepoint(CliFrontend.java:698)
at
org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1065)
at
org.apache.flink.client.cli.CliFrontend.lambda$main$11(CliFrontend.java:1126)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
at
org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1126)
Caused by: java.util.concurrent.CompletionException:
java.util.concurrent.CompletionException: java.lang.NoSuchMethodError:
org.apache.flink.fs.s3presto.shaded.com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
at
org.apache.flink.runtime.jobmaster.JobMaster.lambda$triggerSavepoint$14(JobMaster.java:970)
at
java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:870)
at
java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:852)
at
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)
at
java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1977)
at
org.apache.flink.runtime.checkpoint.PendingCheckpoint.finalizeCheckpoint(PendingCheckpoint.java:292)
at
org.apache.flink.runtime.checkpoint.CheckpointCoordinator.completePendingCheckpoint(CheckpointCoordinator.java:829)
at
org.apache.flink.runtime.checkpoint.CheckpointCoordinator.receiveAcknowledgeMessage(CheckpointCoordinator.java:756)
at
org.apache.flink.runtime.jobmaster.JobMaster.lambda$acknowledgeCheckpoint$8(JobMaster.java:680)
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
at
akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at
scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at
scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: java.util.concurrent.CompletionException:
java.lang.NoSuchMethodError:
org.apache.flink.fs.s3presto.shaded.com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
at
java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292)
at
java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308)
at
java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:593)
at
java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577)
... 12 mor
[jira] [Created] (FLINK-9498) Disable dependency convergence for "flink-end-to-end-tests"
Hai Zhou created FLINK-9498: --- Summary: Disable dependency convergence for "flink-end-to-end-tests" Key: FLINK-9498 URL: https://issues.apache.org/jira/browse/FLINK-9498 Project: Flink Issue Type: Sub-task Components: Build System Reporter: Hai Zhou Assignee: Hai Zhou -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-9186) Enable dependency convergence for flink-libraries
Chesnay Schepler created FLINK-9186: --- Summary: Enable dependency convergence for flink-libraries Key: FLINK-9186 URL: https://issues.apache.org/jira/browse/FLINK-9186 Project: Flink Issue Type: Sub-task Components: Build System Reporter: Chesnay Schepler Assignee: Chesnay Schepler Fix For: 1.5.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-7890) Enable dependency convergence for flink-connector-kafka-base
Piotr Nowojski created FLINK-7890: - Summary: Enable dependency convergence for flink-connector-kafka-base Key: FLINK-7890 URL: https://issues.apache.org/jira/browse/FLINK-7890 Project: Flink Issue Type: Sub-task Components: Build System Reporter: Piotr Nowojski -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-7891) Enable dependency convergence for other modules (please split this subtask up if necessary)
Piotr Nowojski created FLINK-7891: - Summary: Enable dependency convergence for other modules (please split this subtask up if necessary) Key: FLINK-7891 URL: https://issues.apache.org/jira/browse/FLINK-7891 Project: Flink Issue Type: Sub-task Components: Build System Affects Versions: 1.3.2 Reporter: Piotr Nowojski -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-7889) Enable dependency convergence for flink-streaming-java
Piotr Nowojski created FLINK-7889: - Summary: Enable dependency convergence for flink-streaming-java Key: FLINK-7889 URL: https://issues.apache.org/jira/browse/FLINK-7889 Project: Flink Issue Type: Sub-task Components: Build System Affects Versions: 1.3.2 Reporter: Piotr Nowojski -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-7888) Enable dependency convergence for flink-runtime
Piotr Nowojski created FLINK-7888: - Summary: Enable dependency convergence for flink-runtime Key: FLINK-7888 URL: https://issues.apache.org/jira/browse/FLINK-7888 Project: Flink Issue Type: Sub-task Components: Build System Affects Versions: 1.3.2 Reporter: Piotr Nowojski -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-7887) Enable dependency convergence for flink-shaded-hadoop
Piotr Nowojski created FLINK-7887: - Summary: Enable dependency convergence for flink-shaded-hadoop Key: FLINK-7887 URL: https://issues.apache.org/jira/browse/FLINK-7887 Project: Flink Issue Type: Sub-task Components: Build System Affects Versions: 1.3.2 Reporter: Piotr Nowojski -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-7886) Enable dependency convergence for flink-core
Piotr Nowojski created FLINK-7886: - Summary: Enable dependency convergence for flink-core Key: FLINK-7886 URL: https://issues.apache.org/jira/browse/FLINK-7886 Project: Flink Issue Type: Sub-task Components: Build System Affects Versions: 1.3.2 Reporter: Piotr Nowojski Assignee: Piotr Nowojski Fix For: 1.4.0 -- This message was sent by Atlassian JIRA (v6.4.14#64029)
Re: Dependency convergence
+2 ;-) > On 5. Oct 2017, at 11:26, Till Rohrmann <trohrm...@apache.org> wrote: > > +1 for pulling our dependencies straight and guarding it via the > maven-enforcer-plugin. > > On Wed, Oct 4, 2017 at 8:58 PM, Piotr Nowojski <pi...@data-artisans.com> > wrote: > >> I meant for whole flink project. >> >>> On Oct 4, 2017, at 8:43 PM, Bowen Li <bowen...@offerupnow.com> wrote: >>> >>> +1. This is great, Piotrek! >>> >>> BTW, can you clarify what you mean by 'project wide'? Is it the whole >>> `flink` project or just `flink-connector-kafka`? I think it's useful to >>> be applied to the whole flink project. I've seen dependencies conflict >>> problem like this in flink-connector-kinesis. Enabling this in flink >> would >>> protect us from many hidden issues. >>> >>> Bowen >>> >>> >>> >>> On Wed, Oct 4, 2017 at 9:39 AM, Piotr Nowojski <pi...@data-artisans.com> >>> wrote: >>> >>>> Hi, >>>> >>>> I have spent last couple of days trying to find and fix Kafka tests >>>> instabilities on Travis and I think I have finally found the main >> reason: >>>> dependency conflict on Netty. flakka was pulling in 3.8 and zookeeper >> 3.10. >>>> Effect was very subtle, because rarely in some corner cases (but not >>>> always) Netty was deadlocking itself… >>>> >>>> Because of that I would like to enable dependencyConvergence rule in >>>> maven-enforcer-plugin project wide - it catches this error immediately: >>>> >>>> Dependency convergence error for io.netty:netty:3.10.5.Final paths to >>>> dependency are: >>>> +-org.apache.flink:flink-connector-kafka-0.9_2.11:1.4-SNAPSHOT >>>> +-org.apache.kafka:kafka_2.11:0.9.0.1 >>>> +-org.apache.zookeeper:zookeeper:3.4.10 >>>> +-io.netty:netty:3.10.5.Final >>>> and >>>> +-org.apache.flink:flink-connector-kafka-0.9_2.11:1.4-SNAPSHOT >>>> +-org.apache.flink:flink-runtime_2.11:1.4-SNAPSHOT >>>> +-com.data-artisans:flakka-remote_2.11:2.3-custom >>>> +-io.netty:netty:3.8.0.Final >>>> >>>> Currently this rule fails with multiple errors, but after those lost >>>> couple of days I’m pretty determined to fix all of them “just in case”. >>>> dependencyConvergence rule would protect us in the future against such >>>> nasty subtle bugs. Does anyone have any objections/issues that I’m not >>>> aware of? >>>> >>>> Piotrek >> >>
[jira] [Created] (FLINK-7765) Enable dependency convergence
Piotr Nowojski created FLINK-7765: - Summary: Enable dependency convergence Key: FLINK-7765 URL: https://issues.apache.org/jira/browse/FLINK-7765 Project: Flink Issue Type: Improvement Components: Build System Reporter: Piotr Nowojski Assignee: Piotr Nowojski For motivation check [#7739] -- This message was sent by Atlassian JIRA (v6.4.14#64029)
Re: Dependency convergence
+1 for pulling our dependencies straight and guarding it via the maven-enforcer-plugin. On Wed, Oct 4, 2017 at 8:58 PM, Piotr Nowojski <pi...@data-artisans.com> wrote: > I meant for whole flink project. > > > On Oct 4, 2017, at 8:43 PM, Bowen Li <bowen...@offerupnow.com> wrote: > > > > +1. This is great, Piotrek! > > > > BTW, can you clarify what you mean by 'project wide'? Is it the whole > > `flink` project or just `flink-connector-kafka`? I think it's useful to > > be applied to the whole flink project. I've seen dependencies conflict > > problem like this in flink-connector-kinesis. Enabling this in flink > would > > protect us from many hidden issues. > > > > Bowen > > > > > > > > On Wed, Oct 4, 2017 at 9:39 AM, Piotr Nowojski <pi...@data-artisans.com> > > wrote: > > > >> Hi, > >> > >> I have spent last couple of days trying to find and fix Kafka tests > >> instabilities on Travis and I think I have finally found the main > reason: > >> dependency conflict on Netty. flakka was pulling in 3.8 and zookeeper > 3.10. > >> Effect was very subtle, because rarely in some corner cases (but not > >> always) Netty was deadlocking itself… > >> > >> Because of that I would like to enable dependencyConvergence rule in > >> maven-enforcer-plugin project wide - it catches this error immediately: > >> > >> Dependency convergence error for io.netty:netty:3.10.5.Final paths to > >> dependency are: > >> +-org.apache.flink:flink-connector-kafka-0.9_2.11:1.4-SNAPSHOT > >> +-org.apache.kafka:kafka_2.11:0.9.0.1 > >>+-org.apache.zookeeper:zookeeper:3.4.10 > >> +-io.netty:netty:3.10.5.Final > >> and > >> +-org.apache.flink:flink-connector-kafka-0.9_2.11:1.4-SNAPSHOT > >> +-org.apache.flink:flink-runtime_2.11:1.4-SNAPSHOT > >>+-com.data-artisans:flakka-remote_2.11:2.3-custom > >> +-io.netty:netty:3.8.0.Final > >> > >> Currently this rule fails with multiple errors, but after those lost > >> couple of days I’m pretty determined to fix all of them “just in case”. > >> dependencyConvergence rule would protect us in the future against such > >> nasty subtle bugs. Does anyone have any objections/issues that I’m not > >> aware of? > >> > >> Piotrek > >
Re: Dependency convergence
I meant for whole flink project. > On Oct 4, 2017, at 8:43 PM, Bowen Li <bowen...@offerupnow.com> wrote: > > +1. This is great, Piotrek! > > BTW, can you clarify what you mean by 'project wide'? Is it the whole > `flink` project or just `flink-connector-kafka`? I think it's useful to > be applied to the whole flink project. I've seen dependencies conflict > problem like this in flink-connector-kinesis. Enabling this in flink would > protect us from many hidden issues. > > Bowen > > > > On Wed, Oct 4, 2017 at 9:39 AM, Piotr Nowojski <pi...@data-artisans.com> > wrote: > >> Hi, >> >> I have spent last couple of days trying to find and fix Kafka tests >> instabilities on Travis and I think I have finally found the main reason: >> dependency conflict on Netty. flakka was pulling in 3.8 and zookeeper 3.10. >> Effect was very subtle, because rarely in some corner cases (but not >> always) Netty was deadlocking itself… >> >> Because of that I would like to enable dependencyConvergence rule in >> maven-enforcer-plugin project wide - it catches this error immediately: >> >> Dependency convergence error for io.netty:netty:3.10.5.Final paths to >> dependency are: >> +-org.apache.flink:flink-connector-kafka-0.9_2.11:1.4-SNAPSHOT >> +-org.apache.kafka:kafka_2.11:0.9.0.1 >>+-org.apache.zookeeper:zookeeper:3.4.10 >> +-io.netty:netty:3.10.5.Final >> and >> +-org.apache.flink:flink-connector-kafka-0.9_2.11:1.4-SNAPSHOT >> +-org.apache.flink:flink-runtime_2.11:1.4-SNAPSHOT >>+-com.data-artisans:flakka-remote_2.11:2.3-custom >> +-io.netty:netty:3.8.0.Final >> >> Currently this rule fails with multiple errors, but after those lost >> couple of days I’m pretty determined to fix all of them “just in case”. >> dependencyConvergence rule would protect us in the future against such >> nasty subtle bugs. Does anyone have any objections/issues that I’m not >> aware of? >> >> Piotrek
Re: Dependency convergence
+1. This is great, Piotrek! BTW, can you clarify what you mean by 'project wide'? Is it the whole `flink` project or just `flink-connector-kafka`? I think it's useful to be applied to the whole flink project. I've seen dependencies conflict problem like this in flink-connector-kinesis. Enabling this in flink would protect us from many hidden issues. Bowen On Wed, Oct 4, 2017 at 9:39 AM, Piotr Nowojski <pi...@data-artisans.com> wrote: > Hi, > > I have spent last couple of days trying to find and fix Kafka tests > instabilities on Travis and I think I have finally found the main reason: > dependency conflict on Netty. flakka was pulling in 3.8 and zookeeper 3.10. > Effect was very subtle, because rarely in some corner cases (but not > always) Netty was deadlocking itself… > > Because of that I would like to enable dependencyConvergence rule in > maven-enforcer-plugin project wide - it catches this error immediately: > > Dependency convergence error for io.netty:netty:3.10.5.Final paths to > dependency are: > +-org.apache.flink:flink-connector-kafka-0.9_2.11:1.4-SNAPSHOT > +-org.apache.kafka:kafka_2.11:0.9.0.1 > +-org.apache.zookeeper:zookeeper:3.4.10 > +-io.netty:netty:3.10.5.Final > and > +-org.apache.flink:flink-connector-kafka-0.9_2.11:1.4-SNAPSHOT > +-org.apache.flink:flink-runtime_2.11:1.4-SNAPSHOT > +-com.data-artisans:flakka-remote_2.11:2.3-custom > +-io.netty:netty:3.8.0.Final > > Currently this rule fails with multiple errors, but after those lost > couple of days I’m pretty determined to fix all of them “just in case”. > dependencyConvergence rule would protect us in the future against such > nasty subtle bugs. Does anyone have any objections/issues that I’m not > aware of? > > Piotrek
Dependency convergence
Hi, I have spent last couple of days trying to find and fix Kafka tests instabilities on Travis and I think I have finally found the main reason: dependency conflict on Netty. flakka was pulling in 3.8 and zookeeper 3.10. Effect was very subtle, because rarely in some corner cases (but not always) Netty was deadlocking itself… Because of that I would like to enable dependencyConvergence rule in maven-enforcer-plugin project wide - it catches this error immediately: Dependency convergence error for io.netty:netty:3.10.5.Final paths to dependency are: +-org.apache.flink:flink-connector-kafka-0.9_2.11:1.4-SNAPSHOT +-org.apache.kafka:kafka_2.11:0.9.0.1 +-org.apache.zookeeper:zookeeper:3.4.10 +-io.netty:netty:3.10.5.Final and +-org.apache.flink:flink-connector-kafka-0.9_2.11:1.4-SNAPSHOT +-org.apache.flink:flink-runtime_2.11:1.4-SNAPSHOT +-com.data-artisans:flakka-remote_2.11:2.3-custom +-io.netty:netty:3.8.0.Final Currently this rule fails with multiple errors, but after those lost couple of days I’m pretty determined to fix all of them “just in case”. dependencyConvergence rule would protect us in the future against such nasty subtle bugs. Does anyone have any objections/issues that I’m not aware of? Piotrek
[jira] [Created] (FLINK-4034) Dependency convergence on com.101tec:zkclient and com.esotericsoftware.kryo:kryo
Vladislav Pernin created FLINK-4034:
---
Summary: Dependency convergence on com.101tec:zkclient and
com.esotericsoftware.kryo:kryo
Key: FLINK-4034
URL: https://issues.apache.org/jira/browse/FLINK-4034
Project: Flink
Issue Type: Bug
Affects Versions: 1.0.3
Reporter: Vladislav Pernin
If dependency convergence is enabled and asserted on Maven, projects using
Flink do not compile.
Example :
{code}
Dependency convergence error for com.esotericsoftware.kryo:kryo:2.24.0 paths to
dependency are:
+-groupidXXX:artifactidXXX:versionXXX
+-org.apache.flink:flink-java:1.0.3
+-org.apache.flink:flink-core:1.0.3
+-com.esotericsoftware.kryo:kryo:2.24.0
and
+-groupidXXX:artifactidXXX:versionXXX
+-org.apache.flink:flink-streaming-java_2.11:1.0.3
+-org.apache.flink:flink-runtime_2.11:1.0.3
+-com.twitter:chill_2.11:0.7.4
+-com.twitter:chill-java:0.7.4
+-com.esotericsoftware.kryo:kryo:2.21
and
+-groupidXXX:artifactidXXX:versionXXX
+-org.apache.flink:flink-streaming-java_2.11:1.0.3
+-org.apache.flink:flink-runtime_2.11:1.0.3
+-com.twitter:chill_2.11:0.7.4
+-com.esotericsoftware.kryo:kryo:2.21
{code}
{code}
Dependency convergence error for com.101tec:zkclient:0.7 paths to dependency
are:
+-groupidXXX:artifactidXXX:versionXXX
+-org.apache.flink:flink-connector-kafka-0.8_2.11:1.0.3
+-org.apache.flink:flink-connector-kafka-base_2.11:1.0.3
+-com.101tec:zkclient:0.7
and
+-groupidXXX:artifactidXXX:versionXXX
+-org.apache.flink:flink-connector-kafka-0.8_2.11:1.0.3
+-org.apache.kafka:kafka_2.11:0.8.2.2
+-com.101tec:zkclient:0.3
{code}
I cannot emit a pull request without knowing on which specifics versions you
rely.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
