This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch dependabot/maven/org.xerial.snappy-snappy-java-1.1.10.1 in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git
discard d9ce95c1 Bump snappy-java from 1.1.8.3 to 1.1.10.1 add 910fc5a3 [FLINK-31747] Remove Confluent Avro formats from externalized Kafka connector repo add c1e35275 [FLINK-32462] Pin the used shaded version of Guava and Jackson in the Kafka connector add ad62c133 [FLINK-32019][Connector/Kafka] EARLIEST offset strategy for partitions discoveried later based on FLIP-288 add 14d8462b [FLINK-32021][kafka] Improve the java docs of SpecifiedOffsetsInitializer and TimestampOffsetsInitializer add 97dbfcad [FLINK-32455] Copy over TypeSerializerUpgradeTestBase due to breaking change in Flink 1.18 add 21d3b10e [FLINK-32453] Ambiguous assertThat call after upgrade to Flink 1.18 add 9109722c [FLINK-31408] Add support for EOS delivery-guarantee in upsert-kafka add 811716c5 [FLINK-32020] Enable Dynamic Partition Discovery by Default in Kafka Source based on FLIP-288 add 79ae2d70 [FLINK-32591][Connectors/Kafka] Update document of Kafka Source: Enable Dynamic Partition Discovery by Default in Kafka Source add d6525c14 [FLINK-31208][Connectors/Kafka] KafkaSourceReader overrides meaninglessly a method(pauseOrResumeSplits) add 818d1fde [FLINK-33017] Remove dependency on shaded guava add 27a54655 [FLINK-28758] Fix stop-with-savepoint for FlinkKafkaConsumer add 4c03d60e [hotfix][docs] Optimize the Security part in docs add d89a0821 [FLINK-29398] Provide rack ID to KafkaSource to take advantage of Rack Awareness add b09928d5 [FLINK-33219][connector/kafka] Add new archunit violation messages introduced by FLINK-31804. This closes #56 add 8b745073 [FLINK-33149][Connector/Kafka] Bump snappy-java from 1.1.8.3 to 1.1.10.5 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (d9ce95c1) \ N -- N -- N refs/heads/dependabot/maven/org.xerial.snappy-snappy-java-1.1.10.1 (8b745073) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .github/workflows/push_pr.yml | 5 +- .idea/vcs.xml | 1 + .../content.zh/docs/connectors/datastream/kafka.md | 4 +- .../connectors/table/formats/avro-confluent.md | 294 ---------- .../docs/connectors/table/formats/debezium.md | 455 --------------- docs/content.zh/docs/connectors/table/kafka.md | 20 +- docs/content/docs/connectors/datastream/kafka.md | 24 +- .../connectors/table/formats/avro-confluent.md | 301 ---------- .../docs/connectors/table/formats/debezium.md | 454 --------------- docs/content/docs/connectors/table/kafka.md | 17 +- docs/content/docs/connectors/table/upsert-kafka.md | 29 + flink-confluent-schema-registry-e2e-tests/pom.xml | 135 ----- .../registry/test/TestAvroConsumerConfluent.java | 112 ---- .../src/main/resources/avro/user.avsc | 27 - .../flink-end-to-end-tests-common-kafka/pom.xml | 4 +- .../flink/tests/util/kafka/SmokeKafkaITCase.java | 5 +- .../86dfd459-67a9-4b26-9b5c-0b0bbf22681a | 78 +++ flink-connector-kafka/pom.xml | 2 +- .../flink/connector/kafka/sink/KafkaSink.java | 5 +- .../flink/connector/kafka/sink/KafkaWriter.java | 37 +- .../kafka/sink/TwoPhaseCommittingStatefulSink.java | 34 ++ .../flink/connector/kafka/source/KafkaSource.java | 19 +- .../connector/kafka/source/KafkaSourceBuilder.java | 19 +- .../connector/kafka/source/KafkaSourceOptions.java | 6 +- ...aSourceEnumState.java => AssignmentStatus.java} | 33 +- .../source/enumerator/KafkaSourceEnumState.java | 62 +- .../enumerator/KafkaSourceEnumStateSerializer.java | 133 +++-- .../source/enumerator/KafkaSourceEnumerator.java | 47 +- ...java => TopicPartitionAndAssignmentStatus.java} | 23 +- .../initializer/SpecifiedOffsetsInitializer.java | 5 + .../initializer/TimestampOffsetsInitializer.java | 2 + .../source/reader/KafkaPartitionSplitReader.java | 23 + .../kafka/source/reader/KafkaSourceReader.java | 7 - .../connectors/kafka/FlinkKafkaProducer.java | 13 +- .../internals/FlinkKafkaInternalProducer.java | 8 +- .../connectors/kafka/internals/KafkaFetcher.java | 7 + .../kafka/table/KafkaConnectorOptions.java | 6 +- .../connectors/kafka/table/KafkaDynamicSink.java | 2 +- .../kafka/table/KafkaDynamicTableFactory.java | 6 +- .../connectors/kafka/table/ReducingUpsertSink.java | 47 +- .../kafka/table/ReducingUpsertWriter.java | 21 +- .../table/UpsertKafkaDynamicTableFactory.java | 14 +- .../sink/FlinkKafkaInternalProducerITCase.java | 5 +- .../KafkaRecordSerializationSchemaBuilderTest.java | 17 +- .../connector/kafka/sink/KafkaSinkITCase.java | 9 +- .../connector/kafka/sink/KafkaWriterITCase.java | 7 +- .../kafka/sink/TransactionToAbortCheckerTest.java | 46 +- .../source/enumerator/KafkaEnumeratorTest.java | 164 +++++- .../KafkaSourceEnumStateSerializerTest.java | 42 +- .../reader/KafkaPartitionSplitReaderTest.java | 43 +- .../kafka/source/reader/KafkaSourceReaderTest.java | 54 +- .../KafkaRecordDeserializationSchemaTest.java | 6 +- .../connectors/kafka/FlinkKafkaConsumerITCase.java | 129 +++++ .../kafka/FlinkKafkaInternalProducerITCase.java | 7 +- .../connectors/kafka/KafkaConsumerTestBase.java | 13 +- .../kafka/KafkaSerializerUpgradeTest.java | 2 +- .../kafka/shuffle/KafkaShuffleITCase.java | 26 +- .../kafka/table/KafkaDynamicTableFactoryTest.java | 82 ++- .../kafka/table/ReducingUpsertWriterTest.java | 23 +- .../table/UpsertKafkaDynamicTableFactoryTest.java | 58 +- .../testutils/TypeSerializerUpgradeTestBase.java | 603 +++++++++++++++++++ .../serializer-snapshot | Bin .../test-data | Bin .../serializer-snapshot | Bin .../test-data | Bin .../1483f895-db24-4888-a2fa-991d602eaafc | 0 .../bfcdf96e-7dcd-4715-9f39-73483823ec16 | 0 .../archunit-violations/stored.rules | 4 - .../flink-avro-confluent-registry/pom.xml | 204 ------- .../confluent/AvroConfluentFormatOptions.java | 131 ----- .../confluent/CachedSchemaCoderProvider.java | 84 --- ...ConfluentRegistryAvroDeserializationSchema.java | 205 ------- .../ConfluentRegistryAvroSerializationSchema.java | 143 ----- .../confluent/ConfluentSchemaRegistryCoder.java | 93 --- .../confluent/RegistryAvroFormatFactory.java | 264 --------- .../DebeziumAvroDeserializationSchema.java | 207 ------- .../debezium/DebeziumAvroFormatFactory.java | 198 ------- .../debezium/DebeziumAvroSerializationSchema.java | 151 ----- .../org.apache.flink.table.factories.Factory | 17 - .../architecture/TestCodeArchitectureTest.java | 40 -- .../confluent/CachedSchemaCoderProviderTest.java | 143 ----- .../ConfluentSchemaRegistryCoderTest.java | 77 --- .../confluent/RegistryAvroFormatFactoryTest.java | 294 ---------- .../RegistryAvroRowDataSeDeSchemaTest.java | 194 ------- .../debezium/DebeziumAvroFormatFactoryTest.java | 249 -------- .../debezium/DebeziumAvroSerDeSchemaTest.java | 242 -------- .../org.junit.jupiter.api.extension.Extension | 16 - .../src/test/resources/archunit.properties | 31 - .../src/test/resources/debezium-avro-delete.avro | Bin 147 -> 0 bytes .../src/test/resources/debezium-avro-insert.avro | Bin 143 -> 0 bytes .../src/test/resources/debezium-avro-update.avro | Bin 188 -> 0 bytes .../src/test/resources/debezium-test-schema.json | 191 ------ .../src/test/resources/test-keystore.jks | Bin 2327 -> 0 bytes .../flink-sql-avro-confluent-registry/pom.xml | 120 ---- .../src/main/resources/META-INF/NOTICE | 32 -- .../licenses/LICENSE.jakarta-annotation-api | 637 --------------------- .../META-INF/licenses/LICENSE.jakarta-inject | 637 --------------------- .../META-INF/licenses/LICENSE.jakarta-ws-rs-api | 637 --------------------- .../licenses/LICENSE.osgi-resource-locator | 637 --------------------- .../resources/META-INF/licenses/LICENSE.zstd-jni | 26 - flink-formats-kafka/pom.xml | 41 -- pom.xml | 9 +- 102 files changed, 1804 insertions(+), 8032 deletions(-) delete mode 100644 docs/content.zh/docs/connectors/table/formats/avro-confluent.md delete mode 100644 docs/content.zh/docs/connectors/table/formats/debezium.md delete mode 100644 docs/content/docs/connectors/table/formats/avro-confluent.md delete mode 100644 docs/content/docs/connectors/table/formats/debezium.md delete mode 100644 flink-confluent-schema-registry-e2e-tests/pom.xml delete mode 100644 flink-confluent-schema-registry-e2e-tests/src/main/java/org/apache/flink/schema/registry/test/TestAvroConsumerConfluent.java delete mode 100644 flink-confluent-schema-registry-e2e-tests/src/main/resources/avro/user.avsc create mode 100644 flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/sink/TwoPhaseCommittingStatefulSink.java copy flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/source/enumerator/{KafkaSourceEnumState.java => AssignmentStatus.java} (54%) copy flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/source/enumerator/{KafkaSourceEnumState.java => TopicPartitionAndAssignmentStatus.java} (63%) create mode 100644 flink-connector-kafka/src/test/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumerITCase.java create mode 100644 flink-connector-kafka/src/test/java/org/apache/flink/streaming/connectors/kafka/testutils/TypeSerializerUpgradeTestBase.java copy flink-connector-kafka/src/test/resources/{context-state-serializer-1.11 => context-state-serializer-1.17}/serializer-snapshot (100%) copy flink-connector-kafka/src/test/resources/{context-state-serializer-1.11 => context-state-serializer-1.17}/test-data (100%) copy flink-connector-kafka/src/test/resources/{transaction-state-serializer-1.11 => transaction-state-serializer-1.17}/serializer-snapshot (100%) copy flink-connector-kafka/src/test/resources/{transaction-state-serializer-1.11 => transaction-state-serializer-1.17}/test-data (100%) delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/archunit-violations/1483f895-db24-4888-a2fa-991d602eaafc delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/archunit-violations/bfcdf96e-7dcd-4715-9f39-73483823ec16 delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/archunit-violations/stored.rules delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/pom.xml delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/main/java/org/apache/flink/formats/avro/registry/confluent/AvroConfluentFormatOptions.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/main/java/org/apache/flink/formats/avro/registry/confluent/CachedSchemaCoderProvider.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/main/java/org/apache/flink/formats/avro/registry/confluent/ConfluentRegistryAvroDeserializationSchema.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/main/java/org/apache/flink/formats/avro/registry/confluent/ConfluentRegistryAvroSerializationSchema.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/main/java/org/apache/flink/formats/avro/registry/confluent/ConfluentSchemaRegistryCoder.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/main/java/org/apache/flink/formats/avro/registry/confluent/RegistryAvroFormatFactory.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/main/java/org/apache/flink/formats/avro/registry/confluent/debezium/DebeziumAvroDeserializationSchema.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/main/java/org/apache/flink/formats/avro/registry/confluent/debezium/DebeziumAvroFormatFactory.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/main/java/org/apache/flink/formats/avro/registry/confluent/debezium/DebeziumAvroSerializationSchema.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/main/resources/META-INF/services/org.apache.flink.table.factories.Factory delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/test/java/org/apache/flink/architecture/TestCodeArchitectureTest.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/test/java/org/apache/flink/formats/avro/registry/confluent/CachedSchemaCoderProviderTest.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/test/java/org/apache/flink/formats/avro/registry/confluent/ConfluentSchemaRegistryCoderTest.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/test/java/org/apache/flink/formats/avro/registry/confluent/RegistryAvroFormatFactoryTest.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/test/java/org/apache/flink/formats/avro/registry/confluent/RegistryAvroRowDataSeDeSchemaTest.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/test/java/org/apache/flink/formats/avro/registry/confluent/debezium/DebeziumAvroFormatFactoryTest.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/test/java/org/apache/flink/formats/avro/registry/confluent/debezium/DebeziumAvroSerDeSchemaTest.java delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/test/resources/META-INF/services/org.junit.jupiter.api.extension.Extension delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/test/resources/archunit.properties delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/test/resources/debezium-avro-delete.avro delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/test/resources/debezium-avro-insert.avro delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/test/resources/debezium-avro-update.avro delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/test/resources/debezium-test-schema.json delete mode 100644 flink-formats-kafka/flink-avro-confluent-registry/src/test/resources/test-keystore.jks delete mode 100644 flink-formats-kafka/flink-sql-avro-confluent-registry/pom.xml delete mode 100644 flink-formats-kafka/flink-sql-avro-confluent-registry/src/main/resources/META-INF/NOTICE delete mode 100644 flink-formats-kafka/flink-sql-avro-confluent-registry/src/main/resources/META-INF/licenses/LICENSE.jakarta-annotation-api delete mode 100644 flink-formats-kafka/flink-sql-avro-confluent-registry/src/main/resources/META-INF/licenses/LICENSE.jakarta-inject delete mode 100644 flink-formats-kafka/flink-sql-avro-confluent-registry/src/main/resources/META-INF/licenses/LICENSE.jakarta-ws-rs-api delete mode 100644 flink-formats-kafka/flink-sql-avro-confluent-registry/src/main/resources/META-INF/licenses/LICENSE.osgi-resource-locator delete mode 100644 flink-formats-kafka/flink-sql-avro-confluent-registry/src/main/resources/META-INF/licenses/LICENSE.zstd-jni delete mode 100644 flink-formats-kafka/pom.xml