Kafka Server Error

2022-09-26 Thread Namita Jaokar
Hi All, While starting kafka server, the server starts successfully, But after a moment it stops giving the below error. [2022-09-27 09:44:46,765] WARN [SocketServer listenerType=ZK_BROKER, nodeId=0] Unexpected error from /0:0:0:0:0:0:0:1; closing connection (org.apache.kafka.common.network.Selec

Re: Out of order messages when kafka streams application catches up

2022-09-26 Thread John Roesler
Hi Tomasz, Thanks for asking. This sounds like the situation that we fixed in Apache Kafka 3.0, with KIP-695 (https://cwiki.apache.org/confluence/display/KAFKA/KIP-695%3A+Further+Improve+Kafka+Streams+Timestamp+Synchronization). Can you try upgrading and let us know if this fixes the problem?

Copy data from source cluster to target with different number of partitions

2022-09-26 Thread Mikhail Dubrovin
Hi, We have a cluster with topics that contain many partitions. We are going to decrease the number of partitions and looking for any solution. I t would be very useful to make it with MirrorMaker 2 but as we can see, it doesn't allow us to do it. MM2 creates missing partitions for a topic, e.g. s

Re: [VOTE] 3.3.0 RC2

2022-09-26 Thread David Arthur
Thanks for the votes, everyone! Here is the best recent run of the system tests on 3.3 http://confluent-kafka-system-test-results.s3-us-west-2.amazonaws.com/3.3/2022-09-24--001.system-test-kafka-3.3--1664037736--confluentinc--3.3--b084e9068c/report.html. I'm currently re-running the failed tests t

Mirror Maker: copy data from source cluster to target with different number of partitions

2022-09-26 Thread Mikhail Dubrovin
We have a cluster with topics that contain many partitions. We are going to decrease the number of partitions and looking for any solution. I t would be very useful to make it with MirrorMaker 2 but as we can see, it doesn't allow us to do it. MM2 creates missing partitions for a topic, e.g. source

Re: [VOTE] 3.3.0 RC2

2022-09-26 Thread Ismael Juma
+1 provided that the system test results are good. Can you please post them along with the JUnit test results (these seem ok although there are some flakes)? I tested the kraft quick start with the Scala 2.13 binary and ran the tests on the source release. I noticed a non-blocker issue with the KR

Re: [VOTE] 3.3.0 RC2

2022-09-26 Thread Jakub Scholz
+1 (non-binding). I used the staged binaries (Scala 2.13) and Maven artifacts and ran my tests. All seems to work fine. Thanks for running the release. Jakub On Wed, Sep 21, 2022 at 1:17 AM David Arthur wrote: > Hello Kafka users, developers and client-developers, > > This is the second release

Re: [VOTE] 3.3.0 RC2

2022-09-26 Thread Bill Bejeck
Hi Jose and David, Thanks for running the release! I did the following verification steps: I performed the following validations: 1. Verified all checksums and signatures. 2. Built from source and ran unit tests. 3. Ran the first quickstart steps 1. Zookeeper quick start

Re: [VOTE] 3.3.0 RC2

2022-09-26 Thread David Jacot
Thanks for running the release, José and David. I performed the following validations: * Verified all checksums and signatures. * Built from source and ran unit tests. * Ran the first quickstart steps for both ZK and KRaft. * Spotchecked the Javadocs. I have also noticed that the doc is malformed

Re: [VOTE] 3.3.0 RC2

2022-09-26 Thread John Roesler
Thanks for running this, David! I've verified the signatures, looked at the docs, and run the quickstart (ZK and KRaft). I also ran the unit tests, as well as all the tests for Streams locally. The docs look a little malformed (the "collapse/expand" button floats over the text, the collapsed d

Re: [kafka-clients] Re: [VOTE] 3.3.0 RC2

2022-09-26 Thread David Arthur
Happy Monday, everyone! I've uploaded the 3.3 docs to the website to make that part of the release validation easier https://kafka.apache.org/33/documentation.html These docs are not referenced by the top level docs page, so they can only be accessed directly via the "33" url above. I'd like to

in case of disk failure,why not recover from middle position of the log file

2022-09-26 Thread zhang meng
can we write the byte position of .log 、.index file to a position-checkpoint file, and recover from the position to rebuild the index files?