Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #579

2021-03-17 Thread Apache Jenkins Server
See

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #609

2021-03-17 Thread Apache Jenkins Server
See

Re: [ANNOUNCE] New Kafka PMC Member: Chia-Ping Tsai

2021-03-17 Thread Kowshik Prakasam
Congrats Chia-Ping! On Tue, Mar 16, 2021, 6:16 PM Dongjin Lee wrote: > > > Best, > Dongjin > > On Tue, Mar 16, 2021 at 2:20 PM Konstantine Karantasis > wrote: > > > Congratulations Chia-Ping! > > > > Konstantine > > > > On Mon, Mar 15, 2021 at 4:31 AM Rajini Sivaram > > wrote: > > > > >

Re: Inquiry about usage of Kafka Compression

2021-03-17 Thread Dongjin Lee
Hi Loren, This error occurs when your application fails to load the libzstd-jni library file from the temporary library. - zstd-jni v1.3.5-4 (included in Kafka 2.1.0): https://github.com/luben/zstd-jni/blob/v1.3.5-4/src/main/java/com/github/luben/zstd/util/Native.java#L101 -

[GitHub] [kafka-site] Alee4738 opened a new pull request #338: MINOR quickstart.html remove extra closing paren, fix syntax

2021-03-17 Thread GitBox
Alee4738 opened a new pull request #338: URL: https://github.com/apache/kafka-site/pull/338 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Created] (KAFKA-12494) Broker raise InternalError after disk sector medium error without marking dir to offline

2021-03-17 Thread iBlackeyes (Jira)
iBlackeyes created KAFKA-12494: -- Summary: Broker raise InternalError after disk sector medium error without marking dir to offline Key: KAFKA-12494 URL: https://issues.apache.org/jira/browse/KAFKA-12494

[jira] [Created] (KAFKA-12493) The controller should handle the consistency between the controllerContext and the partition replicas assignment on zookeeper

2021-03-17 Thread Wenbing Shen (Jira)
Wenbing Shen created KAFKA-12493: Summary: The controller should handle the consistency between the controllerContext and the partition replicas assignment on zookeeper Key: KAFKA-12493 URL:

[jira] [Resolved] (KAFKA-12459) Improve raft simulation tests

2021-03-17 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-12459. - Resolution: Fixed > Improve raft simulation tests > - > >

[jira] [Created] (KAFKA-12492) Formatting of example RocksDBConfigSetter is messed up

2021-03-17 Thread A. Sophie Blee-Goldman (Jira)
A. Sophie Blee-Goldman created KAFKA-12492: -- Summary: Formatting of example RocksDBConfigSetter is messed up Key: KAFKA-12492 URL: https://issues.apache.org/jira/browse/KAFKA-12492 Project:

RE: MirrorMaker 2.0 - Offset Sync - Questions/Improvements

2021-03-17 Thread Georg Friedrich
Hi Ryanne, thank you for your response. 1) Yes, right - I've missed the condition that is part of the PartitionState class. Thanks for pointing me. :) 2) Ok, how should I go on there? Shall I create a ticket or a KIP or even both? From my point of view this is not a major change, but for

[jira] [Created] (KAFKA-12491) RocksDB not being pulled in as a transitive dependency

2021-03-17 Thread A. Sophie Blee-Goldman (Jira)
A. Sophie Blee-Goldman created KAFKA-12491: -- Summary: RocksDB not being pulled in as a transitive dependency Key: KAFKA-12491 URL: https://issues.apache.org/jira/browse/KAFKA-12491 Project:

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #608

2021-03-17 Thread Apache Jenkins Server
See Changes: [github] MINOR: fix failing ZooKeeper system tests (#10297) -- [...truncated 7.38 MB...] KafkaZkClientTest > testUpdateBrokerInfo() STARTED

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #636

2021-03-17 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-12490) Forwarded requests should use timeout from request when possible

2021-03-17 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-12490: --- Summary: Forwarded requests should use timeout from request when possible Key: KAFKA-12490 URL: https://issues.apache.org/jira/browse/KAFKA-12490 Project:

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #578

2021-03-17 Thread Apache Jenkins Server
See Changes: [github] MINOR: fix client_compatibility_features_test.py (#10292) [github] MINOR: fix failing ZooKeeper system tests (#10297) -- [...truncated

Re: [VOTE] KIP-708: Rack awareness for Kafka Streams

2021-03-17 Thread Guozhang Wang
SGTM for going back to encoding the full names too --- flexibility wins here, and if users do hit limits on bytes, probably they'd consider giving some shorter names anyways :) Guozhang On Wed, Mar 17, 2021 at 11:25 AM Levani Kokhreidze wrote: > Hi Sophie, > > No worries! And thanks for taking

Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #67

2021-03-17 Thread Apache Jenkins Server
See Changes: [Colin McCabe] MINOR: fix client_compatibility_features_test.py (#10292) [Colin McCabe] MINOR: fix failing ZooKeeper system tests (#10297) --

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #607

2021-03-17 Thread Apache Jenkins Server
See Changes: [github] MINOR: fix client_compatibility_features_test.py (#10292) -- [...truncated 3.69 MB...] KafkaZkClientTest > testUpdateBrokerInfo()

Re: [VOTE] KIP-708: Rack awareness for Kafka Streams

2021-03-17 Thread Levani Kokhreidze
Hi Sophie, No worries! And thanks for taking a look. I’ve updated the KIP. Will wait some time for any additional feedback that might arise. Best, Levani > On 17. Mar 2021, at 19:11, Sophie Blee-Goldman > wrote: > > Ah, sorry for hijacking the VOTE thread :( > > Limiting the tag length and

Re: [VOTE] KIP-708: Rack awareness for Kafka Streams

2021-03-17 Thread Sophie Blee-Goldman
Ah, sorry for hijacking the VOTE thread :( Limiting the tag length and total amount of tags specified are already part > of the implementation I work on. Assuming that encoding a limited number of strings is acceptable, I think it's the most > straightforward way to move forward. Any objections?

[DISCUSS] KIP-723: Add socket.tcp.no.delay property to Kafka Config

2021-03-17 Thread Andrei Iatsuk
Hello everyone, I would like to start a discussion on KIP-723, which propose adding a Kafka Config property with TCP_NODELAY socket option flag, that currently hardcoded in true. https://cwiki.apache.org/confluence/display/KAFKA/KIP-723%3A+Add+socket.tcp.no.delay+property+to+Kafka+Config

Inquiry about usage of Kafka Compression

2021-03-17 Thread Loren Abigail Sion
Good day, We're currently in the process of implementing our application with kafka compression type ZStandard (zstd). However during the testing process the consumer encountered this error: [ERROR] (consumer-1) org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer

Re: [VOTE] KIP-708: Rack awareness for Kafka Streams

2021-03-17 Thread Levani Kokhreidze
Hi Sophie and Bruno, Thanks for the questions and suggestions. Not sure if it's best to discuss this in the DISCUSSION thread, but I will write it here first, and if it needs more discussion, we can move to the DISCUSSION thread. Actually, in the implementation, I have a version field in the

Re: Kafka logos and branding

2021-03-17 Thread Jun Rao
Hi, Justin, Thanks for the suggestions. Will follow up. Jun On Tue, Mar 16, 2021 at 5:49 PM Justin Mclean wrote: > Hi, > > As I mentioned on the dev list I can see the logos for the Kafka project > are out of date. [1] Just a suggestion - which you are free to ignore. From > a branding and

Re: [ANNOUNCE] New committer: Tom Bentley

2021-03-17 Thread Chia-Ping Tsai
Congratulations!!! On 2021/03/15 17:59:56, Mickael Maison wrote: > Hi all, > > The PMC for Apache Kafka has invited Tom Bentley as a committer, and > we are excited to announce that he accepted! > > Tom first contributed to Apache Kafka in June 2017 and has been > actively contributing since

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #606

2021-03-17 Thread Apache Jenkins Server
See Changes: [github] MINOR: remove some specifying types in tool command (#10329) [github] MINOR: Remove redundant allows in import-control.xml (#10339)

Re: [VOTE] KIP-717: Deprecate batch-size config from console producer

2021-03-17 Thread Manikumar
Hi Kamal, It looks like we just forgot this config, when we removed old producer code. I think we dont require KIP for this. we can directly fix with a minor PR . Thanks. On Wed, Mar 17, 2021 at 7:02 PM Dongjin Lee wrote: > +1. (non-binding) > > Thanks, > Dongjin > > On Thu, Mar 11, 2021 at

Re: [VOTE] KIP-717: Deprecate batch-size config from console producer

2021-03-17 Thread Dongjin Lee
+1. (non-binding) Thanks, Dongjin On Thu, Mar 11, 2021 at 5:52 PM Manikumar wrote: > +1 (binding). Thanks for the KIP > I think we can remove the config option as the config option is unused. > > On Wed, Mar 10, 2021 at 3:06 PM Kamal Chandraprakash < > kamal.chandraprak...@gmail.com> wrote: >

Re: [DISCUSS] KIP-720: Deprecate MirrorMaker v1

2021-03-17 Thread Dongjin Lee
+1. Thanks for the proposal. Best, Dongjin On Wed, Mar 17, 2021 at 9:59 PM Ryanne Dolan wrote: > Ben, the documentation was recently updated to include a new georeplication > section which covers MM2. Actually, I think MM1 is no longer mentioned > anywhere, and the documentation refers to MM2

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #635

2021-03-17 Thread Apache Jenkins Server
See Changes: [github] MINOR: remove some specifying types in tool command (#10329) [github] MINOR: Remove redundant allows in import-control.xml (#10339)

Re: [DISCUSS] KIP-720: Deprecate MirrorMaker v1

2021-03-17 Thread Ryanne Dolan
Ben, the documentation was recently updated to include a new georeplication section which covers MM2. Actually, I think MM1 is no longer mentioned anywhere, and the documentation refers to MM2 as just Mirror Maker now. Ryanne On Wed, Mar 17, 2021, 6:08 AM Ben Stopford wrote: > What about the

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #577

2021-03-17 Thread Apache Jenkins Server
See Changes: [github] MINOR: remove some specifying types in tool command (#10329) [github] MINOR: Remove redundant allows in import-control.xml (#10339) --

Re: Why are Javadocs published on downloads.apache.org?

2021-03-17 Thread sebb
On Wed, 17 Mar 2021 at 11:56, Tom Bentley wrote: > > Hi Sebb, > > I think this has been addressed for future releases by > https://github.com/apache/kafka/pull/10203. Thanks for the info. I hope that fixes it. > AFAIU removing the Javadocs for > previous releases would need to be done by

Re: Why are Javadocs published on downloads.apache.org?

2021-03-17 Thread Tom Bentley
Hi Sebb, I think this has been addressed for future releases by https://github.com/apache/kafka/pull/10203. AFAIU removing the Javadocs for previous releases would need to be done by someone on the PMC. Kind regards, Tom On Wed, Mar 17, 2021 at 11:47 AM sebb wrote: > PING? > > On Sat, 13 Mar

Re: Why are Javadocs published on downloads.apache.org?

2021-03-17 Thread sebb
PING? On Sat, 13 Mar 2021 at 15:40, sebb wrote: > > Is anyone there? > > On Sat, 6 Mar 2021 at 11:33, sebb wrote: > > > > As the subject says: AFAICT the Kafka project is the only project > > which publishes Javadocs as individual files on downloads.a.o. > > > > What is the use case for this? >

Re: request permission to create KIP

2021-03-17 Thread Andrei Iatsuk
Thanks, Manikumar! > On 17 Mar 2021, at 14:00, Manikumar wrote: > > Hi, > > I have given you the wiki permissions to create KIP. Thanks for your > interest in the Kafka Project. > > Thanks, > > On Wed, Mar 17, 2021 at 6:40 AM Andrei Iatsuk wrote: > >> Hello! >> >> I create improvement

[jira] [Created] (KAFKA-12489) Flaky test ControllerIntegrationTest.testPartitionReassignmentToBrokerWithOfflineLogDir

2021-03-17 Thread dengziming (Jira)
dengziming created KAFKA-12489: -- Summary: Flaky test ControllerIntegrationTest.testPartitionReassignmentToBrokerWithOfflineLogDir Key: KAFKA-12489 URL: https://issues.apache.org/jira/browse/KAFKA-12489

Re: [DISCUSS] KIP-720: Deprecate MirrorMaker v1

2021-03-17 Thread Ben Stopford
What about the documentation? Currently, there doesn't seem to be much documentation around Mirror Maker 2. Is there a plan to address that? On Wed, 17 Mar 2021 at 10:56, Manikumar wrote: > +1. Thanks for the KIP. > > > On Sun, Mar 14, 2021 at 12:24 PM Ryanne Dolan > wrote: > > > Hey y'all,

Re: request permission to create KIP

2021-03-17 Thread Manikumar
Hi, I have given you the wiki permissions to create KIP. Thanks for your interest in the Kafka Project. Thanks, On Wed, Mar 17, 2021 at 6:40 AM Andrei Iatsuk wrote: > Hello! > > I create improvement task > https://issues.apache.org/jira/browse/KAFKA-12481 < >

Re: [DISCUSS] KIP-720: Deprecate MirrorMaker v1

2021-03-17 Thread Manikumar
+1. Thanks for the KIP. On Sun, Mar 14, 2021 at 12:24 PM Ryanne Dolan wrote: > Hey y'all, I'd like to start the discussion on KIP-720, which proposes to > deprecate the original MirrorMaker in the upcoming 3.0 major release. > > >

Re: [ANNOUNCE] New committer: Tom Bentley

2021-03-17 Thread Tom Bentley
Thanks folks! On Wed, Mar 17, 2021 at 1:21 AM Dongjin Lee wrote: > Congratulations, Tom! Your contributions are always great!! > > +1. Thanks for supporting KIP-653: Upgrade log4j to log4j2 again. > > Best, > Dongjin > > On Tue, Mar 16, 2021 at 8:24 PM Rajini Sivaram > wrote: > > >