[jira] [Created] (KAFKA-13301) The relationship between request.timeout. ms and max.poll.interval.ms in the Consumer Configs is incorrect.

[yangshengwei (Jira)]

yangshengwei created KAFKA-13301:


 Summary: The relationship between request.timeout. ms and 
max.poll.interval.ms in the Consumer Configs is incorrect.
 Key: KAFKA-13301
 URL: https://issues.apache.org/jira/browse/KAFKA-13301
 Project: Kafka
  Issue Type: Improvement
Reporter: yangshengwei


in Consumer Configs,The value of the configuration max.poll.interval.ms always 
be larger than request.timeout.ms must . But here's what the official document 
says:  The value of the configuration request.timeout.ms must always be larger 
than max.poll.interval.ms.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: [VOTE] 3.0.0 RC2

[Konstantine Karantasis]

I'm also +1 (binding) given that:

* I ran the release and generated RC2.
* Verified all checksums and signatures.
* Built and installed 3.0.0 RC2 from the source archive and the git tag.
* Spotchecked the Javadocs of RC2.
* Went through the documentation of 3.0.0 after RC2.

I confirm the minor differences in the documentation mentioned by Bill and
Randall and I agree that these can be addressed directly to the docs repo
and added to the source code as a follow-up in the 3.0 branch without
requiring a new RC. I'll do that while promoting RC2 as the official 3.0.0
release.

Konstantine

On Wed, Sep 15, 2021 at 12:34 AM Israel Ekpo  wrote:

> Hi Konstantine,
>
> Thanks for running the release
>
> I ran the following checks:
>
>- PGP Signatures used to sign the release artifacts
>- Validation of Release Artifacts Cryptographic Hashes (ASC MD5 SHA1
>SHA512)
>- Validation of Kafka Source and Tests
>- Validation of Kafka Site Documentation
>- Manual Check of Javadocs
>- Validation of Cluster Setup for KRaft and Legacy Modes
>
> *+1 from me (non-binding)*
>
> To encourage other community members to participate in the release
> candidate validations and voting, I have set up the following resource as
> part of the work for KAFKA-9861
>
> It is a set of scripts and Docker images that allows community members to
> run local validations in a consistent manner.
>
> https://github.com/izzyacademy/apache-kafka-release-party
>
> Please take a look at the resource and share any feedback that you may
> have.
>
> I plan to create a video tutorial that walks community members through how
> it can be used soon. Stay tuned
>
>
>
>
> On Wed, Sep 8, 2021 at 5:59 PM Konstantine Karantasis <
> kkaranta...@apache.org> wrote:
>
> > Hello again Kafka users, developers and client-developers,
> >
> > This is the third candidate for release of Apache Kafka 3.0.0.
> > It is a major release that includes many new features, including:
> >
> > * The deprecation of support for Java 8 and Scala 2.12.
> > * Kafka Raft support for snapshots of the metadata topic and other
> > improvements in the self-managed quorum.
> > * Deprecation of message formats v0 and v1.
> > * Stronger delivery guarantees for the Kafka producer enabled by default.
> > * Optimizations in OffsetFetch and FindCoordinator requests.
> > * More flexible Mirror Maker 2 configuration and deprecation of Mirror
> > Maker 1.
> > * Ability to restart a connector's tasks on a single call in Kafka
> Connect.
> > * Connector log contexts and connector client overrides are now enabled
> by
> > default.
> > * Enhanced semantics for timestamp synchronization in Kafka Streams.
> > * Revamped public API for Stream's TaskId.
> > * Default serde becomes null in Kafka Streams and several other
> > configuration changes.
> >
> > You may read and review a more detailed list of changes in the 3.0.0 blog
> > post draft here:
> >
> https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache6
> >
> > Release notes for the 3.0.0 release:
> > https://home.apache.org/~kkarantasis/kafka-3.0.0-rc2/RELEASE_NOTES.html
> >
> > *** Please download, test and vote by Tuesday, September 14, 2021 ***
> >
> > Kafka's KEYS file containing PGP keys we use to sign the release:
> > https://kafka.apache.org/KEYS
> >
> > * Release artifacts to be voted upon (source and binary):
> > https://home.apache.org/~kkarantasis/kafka-3.0.0-rc2/
> >
> > * Maven artifacts to be voted upon:
> > https://repository.apache.org/content/groups/staging/org/apache/kafka/
> >
> > * Javadoc:
> > https://home.apache.org/~kkarantasis/kafka-3.0.0-rc2/javadoc/
> >
> > * Tag to be voted upon (off 3.0 branch) is the 3.0.0 tag:
> > https://github.com/apache/kafka/releases/tag/3.0.0-rc2
> >
> > * Documentation:
> > https://kafka.apache.org/30/documentation.html
> >
> > * Protocol:
> > https://kafka.apache.org/30/protocol.html
> >
> > * Successful Jenkins builds for the 3.0 branch:
> > Unit/integration tests:
> >
> >
> https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka/detail/3.0/129/
> > (1 flaky test failure)
> > System tests:
> > https://jenkins.confluent.io/job/system-test-kafka/job/3.0/67/
> > (1 flaky test failure)
> >
> > /**
> >
> > Thanks,
> > Konstantine
> >
>

[RESULTS] [VOTE] Release Kafka version 3.0.0

[Konstantine Karantasis]

This vote passes with 6 +1 votes (out of which 4 binding votes) and no 0 or
-1 votes.

+1 votes
PMC Members:
* Bill Bejeck
* Colin McCabe
* Randall Hauch
* Konstantine Karantasis

Committers:
* No votes from additional committers

Community:
* Israel Ekpo
* Igor Soarez

0 votes
* No votes

-1 votes
* No votes

Vote thread:

https://lists.apache.org/thread.html/r57230f64abc755b8c0725a78fd479cb6624bdf6771e6df9850e27bdb%40%3Cdev.kafka.apache.org%3E
or
https://www.mail-archive.com/dev@kafka.apache.org/msg120900.html

I will continue with the release process and the release announcement will
follow in the next few days.

Thanks everyone for your vote and confirmation of this release candidate.

Sincerely,
Konstantine Karantasis


On Wed, Sep 15, 2021 at 12:28 PM Konstantine Karantasis <
k.karanta...@gmail.com> wrote:

>
> I'm also +1 (binding) given that:
>
> * I ran the release and generated RC2.
> * Verified all checksums and signatures.
> * Built and installed 3.0.0 RC2 from the source archive and the git tag.
> * Spotchecked the Javadocs of RC2.
> * Went through the documentation of 3.0.0 after RC2.
>
> I confirm the minor differences in the documentation mentioned by Bill and
> Randall and I agree that these can be addressed directly to the docs repo
> and added to the source code as a follow-up in the 3.0 branch without
> requiring a new RC. I'll do that while promoting RC2 as the official 3.0.0
> release.
>
> Konstantine
>
> On Wed, Sep 15, 2021 at 12:34 AM Israel Ekpo  wrote:
>
>> Hi Konstantine,
>>
>> Thanks for running the release
>>
>> I ran the following checks:
>>
>>- PGP Signatures used to sign the release artifacts
>>- Validation of Release Artifacts Cryptographic Hashes (ASC MD5 SHA1
>>SHA512)
>>- Validation of Kafka Source and Tests
>>- Validation of Kafka Site Documentation
>>- Manual Check of Javadocs
>>- Validation of Cluster Setup for KRaft and Legacy Modes
>>
>> *+1 from me (non-binding)*
>>
>> To encourage other community members to participate in the release
>> candidate validations and voting, I have set up the following resource as
>> part of the work for KAFKA-9861
>>
>> It is a set of scripts and Docker images that allows community members to
>> run local validations in a consistent manner.
>>
>> https://github.com/izzyacademy/apache-kafka-release-party
>>
>> Please take a look at the resource and share any feedback that you may
>> have.
>>
>> I plan to create a video tutorial that walks community members through how
>> it can be used soon. Stay tuned
>>
>>
>>
>>
>> On Wed, Sep 8, 2021 at 5:59 PM Konstantine Karantasis <
>> kkaranta...@apache.org> wrote:
>>
>> > Hello again Kafka users, developers and client-developers,
>> >
>> > This is the third candidate for release of Apache Kafka 3.0.0.
>> > It is a major release that includes many new features, including:
>> >
>> > * The deprecation of support for Java 8 and Scala 2.12.
>> > * Kafka Raft support for snapshots of the metadata topic and other
>> > improvements in the self-managed quorum.
>> > * Deprecation of message formats v0 and v1.
>> > * Stronger delivery guarantees for the Kafka producer enabled by
>> default.
>> > * Optimizations in OffsetFetch and FindCoordinator requests.
>> > * More flexible Mirror Maker 2 configuration and deprecation of Mirror
>> > Maker 1.
>> > * Ability to restart a connector's tasks on a single call in Kafka
>> Connect.
>> > * Connector log contexts and connector client overrides are now enabled
>> by
>> > default.
>> > * Enhanced semantics for timestamp synchronization in Kafka Streams.
>> > * Revamped public API for Stream's TaskId.
>> > * Default serde becomes null in Kafka Streams and several other
>> > configuration changes.
>> >
>> > You may read and review a more detailed list of changes in the 3.0.0
>> blog
>> > post draft here:
>> >
>> https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache6
>> >
>> > Release notes for the 3.0.0 release:
>> > https://home.apache.org/~kkarantasis/kafka-3.0.0-rc2/RELEASE_NOTES.html
>> >
>> > *** Please download, test and vote by Tuesday, September 14, 2021 ***
>> >
>> > Kafka's KEYS file containing PGP keys we use to sign the release:
>> > https://kafka.apache.org/KEYS
>> >
>> > * Release artifacts to be voted upon (source and binary):
>> > https://home.apache.org/~kkarantasis/kafka-3.0.0-rc2/
>> >
>> > * Maven artifacts to be voted upon:
>> > https://repository.apache.org/content/groups/staging/org/apache/kafka/
>> >
>> > * Javadoc:
>> > https://home.apache.org/~kkarantasis/kafka-3.0.0-rc2/javadoc/
>> >
>> > * Tag to be voted upon (off 3.0 branch) is the 3.0.0 tag:
>> > https://github.com/apache/kafka/releases/tag/3.0.0-rc2
>> >
>> > * Documentation:
>> > https://kafka.apache.org/30/documentation.html
>> >
>> > * Protocol:
>> > https://kafka.apache.org/30/protocol.html
>> >
>> > * Successful Jenkins builds for the 3.0 branch:
>> > Unit/integration tests:
>> >
>> >
>> https://ci-builds.apache.org/blue/organizatio

[jira] [Created] (KAFKA-13302) [IEP-59] Support not default page size

[Nikolay Izhikov (Jira)]

Nikolay Izhikov created KAFKA-13302:
---

 Summary: [IEP-59] Support not default page size
 Key: KAFKA-13302
 URL: https://issues.apache.org/jira/browse/KAFKA-13302
 Project: Kafka
  Issue Type: Improvement
Reporter: Nikolay Izhikov


Currently, CDC doesn't support not default page size.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (KAFKA-13303) RoundRobinPartitioner broken by KIP-480

[Jon McEwen (Jira)]

Jon McEwen created KAFKA-13303:
--

 Summary: RoundRobinPartitioner broken by KIP-480
 Key: KAFKA-13303
 URL: https://issues.apache.org/jira/browse/KAFKA-13303
 Project: Kafka
  Issue Type: Bug
Reporter: Jon McEwen


Since KIP-480 Sticky Partitioning, the RoundRobinPartitioner doesn't behave 
correctly.  An additional call to `partition()` on new batch leads to 
partitions being skipped.

 

I have a fix that I would like to contribute, but I need help getting started 
as a contributor, e.g. for basic things like formatting the code.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: [DISCUSS] KIP-774: Deprecate public access to Admin client's *Result constructors

[Tom Bentley]

Hi,

I've noticed that ElectLeadersResult is also the only result class to be
declared final, which means that mocking frameworks like Mockito cannot
mock it. So I'd like to also propose to remove that modifier at the same
time as deprecating the public use of the constructors. I've updated the
KIP to mention this.

Since there haven't been any other comments I'll start a vote soon.

Kind regards,

Tom

On Thu, Sep 9, 2021 at 5:01 PM Josep Prat 
wrote:

> Hi Tom,
>
> Thanks for your elaborate explanation. I agree with you, it doesn't seem
> like the best option right now. Thanks for updating the KIP with this
> rejected alternative.
>
> Best,
> ———
> Josep Prat
>
> Aiven Deutschland GmbH
>
> Immanuelkirchstraße 26, 10405 Berlin
>
> Amtsgericht Charlottenburg, HRB 209739 B
>
> Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
>
> m: +491715557497
>
> w: aiven.io
>
> e: josep.p...@aiven.io
>
> On Thu, Sep 9, 2021, 17:37 Tom Bentley  wrote:
>
> > Hi Josep,
> >
> > Thanks for the question! I did consider it briefly:
> >
> > * As you mention, it would also be quite a lot more code (interfaces +
> > impls) for relatively small protection.
> > * It wouldn't simplify life for people wanting to mock the Admin client.
> It
> > would break code at runtime for people who (for whatever reason) are
> > already using reflection to instantiate the package-private constructors.
> > * I don't  _think_ it would be binary compatible for clients that were
> just
> > invoking methods on Result instances (specifically, I _think_ the JVM
> > rejects bytecode that uses invokevirtual on an interface, the byte code
> > should be using invokeinterface instead). Maybe that's not a huge problem
> > because people should not be substituting a Kafka 4.x jar for a 3.x one
> at
> > runtime.
> >
> > So on balance I'm inclined to the simpler approach in the KIP.
> >
> > If we _did_ decide to switch to interface in 4.0, deprecating the
> > constructors would be a first step anyway, so it would still make sense
> to
> > deprecate now. The difference would be what happens for 4.0 (or 5.0...):
> > Either changing the access modifier or introducing interfaces. Therefore
> > it's something we could change our minds on before that major release, if
> > there were other motivations for using interfaces.
> >
> > I've added this to the rejected alternatives.
> >
> > Kind regards,
> >
> > Tom
> >
> > On Thu, Sep 9, 2021 at 3:54 PM Josep Prat 
> > wrote:
> >
> > > Hi Tom,
> > > Thanks for the KIP,
> > > I have one question. Have you considered converting those classes to
> > > interfaces? This would also solve the problem. I must admit that the
> > change
> > > is way bigger this way, but I would argue it offers a cleaner
> distinction
> > > and it offers more safety against mistakenly making methods public that
> > > shouldn't be.
> > >
> > >
> > > Thanks!
> > > ———
> > > Josep Prat
> > >
> > > Aiven Deutschland GmbH
> > >
> > > Immanuelkirchstraße 26, 10405 Berlin
> > >
> > > Amtsgericht Charlottenburg, HRB 209739 B
> > >
> > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> > >
> > > m: +491715557497
> > >
> > > w: aiven.io
> > >
> > > e: josep.p...@aiven.io
> > >
> > > On Thu, Sep 9, 2021, 16:25 Tom Bentley  wrote:
> > >
> > > > Hi,
> > > >
> > > > I've written a small KIP-774 that proposes to deprecate public access
> > to
> > > > the Admin client's *Result constructors:
> > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-774%3A+Deprecate+public+access+to+Admin+client%27s+*Result+constructors
> > > >
> > > > I'd be grateful for any comments you may have.
> > > >
> > > > Kind regards,
> > > >
> > > > Tom
> > > >
> > >
> >
>

Re: [kafka-clients] Re: [VOTE] 2.8.1 RC1

[David Jacot]

Hi Chris, Josep,

Thank you for reporting the issue and explaining the fix. JDK11 was
indeed used to generate the javadoc. I don't consider this as a blocker
for the release as we can fix it independently.

Best,
David

On Tue, Sep 14, 2021 at 11:37 PM Israel Ekpo  wrote:

> Hi Community Members,
>
> To encourage other community members to participate in the release
> candidate validations and voting, I have set up the following resource as
> part of the work for KAFKA-9861
>
> It is a set of scripts and Docker images that allows community members to
> run local validations in a consistent manner.
>
> https://github.com/izzyacademy/apache-kafka-release-party
>
> Please take a look at the resource and share any feedback that you may
> have. I used it to perform my validation for the 3.0.0 Release Candidate.
>
> I plan to create a video tutorial that walks community members through how
> it can be used soon. Stay tuned.
>
> On Tue, Sep 14, 2021 at 3:13 PM 'Josep Prat' via kafka-clients <
> kafka-clie...@googlegroups.com> wrote:
>
> > Hi Ismael,
> >
> > Yes the 'fix' was merged in the 3.0.0 branch (trunk at that time). I also
> > checked the current 3.0.0 RC2 and the javadoc  search works as expected.
> >
> > Best,
> > ———
> > Josep Prat
> >
> > Aiven Deutschland GmbH
> >
> > Immanuelkirchstraße 26, 10405 Berlin
> >
> > Amtsgericht Charlottenburg, HRB 209739 B
> >
> > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> >
> > m: +491715557497
> >
> > w: aiven.io
> >
> > e: josep.p...@aiven.io
> >
> > On Tue, Sep 14, 2021, 21:00 Ismael Juma  wrote:
> >
> >> Josep,
> >>
> >> This is fixed in 3.0.0, right?
> >>
> >> Ismael
> >>
> >> On Tue, Sep 14, 2021 at 11:32 AM Josep Prat  >
> >> wrote:
> >>
> >> > Hi Chris and David,
> >> >
> >> > Regarding the API search, this is a known bug in JDK 11 and prior. It
> >> can't
> >> > correctly generate URLs for projects not using the module system
> (Kafka)
> >> > that link to projects that use it (Java Standard Library). The bug has
> >> been
> >> > fixed in JDK 12 and higher.
> >> > To have the search work as expected, javadoc must be generated with
> JDK
> >> 12
> >> > or higher (for example JDK16 or the freshly released 17). For further
> >> info
> >> > check https://issues.apache.org/jira/browse/KAFKA-12782 or
> >> > https://github.com/apache/kafka/pull/10780
> >> >
> >> > Best,
> >> > ———
> >> > Josep Prat
> >> >
> >> > Aiven Deutschland GmbH
> >> >
> >> > Immanuelkirchstraße 26, 10405 Berlin
> >> >
> >> > Amtsgericht Charlottenburg, HRB 209739 B
> >> >
> >> > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> >> >
> >> > m: +491715557497
> >> >
> >> > w: aiven.io
> >> >
> >> > e: josep.p...@aiven.io
> >> >
> >> > On Tue, Sep 14, 2021, 19:42 Manikumar 
> >> wrote:
> >> >
> >> > > Hi,
> >> > >
> >> > > +1 (binding)
> >> > >
> >> > > - verified the signatures
> >> > > - ran the tests on the source archive
> >> > > - verified the quickstart with binary
> >> > > - verified the artifacts, javadoc
> >> > >
> >> > > Thanks for running the release!
> >> > >
> >> > > Thanks,
> >> > > Manikumar
> >> > >
> >> > > On Tue, Sep 14, 2021 at 10:36 PM Chris Egerton
> >> >  >> > > >
> >> > > wrote:
> >> > >
> >> > > > Hi David,
> >> > > >
> >> > > > I took a look at the Javadocs and noticed a small issue. Using the
> >> > search
> >> > > > bar at the top of the landing page (
> >> > > > https://home.apache.org/~dajac/kafka-2.8.1-rc1/javadoc/), I
> entered
> >> > > > "KafkaProducer" and clicked on the search item that came up. This
> >> > brought
> >> > > > me to
> >> > > >
> >> > > >
> >> > >
> >> >
> >>
> https://home.apache.org/~dajac/kafka-2.8.1-rc1/javadoc/undefined/org/apache/kafka/clients/producer/KafkaProducer.html
> >> > > > ,
> >> > > > which displayed a 404 "Not Found" error.
> >> > > >
> >> > > > This doesn't appear to be a regression as the same behavior occurs
> >> for
> >> > me
> >> > > > when browsing the 2.8.0 Javadocs (
> >> > > >
> >> https://kafka.apache.org/28/javadoc/index.html?overview-summary.html),
> >> > > but
> >> > > > I wanted to bring it up just in case. Normally I don't use the
> >> search
> >> > bar
> >> > > > but with the removal of sidebar frames from Javadocs I've had to
> >> start
> >> > > > relying on it a little bit more.
> >> > > >
> >> > > > Cheers,
> >> > > >
> >> > > > Chris
> >> > > >
> >> > > > On Tue, Sep 14, 2021 at 12:56 PM Randall Hauch  >
> >> > > wrote:
> >> > > >
> >> > > > > Thanks for generating a new RC1 with the corrected site docs,
> >> David.
> >> > > > >
> >> > > > > I was able to successfully complete the following:
> >> > > > >
> >> > > > > - Installed 2.8.1 RC0 and performed quickstart for broker and
> >> Connect
> >> > > > > - Verified signatures and checksums
> >> > > > > - Verified the tag
> >> > > > > - Manually compared the release notes to JIRA
> >> > > > > - Build release archive from the tag, ran Connect tests,
> installed
> >> > > > locally,
> >> > > > > and ran a portion of quickstart
> >> > > > > - Manually spotch

Re: [kafka-clients] Re: [VOTE] 2.8.1 RC1

[David Jacot]

Hi Israel,

Thanks! That seems pretty cool. You should bring it up in an independent
thread in order to give it more visibility. It might be lost in the middle
of
this vote thread.

Best,
David

On Wed, Sep 15, 2021 at 3:39 PM David Jacot  wrote:

> Hi Chris, Josep,
>
> Thank you for reporting the issue and explaining the fix. JDK11 was
> indeed used to generate the javadoc. I don't consider this as a blocker
> for the release as we can fix it independently.
>
> Best,
> David
>
> On Tue, Sep 14, 2021 at 11:37 PM Israel Ekpo  wrote:
>
>> Hi Community Members,
>>
>> To encourage other community members to participate in the release
>> candidate validations and voting, I have set up the following resource as
>> part of the work for KAFKA-9861
>>
>> It is a set of scripts and Docker images that allows community members to
>> run local validations in a consistent manner.
>>
>> https://github.com/izzyacademy/apache-kafka-release-party
>>
>> Please take a look at the resource and share any feedback that you may
>> have. I used it to perform my validation for the 3.0.0 Release Candidate.
>>
>> I plan to create a video tutorial that walks community members through how
>> it can be used soon. Stay tuned.
>>
>> On Tue, Sep 14, 2021 at 3:13 PM 'Josep Prat' via kafka-clients <
>> kafka-clie...@googlegroups.com> wrote:
>>
>> > Hi Ismael,
>> >
>> > Yes the 'fix' was merged in the 3.0.0 branch (trunk at that time). I
>> also
>> > checked the current 3.0.0 RC2 and the javadoc  search works as expected.
>> >
>> > Best,
>> > ———
>> > Josep Prat
>> >
>> > Aiven Deutschland GmbH
>> >
>> > Immanuelkirchstraße 26, 10405 Berlin
>> >
>> > Amtsgericht Charlottenburg, HRB 209739 B
>> >
>> > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
>> >
>> > m: +491715557497
>> >
>> > w: aiven.io
>> >
>> > e: josep.p...@aiven.io
>> >
>> > On Tue, Sep 14, 2021, 21:00 Ismael Juma  wrote:
>> >
>> >> Josep,
>> >>
>> >> This is fixed in 3.0.0, right?
>> >>
>> >> Ismael
>> >>
>> >> On Tue, Sep 14, 2021 at 11:32 AM Josep Prat
>> 
>> >> wrote:
>> >>
>> >> > Hi Chris and David,
>> >> >
>> >> > Regarding the API search, this is a known bug in JDK 11 and prior. It
>> >> can't
>> >> > correctly generate URLs for projects not using the module system
>> (Kafka)
>> >> > that link to projects that use it (Java Standard Library). The bug
>> has
>> >> been
>> >> > fixed in JDK 12 and higher.
>> >> > To have the search work as expected, javadoc must be generated with
>> JDK
>> >> 12
>> >> > or higher (for example JDK16 or the freshly released 17). For further
>> >> info
>> >> > check https://issues.apache.org/jira/browse/KAFKA-12782 or
>> >> > https://github.com/apache/kafka/pull/10780
>> >> >
>> >> > Best,
>> >> > ———
>> >> > Josep Prat
>> >> >
>> >> > Aiven Deutschland GmbH
>> >> >
>> >> > Immanuelkirchstraße 26, 10405 Berlin
>> >> >
>> >> > Amtsgericht Charlottenburg, HRB 209739 B
>> >> >
>> >> > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
>> >> >
>> >> > m: +491715557497
>> >> >
>> >> > w: aiven.io
>> >> >
>> >> > e: josep.p...@aiven.io
>> >> >
>> >> > On Tue, Sep 14, 2021, 19:42 Manikumar 
>> >> wrote:
>> >> >
>> >> > > Hi,
>> >> > >
>> >> > > +1 (binding)
>> >> > >
>> >> > > - verified the signatures
>> >> > > - ran the tests on the source archive
>> >> > > - verified the quickstart with binary
>> >> > > - verified the artifacts, javadoc
>> >> > >
>> >> > > Thanks for running the release!
>> >> > >
>> >> > > Thanks,
>> >> > > Manikumar
>> >> > >
>> >> > > On Tue, Sep 14, 2021 at 10:36 PM Chris Egerton
>> >> > > >> > > >
>> >> > > wrote:
>> >> > >
>> >> > > > Hi David,
>> >> > > >
>> >> > > > I took a look at the Javadocs and noticed a small issue. Using
>> the
>> >> > search
>> >> > > > bar at the top of the landing page (
>> >> > > > https://home.apache.org/~dajac/kafka-2.8.1-rc1/javadoc/), I
>> entered
>> >> > > > "KafkaProducer" and clicked on the search item that came up. This
>> >> > brought
>> >> > > > me to
>> >> > > >
>> >> > > >
>> >> > >
>> >> >
>> >>
>> https://home.apache.org/~dajac/kafka-2.8.1-rc1/javadoc/undefined/org/apache/kafka/clients/producer/KafkaProducer.html
>> >> > > > ,
>> >> > > > which displayed a 404 "Not Found" error.
>> >> > > >
>> >> > > > This doesn't appear to be a regression as the same behavior
>> occurs
>> >> for
>> >> > me
>> >> > > > when browsing the 2.8.0 Javadocs (
>> >> > > >
>> >> https://kafka.apache.org/28/javadoc/index.html?overview-summary.html),
>> >> > > but
>> >> > > > I wanted to bring it up just in case. Normally I don't use the
>> >> search
>> >> > bar
>> >> > > > but with the removal of sidebar frames from Javadocs I've had to
>> >> start
>> >> > > > relying on it a little bit more.
>> >> > > >
>> >> > > > Cheers,
>> >> > > >
>> >> > > > Chris
>> >> > > >
>> >> > > > On Tue, Sep 14, 2021 at 12:56 PM Randall Hauch <
>> rha...@apache.org>
>> >> > > wrote:
>> >> > > >
>> >> > > > > Thanks for generating a new RC1 with the corrected site docs,
>> >> David.
>> >> > > > >
>> >> > > > > I was able to 

[jira] [Created] (KAFKA-13304) Implicit cast of source type long to narrower destination type int in org.apache.kafka.common.network.MultiSend.java

[Thomas Bachmann (Jira)]

Thomas Bachmann created KAFKA-13304:
---

 Summary: Implicit cast of source type long to narrower destination 
type int in org.apache.kafka.common.network.MultiSend.java
 Key: KAFKA-13304
 URL: https://issues.apache.org/jira/browse/KAFKA-13304
 Project: Kafka
  Issue Type: Bug
  Components: network
Affects Versions: 2.8.0
Reporter: Thomas Bachmann


During a security review of Kafka I came across this bug 
[https://lgtm.com/projects/g/apache/kafka/rev/78ba492e3e70fd9db61bc82469371d04a8d6b762/files/clients/src/main/java/org/apache/kafka/common/network/MultiSend.java?sort=name&dir=ASC&mode=heatmap#x9c1b5901406741c6:1]
{code:java}
@Override74public long writeTo(GatheringByteChannel channel) throws 
IOException {75if (completed())76throw new 
KafkaException("This operation cannot be completed on a complete 
request.");7778int totalWrittenPerCall = 0;79boolean 
sendComplete = false;80do {81long written = 
current.writeTo(channel);82totalWritten += written;83
totalWrittenPerCall += written;
{code}
"Implicit cast of source type long to narrower destination type int."



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Abe to access Kafka Services from local

[Ukendiran Dhanasekaran, Integra-PDY, IN]

Hi Team,

We are try to configure Kafka Server and Kafka Zookeeper in Azure Linux box 
through PLAINTEXT listener protocol. Inside the Linux box we are able to access 
both the services. While we try to access from our local machine it not 
connecting.

We tried with KAFKAJS node module package to connect Kafka from local machine. 
There we got error will connecting Kafka Sever.

We try the following document to configure Kafka in SASL_PLAINTEXT protocal. We 
re facing problem to start Kaka service.

https://docs.vmware.com/en/VMware-Smart-Assurance/10.1.0/deployment-scenarios/GUID-3E473EC3-732A-4963-81BD-13BCCD3AC700.html

We are struck with the third step in the above document link.

Please find the below error.
[cid:image004.png@01D7AA3D.B3B835C0]

Please assist to fix the issue ASAP.


Thanks & Regards,
Ukendiran
Senior Developer, Products
Integra Software Services

P : +91-413-4212124 Ext: 369  |  M : +91 9600830086
A : 100 Feet Road (ECR), Pakkamudiyanpet, Pondicherry 605 008, India
W : www.integra.co.in  |  E : 
ukendiran.dhanaseka...@integra.co.in
Powering Content Transformation
India | USA | UK | Japan | Canada | Germany

[cid:image001.png@01D48961.790041C0][cid:image002.png@01D48961.790041C0][cid:image003.png@01D48961.790041C0]

Re: [kafka-clients] Re: [VOTE] 2.8.1 RC1

[Josep Prat]

Hi David,

I agree with you, the faulty search shouldn't be a blocker for the release.

Best

———
Josep Prat

Aiven Deutschland GmbH

Immanuelkirchstraße 26, 10405 Berlin

Amtsgericht Charlottenburg, HRB 209739 B

Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen

m: +491715557497

w: aiven.io

e: josep.p...@aiven.io

On Wed, Sep 15, 2021, 15:41 David Jacot  wrote:

> Hi Israel,
>
> Thanks! That seems pretty cool. You should bring it up in an independent
> thread in order to give it more visibility. It might be lost in the middle
> of
> this vote thread.
>
> Best,
> David
>
> On Wed, Sep 15, 2021 at 3:39 PM David Jacot  wrote:
>
>> Hi Chris, Josep,
>>
>> Thank you for reporting the issue and explaining the fix. JDK11 was
>> indeed used to generate the javadoc. I don't consider this as a blocker
>> for the release as we can fix it independently.
>>
>> Best,
>> David
>>
>> On Tue, Sep 14, 2021 at 11:37 PM Israel Ekpo 
>> wrote:
>>
>>> Hi Community Members,
>>>
>>> To encourage other community members to participate in the release
>>> candidate validations and voting, I have set up the following resource as
>>> part of the work for KAFKA-9861
>>>
>>> It is a set of scripts and Docker images that allows community members to
>>> run local validations in a consistent manner.
>>>
>>> https://github.com/izzyacademy/apache-kafka-release-party
>>>
>>> Please take a look at the resource and share any feedback that you may
>>> have. I used it to perform my validation for the 3.0.0 Release Candidate.
>>>
>>> I plan to create a video tutorial that walks community members through
>>> how
>>> it can be used soon. Stay tuned.
>>>
>>> On Tue, Sep 14, 2021 at 3:13 PM 'Josep Prat' via kafka-clients <
>>> kafka-clie...@googlegroups.com> wrote:
>>>
>>> > Hi Ismael,
>>> >
>>> > Yes the 'fix' was merged in the 3.0.0 branch (trunk at that time). I
>>> also
>>> > checked the current 3.0.0 RC2 and the javadoc  search works as
>>> expected.
>>> >
>>> > Best,
>>> > ———
>>> > Josep Prat
>>> >
>>> > Aiven Deutschland GmbH
>>> >
>>> > Immanuelkirchstraße 26, 10405 Berlin
>>> >
>>> > Amtsgericht Charlottenburg, HRB 209739 B
>>> >
>>> > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
>>> >
>>> > m: +491715557497
>>> >
>>> > w: aiven.io
>>> >
>>> > e: josep.p...@aiven.io
>>> >
>>> > On Tue, Sep 14, 2021, 21:00 Ismael Juma  wrote:
>>> >
>>> >> Josep,
>>> >>
>>> >> This is fixed in 3.0.0, right?
>>> >>
>>> >> Ismael
>>> >>
>>> >> On Tue, Sep 14, 2021 at 11:32 AM Josep Prat
>>> 
>>> >> wrote:
>>> >>
>>> >> > Hi Chris and David,
>>> >> >
>>> >> > Regarding the API search, this is a known bug in JDK 11 and prior.
>>> It
>>> >> can't
>>> >> > correctly generate URLs for projects not using the module system
>>> (Kafka)
>>> >> > that link to projects that use it (Java Standard Library). The bug
>>> has
>>> >> been
>>> >> > fixed in JDK 12 and higher.
>>> >> > To have the search work as expected, javadoc must be generated with
>>> JDK
>>> >> 12
>>> >> > or higher (for example JDK16 or the freshly released 17). For
>>> further
>>> >> info
>>> >> > check https://issues.apache.org/jira/browse/KAFKA-12782 or
>>> >> > https://github.com/apache/kafka/pull/10780
>>> >> >
>>> >> > Best,
>>> >> > ———
>>> >> > Josep Prat
>>> >> >
>>> >> > Aiven Deutschland GmbH
>>> >> >
>>> >> > Immanuelkirchstraße 26, 10405 Berlin
>>> >> >
>>> >> > Amtsgericht Charlottenburg, HRB 209739 B
>>> >> >
>>> >> > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
>>> >> >
>>> >> > m: +491715557497
>>> >> >
>>> >> > w: aiven.io
>>> >> >
>>> >> > e: josep.p...@aiven.io
>>> >> >
>>> >> > On Tue, Sep 14, 2021, 19:42 Manikumar 
>>> >> wrote:
>>> >> >
>>> >> > > Hi,
>>> >> > >
>>> >> > > +1 (binding)
>>> >> > >
>>> >> > > - verified the signatures
>>> >> > > - ran the tests on the source archive
>>> >> > > - verified the quickstart with binary
>>> >> > > - verified the artifacts, javadoc
>>> >> > >
>>> >> > > Thanks for running the release!
>>> >> > >
>>> >> > > Thanks,
>>> >> > > Manikumar
>>> >> > >
>>> >> > > On Tue, Sep 14, 2021 at 10:36 PM Chris Egerton
>>> >> > >> >> > > >
>>> >> > > wrote:
>>> >> > >
>>> >> > > > Hi David,
>>> >> > > >
>>> >> > > > I took a look at the Javadocs and noticed a small issue. Using
>>> the
>>> >> > search
>>> >> > > > bar at the top of the landing page (
>>> >> > > > https://home.apache.org/~dajac/kafka-2.8.1-rc1/javadoc/), I
>>> entered
>>> >> > > > "KafkaProducer" and clicked on the search item that came up.
>>> This
>>> >> > brought
>>> >> > > > me to
>>> >> > > >
>>> >> > > >
>>> >> > >
>>> >> >
>>> >>
>>> https://home.apache.org/~dajac/kafka-2.8.1-rc1/javadoc/undefined/org/apache/kafka/clients/producer/KafkaProducer.html
>>> >> > > > ,
>>> >> > > > which displayed a 404 "Not Found" error.
>>> >> > > >
>>> >> > > > This doesn't appear to be a regression as the same behavior
>>> occurs
>>> >> for
>>> >> > me
>>> >> > > > when browsing the 2.8.0 Javadocs (
>>> >> > > >
>>> >> https://kafka.apache.org/28/javadoc/index.html?overview-summary.html
>>

Re: [kafka-clients] Re: [VOTE] 2.8.1 RC1

[Bill Bejeck]

HI David,

Thanks for running the 2.8.1 release!

I validated the release doing the following:

   - built from source
   - ran all the unit tests
   - validated the checksums and signatures
   - ran through the quick start
   - ran through the quick start Kafka Streams application
   - looked at the docs and javadoc

I noticed the same doc issues as Randall and I agree it's minor and can be
fixed directly on the docs website

+1 (binding)

-Bill

On Wed, Sep 15, 2021 at 9:41 AM David Jacot 
wrote:

> Hi Israel,
>
> Thanks! That seems pretty cool. You should bring it up in an independent
> thread in order to give it more visibility. It might be lost in the middle
> of
> this vote thread.
>
> Best,
> David
>
> On Wed, Sep 15, 2021 at 3:39 PM David Jacot  wrote:
>
> > Hi Chris, Josep,
> >
> > Thank you for reporting the issue and explaining the fix. JDK11 was
> > indeed used to generate the javadoc. I don't consider this as a blocker
> > for the release as we can fix it independently.
> >
> > Best,
> > David
> >
> > On Tue, Sep 14, 2021 at 11:37 PM Israel Ekpo 
> wrote:
> >
> >> Hi Community Members,
> >>
> >> To encourage other community members to participate in the release
> >> candidate validations and voting, I have set up the following resource
> as
> >> part of the work for KAFKA-9861
> >>
> >> It is a set of scripts and Docker images that allows community members
> to
> >> run local validations in a consistent manner.
> >>
> >> https://github.com/izzyacademy/apache-kafka-release-party
> >>
> >> Please take a look at the resource and share any feedback that you may
> >> have. I used it to perform my validation for the 3.0.0 Release
> Candidate.
> >>
> >> I plan to create a video tutorial that walks community members through
> how
> >> it can be used soon. Stay tuned.
> >>
> >> On Tue, Sep 14, 2021 at 3:13 PM 'Josep Prat' via kafka-clients <
> >> kafka-clie...@googlegroups.com> wrote:
> >>
> >> > Hi Ismael,
> >> >
> >> > Yes the 'fix' was merged in the 3.0.0 branch (trunk at that time). I
> >> also
> >> > checked the current 3.0.0 RC2 and the javadoc  search works as
> expected.
> >> >
> >> > Best,
> >> > ———
> >> > Josep Prat
> >> >
> >> > Aiven Deutschland GmbH
> >> >
> >> > Immanuelkirchstraße 26, 10405 Berlin
> >> >
> >> > Amtsgericht Charlottenburg, HRB 209739 B
> >> >
> >> > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> >> >
> >> > m: +491715557497
> >> >
> >> > w: aiven.io
> >> >
> >> > e: josep.p...@aiven.io
> >> >
> >> > On Tue, Sep 14, 2021, 21:00 Ismael Juma  wrote:
> >> >
> >> >> Josep,
> >> >>
> >> >> This is fixed in 3.0.0, right?
> >> >>
> >> >> Ismael
> >> >>
> >> >> On Tue, Sep 14, 2021 at 11:32 AM Josep Prat
> >> 
> >> >> wrote:
> >> >>
> >> >> > Hi Chris and David,
> >> >> >
> >> >> > Regarding the API search, this is a known bug in JDK 11 and prior.
> It
> >> >> can't
> >> >> > correctly generate URLs for projects not using the module system
> >> (Kafka)
> >> >> > that link to projects that use it (Java Standard Library). The bug
> >> has
> >> >> been
> >> >> > fixed in JDK 12 and higher.
> >> >> > To have the search work as expected, javadoc must be generated with
> >> JDK
> >> >> 12
> >> >> > or higher (for example JDK16 or the freshly released 17). For
> further
> >> >> info
> >> >> > check https://issues.apache.org/jira/browse/KAFKA-12782 or
> >> >> > https://github.com/apache/kafka/pull/10780
> >> >> >
> >> >> > Best,
> >> >> > ———
> >> >> > Josep Prat
> >> >> >
> >> >> > Aiven Deutschland GmbH
> >> >> >
> >> >> > Immanuelkirchstraße 26, 10405 Berlin
> >> >> >
> >> >> > Amtsgericht Charlottenburg, HRB 209739 B
> >> >> >
> >> >> > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> >> >> >
> >> >> > m: +491715557497
> >> >> >
> >> >> > w: aiven.io
> >> >> >
> >> >> > e: josep.p...@aiven.io
> >> >> >
> >> >> > On Tue, Sep 14, 2021, 19:42 Manikumar 
> >> >> wrote:
> >> >> >
> >> >> > > Hi,
> >> >> > >
> >> >> > > +1 (binding)
> >> >> > >
> >> >> > > - verified the signatures
> >> >> > > - ran the tests on the source archive
> >> >> > > - verified the quickstart with binary
> >> >> > > - verified the artifacts, javadoc
> >> >> > >
> >> >> > > Thanks for running the release!
> >> >> > >
> >> >> > > Thanks,
> >> >> > > Manikumar
> >> >> > >
> >> >> > > On Tue, Sep 14, 2021 at 10:36 PM Chris Egerton
> >> >> >  >> >> > > >
> >> >> > > wrote:
> >> >> > >
> >> >> > > > Hi David,
> >> >> > > >
> >> >> > > > I took a look at the Javadocs and noticed a small issue. Using
> >> the
> >> >> > search
> >> >> > > > bar at the top of the landing page (
> >> >> > > > https://home.apache.org/~dajac/kafka-2.8.1-rc1/javadoc/), I
> >> entered
> >> >> > > > "KafkaProducer" and clicked on the search item that came up.
> This
> >> >> > brought
> >> >> > > > me to
> >> >> > > >
> >> >> > > >
> >> >> > >
> >> >> >
> >> >>
> >>
> https://home.apache.org/~dajac/kafka-2.8.1-rc1/javadoc/undefined/org/apache/kafka/clients/producer/KafkaProducer.html
> >> >> > > > ,
> >> >> > > > which displayed a 404 "N

Re: [kafka-clients] Re: [VOTE] 2.8.1 RC1

[Israel Ekpo]

No problem, David.

I will bring it up in a separate email thread later today.

On Wed, Sep 15, 2021 at 9:42 AM David Jacot 
wrote:

> Hi Israel,
>
> Thanks! That seems pretty cool. You should bring it up in an independent
> thread in order to give it more visibility. It might be lost in the middle
> of
> this vote thread.
>
> Best,
> David
>
> On Wed, Sep 15, 2021 at 3:39 PM David Jacot  wrote:
>
> > Hi Chris, Josep,
> >
> > Thank you for reporting the issue and explaining the fix. JDK11 was
> > indeed used to generate the javadoc. I don't consider this as a blocker
> > for the release as we can fix it independently.
> >
> > Best,
> > David
> >
> > On Tue, Sep 14, 2021 at 11:37 PM Israel Ekpo 
> wrote:
> >
> >> Hi Community Members,
> >>
> >> To encourage other community members to participate in the release
> >> candidate validations and voting, I have set up the following resource
> as
> >> part of the work for KAFKA-9861
> >>
> >> It is a set of scripts and Docker images that allows community members
> to
> >> run local validations in a consistent manner.
> >>
> >> https://github.com/izzyacademy/apache-kafka-release-party
> >>
> >> Please take a look at the resource and share any feedback that you may
> >> have. I used it to perform my validation for the 3.0.0 Release
> Candidate.
> >>
> >> I plan to create a video tutorial that walks community members through
> how
> >> it can be used soon. Stay tuned.
> >>
> >> On Tue, Sep 14, 2021 at 3:13 PM 'Josep Prat' via kafka-clients <
> >> kafka-clie...@googlegroups.com> wrote:
> >>
> >> > Hi Ismael,
> >> >
> >> > Yes the 'fix' was merged in the 3.0.0 branch (trunk at that time). I
> >> also
> >> > checked the current 3.0.0 RC2 and the javadoc  search works as
> expected.
> >> >
> >> > Best,
> >> > ———
> >> > Josep Prat
> >> >
> >> > Aiven Deutschland GmbH
> >> >
> >> > Immanuelkirchstraße 26, 10405 Berlin
> >> >
> >> > Amtsgericht Charlottenburg, HRB 209739 B
> >> >
> >> > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> >> >
> >> > m: +491715557497
> >> >
> >> > w: aiven.io
> >> >
> >> > e: josep.p...@aiven.io
> >> >
> >> > On Tue, Sep 14, 2021, 21:00 Ismael Juma  wrote:
> >> >
> >> >> Josep,
> >> >>
> >> >> This is fixed in 3.0.0, right?
> >> >>
> >> >> Ismael
> >> >>
> >> >> On Tue, Sep 14, 2021 at 11:32 AM Josep Prat
> >> 
> >> >> wrote:
> >> >>
> >> >> > Hi Chris and David,
> >> >> >
> >> >> > Regarding the API search, this is a known bug in JDK 11 and prior.
> It
> >> >> can't
> >> >> > correctly generate URLs for projects not using the module system
> >> (Kafka)
> >> >> > that link to projects that use it (Java Standard Library). The bug
> >> has
> >> >> been
> >> >> > fixed in JDK 12 and higher.
> >> >> > To have the search work as expected, javadoc must be generated with
> >> JDK
> >> >> 12
> >> >> > or higher (for example JDK16 or the freshly released 17). For
> further
> >> >> info
> >> >> > check https://issues.apache.org/jira/browse/KAFKA-12782 or
> >> >> > https://github.com/apache/kafka/pull/10780
> >> >> >
> >> >> > Best,
> >> >> > ———
> >> >> > Josep Prat
> >> >> >
> >> >> > Aiven Deutschland GmbH
> >> >> >
> >> >> > Immanuelkirchstraße 26, 10405 Berlin
> >> >> >
> >> >> > Amtsgericht Charlottenburg, HRB 209739 B
> >> >> >
> >> >> > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> >> >> >
> >> >> > m: +491715557497
> >> >> >
> >> >> > w: aiven.io
> >> >> >
> >> >> > e: josep.p...@aiven.io
> >> >> >
> >> >> > On Tue, Sep 14, 2021, 19:42 Manikumar 
> >> >> wrote:
> >> >> >
> >> >> > > Hi,
> >> >> > >
> >> >> > > +1 (binding)
> >> >> > >
> >> >> > > - verified the signatures
> >> >> > > - ran the tests on the source archive
> >> >> > > - verified the quickstart with binary
> >> >> > > - verified the artifacts, javadoc
> >> >> > >
> >> >> > > Thanks for running the release!
> >> >> > >
> >> >> > > Thanks,
> >> >> > > Manikumar
> >> >> > >
> >> >> > > On Tue, Sep 14, 2021 at 10:36 PM Chris Egerton
> >> >> >  >> >> > > >
> >> >> > > wrote:
> >> >> > >
> >> >> > > > Hi David,
> >> >> > > >
> >> >> > > > I took a look at the Javadocs and noticed a small issue. Using
> >> the
> >> >> > search
> >> >> > > > bar at the top of the landing page (
> >> >> > > > https://home.apache.org/~dajac/kafka-2.8.1-rc1/javadoc/), I
> >> entered
> >> >> > > > "KafkaProducer" and clicked on the search item that came up.
> This
> >> >> > brought
> >> >> > > > me to
> >> >> > > >
> >> >> > > >
> >> >> > >
> >> >> >
> >> >>
> >>
> https://home.apache.org/~dajac/kafka-2.8.1-rc1/javadoc/undefined/org/apache/kafka/clients/producer/KafkaProducer.html
> >> >> > > > ,
> >> >> > > > which displayed a 404 "Not Found" error.
> >> >> > > >
> >> >> > > > This doesn't appear to be a regression as the same behavior
> >> occurs
> >> >> for
> >> >> > me
> >> >> > > > when browsing the 2.8.0 Javadocs (
> >> >> > > >
> >> >> https://kafka.apache.org/28/javadoc/index.html?overview-summary.html
> ),
> >> >> > > but
> >> >> > > > I wanted to bring it up just in case. Normally I don't 

[jira] [Resolved] (KAFKA-13162) ElectLeader API must be forwarded to Controller

[Jason Gustafson (Jira)]

 [ 
https://issues.apache.org/jira/browse/KAFKA-13162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Gustafson resolved KAFKA-13162.
-
Resolution: Fixed

> ElectLeader API must be forwarded to Controller
> ---
>
> Key: KAFKA-13162
> URL: https://issues.apache.org/jira/browse/KAFKA-13162
> Project: Kafka
>  Issue Type: Bug
>Reporter: Jason Gustafson
>Assignee: Jason Gustafson
>Priority: Blocker
> Fix For: 3.1.0
>
>
> We're missing the logic to forward ElectLeaders requests to the controller. 
> This means that `kafka-leader-election.sh` does not work correctly.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (KAFKA-13305) NullPointerException in LogCleanerManager "uncleanable-bytes" gauge

[Vincent Jiang (Jira)]

Vincent Jiang created KAFKA-13305:
-

 Summary: NullPointerException in LogCleanerManager 
"uncleanable-bytes" gauge
 Key: KAFKA-13305
 URL: https://issues.apache.org/jira/browse/KAFKA-13305
 Project: Kafka
  Issue Type: Bug
  Components: log cleaner
Reporter: Vincent Jiang


We've seen following exception in production environment:
{quote} java.lang.NullPointerException: Cannot invoke 
"kafka.log.UnifiedLog.logStartOffset()" because "log" is null at

kafka.log.LogCleanerManager$.cleanableOffsets(LogCleanerManager.scala:599)
{quote}
Looks like uncleanablePartitions never has partitions removed from it to 
reflect partition deletion/reassignment.

 

We should fix the NullPointerException and removed deleted partitions from 
uncleanablePartitions.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #471

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 492710 lines...]
[2021-09-15T17:54:15.820Z] > Task :connect:json:testJar
[2021-09-15T17:54:15.820Z] > Task :connect:json:testSrcJar
[2021-09-15T17:54:15.820Z] > Task :metadata:compileTestJava UP-TO-DATE
[2021-09-15T17:54:15.820Z] > Task :metadata:testClasses UP-TO-DATE
[2021-09-15T17:54:15.820Z] > Task :core:compileScala UP-TO-DATE
[2021-09-15T17:54:15.820Z] > Task :core:classes UP-TO-DATE
[2021-09-15T17:54:15.820Z] > Task :core:compileTestJava NO-SOURCE
[2021-09-15T17:54:15.820Z] > Task 
:clients:generateMetadataFileForMavenJavaPublication
[2021-09-15T17:54:15.820Z] > Task 
:clients:generatePomFileForMavenJavaPublication
[2021-09-15T17:54:15.820Z] 
[2021-09-15T17:54:15.820Z] > Task :streams:processMessages
[2021-09-15T17:54:15.820Z] Execution optimizations have been disabled for task 
':streams:processMessages' to ensure correctness due to the following reasons:
[2021-09-15T17:54:15.820Z]   - Gradle detected a problem with the following 
location: 
'/home/jenkins/workspace/Kafka_kafka_trunk/streams/src/generated/java/org/apache/kafka/streams/internals/generated'.
 Reason: Task ':streams:srcJar' uses this output of task 
':streams:processMessages' without declaring an explicit or implicit 
dependency. This can lead to incorrect results being produced, depending on 
what order the tasks are executed. Please refer to 
https://docs.gradle.org/7.2/userguide/validation_problems.html#implicit_dependency
 for more details about this problem.
[2021-09-15T17:54:15.820Z] MessageGenerator: processed 1 Kafka message JSON 
files(s).
[2021-09-15T17:54:15.820Z] 
[2021-09-15T17:54:15.820Z] > Task :core:compileTestScala UP-TO-DATE
[2021-09-15T17:54:15.820Z] > Task :core:testClasses UP-TO-DATE
[2021-09-15T17:54:15.820Z] > Task :streams:compileJava UP-TO-DATE
[2021-09-15T17:54:15.820Z] > Task :streams:classes UP-TO-DATE
[2021-09-15T17:54:15.820Z] > Task :streams:copyDependantLibs UP-TO-DATE
[2021-09-15T17:54:15.820Z] > Task :streams:test-utils:compileJava UP-TO-DATE
[2021-09-15T17:54:15.820Z] > Task :streams:jar UP-TO-DATE
[2021-09-15T17:54:15.820Z] > Task 
:streams:generateMetadataFileForMavenJavaPublication
[2021-09-15T17:54:19.571Z] > Task :connect:api:javadoc
[2021-09-15T17:54:19.571Z] > Task :connect:api:copyDependantLibs UP-TO-DATE
[2021-09-15T17:54:19.571Z] > Task :connect:api:jar UP-TO-DATE
[2021-09-15T17:54:19.571Z] > Task 
:connect:api:generateMetadataFileForMavenJavaPublication
[2021-09-15T17:54:19.571Z] > Task :connect:json:copyDependantLibs UP-TO-DATE
[2021-09-15T17:54:19.571Z] > Task :connect:json:jar UP-TO-DATE
[2021-09-15T17:54:19.571Z] > Task 
:connect:json:generateMetadataFileForMavenJavaPublication
[2021-09-15T17:54:19.571Z] > Task 
:connect:json:publishMavenJavaPublicationToMavenLocal
[2021-09-15T17:54:19.571Z] > Task :connect:json:publishToMavenLocal
[2021-09-15T17:54:19.571Z] > Task :connect:api:javadocJar
[2021-09-15T17:54:19.571Z] > Task :connect:api:compileTestJava UP-TO-DATE
[2021-09-15T17:54:19.571Z] > Task :connect:api:testClasses UP-TO-DATE
[2021-09-15T17:54:19.571Z] > Task :connect:api:testJar
[2021-09-15T17:54:19.571Z] > Task :connect:api:testSrcJar
[2021-09-15T17:54:19.571Z] > Task 
:connect:api:publishMavenJavaPublicationToMavenLocal
[2021-09-15T17:54:19.571Z] > Task :connect:api:publishToMavenLocal
[2021-09-15T17:54:22.185Z] > Task :streams:javadoc
[2021-09-15T17:54:23.115Z] > Task :streams:javadocJar
[2021-09-15T17:54:23.115Z] > Task :streams:compileTestJava UP-TO-DATE
[2021-09-15T17:54:23.115Z] > Task :streams:processTestResources UP-TO-DATE
[2021-09-15T17:54:23.115Z] > Task :streams:testClasses UP-TO-DATE
[2021-09-15T17:54:23.115Z] > Task :streams:testJar
[2021-09-15T17:54:24.044Z] > Task :streams:testSrcJar
[2021-09-15T17:54:24.044Z] > Task 
:streams:publishMavenJavaPublicationToMavenLocal
[2021-09-15T17:54:24.044Z] > Task :streams:publishToMavenLocal
[2021-09-15T17:54:24.044Z] > Task :clients:javadoc
[2021-09-15T17:54:24.973Z] > Task :clients:javadocJar
[2021-09-15T17:54:24.973Z] 
[2021-09-15T17:54:24.973Z] > Task :clients:srcJar
[2021-09-15T17:54:24.973Z] Execution optimizations have been disabled for task 
':clients:srcJar' to ensure correctness due to the following reasons:
[2021-09-15T17:54:24.973Z]   - Gradle detected a problem with the following 
location: 
'/home/jenkins/workspace/Kafka_kafka_trunk/clients/src/generated/java'. Reason: 
Task ':clients:srcJar' uses this output of task ':clients:processMessages' 
without declaring an explicit or implicit dependency. This can lead to 
incorrect results being produced, depending on what order the tasks are 
executed. Please refer to 
https://docs.gradle.org/7.2/userguide/validation_problems.html#implicit_dependency
 for more details about this problem.
[2021-09-15T17:54:25.902Z] 
[2021-09-15T17:54:25.902Z] > Task :clients:testJar
[2021-09-15T17:54:25.902Z] > Task :clients:testSrcJa

[GitHub] [kafka-site] allanassis opened a new pull request #373: Add Globo (https://www.globo.com/) to the list of the "Powered By ❤️"

[GitBox]

allanassis opened a new pull request #373:
URL: https://github.com/apache/kafka-site/pull/373


   I work at [Globo](https://globo.com/). We are a huge company here in Brazil 
and we use Kafka for our big data event ingestion and for our logging system.
   
   Here how should appear at the powered-by page.
   
   https://user-images.githubusercontent.com/23871115/133518617-592a1cc8-89f6-4660-b209-858499beb146.png";>
   



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[DISCUSS] KIP-775: Custom partitioners in foreign key joins

[Victoria Xia]

Hi,

I've opened a small KIP for adding Kafka Streams support for foreign key
joins on tables with custom partitioners:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-775%3A+Custom+partitioners+in+foreign+key+joins

Feedback appreciated. Thanks!

- Victoria

[DISCUSS] Before you Vote for Apache Kafka RCs, Watch This!

[Israel Ekpo]

Before you Vote for Apache Kafka RCs, Watch This!

https://youtu.be/T1VqFszLuQs

Hello Kafka Community Members and welcome to the Apache Kafka Release Party!

As part of an effort (KAFKA-9861) to get more community participation
during release candidate (RC) validations, we have created the following
steps to hopefully allow more community members to participate thoroughly
in this validation process prior to casting their votes for specific RCs.

It is also our hope that more community members will be able to participate
in the process as a result. If you have any suggestions for improvement or
would like to share changes, please feel free to send in a pull request or
open issues against this github repo.

I would like to solicit feedback from the users, community members,
committers and PMC members on how this can be incorporated into the release
process and AK code base.

My initial thoughts are to include the link to this resource or its
modified form as part of the release candidate announcement to encourage
users to participate in the RC validation process.

Thanks in advance for your participation.

*Process Simplification - Community Validation of Kafka Release Candidates*
https://issues.apache.org/jira/browse/KAFKA-9861

*Github Repository Accompanying this Tutorial*
https://github.com/izzyacademy/apache-kafka-release-party

*YouTube Video Explaining the Resources and How to Use It*
https://youtu.be/T1VqFszLuQs

Become a Contributor

[Luiz Fernando Fonseca]

Hello. I would like to become a contributor inside JIRA.
Username: luizfrf