Re: Contribution help please

2021-09-19 Thread Boyang Chen
Have you checked out https://kafka.apache.org/coding-guide? On Fri, Sep 17, 2021 at 7:12 AM Jon McEwen wrote: > Hello Kafka folks, > > Could somone please tell me how to correctly format kafka Java code? > Either on command line or in IntelliJ. > > Many thanks > > Jon McEwen > >

Re: [DISCUSS] KIP-776: Add Consumer#peek for debugging/tuning

2021-09-19 Thread Boyang Chen
Thanks Luke for the KIP. I think I understand the motivation is to avoid affecting offset positions of the records, but the feature could be easily realized on the user side by using manual offset commit + offset position rewind. So the new peek() function doesn't provide any new functionality

Re: Contribute

2021-09-19 Thread Boyang Chen
Thanks for your interest in Kafka Soren, your account has been added. On Sun, Sep 19, 2021 at 10:38 AM Soren Schwartz wrote: > Hello, > > I would like to begin contribute. Following the guidelines I’m asked to > contact you such that I can use my JIRA account to assign myself to JIRA > tickets.

Re: [DISCUSS] KIP-763: Range queries with open endpoints

2021-08-28 Thread Boyang Chen
Thanks Patrick for the KIP and sorry for being late to the party here. One thing I would like to understand is, what's the expected behavior when a user specifies a null key in previous versions? In the new version which uses null key for open-ended range queries, could it potentially hide bugs in

Making topic validation public

2021-08-15 Thread Boyang Chen
Hey there, Kafka has an internal topic validation logic which is very useful and effective. Do you think it's possible to make it part of the

Re: Jira contributor access

2021-07-22 Thread Boyang Chen
Done, thanks for your interest in Kafka! On Thu, Jul 22, 2021 at 10:37 AM Knowles Atchison Jr wrote: > Requesting Jira contributor access. > > Username: katchison >

Re: [ANNOUNCE] New Kafka PMC Member: Konstantine Karantasis

2021-06-21 Thread Boyang Chen
Congratulations Konstantine! On Mon, Jun 21, 2021 at 10:16 AM Matthias J. Sax wrote: > Congrats! > > On 6/21/21 12:57 PM, Raymond Ng wrote: > > Congrats Konstantine! > > > > /Ray > > > > On Mon, Jun 21, 2021 at 9:45 AM Guozhang Wang > wrote: > > > >> Congratulations Konstantine! > >> > >> On

Re: Contributor List

2021-06-18 Thread Boyang Chen
Added you to the jira contributor, thanks for your interest. Let me know your wiki user id so that I could add you there as well. Boyang On Fri, Jun 18, 2021 at 10:11 AM Kai Herrera wrote: > Hello, > > I would like to be added to the contributor list. > > Username: Kai1015 > > Many thanks! >

Re: [VOTE] KIP-749: Add --files and --file-separator options to the ConsoleProducer

2021-06-11 Thread Boyang Chen
;(cat file1 file2) > > > > בתאריך יום ב׳, 7 ביוני 2021, 05:05, מאת Ran Lupovich ‏< > > ranlupov...@gmail.com > > >: > > > > > kafka-console-producer.sh --broker-list localhost:9092 --topic my_topic > > < my_file.txt > > > > > &

Re: [VOTE] KIP-749: Add --files and --file-separator options to the ConsoleProducer

2021-06-06 Thread Boyang Chen
Thanks for the KIP Wenbing. I have a couple of questions: 1. Could you add more descriptions into the motivation section, as of when the new options are favored and what's the current workaround? 2. Could you separate out the public interface and proposed changes sections, such that the new

[jira] [Resolved] (KAFKA-7728) Add JoinReason to the join group request for better rebalance handling

2021-04-13 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-7728. Resolution: Won't Fix This is no longer a critical fix to the static membership, as leader rejoin

[jira] [Created] (KAFKA-12499) Adjust transaction timeout according to commit interval on Streams EOS

2021-03-18 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-12499: --- Summary: Adjust transaction timeout according to commit interval on Streams EOS Key: KAFKA-12499 URL: https://issues.apache.org/jira/browse/KAFKA-12499 Project: Kafka

[jira] [Resolved] (KAFKA-12381) Incompatible change in verifiable_producer.log in 2.8

2021-03-05 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-12381. - Resolution: Fixed > Incompatible change in verifiable_producer.log in

Re: [VOTE] KIP-715: Expose Committed offset in streams

2021-02-28 Thread Boyang Chen
Thanks Walker for the proposal, +1 (binding) from me. On Fri, Feb 26, 2021 at 12:42 PM Walker Carlson wrote: > Hello all, > > I would like to bring KIP-715 to a vote. Here is the KIP: > https://cwiki.apache.org/confluence/x/aRRRCg. > > Walker >

Re: [DISCUSS] KIP-715: Expose Committed offset in streams

2021-02-26 Thread Boyang Chen
ems to be the last concern. If there are no others I will put this > up for a vote soon. > > walker > > On Thu, Feb 25, 2021 at 12:35 PM Boyang Chen > wrote: > > > For the 3rd point, yes, what I'm proposing is an edge case. For example, > > when we have 4 tasks [

Re: [DISCUSS] KIP-715: Expose Committed offset in streams

2021-02-25 Thread Boyang Chen
> consolidate on the existing `TaskMetadata` since we have already > > accumulated a bunch of such classes, and its better to keep them small as > > public APIs. You can see > https://issues.apache.org/jira/browse/KAFKA-12370 > > for a reference and a proposal. > > > &

Re: [DISCUSS] KIP-715: Expose Committed offset in streams

2021-02-25 Thread Boyang Chen
tc. > > > > 5) We need to clarify how is "idling" being defined here: e.g. we can > > clearly state that a task is considered idle only if 1) lag is > > increasing, indicating that there are indeed new records arrived at > source, > > while commit

Re: [DISCUSS] KIP-715: Expose Committed offset in streams

2021-02-22 Thread Boyang Chen
Thanks Walker for the proposed KIP! This should definitely empower KStream users with better visibility. Meanwhile I got a couple of questions/suggestions: 1. typo "repost/report" in the motivation section. 2. What offsets do we report when the task is under restoration or rebalancing? 3.

[jira] [Created] (KAFKA-12307) Wrap non-fatal exception as CommitFailedException when thrown from commitTxn

2021-02-06 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-12307: --- Summary: Wrap non-fatal exception as CommitFailedException when thrown from commitTxn Key: KAFKA-12307 URL: https://issues.apache.org/jira/browse/KAFKA-12307 Project

[jira] [Created] (KAFKA-12304) Improve topic validation in auto topic creation

2021-02-05 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-12304: --- Summary: Improve topic validation in auto topic creation Key: KAFKA-12304 URL: https://issues.apache.org/jira/browse/KAFKA-12304 Project: Kafka Issue Type

[jira] [Created] (KAFKA-12294) Consider using the forwarding mechanism for metadata auto topic creation

2021-02-04 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-12294: --- Summary: Consider using the forwarding mechanism for metadata auto topic creation Key: KAFKA-12294 URL: https://issues.apache.org/jira/browse/KAFKA-12294 Project

Re: [VOTE] KIP-691: Transactional Producer Exception Handling

2021-02-02 Thread Boyang Chen
On Thu, Jan 28, 2021 at 10:38 PM Guozhang Wang wrote: > Thanks Boyang for the thorough discussion. The current KIP LGTM. > > On Thu, Jan 28, 2021 at 1:36 PM Boyang Chen > wrote: > > > Hey everyone, > > > > I would like to start the voting for KIP-691 to improve tra

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-02-02 Thread Boyang Chen
Thanks Jason! On Tue, Feb 2, 2021 at 11:10 PM Jason Gustafson wrote: > Hi Boyang, sounds good to me. > > -Jason > > On Mon, Feb 1, 2021 at 9:32 AM Boyang Chen > wrote: > > > Hey Jason and Chia-Ping, > > > > looking at the discussion thread

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-02-01 Thread Boyang Chen
gt; > sure. I'd like to join this bigger party :) > > On 2021/01/30 01:03:57, Boyang Chen wrote: > > This is a great proposal Jason, I already integrated KIP-691 with KIP-706 > > template to provide a new ProduceFailedException as well as a new > > Producer#produc

[jira] [Created] (KAFKA-12260) PartitionsFor should not return null value

2021-01-30 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-12260: --- Summary: PartitionsFor should not return null value Key: KAFKA-12260 URL: https://issues.apache.org/jira/browse/KAFKA-12260 Project: Kafka Issue Type

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-01-29 Thread Boyang Chen
Chia-Ping has been thinking about this: > https://issues.apache.org/jira/browse/KAFKA-12227. Is there a way to > consolidate our efforts in order to avoid unnecessary noise for users? It > would be awesome to see a more modern API which also addresses the > confusing error handling. > > -Jason &g

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-01-29 Thread Boyang Chen
Hi Boyang, > > Do you think it's necessary to deprecate the old `onCompletion` callback? I > was thinking there's probably no harm leaving it around. Users might not > care about the failure type. Other than that, it looks good to me. > > Thanks, > Jason > > On Thu, Jan 2

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-01-28 Thread Boyang Chen
rrent transactions. Is > that correct? > > On Thu, Jan 28, 2021 at 5:06 PM Boyang Chen > wrote: > > > Hey Guozhang, I think TimeoutException would not be covered here as it > > potentially has a risk of hitting an illegal state on the broker side > when > > the pre

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-01-28 Thread Boyang Chen
gt; > Guozhang > > On Thu, Jan 28, 2021 at 1:08 PM Boyang Chen > wrote: > > > Thanks Jason, I agree with the proposed solution here, will update the > KIP. > > > > On Thu, Jan 28, 2021 at 10:52 AM Jason Gustafson > > wrote: > > > > > Hi B

[VOTE] KIP-691: Transactional Producer Exception Handling

2021-01-28 Thread Boyang Chen
Hey everyone, I would like to start the voting for KIP-691 to improve transactional producer exception handling: https://cwiki.apache.org/confluence/display/KAFKA/KIP-691%3A+Enhance+Transactional+Producer+Exception+Handling let me know your thoughts, thanks! Boyang

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-01-28 Thread Boyang Chen
> this.onCompletion(metadata, failure.cause()); > } > > This would give streams and other applications enough information to know > whether the message can be retried and whether the transaction can be > aborted. > > What do you think? > > -Jason > >

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-01-27 Thread Boyang Chen
y we are receiving all emails kindly remove us from > > dev@kafka.apache.org we don't want to receive emails anymore. > > > > Thanks > > > On 01/23/2021 4:14 AM Guozhang Wang wrote: > > > > > > > > > Thanks Boyang, yes I think I was co

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-01-22 Thread Boyang Chen
consumer/producer modules. Let me know what you think. Best, Boyang On Fri, Jan 22, 2021 at 11:05 AM Boyang Chen wrote: > My understanding is that abortTransaction would only throw when the > producer is in fatal state. For CommitFailed, the producer should still be > in the abortable er

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-01-22 Thread Boyang Chen
throw e; > > } > > } catch (KafkaException e) { > > producer.close(); > > consumer.close(); > > throw e; > > } > > ... > > > > Guozhang > > > > On Fri, Jan 22, 2021 at 10:47

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-01-22 Thread Boyang Chen
me know your thoughts on the new approach here, thank you! Best, Boyang On Tue, Jan 19, 2021 at 11:11 AM Guozhang Wang wrote: > Thanks for your clarification on 2)/3), that makes sense. > > On Tue, Jan 19, 2021 at 10:16 AM Boyang Chen > wrote: > > > Thanks for the input Guo

Re: Kafka Advisory Topic

2021-01-20 Thread Boyang Chen
Hey Knowles, in Kafka people normally use admin clients to get those metadata. I'm not sure why you mentioned specifically that having a topic to manage these information is useful, but a good news is that in KIP-500

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-01-19 Thread Boyang Chen
nd() instead of waiting to later stage of processing. In that sense, I agree we should continue to record send exceptions even under EOS case to ensure the strength of stream side Producer logic. On the safer side, we no longer need to wrap certain fatal exceptions like ProducerFenced as TaskMigrat

[jira] [Created] (KAFKA-12215) Broker could cache its overlapping ApiVersions with active controller

2021-01-15 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-12215: --- Summary: Broker could cache its overlapping ApiVersions with active controller Key: KAFKA-12215 URL: https://issues.apache.org/jira/browse/KAFKA-12215 Project: Kafka

Re: [VOTE] KIP-687: Automatic Reloading of Security Store

2021-01-13 Thread Boyang Chen
021 at 12:27 PM Boyang Chen > wrote: > > > > Hey folks, > > > > just bumping up this thread and see if you have further comments. > > > > On Wed, Dec 16, 2020 at 3:25 PM Boyang Chen > > wrote: > > > > > Hey there, > > > >

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

2021-01-12 Thread Boyang Chen
down. Let me know your thoughts. Best, Boyang On Fri, Jan 8, 2021 at 10:42 AM Boyang Chen wrote: > > > On Fri, Jan 8, 2021 at 4:46 AM Rajini Sivaram > wrote: > >> Hi Boyang, >> >> Thanks for the responses. Follow up comments on a couple of those: >>

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

2021-01-08 Thread Boyang Chen
ion on how the tooling is being used today for security store reloading which has an ordering that we might need to change? > > On Thu, Jan 7, 2021 at 6:46 PM Boyang Chen > wrote: > > > Hey David, thanks for the feedback. > > > > On Thu, Jan 7, 2021 at 2:3

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

2021-01-07 Thread Boyang Chen
o the > > configurations it would affect. I'm happy with the updates. > > > > -Jason > > > > On Tue, Jan 5, 2021 at 8:34 PM Boyang Chen > > wrote: > > > > > Thanks Jason for the feedback. I separated the time configs for key > store >

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

2021-01-07 Thread Boyang Chen
> I > > suggested tying the refresh configuration more directly to the > > configurations it would affect. I'm happy with the updates. > > > > -Jason > > > > On Tue, Jan 5, 2021 at 8:34 PM Boyang Chen > > wrote: > > > > > Thanks Jason

Re: [VOTE] KIP-687: Automatic Reloading of Security Store

2021-01-06 Thread Boyang Chen
Hey folks, just bumping up this thread and see if you have further comments. On Wed, Dec 16, 2020 at 3:25 PM Boyang Chen wrote: > Hey there, > > I would like to start the voting for KIP-687: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-687 > %3A+Automatic+Reloading+of

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

2021-01-05 Thread Boyang Chen
Thanks Jason for the feedback. I separated the time configs for key store and trust store, and rename the configs as you proposed. Best, Boyang On Mon, Dec 14, 2020 at 3:47 PM Boyang Chen wrote: > Hey there, > > bumping up this thread to see if there are further questions

Re: [ANNOUNCE] Apache Kafka 2.7.0

2020-12-28 Thread Boyang Chen
> > > between systems or applications. > > > > > > ** Building real-time streaming applications that transform or react > > > to the streams of data. > > > > > > > > > Apache Kafka is in use at large and small companies worldwide, > includ

Re: Kafka JIRA ticket assign access request

2020-12-20 Thread Boyang Chen
Done, thanks for your contribution! From: Avijit Chakraborty Sent: Sunday, December 20, 2020 8:47 PM To: dev@kafka.apache.org Subject: Kafka JIRA ticket assign access request Hello Team, I am a newbie in Kafka. So I would like to contribute to the Kafka

[jira] [Created] (KAFKA-10868) Avoid double wrapping KafkaException

2020-12-18 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10868: --- Summary: Avoid double wrapping KafkaException Key: KAFKA-10868 URL: https://issues.apache.org/jira/browse/KAFKA-10868 Project: Kafka Issue Type: Sub-task

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2020-12-17 Thread Boyang Chen
, thanks! On Thu, Dec 17, 2020 at 8:36 PM Boyang Chen wrote: > Thanks Bruno for the feedback. > > On Mon, Dec 7, 2020 at 5:26 AM Bruno Cadonna wrote: > >> Thanks Boyang for the KIP! >> >> Like Matthias, I do also not know the producer internal well enough to >> comme

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2020-12-17 Thread Boyang Chen
rs like > > ConcurrentTxn or InvalidTxnState are not due to the state being corrupted > > at the broker side, but maybe users are doing something wrong. So I'm > > wondering if we should further distinguish those non-fatal errors between > > a) those that are caused by Kafka it

[VOTE] KIP-687: Automatic Reloading of Security Store

2020-12-16 Thread Boyang Chen
Hey there, I would like to start the voting for KIP-687: https://cwiki.apache.org/confluence/display/KAFKA/KIP-687 %3A+Automatic+Reloading+of+Security+Store to make the security store reloading automated. Best, Boyang

Re: [VOTE] voting on KIP-631: the quorum-based Kafka controller

2020-12-15 Thread Boyang Chen
Thanks Colin for the great work to polish the KIP and reach this final stage. +1 (binding) from me On Tue, Dec 15, 2020 at 9:11 AM David Arthur wrote: > Colin, thanks for driving this. I just read through the KIP again and I > think it is in good shape. Exciting stuff! > > +1 binding > > -David

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

2020-12-14 Thread Boyang Chen
Hey there, bumping up this thread to see if there are further questions regarding the updated proposal. Best, Boyang On Thu, Dec 10, 2020 at 11:52 AM Boyang Chen wrote: > After some offline discussions, we believe that it's the right direction > to go by doing a hybrid approach which in

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

2020-12-10 Thread Boyang Chen
the file-watch does not take effect. The current default reloading interval is set to 5 min. I have updated the KIP and ticket, feel free to check out and see if it makes sense. Best, Boyang On Tue, Dec 8, 2020 at 8:58 PM Boyang Chen wrote: > Hey Gwen, thanks for the feedback. > > On S

[jira] [Resolved] (KAFKA-9552) Stream should handle OutOfSequence exception thrown from Producer

2020-12-10 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-9552. Resolution: Not A Problem > Stream should handle OutOfSequence exception thrown from Produ

[jira] [Resolved] (KAFKA-10813) StreamsProducer should catch InvalidProducerEpoch and throw TaskMigrated in all cases

2020-12-10 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-10813. - Resolution: Fixed > StreamsProducer should catch InvalidProducerEpoch and throw TaskMigra

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

2020-12-08 Thread Boyang Chen
g the interval in addition to the file watch could result in a > better worst case scenario. > > I understand it would require introducing at least one new configuration > for the interval, so maybe this doesn't have to solved in this KIP. > > > > -- >

Re: [VOTE] 2.7.0 RC4

2020-12-06 Thread Boyang Chen
Hey Bill, Unfortunately we have found another regression in 2.7 streams, which I have filed a blocker here . The implementation is done, and I will try to get reviews and merge ASAP. Best, Boyang On Fri, Dec 4, 2020 at 3:14 PM Jack Yang wrote:

[jira] [Created] (KAFKA-10813) StreamsProducer should catch InvalidProducerEpoch and throw TaskMigrated in all cases

2020-12-04 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10813: --- Summary: StreamsProducer should catch InvalidProducerEpoch and throw TaskMigrated in all cases Key: KAFKA-10813 URL: https://issues.apache.org/jira/browse/KAFKA-10813

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

2020-12-04 Thread Boyang Chen
solution. > > Cheers > noa > > ps. It seems my apple.com <http://apple.com/> email address ends up on > the list as apple.com <http://apple.com/>.INVALID. Is this a known > problem? For now I’m working around it by using my personal email. > > > On 4 Dec 2020, at

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

2020-12-04 Thread Boyang Chen
llo, Boyang Chen. > > I think this KIP overlaps with my idea [1] of exposing information about > certificates Kafka uses. > Kafka administrator should initiate renewal certificates procedure not > long before the certificate expires. > But, for now, there is no way for a

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

2020-12-04 Thread Boyang Chen
ils, the previous store should be effective. I will state that in the KIP. > Thanks, > > -- > Igor > > On Fri, Dec 4, 2020, at 1:28 AM, Boyang Chen wrote: > > Hey there, > > > > I would like to start the discussion thread for KIP-687: > > > https://cwiki.apa

[DISCUSS] KIP-687: Automatic Reloading of Security Store

2020-12-03 Thread Boyang Chen
Hey there, I would like to start the discussion thread for KIP-687: https://cwiki.apache.org/confluence/display/KAFKA/KIP-687%3A+Automatic+Reloading+of+Security+Store This KIP is trying to deprecate the AlterConfigs API support of updating the security store by reloading path in-place, and

[jira] [Created] (KAFKA-10807) AlterConfig should be validated by the target broker

2020-12-03 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10807: --- Summary: AlterConfig should be validated by the target broker Key: KAFKA-10807 URL: https://issues.apache.org/jira/browse/KAFKA-10807 Project: Kafka Issue

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2020-12-02 Thread Boyang Chen
t; > What I am wondering is, if we should introduce an exception interface > that non-fatal exception would implement instead of creating a new class > that will wrap non-fatal exceptions? What would be the pros/cons for > both designs? > > > -Matthias > > > On 12/2/20

[DISCUSS] KIP-691: Transactional Producer Exception Handling

2020-12-02 Thread Boyang Chen
Hey there, I would like to start a discussion thread for KIP-691: https://cwiki.apache.org/confluence/display/KAFKA/KIP-691%3A+Enhance+Transactional+Producer+Exception+Handling The KIP is aiming to simplify the exception handling logic for transactional Producer users by classifying fatal and

[DISCUSSION] KIP-650: Enhance Kafkaesque Raft semantics

2020-12-02 Thread Boyang Chen
Hey there, I would like to start a discussion thread for a KIP to improve on our existing Kafka Raft semantics, specifically adding pre-vote and linearizable read: https://cwiki.apache.org/confluence/display/KAFKA/KIP-650%3A+Enhance+Kafkaesque+Raft+semantics Let me know what you think, thank

Re: Add permission to create KIP on Confluence

2020-11-23 Thread Boyang Chen
Done, thank you for contributing! From: Prateek Agarwal Sent: Tuesday, November 24, 2020 1:19 AM To: dev@kafka.apache.org Subject: Add permission to create KIP on Confluence Hi team, I have created an account on the Apache Confluence site with username

[jira] [Created] (KAFKA-10733) Enforce exception thrown for KafkaProducer txn APIs

2020-11-17 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10733: --- Summary: Enforce exception thrown for KafkaProducer txn APIs Key: KAFKA-10733 URL: https://issues.apache.org/jira/browse/KAFKA-10733 Project: Kafka Issue Type

[jira] [Created] (KAFKA-10714) Save unnecessary end txn call when the transaction is confirmed to be done

2020-11-12 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10714: --- Summary: Save unnecessary end txn call when the transaction is confirmed to be done Key: KAFKA-10714 URL: https://issues.apache.org/jira/browse/KAFKA-10714 Project

[jira] [Created] (KAFKA-10699) Add system test coverage for group coordinator emigration

2020-11-08 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10699: --- Summary: Add system test coverage for group coordinator emigration Key: KAFKA-10699 URL: https://issues.apache.org/jira/browse/KAFKA-10699 Project: Kafka

Re: [VOTE] 2.7.0 RC1

2020-11-05 Thread Boyang Chen
Hey Bill, we (Kudos to Magnus) found a blocker for 2.7 on the new Producer error code: https://issues.apache.org/jira/browse/KAFKA-10687 that needs to be fixed. I will start preparing the patch ASAP, just FYI. Best, Boyang On Wed, Nov 4, 2020 at 11:42 AM Bill Bejeck wrote: > * Successful

[jira] [Created] (KAFKA-10687) Produce request should be bumped for new error code PRODUCE_FENCED

2020-11-05 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10687: --- Summary: Produce request should be bumped for new error code PRODUCE_FENCED Key: KAFKA-10687 URL: https://issues.apache.org/jira/browse/KAFKA-10687 Project: Kafka

[jira] [Resolved] (KAFKA-10181) Create Envelope RPC and redirection template for configuration change RPCs

2020-11-04 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-10181. - Resolution: Fixed > Create Envelope RPC and redirection template for configuration change R

[jira] [Resolved] (KAFKA-10343) Add IBP based ApiVersion constraint tests

2020-11-02 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-10343. - Resolution: Won't Fix We are planning to work on a more long-term fix for this issue, see

[jira] [Created] (KAFKA-10674) Brokers should know the active controller ApiVersion after enabling KIP-590 forwarding

2020-11-02 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10674: --- Summary: Brokers should know the active controller ApiVersion after enabling KIP-590 forwarding Key: KAFKA-10674 URL: https://issues.apache.org/jira/browse/KAFKA-10674

[jira] [Created] (KAFKA-10668) Avoid deserialization on second hop for request forwarding

2020-10-30 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10668: --- Summary: Avoid deserialization on second hop for request forwarding Key: KAFKA-10668 URL: https://issues.apache.org/jira/browse/KAFKA-10668 Project: Kafka

[jira] [Created] (KAFKA-10667) Add timeout for forwarding requests

2020-10-30 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10667: --- Summary: Add timeout for forwarding requests Key: KAFKA-10667 URL: https://issues.apache.org/jira/browse/KAFKA-10667 Project: Kafka Issue Type: Sub-task

Re: Permission for contribution

2020-10-29 Thread Boyang Chen
Added you to the JIRA. What's your id for wiki? On Thu, Oct 29, 2020 at 1:23 PM rohit deshpande wrote: > I forgot to provide details. > > My email id: rohitmdeshpa...@gmail.com > This request is regarding code contribution. > Thanks, > Rohit > > On Thu, Oct 29, 2020 at 11:58 AM rohit deshpande

[jira] [Created] (KAFKA-10663) Flakey test ConsumerBounceTest#testSeekAndCommitWithBrokerFailures

2020-10-29 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10663: --- Summary: Flakey test ConsumerBounceTest#testSeekAndCommitWithBrokerFailures Key: KAFKA-10663 URL: https://issues.apache.org/jira/browse/KAFKA-10663 Project: Kafka

Re: [DISCUSS] Apache Kafka 2.7.0 release

2020-10-29 Thread Boyang Chen
; > we > > > > > > > > won't > > > > > > > > >>>>> be > > > > > > > > >>>>>>> able to merge the tooling changes before feature > freeze > > > > date. > > > > > > >

[jira] [Created] (KAFKA-10657) Incorporate Envelope into auto-generated JSON schema

2020-10-28 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10657: --- Summary: Incorporate Envelope into auto-generated JSON schema Key: KAFKA-10657 URL: https://issues.apache.org/jira/browse/KAFKA-10657 Project: Kafka Issue

[jira] [Resolved] (KAFKA-9999) Internal topic creation failure should be non-fatal and trigger explicit rebalance

2020-10-22 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-. Resolution: Won't Fix > Internal topic creation failure should be non-fatal and trigger expli

Re: [ANNOUNCE] New committer: David Jacot

2020-10-16 Thread Boyang Chen
Congrats David, well deserved! On Fri, Oct 16, 2020 at 6:45 PM John Roesler wrote: > Congratulations, David! > -John > > On Fri, Oct 16, 2020, at 20:15, Konstantine Karantasis wrote: > > Congrats, David! > > > > Konstantine > > > > > > On Fri, Oct 16, 2020 at 3:36 PM Ismael Juma wrote: > > > >

[jira] [Created] (KAFKA-10607) Ensure the error counts contains the NONE

2020-10-13 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10607: --- Summary: Ensure the error counts contains the NONE Key: KAFKA-10607 URL: https://issues.apache.org/jira/browse/KAFKA-10607 Project: Kafka Issue Type

[jira] [Created] (KAFKA-10594) Enhance Raft exception handling

2020-10-09 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10594: --- Summary: Enhance Raft exception handling Key: KAFKA-10594 URL: https://issues.apache.org/jira/browse/KAFKA-10594 Project: Kafka Issue Type: Sub-task

Re: [VOTE] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

2020-10-09 Thread Boyang Chen
> I think this approach would give users enough time to add the required > support. In any case, I don't think compatibility should be a blocker here > if we think it's the best way forward. This seems like a decision which > will affect things for a long time and we need to be allowed to

Re: [VOTE] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

2020-09-25 Thread Boyang Chen
roblem only. Admin clients still need to learn the proper ApiVersion from the broker, which means we need to bump IBP to limit the version range. Boyang > Thanks, > > Jun > > On Thu, Sep 24, 2020 at 6:22 PM Boyang Chen > wrote: > > > Hey Jason and Jun, > > > > tha

Re: [VOTE] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

2020-09-24 Thread Boyang Chen
or > > > > conversion between versions, but that would restrict the flexibility > > that > > > > the versioning is providing. It would also be a large effort to avoid > > > > introducing regressions through conversion. Sadly this broadens the >

Re: [VOTE] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

2020-09-24 Thread Boyang Chen
in any circumstance, since the flexible field support is required to be open-ended on the high side. Let me know if you have any questions. Best, Boyang On Thu, Aug 6, 2020 at 6:11 PM Boyang Chen wrote: > Hey there, > > we are going to introduce a minor change to bump the version of

Re: [DISCUSS] KIP-671: Shutdown Streams Application when appropriate exception is thrown

2020-09-21 Thread Boyang Chen
Thanks for the KIP Walker. In the KIP we mentioned "In order to communicate the shutdown request from one client to the others we propose to update the SubcriptionInfoData to include a short field which will encode an error code.", is there a dedicated error code that we should define here, or it

Re: [DISCUSS] Apache Kafka 2.7.0 release

2020-09-21 Thread Boyang Chen
Hey Bill, unfortunately KIP-590 will not be in 2.7 release, could you move it to postponed KIPs? Best, Boyang On Thu, Sep 10, 2020 at 2:41 PM Bill Bejeck wrote: > Hi Gary, > > It's been added. > > Regards, > Bill > > On Thu, Sep 10, 2020 at 4:14 PM Gary Russell wrote: > > > Can someone add a

[jira] [Created] (KAFKA-10508) Consider moving ForwardRequestHandler to a separate class

2020-09-21 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10508: --- Summary: Consider moving ForwardRequestHandler to a separate class Key: KAFKA-10508 URL: https://issues.apache.org/jira/browse/KAFKA-10508 Project: Kafka

Re: [VOTE] KIP-664: Provide tooling to detect and abort hanging transactions

2020-09-18 Thread Boyang Chen
Thanks Jason, +1 (binding) from me Boyang On Fri, Sep 11, 2020 at 10:12 AM Robert Barrett wrote: > +1 (non-binding) > > Thanks Jason! > > On Tue, Sep 8, 2020 at 5:28 PM Guozhang Wang wrote: > > > +1. Thanks! > > > > Guozhang > > > > On Tue, Sep 8, 2020 at 3:04 PM Ron Dagostino wrote: > > > >

Re: [DISCUSS] KIP-664: Provide tooling to detect and abort hanging transactions

2020-09-17 Thread Boyang Chen
Thanks for the updates Jason. I'm pretty satisfied with the overall motivation and proposed solution, just a couple of more comments. 1. Why do we need to use type string for `StatesFilter` instead of a short value, as we could translate it and save space? 2. I'm wondering whether the

Re: [DISCUSS] KIP-664: Provide tooling to detect and abort hanging transactions

2020-08-27 Thread Boyang Chen
Thanks Jason for the tooling proposal. A couple of comments: 1. For the analysis section, is there any consistency guarantee for `ListTransactions` and `DescribeTransactions`? Let's say the coordinator receives a DescribeTransactions while the transaction is almost complete at the same time,

Re: Requesting to add to contributor list and write access for wiki

2020-08-20 Thread Boyang Chen
Added both permissions, you are good to go. On Thu, Aug 20, 2020 at 8:05 AM sasilekha wrote: > Hello Team, > > I am interested in contributing to Apache Kafka codebase. Kindly add me to > contributor list. It would help me in assigning Jiras to myself on Kafka. > > Also, kindly grant me wiki

Re: [VOTE] KIP-657: Add Customized Kafka Streams Logo

2020-08-19 Thread Boyang Chen
e: > > > > > > > > I'm leaning towards design B primarily because it reminds me of the > > > Firefox > > > > logo which I like a lot. But I also share Adam's concern that it > should > > > > better not obscure the Kafka logo --- so if we can tw

Re: Permission to create a KIP

2020-08-18 Thread Boyang Chen
Done, thanks for the interest in Kafka! On Tue, Aug 18, 2020 at 10:20 AM Neemias Junior wrote: > Hello, could you please give me permission to create a Kafka Improvement > Proposal? My ID is neemiasjnr. If you want I can explain what I'm going to > propose beforehand. Thank you! > > Best

Re: [EXTERNAL] Re: Request for access to create KIP

2020-08-14 Thread Boyang Chen
Done! On Thu, Aug 13, 2020 at 2:25 PM Koushik Chitta wrote: > Accountid: koushikchitta > > Cheers, > Koushik > > -Original Message----- > From: Boyang Chen > Sent: Sunday, August 9, 2020 6:02 PM > To: dev > Subject: [EXTERNAL] Re: Request for access to c

  1   2   3   4   5   6   7   8   >