Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

Can you describe how sourceName is inferred based on the new API ? Please fill out JIRA number. BTW here is the URL for the KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-233%3A+Simplify+StreamsBuilder%23addGlobalStore On Mon, Dec 4, 2017 at 7:39 AM, Panuwat Anawatmongkhon <

[jira] [Created] (KAFKA-6307) mBeanName should be removed before returning from JmxReporter#removeAttribute()

Ted Yu created KAFKA-6307: - Summary: mBeanName should be removed before returning from JmxReporter#removeAttribute() Key: KAFKA-6307 URL: https://issues.apache.org/jira/browse/KAFKA-6307 Project: Kafka

[jira] [Created] (KAFKA-6303) Potential lack of synchronization in NioEchoServer#AcceptorThread

Ted Yu created KAFKA-6303: - Summary: Potential lack of synchronization in NioEchoServer#AcceptorThread Key: KAFKA-6303 URL: https://issues.apache.org/jira/browse/KAFKA-6303 Project: Kafka Issue

[jira] [Created] (KAFKA-6300) SelectorTest may fail with ConcurrentModificationException

Ted Yu created KAFKA-6300: - Summary: SelectorTest may fail with ConcurrentModificationException Key: KAFKA-6300 URL: https://issues.apache.org/jira/browse/KAFKA-6300 Project: Kafka Issue Type: Test

Re: [DISCUSS] KIP-232: Detect outdated metadata by adding ControllerMetadataEpoch field

bq. It the controller_epoch of the incoming MetadataResponse, or if the controller_epoch is the same but the controller_metadata_epoch Can you update the above sentence so that the intention is clearer ? Thanks On Fri, Dec 1, 2017 at 6:33 PM, Dong Lin wrote: > Hi all, > >

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

dminClient. */brokers/ids/id* contains the ephemeral > metadata registered by broker *.* For broker version, we don't want the > data to outlive the broker. Hence adding it to */brokers/ids/id.* > > On Fri, Dec 1, 2017 at 5:38 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > &

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

>> > > On Wed, Nov 22, 2017, at 12:52, Rajini Sivaram wrote: > >>> > > > Hi Tom, > >>> > > > > >>> > > > No, I am not proposing this as a way to configure replication > >>> quotas. > >>> > &

Re: [VOTE] KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer

+1 On Thu, Nov 30, 2017 at 12:56 AM, Manikumar wrote: > +1 (non-binding) > > On Thu, Nov 30, 2017 at 8:35 AM, Hu Xi wrote: > > > Hi all, > > > > As I didn't see any further discussion around this KIP, I'd like to start > > voting. > > > > KIP

Re: [DISCUSS] KIP-227: Introduce Incremental FetchRequests to Increase Partition Scalability

For compatibility, I assume that the follower with new code would detect when the leader doesn't support this feature and fall back to the existing full request. Cheers On Tue, Nov 21, 2017 at 3:44 PM, Colin McCabe <cmcc...@apache.org> wrote: > On Tue, Nov 21, 2017, at 14:35, Ted

Re: [DISCUSS] KIP-227: Introduce Incremental FetchRequests to Increase Partition Scalability

Fill out the JIRA number. bq. If the leader receives an *IncrementalFetchRequest* with a UUID that does not match that of the latest *FetchResponse* *By *latest *FetchResponse, you mean latest response for the broker Id, right ?* *Cheers* On Tue, Nov 21, 2017 at 1:02 PM, Colin McCabe

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

Thanks for the quick response. It seems the config following --delete-config should be quoted. Cheers On Mon, Nov 20, 2017 at 12:02 PM, Rajini Sivaram <rajinisiva...@gmail.com> wrote: > Ted, > > Have added an example for --delete-config. > > On Mon, Nov 20, 2017 at 7:

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

hannel created using the old SslFactory will not be > impacted. > > Regards, > > Rajini > > > On Mon, Nov 20, 2017 at 4:39 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > bq. (e.g. increase network/IO threads) > > > > Would decreasi

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

bq. (e.g. increase network/IO threads) Would decreasing network/IO threads be supported ? bq. void reconfigure(Map configs); What if some keys in configs are not in the Set returned by reconfigurableConfigs() ? Would exception be thrown ? If so, please specify which exception

Re: SessionKeySchema#segmentsToSearch()

GreaterThanEqualToTimestamp` and ` > getMaxSegmentLessThanEqualToTimestamp`: I think you meant to leave it as a > comment on https://github.com/apache/kafka/pull/4162? This is only added > in > that PR. > > > Guozhang > > > On Sat, Nov 18, 2017 at 11:16 AM, Ted Yu <yuzhih...@gmail.

Re: SessionKeySchema#segmentsToSearch()

, from, to); The minSegment would be first in List and maxSegment would be last in List. On Sat, Nov 18, 2017 at 11:09 AM, Ted Yu <yuzhih...@gmail.com> wrote: > Hi, > I was reading code for SessionKeySchema#segmentsToSearch() where: > > public List segmentsToSearch(final Segmen

SessionKeySchema#segmentsToSearch()

Hi, I was reading code for SessionKeySchema#segmentsToSearch() where: public List segmentsToSearch(final Segments segments, final long from, final long to) { return segments.segments(from, Long.MAX_VALUE); I wonder why the parameter to is ignored. WindowKeySchema#segmentsToSearch()

Re: Interested in being a contributor

Please read this: https://kafka.apache.org/contributing You can use this Filter to find issues for new contributor: https://issues.apache.org/jira/issues/?jql=project%20%3D%20KAFKA%20AND%20labels%20%3D%20newbie%20AND%20status%20%3D%20Open Cheers On Sat, Nov 18, 2017 at 2:12 AM, Panuwat

[jira] [Created] (KAFKA-6232) SaslSslAdminClientIntegrationTest sometimes fails

Ted Yu created KAFKA-6232: - Summary: SaslSslAdminClientIntegrationTest sometimes fails Key: KAFKA-6232 URL: https://issues.apache.org/jira/browse/KAFKA-6232 Project: Kafka Issue Type: Test

Re: [VOTE] KIP-220: Add AdminClient into Kafka Streams' ClientSupplier

+1 On Fri, Nov 17, 2017 at 9:34 AM, Bill Bejeck wrote: > +1 > > Thanks, > Bill > > On Fri, Nov 17, 2017 at 12:13 PM, Colin McCabe wrote: > > > +1 (non-binding) > > > > Colin > > > > On Tue, Nov 14, 2017, at 10:02, Guozhang Wang wrote: > > > Hello folks, >

[jira] [Created] (KAFKA-6228) Intermittent test failure in FetchRequestTest.testDownConversionWithConnectionFailure

Ted Yu created KAFKA-6228: - Summary: Intermittent test failure in FetchRequestTest.testDownConversionWithConnectionFailure Key: KAFKA-6228 URL: https://issues.apache.org/jira/browse/KAFKA-6228 Project: Kafka

[jira] [Created] (KAFKA-6215) KafkaStreamsTest fails in trunk

Ted Yu created KAFKA-6215: - Summary: KafkaStreamsTest fails in trunk Key: KAFKA-6215 URL: https://issues.apache.org/jira/browse/KAFKA-6215 Project: Kafka Issue Type: Test Reporter: Ted

Re: [VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

Can you fill in JIRA number (KAFKA-6058 ) ? If one JIRA is used for the two additions, consider updating the JIRA title. On Tue, Nov 14, 2017 at 9:04 AM, Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Hi all, > > As I didn't

Re: [VOTE] KIP-224: Add configuration parameters `retries` to Streams API

+1 On Mon, Nov 13, 2017 at 4:20 PM, Matthias J. Sax wrote: > Hi @all, > > I would like to start the vote for KIP-224: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 224%3A+Add+configuration+parameter+%60retries%60+to+Streams+API > > > Thanks a lot! > > >

Re: [VOTE] 0.11.0.2 RC0

ilure. It has been difficult to make > integration tests for quotas reliable since they verify the time taken to > complete after running for a short duration. We should make the tests > reliable, but this shouldn't be a blocker for the release. > > > On Sat, Nov 11, 2017 at 5:29 PM

Re: [VOTE] 0.11.0.2 RC0

Running test suite I saw: kafka.admin.ReassignPartitionsClusterTest > shouldExecuteThrottledReassignment FAILED java.lang.AssertionError: Expected replication to be < 1 but was 10138 at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.assertTrue(Assert.java:41)

Re: [DISCUSS] KIP-224: Add configuration parameters `retries` and `retry.backoff.ms` to Streams API

>> can > >>> effectively swallow-and-retry-in-next-loop as we did for non-global > >> stores. > >>> Since global stores are per task not per thread, we would not process > the > >>> task after the global store is bootstrapped fu

[jira] [Resolved] (KAFKA-6135) TransactionsTest#testFencingOnCommit may fail due to unexpected KafkaException

[ https://issues.apache.org/jira/browse/KAFKA-6135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved KAFKA-6135. --- Resolution: Cannot Reproduce > TransactionsTest#testFencingOnCommit may fail due to unexpected KafkaExcept

Re: [DISCUSS]KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer

Can you fill out JIRA number ? "TOPIC-PARTITION_ID.record-lead" In the code sample, "records-" is used. Please make them consistent. On Thu, Nov 9, 2017 at 1:03 AM, Hu Xi wrote: > Hi all, > > > As per Jun Rao's suggestion, I opened up the KIP-223(https://cwiki.apache. >

Re: Regarding kafka produce Image(18mb)

bq. Each image if of 18mb in size. Seems the image size is non-trivial. Can you tell us more about use case ? e.g. what systems (Apache projects) are involved. Just want to see if there is another route for sending the images. On Thu, Nov 9, 2017 at 2:15 AM, SADHNA

[jira] [Created] (KAFKA-6193) ReassignPartitionsClusterTest.shouldPerformMultipleReassignmentOperationsOverVariousTopics fails sometimes

Ted Yu created KAFKA-6193: - Summary: ReassignPartitionsClusterTest.shouldPerformMultipleReassignmentOperationsOverVariousTopics fails sometimes Key: KAFKA-6193 URL: https://issues.apache.org/jira/browse/KAFKA-6193

Re: [DISCUSS] KIP-224: Add configuration parameters `retries` and `retry.backoff.ms` to Streams API

lgtm bq. pass both parameter parameter should be in plural. Same with 'two new configuration parameter' Cheers On Thu, Nov 9, 2017 at 4:20 AM, Damian Guy wrote: > Thanks Matthias, LGTM > > On Thu, 9 Nov 2017 at 11:13 Matthias J. Sax wrote: > > >

Re: kafka-pr-jdk9-scala2.12 keeps failing

in later builds: > https://builds.apache.org/job/kafka-pr-jdk9-scala2.12/2498/console > > Does anything get reverted? > > > Guozhang > > > On Tue, Nov 7, 2017 at 8:33 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > https://builds.apache.org/job/kafka-pr-j

Re: kafka-pr-jdk9-scala2.12 keeps failing

2498/console > > Does anything get reverted? > > > Guozhang > > > On Tue, Nov 7, 2017 at 8:33 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > https://builds.apache.org/job/kafka-pr-jdk9-scala2.12/2470/ is green. > > > > Thanks Ismael. > > >

Re: kafka-pr-jdk9-scala2.12 keeps failing

Mon, Nov 6, 2017 at 6:25 PM, Ismael Juma <ism...@juma.me.uk> wrote: > > > Thanks! > > > > Ismael > > > > On Mon, Nov 6, 2017 at 3:48 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > >> Logged https://issues.apache.org/jira/browse/INFRA-15

Re: [DISCUSS] KIP-213 Support non-key joining in KTable

1.2017 12:58, Damian Guy wrote: >>>>>> >>>>>> Hi Jan, Thanks for the KIP! >>>>>>> >>>>>>> In both alternatives the API will need to use the `Joined` class >>>>>>> rather >>>>>>&

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

bq. enlarge the score of through() I guess you meant scope. On Mon, Nov 6, 2017 at 1:15 PM, Jeyhun Karimov wrote: > Hi, > > Sorry for the late reply. I am convinced that we should enlarge the score > of through() (add more overloads) instead of introducing a separate set

Re: [DISCUSS] 0.11.0.2 bug fix release

After clicking the outstanding issues link, I only saw KAFKA-6007. Here is the filter in case anyone encounters the same : status in (Open, Reopened, "In Progress", "Patch Available") AND Project = kafka AND fixVersion=0.11.0.2 On Mon, Nov 6, 2017 at 2:47 AM, Rajini Sivaram

Re: [ANNOUNCE] New committer: Onur Karaman

Congratulations, Onur! On Mon, Nov 6, 2017 at 9:24 AM, Jun Rao wrote: > Hi, everyone, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur > Karaman. > > Onur's most significant work is the improvement of Kafka controller, which > is the brain of a

Re: kafka producer : number of record pushed to topic limited

Can you give us some more information ? Were you using a single node setup (127.0.0.1) ? Which release of Kafka are you using ? Anything interesting from broker log ? On Mon, Nov 6, 2017 at 8:52 AM, Dhia Beji wrote: > Hello, > > Would you please help me, I m trying to

Re: [DISCUSS] KIP-222 - Add "describe consumer group" to KafkaAdminClient

Please fill out Discussion thread and JIRA fields. Thanks On Mon, Nov 6, 2017 at 2:02 AM, Tom Bentley wrote: > Hi Jorge, > > Thanks for the KIP. A few initial comments: > > 1. The AdminClient doesn't have any API like `listConsumerGroups()` > currently, so in general how

Re: kafka-pr-jdk9-scala2.12 keeps failing

t; Ismael > > On 3 Nov 2017 1:53 am, "Ted Yu" <yuzhih...@gmail.com> wrote: > > > Looking at earlier runs, e.g. : > > https://builds.apache.org/job/kafka-pr-jdk9-scala2.12/2384/console > > > > FAILURE: Build failed with an exception. > >

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

t; > Maybe, we could use `through()` to create a topics in the back ground > and picky back all to `Produced`. > > > -Matthias > > On 11/4/17 4:16 PM, Ted Yu wrote: > > API is given without much javadoc on the role / meaning of method > > parameters. > > > &g

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

API is given without much javadoc on the role / meaning of method parameters. Can you enrich with descriptive javadoc ? On Sat, Nov 4, 2017 at 8:01 AM, Jeyhun Karimov wrote: > Dear community, > > I would like to initiate discussion on KIP-221 [1] based on issue [2]. >

Re: [DISCUSS] KIP-220: Add AdminClient into Kafka Streams' ClientSupplier

Looks good overall. bq. the creation within StreamsPartitionAssignor Typo above: should be StreamPartitionAssignor On Fri, Nov 3, 2017 at 4:49 PM, Guozhang Wang wrote: > Hello folks, > > I have filed a new KIP on adding AdminClient into Streams for internal > topic

Re: kafka-pr-jdk9-scala2.12 keeps failing

grade caused the issue? > > > Guozhang > > On Thu, Nov 2, 2017 at 6:25 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > Hi, > > I took a look at recent runs under https://builds.apache. > > org/job/kafka-pr-jdk9-scala2.12 > > > > All the recent runs faile

kafka-pr-jdk9-scala2.12 keeps failing

Hi, I took a look at recent runs under https://builds.apache. org/job/kafka-pr-jdk9-scala2.12 All the recent runs failed with: Could not update commit status of the Pull Request on GitHub. org.kohsuke.github.HttpException: Server returned HTTP response code: 201, message: 'Created' for URL:

Re: [DISCUSS] KIP-217: Expose a timeout to allow an expired ZK session to be re-created

The following JIRA provides some background on why upgrading immediately following new release may not be prudent (though I expect this to be rare): ZOOKEEPER-2347 On Thu, Nov 2, 2017 at 3:00 PM, Ted Yu <yuzhih...@gmail.com> wrote: > Stephane: > bq. hasn't acted in over a year &

Re: [DISCUSS] KIP-217: Expose a timeout to allow an expired ZK session to be re-created

ig and just retry > the creation of Zookeeper forever. This is an improvement from the current > situation and if zookeeper-2184 is fixed in the future, we don't need to > deprecate the config. > > Thanks, > > Jun > > On Thu, Nov 2, 2017 at 9:02 AM, Ted Yu <yuzhih...

[jira] [Resolved] (KAFKA-6137) RestoreIntegrationTest sometimes fails with assertion error

[ https://issues.apache.org/jira/browse/KAFKA-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved KAFKA-6137. --- Resolution: Cannot Reproduce > RestoreIntegrationTest sometimes fails with assertion er

Re: [DISCUSS] KIP-217: Expose a timeout to allow an expired ZK session to be re-created

ZOOKEEPER-2184 is scheduled for 3.4.12 whose release is unknown. I think adding the session recreation on Kafka side should benefit Kafka users, especially those who don't plan to move to 3.4.12+ in the near future. On Wed, Nov 1, 2017 at 6:34 PM, Jun Rao wrote: > Hi,

Re: [VOTE] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

+1 On Wed, Nov 1, 2017 at 4:50 PM, Guozhang Wang wrote: > +1 (binding) from me. Thanks! > > On Wed, Nov 1, 2017 at 4:50 PM, Guozhang Wang wrote: > > > The vote should stay open for at least 72 hours. The bylaws can be found > > here

Re: [DISCUSS] KIP-218: Make KafkaFuture.Function java 8 lambda compatible

KAFKA-4423 is still open. When would Java 7 be dropped ? Thanks On Wed, Nov 1, 2017 at 8:56 AM, Ismael Juma <ism...@juma.me.uk> wrote: > On Wed, Nov 1, 2017 at 3:51 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > bq. Wait for a kafka release which will not support java

Re: [DISCUSS] KIP-218: Make KafkaFuture.Function java 8 lambda compatible

bq. PR#4033 makes from those abstract classes interfaces. Please adjust the syntax. bq. Wait for a kafka release which will not support java 7 anymore Do you want to raise a separate thread for the above ? On Wed, Nov 1, 2017 at 7:50 AM, Steven Aerts

Re: [VOTE] KIP-215: Add topic regex support for Connect sinks

+1 Original message From: Jeff Klukas Date: 11/1/17 7:40 AM (GMT-08:00) To: dev@kafka.apache.org Subject: [VOTE] KIP-215: Add topic regex support for Connect sinks I haven't heard any additional concerns over the proposal, so I'd like to get the voting

Re: [VOTE] 1.0.0 RC4

+1 (non-binding) Verified signatures. Ran test suite. On Tue, Oct 31, 2017 at 8:53 AM, Manikumar wrote: > +1 (non-binding). Verified quickstart, ran producer/consumer perf scripts, > streams quickstart > ran tests on src distribution. > > On Tue, Oct 31, 2017 at 8:42

Re: [DISCUSS] KIP-190: Handle client-ids consistently between clients and brokers

Can the Discussion Thread link be filled out ? Cheers On Wed, Sep 27, 2017 at 2:03 AM, Mickael Maison wrote: > I don't know the history either, I quickly scanned the KIP-55 threads > and couldn't see it being discussed. > > Anyway, your suggestion sounds good to me,

Re: [VOTE] KIP-214: Add zookeeper.max.in.flight.requests config to the broker

+1 On Fri, Oct 27, 2017 at 10:15 AM, Onur Karaman wrote: > I'd like to start the vote for KIP-214: Add > zookeeper.max.in.flight.requests config to the broker > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- >

Re: Errors when running integration/kafka/tools/MirrorMakerIntegrationTest

The error log appears in other tests as well. I ran MirrorMakerIntegrationTest on trunk just now - it passed. I didn't see the test failing in any recent Jenkins builds. There're flaky tests, such as KAFKA-6137 FYI On Fri, Oct 27, 2017 at 8:35 AM, Pavel Drankov wrote: >

[jira] [Resolved] (KAFKA-6109) ResetIntegrationTest may fail due to IllegalArgumentException

[ https://issues.apache.org/jira/browse/KAFKA-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved KAFKA-6109. --- Resolution: Cannot Reproduce > ResetIntegrationTest may fail due to IllegalArgumentExcept

[jira] [Created] (KAFKA-6137) RestoreIntegrationTest sometimes fails with assertion error

Ted Yu created KAFKA-6137: - Summary: RestoreIntegrationTest sometimes fails with assertion error Key: KAFKA-6137 URL: https://issues.apache.org/jira/browse/KAFKA-6137 Project: Kafka Issue Type

Re: Re: [DISCUSS] KIP-213 Support non-key joining in KTable

> Not even sure if it makes sense to introduce A and B or just stick with > "this ktable", "other ktable" > > Thank you > Jan > > > On 27.10.2017 06:58, Ted Yu wrote: > >> Do you mind addressing my previous comments ? >> >> http://search

Re: [DISCUSS] KIP-213 Support non-key joining in KTable

Do you mind addressing my previous comments ? http://search-hadoop.com/m/Kafka/uyzND1hzF8SRzUqb?subj=Re+DISCUSS+KIP+213+Support+non+key+joining+in+KTable On Thu, Oct 26, 2017 at 9:38 PM, Jan Filipiak wrote: > Hello everyone, > > this is the new discussion thread after

Re: [DISCUSS] KIP-215: Add topic regex support for Connect sinks

bq. Users may specify only one of 'topics' or 'topics.pattern'. Can you fill in which exception would be thrown if both of them are specified ? Cheers On Thu, Oct 26, 2017 at 6:27 PM, Jeff Klukas wrote: > Looking for feedback on > >

Re: Failed to start Apache Kafka

Hmm. You ran into KAFKA-5077. Can you try 1.0.0 RC3 ? http://search-hadoop.com/m/Kafka/uyzND18Q3Vh1Q5jUV1?subj=+VOTE+1+0+0+RC3 On Thu, Oct 26, 2017 at 10:08 AM, Naren gs wrote: > Hello, > I am starter in Apache Kafka, I downloaded the latest version and on > running the

[jira] [Created] (KAFKA-6135) TransactionsTest#testFencingOnCommit may fail due to unexpected KafkaException

Ted Yu created KAFKA-6135: - Summary: TransactionsTest#testFencingOnCommit may fail due to unexpected KafkaException Key: KAFKA-6135 URL: https://issues.apache.org/jira/browse/KAFKA-6135 Project: Kafka

Re: [DISCUSS] KIP-214: Add zookeeper.max.in.flight.requests config to the broker

Can you fill out JIRA number ? Thanks Original message From: Onur Karaman Date: 10/25/17 10:37 PM (GMT-08:00) To: dev@kafka.apache.org Subject: [DISCUSS] KIP-214: Add zookeeper.max.in.flight.requests config to the broker Hey everyone. Giving

Re: [DISCUSS] KIP-213: Add zookeeper.max.in.flight.requests config to the broker

This is for KAFKA-5894, right ? Please fill out the JIRA link. +1 on this proposal. On Wed, Oct 25, 2017 at 4:11 PM, Onur Karaman wrote: > Hey everyone. > > I made a config kip, KIP-213: Add zookeeper.max.in.flight.requests config > to the broker: >

Re: [VOTE] 1.0.0 RC3

bq. Tag to be voted upon (off 1.0 branch) is the 1.0.0-rc2 tag: There seems to be a typo above: 1.0.0-rc3 tag FYI On Mon, Oct 23, 2017 at 6:00 PM, Guozhang Wang wrote: > Hello Kafka users, developers and client-developers, > > This is the third candidate for release of

[jira] [Created] (KAFKA-6109) ResetIntegrationTest may fail due to IllegalArgumentException

Ted Yu created KAFKA-6109: - Summary: ResetIntegrationTest may fail due to IllegalArgumentException Key: KAFKA-6109 URL: https://issues.apache.org/jira/browse/KAFKA-6109 Project: Kafka Issue Type

Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

Please fill out 'Rejected Alternatives' section. Thanks On Wed, Oct 18, 2017 at 4:45 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Hi all, > > I created a KIP to address the group offset expiration issue reported in > KAFKA-4682: >

[jira] [Resolved] (KAFKA-5911) Avoid creation of extra Map for futures in KafkaAdminClient

[ https://issues.apache.org/jira/browse/KAFKA-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved KAFKA-5911. --- Resolution: Later > Avoid creation of extra Map for futures in KafkaAdminCli

Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

Can you create JIRA that corresponds to the KIP ? For the new config, how about naming it production.exception.processor.class ? This way it is clear that class name should be specified. Cheers On Wed, Oct 18, 2017 at 2:40 PM, Matt Farmer wrote: > Hello everyone, > > This is the

Re: working on KAFKA-4928

There was a PR https://github.com/apache/kafka/pull/2889 which was closed. It would be good for committers to chime in on the previous attempt. On Wed, Oct 18, 2017 at 8:39 AM, Pavel Drankov wrote: > Hi, > > My name is Pavel and I'm a very new to Kafka. I actually would

Re: [VOTE] KIP-207:The Offsets which ListOffsetsResponse returns should monotonically increase even during a partition leader change

+1 On Tue, Oct 17, 2017 at 11:23 AM, Apurva Mehta wrote: > +1 (non-binding) > > On Tue, Oct 17, 2017 at 11:11 AM, Colin McCabe wrote: > > > Hi all, > > > > I'd like to start the voting process for KIP-207:The Offsets which > > ListOffsetsResponse

Re: [VOTE] 1.0.0 RC1

After specifying the location of zookeeper jar: export CLASSPATH= The command can be executed successfully: bin/zookeeper-server-start.sh config/zookeeper.properties This doesn't seem to be Java 9 specific issue. On Mon, Oct 16, 2017 at 5:30 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com>

Re: [DISCUSS] KIP-209 Connection String Support

Can't you use IllegalArgumentException ? Some example in current code base: clients/src/main/java/org/apache/kafka/clients/Metadata.java: throw new IllegalArgumentException("Max time to wait for metadata updates should not be < 0 milliseconds"); On Mon, Oct 16, 2017 at 3:06 PM, Clebert Suconic

Re: [DISCUSS] KIP-209 Connection String Support

bq. I was waiting my email to go through the servers http://search-hadoop.com/ indexes mailing lists actively. The delay is very short. FYI On Mon, Oct 16, 2017 at 2:44 PM, Clebert Suconic <clebert.suco...@gmail.com> wrote: > On Mon, Oct 16, 2017 at 5:41 PM, Ted Yu <yuzhih...@gmai

Re: [DISCUSS] KIP-209 Connection String Support

Please update link for Discussion thread and JIRA There're two TBD's for Invalid conversion and parameters. Can you fill them out ? Thanks On Mon, Oct 16, 2017 at 2:30 PM, Clebert Suconic wrote: > I would like to start a discussion about KIP-209 >

Re: [DISCUSS] KIP-208: Add SSL support to Kafka Connect REST interface

+1 to this proposal. On Mon, Oct 16, 2017 at 7:49 AM, Jakub Scholz wrote: > I was having some more thoughts about it. We can simply take over what > Kafka broker implements for the listeners: > - We can take over the "listener" and "listener.security.protocol.map" > options to

Re: [DISCUSS] KIP-59 : Proposal for a kafka broker command

Please fill 'Discussion thread:' with URL to this thread. For 'Proposed Changes' section, is it possible to indent the lines from 'Broker Id' to 'Trailing partition count' ? This way, it is easier to read. bq. The command kafka-brokers.sh requires zookeeper information Is the above still true

Re: [VOTE] KIP-171 - Extend Consumer Group Reset Offset for Stream Application

+1 On Fri, Oct 13, 2017 at 3:32 PM, Matthias J. Sax wrote: > +1 > > > > On 9/11/17 3:04 PM, Jorge Esteban Quilcate Otoya wrote: > > Hi All, > > > > It seems that there is no further concern with the KIP-171. > > At this point we would like to start the voting process. > >

Re: [DISCUSS] KIP-208: Add SSL support to Kafka Connect REST interface

I agree with Randall. Actually I had the same thought during first round of review. On Fri, Oct 13, 2017 at 9:25 AM, Randall Hauch wrote: > Also, do we need these properties to be preceded with `rest`? I'd argue > that we're just configuring the worker's SSL information, and

Re: [VOTE] 1.0.0 RC0

gt; users, I think it is OK to not mention it in the upgrade guides. > > For developers rather than users of Kafka, they are assumed to be familiar > with the codebase and not only rely on upgrade guide docs for such > information. > > > Guozhang > > On Thu, Oct 12, 2017

Re: [VOTE] 1.0.0 RC0

> > Thanks Ted, > > > > I'm looking into this for possible doc changes now. > > > > Guozhang > > > > On Wed, Oct 11, 2017 at 3:23 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > >> Looks like the following change is needed for some dow

[jira] [Resolved] (KAFKA-5988) Consider removing StreamThread#STREAM_THREAD_ID_SEQUENCE

[ https://issues.apache.org/jira/browse/KAFKA-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved KAFKA-5988. --- Resolution: Won't Fix > Consider removing StreamThread#STREAM_THREAD_ID_SEQUE

Re: Limit Jenkins jobs on H0 to H13

e: > Hi Ted, > > Thanks for following up with INFRA on the issues we've been seeing. I asked > a clarifying comment in that ticket (for some reason it only allowed me to > add an internal comment). > > Ismael > > On Wed, Sep 20, 2017 at 2:31 AM, Ted Yu <yuzhih...@gmail.com

Re: [VOTE] 1.0.0 RC0

Looks like the following change is needed for some downstream project to compile their code (which was using 0.11.0.1): -import org.apache.kafka.common.protocol.SecurityProtocol; +import org.apache.kafka.common.security.auth.SecurityProtocol; I took a look at docs/upgrade.html but didn't see any

Re: Kafka Consumer - org.apache.kafka.common.errors.TimeoutException: Failed to get offsets by times in 305000 ms

I don't see values for the Consumer Properties. Can you try out 0.11.0.1 ? See http://search-hadoop.com/m/Kafka/uyzND1qxYr5prjxv?subj=Incorrect+consumer+offsets+after+broker+restart+0+11+0+0 On Wed, Oct 11, 2017 at 11:37 AM, SenthilKumar K wrote: > Hi All , Recently we

Re: [VOTE] KIP-204 : adding records deletion operation to the new Admin Client API

+1 On Mon, Oct 2, 2017 at 10:51 PM, Paolo Patierno wrote: > Hi all, > > I didn't see any further discussion around this KIP, so I'd like to start > the vote for it. > > Just for reference : https://cwiki.apache.org/ > confluence/display/KAFKA/KIP-204+%3A+adding+records+ >

Re: [VOTE] 1.0.0 RC0

Guozhang: I took a brief look under the staging tree. e.g. https://repository.apache.org/content/groups/staging/org/apache/kafka/kafka-clients/ I don't see 1.0.0 jars. Would the jars be populated later ? Thanks On Tue, Oct 10, 2017 at 6:34 PM, Guozhang Wang wrote: > Hello

Re: [DISCUSS] KIP-208: Add SSL support to Kafka Connect REST interface

For rest.ssl.clientAuth , I don't find counterpart in existing code. Can you add explanation on the KIP ? Thanks On Mon, Oct 9, 2017 at 8:25 AM, Jakub Scholz wrote: > Hi, > > I would like to start a discussion about KIP-208: Add SSL support to Kafka > Connect REST interface (

[jira] [Created] (KAFKA-6024) Consider moving validation in KafkaConsumer ahead of call to acquireAndEnsureOpen()

Ted Yu created KAFKA-6024: - Summary: Consider moving validation in KafkaConsumer ahead of call to acquireAndEnsureOpen() Key: KAFKA-6024 URL: https://issues.apache.org/jira/browse/KAFKA-6024 Project: Kafka

[jira] [Created] (KAFKA-6023) ThreadCache#sizeBytes() should check overflow

Ted Yu created KAFKA-6023: - Summary: ThreadCache#sizeBytes() should check overflow Key: KAFKA-6023 URL: https://issues.apache.org/jira/browse/KAFKA-6023 Project: Kafka Issue Type: Bug

Re: Can't build Kafka project

'm missing the following: > > /kafka/core/build/classes/java/test > > The core project itself doesn't have any java test source code under src/ > > > > > > On Sun, Oct 1, 2017 at 1:04 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > In streams/.classpath , you

Re: [DISCUSS] KIP-186: Increase offsets retention default to 7 days

+1 on the KIP. bq. introducing offsets.retention.hours config property Probably the introduction would cause confusion among users due to the existing minutes config. On Fri, Oct 6, 2017 at 10:53 AM, Manikumar wrote: > looks like VOTE thread is started for this KIP.

[jira] [Resolved] (KAFKA-5916) Upgrade rocksdb dependency to 5.8

[ https://issues.apache.org/jira/browse/KAFKA-5916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved KAFKA-5916. --- Resolution: Duplicate With KAFKA-5576 > Upgrade rocksdb dependency to

Re: want to join this mail list

See https://kafka.apache.org/contact for instructions. 2017-10-04 19:31 GMT-07:00 吴晓菊 : > -- > > Chrysan Wu > 联系方式：17717640807 >

Re: [DISCUSS] KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics

Randall: bq. AdminClient currently allows changing the replication factory. By 'replication factory' did you mean 'replication factor' ? Cheers On Wed, Oct 4, 2017 at 9:58 AM, Randall Hauch wrote: > Currently the KIP's scope is only topics that don't yet exist, and we have >

Re: integration between pull request and JIRA

want, too. (That actually happens, > when you get tagged or comment on one, ie, you get auto subscribed to > the PR.) > > There is a "Subscribe" button on the right hand side. > > -Matthias > > > On 9/5/17 8:57 PM, Ted Yu wrote: > > bq. I did get tagged or

[jira] [Resolved] (KAFKA-5842) QueryableStateIntegrationTest may fail with JDK 7

[ https://issues.apache.org/jira/browse/KAFKA-5842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved KAFKA-5842. --- Resolution: Cannot Reproduce > QueryableStateIntegrationTest may fail with JD

<    1   2   3   4   5   >