[jira] [Updated] (KAFKA-4201) Add an --assignment-strategy option to Mirror Maker

[ https://issues.apache.org/jira/browse/KAFKA-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-4201: --- Summary: Add an --assignment-strategy option to Mirror Maker (was: Add a

[jira] [Created] (KAFKA-4201) Add a --assignment-strategy option to Mirror Maker

Vahid Hashemian created KAFKA-4201: -- Summary: Add a --assignment-strategy option to Mirror Maker Key: KAFKA-4201 URL: https://issues.apache.org/jira/browse/KAFKA-4201 Project: Kafka Issue

[jira] [Commented] (KAFKA-4178) Replication Throttling: Consolidate Rate Classes

[ https://issues.apache.org/jira/browse/KAFKA-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508193#comment-15508193 ] Jun Rao commented on KAFKA-4178: [~jjkoshy], [~aauradkar], could you provide some context on the changes

[jira] [Updated] (KAFKA-3438) Rack Aware Replica Reassignment should warn of overloaded brokers

[ https://issues.apache.org/jira/browse/KAFKA-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-3438: --- Fix Version/s: (was: 0.10.1.0) Status: Patch Available (was: Open) > Rack

[jira] [Commented] (KAFKA-3438) Rack Aware Replica Reassignment should warn of overloaded brokers

[ https://issues.apache.org/jira/browse/KAFKA-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508184#comment-15508184 ] ASF GitHub Bot commented on KAFKA-3438: --- GitHub user vahidhashemian opened a pull request:

[GitHub] kafka pull request #1894: KAFKA-3438: Rack-aware replica assignment should w...

GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/1894 KAFKA-3438: Rack-aware replica assignment should warn of overloaded brokers When using the `--generate` option of the replica reassignment tool the balance of replicas across brokers is

Re: [UPDATE] 0.10.1 Release Progress

Great ! Thanks, Mayuresh On Tue, Sep 20, 2016 at 2:43 PM, Becket Qin wrote: > Awesome! > > On Mon, Sep 19, 2016 at 11:42 PM, Neha Narkhede wrote: > > > Nice! > > On Mon, Sep 19, 2016 at 11:33 PM Ismael Juma wrote: > > > > > Well

Re: [UPDATE] 0.10.1 Release Progress

Awesome! On Mon, Sep 19, 2016 at 11:42 PM, Neha Narkhede wrote: > Nice! > On Mon, Sep 19, 2016 at 11:33 PM Ismael Juma wrote: > > > Well done everyone. :) > > > > On 20 Sep 2016 5:23 am, "Jason Gustafson" wrote: > > > > > Thanks

Status of KIP-68: Add a consumed log retention

Hi All, Wanted to find out more on the status of KIP-68. There are no details in the discussion thread and the pointers are not updated. Is this being actively worked on? This is clearly needed to support smarter and more cost effective retentions.

RE: Kafka duplicate offset at Consumer

Are you using the new java consumer? What method are you using to commit offsets? -Dave -Original Message- From: Ghosh, Achintya (Contractor) [mailto:achintya_gh...@comcast.com] Sent: Tuesday, September 20, 2016 8:56 AM To: us...@kafka.apache.org Cc: dev@kafka.apache.org Subject:

[jira] [Commented] (KAFKA-1954) Speed Up The Unit Tests

[ https://issues.apache.org/jira/browse/KAFKA-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507561#comment-15507561 ] Balint Molnar commented on KAFKA-1954: -- Thanks, [~ijuma]. I realized nearly every test case recreates

[jira] [Commented] (KAFKA-1954) Speed Up The Unit Tests

[ https://issues.apache.org/jira/browse/KAFKA-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507511#comment-15507511 ] Ismael Juma commented on KAFKA-1954: It's worth mentioning that we use one gradle fork per core by

[jira] [Commented] (KAFKA-4196) Transient test failure: DeleteConsumerGroupTest.testConsumptionOnRecreatedTopicAfterTopicWideDeleteInZK

[ https://issues.apache.org/jira/browse/KAFKA-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507443#comment-15507443 ] Flavio Junqueira commented on KAFKA-4196: - After a cursory look, it looks like we could have this

[jira] [Commented] (KAFKA-1954) Speed Up The Unit Tests

[ https://issues.apache.org/jira/browse/KAFKA-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507444#comment-15507444 ] Sriharsha Chintalapani commented on KAFKA-1954: --- [~baluchicken] feel free to take it over.

[jira] [Commented] (KAFKA-1954) Speed Up The Unit Tests

[ https://issues.apache.org/jira/browse/KAFKA-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507430#comment-15507430 ] Balint Molnar commented on KAFKA-1954: -- [~sriharsha] if you are not working on this, do you mind if I

[jira] [Comment Edited] (KAFKA-3888) Allow consumer to send heartbeats in background thread (KIP-62)

[ https://issues.apache.org/jira/browse/KAFKA-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507290#comment-15507290 ] Deepika Kakrania edited comment on KAFKA-3888 at 9/20/16 6:26 PM: -- Where

[jira] [Commented] (KAFKA-4196) Transient test failure: DeleteConsumerGroupTest.testConsumptionOnRecreatedTopicAfterTopicWideDeleteInZK

[ https://issues.apache.org/jira/browse/KAFKA-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507305#comment-15507305 ] Ismael Juma commented on KAFKA-4196: Yes. It seems to be rare, so not urgent. I cc'd you in case the

[jira] [Commented] (KAFKA-3888) Allow consumer to send heartbeats in background thread (KIP-62)

[ https://issues.apache.org/jira/browse/KAFKA-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507290#comment-15507290 ] Deepika Kakrania commented on KAFKA-3888: - Where can I download 0.10.1.0 from? > Allow consumer

[jira] [Commented] (KAFKA-4196) Transient test failure: DeleteConsumerGroupTest.testConsumptionOnRecreatedTopicAfterTopicWideDeleteInZK

[ https://issues.apache.org/jira/browse/KAFKA-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507287#comment-15507287 ] Flavio Junqueira commented on KAFKA-4196: - [~ijuma] is this from trunk? > Transient test failure:

[jira] [Assigned] (KAFKA-4200) Minor issue with throttle argument in kafka-reassign-partitions.sh

[ https://issues.apache.org/jira/browse/KAFKA-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford reassigned KAFKA-4200: --- Assignee: Ben Stopford > Minor issue with throttle argument in kafka-reassign-partitions.sh

[jira] [Created] (KAFKA-4200) Minor issue with throttle argument in kafka-reassign-partitions.sh

Ben Stopford created KAFKA-4200: --- Summary: Minor issue with throttle argument in kafka-reassign-partitions.sh Key: KAFKA-4200 URL: https://issues.apache.org/jira/browse/KAFKA-4200 Project: Kafka

[jira] [Commented] (KAFKA-4178) Replication Throttling: Consolidate Rate Classes

[ https://issues.apache.org/jira/browse/KAFKA-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507247#comment-15507247 ] ASF GitHub Bot commented on KAFKA-4178: --- GitHub user benstopford opened a pull request:

[GitHub] kafka pull request #1893: KAFKA-4178: Windows in Rate Calculation

GitHub user benstopford opened a pull request: https://github.com/apache/kafka/pull/1893 KAFKA-4178: Windows in Rate Calculation ReplicationQuotas included a new Rate class which changed the way the window is calculated. @junrao asked that we look to consolidate this. On balance I

Jenkins build is back to normal : kafka-trunk-jdk7 #1560

See

Build failed in Jenkins: kafka-trunk-jdk8 #902

See Changes: [ismael] KAFKA-4184; Intermittent failures in [ismael] KAFKA-4197; Make ReassignPartitionsTest System Test move data -- [...truncated 3606 lines...]

Build failed in Jenkins: kafka-0.10.1-jdk7 #2

See Changes: [ismael] KAFKA-4184; Intermittent failures in [ismael] KAFKA-4197; Make ReassignPartitionsTest System Test move data -- [...truncated 3904 lines...] kafka.log.LogTest >

[jira] [Updated] (KAFKA-4197) Make ReassignPartitionsTest System Test move data

[ https://issues.apache.org/jira/browse/KAFKA-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4197: --- Resolution: Fixed Fix Version/s: 0.10.1.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (KAFKA-4197) Make ReassignPartitionsTest System Test move data

[ https://issues.apache.org/jira/browse/KAFKA-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506767#comment-15506767 ] ASF GitHub Bot commented on KAFKA-4197: --- Github user asfgit closed the pull request at:

[jira] [Updated] (KAFKA-4184) Test failure in ReplicationQuotasTest.shouldBootstrapTwoBrokersWithFollowerThrottle

[ https://issues.apache.org/jira/browse/KAFKA-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4184: --- Fix Version/s: 0.10.1.0 > Test failure in >

[jira] [Resolved] (KAFKA-4184) Test failure in ReplicationQuotasTest.shouldBootstrapTwoBrokersWithFollowerThrottle

[ https://issues.apache.org/jira/browse/KAFKA-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-4184. Resolution: Fixed Reviewer: Ismael Juma > Test failure in >

[GitHub] kafka pull request #1892: KAFKA-4197: Make ReassignPartitionsTest System Tes...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1892 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4184) Test failure in ReplicationQuotasTest.shouldBootstrapTwoBrokersWithFollowerThrottle

[ https://issues.apache.org/jira/browse/KAFKA-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506763#comment-15506763 ] ASF GitHub Bot commented on KAFKA-4184: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1873: KAFKA-4184: Intermitant failures in ReplicationQuo...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1873 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (KAFKA-4199) When a window store segment is dropped we should also clear any corresponding cached entries

Damian Guy created KAFKA-4199: - Summary: When a window store segment is dropped we should also clear any corresponding cached entries Key: KAFKA-4199 URL: https://issues.apache.org/jira/browse/KAFKA-4199

Build failed in Jenkins: kafka-trunk-jdk7 #1559

See Changes: [ismael] HOTFIX: Added check for metadata unavailable -- [...truncated 7259 lines...] kafka.api.ProducerFailureHandlingTest > testTooLargeRecordWithAckOne STARTED

Kafka duplicate offset at Consumer

Hi there, I see a lot of same offset value kafka consumer receives hence it creates a lot of duplicate messages. What could be the reason and how we can solve this issue? Thanks Achintya

[jira] [Commented] (KAFKA-4197) Make ReassignPartitionsTest System Test move data

[ https://issues.apache.org/jira/browse/KAFKA-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506446#comment-15506446 ] Ben Stopford commented on KAFKA-4197: - https://github.com/apache/kafka/pull/1892 > Make

[jira] [Updated] (KAFKA-4197) Make ReassignPartitionsTest System Test move data

[ https://issues.apache.org/jira/browse/KAFKA-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4197: Assignee: Ben Stopford Status: Patch Available (was: Open) > Make ReassignPartitionsTest

[jira] [Created] (KAFKA-4198) Transient test failure: ConsumerBounceTest.testConsumptionWithBrokerFailures

Ismael Juma created KAFKA-4198: -- Summary: Transient test failure: ConsumerBounceTest.testConsumptionWithBrokerFailures Key: KAFKA-4198 URL: https://issues.apache.org/jira/browse/KAFKA-4198 Project:

[jira] [Created] (KAFKA-4197) Make ReassignPartitionsTest System Test move data

Ben Stopford created KAFKA-4197: --- Summary: Make ReassignPartitionsTest System Test move data Key: KAFKA-4197 URL: https://issues.apache.org/jira/browse/KAFKA-4197 Project: Kafka Issue Type:

[GitHub] kafka pull request #1892: KAFKA-[TBD]: Make ReassignPartitionsTest System Te...

GitHub user benstopford opened a pull request: https://github.com/apache/kafka/pull/1892 KAFKA-[TBD]: Make ReassignPartitionsTest System Test move data The ReassignPartitionsTest system tests doesn't reassign any replicas (i.e. move data). This is a simple issue. It uses

Jenkins build is back to normal : kafka-trunk-jdk8 #901

See

Build failed in Jenkins: kafka-trunk-jdk8 #900

See Changes: [jason] KAFKA-4193; Fix for intermittent failure in FetcherTest -- [...truncated 13489 lines...] org.apache.kafka.streams.state.internals.InMemoryLRUCacheStoreTest > testRestore

[GitHub] kafka pull request #1891: MINOR: add javadoc comment to PersistenKeyValueFac...

GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1891 MINOR: add javadoc comment to PersistenKeyValueFactory.enableCaching missing javadoc on public API method PersistenKeyValueFactory.enableCaching You can merge this pull request into a Git repository

[GitHub] kafka pull request #1887: HOTFIX: Added check for metadata unavailable

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1887 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #1890: MINOR: Use `nanoTime` in `testRequestExpiry` to fi...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1890 MINOR: Use `nanoTime` in `testRequestExpiry` to fix transient test failure We recently switched `SystemTimer` to use `nanoTime`, but we were still using `System.currentTimeMillis` in the test.

[GitHub] kafka pull request #1889: MINOR: Increase `zkConnectionTimeout` and timeout ...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1889 MINOR: Increase `zkConnectionTimeout` and timeout in `testReachableServer` We had a number of failures recently due to these timeouts being too low. It's a particular problem if multiple forks are

[jira] [Commented] (KAFKA-4133) Provide a configuration to control consumer max in-flight fetches

[ https://issues.apache.org/jira/browse/KAFKA-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506187#comment-15506187 ] Mickael Maison commented on KAFKA-4133: --- Due to a KIP # collision, it is now KIP-81:

Build failed in Jenkins: kafka-trunk-jdk7 #1558

See Changes: [jason] MINOR: Bump to version 0.10.2 [jason] KAFKA-4193; Fix for intermittent failure in FetcherTest -- [...truncated 12689 lines...]

[jira] [Commented] (KAFKA-4196) Transient test failure: DeleteConsumerGroupTest.testConsumptionOnRecreatedTopicAfterTopicWideDeleteInZK

[ https://issues.apache.org/jira/browse/KAFKA-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506176#comment-15506176 ] Ismael Juma commented on KAFKA-4196: cc [~junrao] [~fpj] > Transient test failure: >

[jira] [Updated] (KAFKA-4192) Update upgrade documentation for 0.10.1.0 to mention inter.broker.protocol.version

[ https://issues.apache.org/jira/browse/KAFKA-4192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4192: --- Summary: Update upgrade documentation for 0.10.1.0 to mention inter.broker.protocol.version (was:

[jira] [Resolved] (KAFKA-4192) Update upgrade documentation to mention inter.broker.protocol.version

[ https://issues.apache.org/jira/browse/KAFKA-4192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-4192. Resolution: Fixed Assignee: Jiangjie Qin (was: Ismael Juma) Fix Version/s: 0.10.1.0

[jira] [Updated] (KAFKA-4192) Update upgrade documentation to mention inter.broker.protocol.version

[ https://issues.apache.org/jira/browse/KAFKA-4192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4192: --- Fix Version/s: (was: 0.10.1.0) > Update upgrade documentation to mention

[GitHub] kafka pull request #1888: MINOR: remove unused code from InternalTopicManage...

GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1888 MINOR: remove unused code from InternalTopicManager Remove isValidCleanupPolicy and related fields as they are never used. You can merge this pull request into a Git repository by running: $ git

[GitHub] kafka pull request #1887: HOTFIX: Added check for metadata unavailable

GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/1887 HOTFIX: Added check for metadata unavailable You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka hotfix-metadata-unavailable

Re: [UPDATE] 0.10.1 Release Progress

Nice! On Mon, Sep 19, 2016 at 11:33 PM Ismael Juma wrote: > Well done everyone. :) > > On 20 Sep 2016 5:23 am, "Jason Gustafson" wrote: > > > Thanks everyone for the hard work! The 0.10.1 release branch has been > > created. We're now entering the

Re: [UPDATE] 0.10.1 Release Progress

Well done everyone. :) On 20 Sep 2016 5:23 am, "Jason Gustafson" wrote: > Thanks everyone for the hard work! The 0.10.1 release branch has been > created. We're now entering the stabilization phase of this release which > means we'll focus on bug fixes and testing. > >

Build failed in Jenkins: kafka-trunk-jdk8 #899

See Changes: [jason] MINOR: Bump to version 0.10.2 -- [...truncated 3610 lines...] kafka.log.LogTest > testReadAtLogGap STARTED kafka.log.LogTest > testReadAtLogGap PASSED kafka.log.LogTest >

[jira] [Updated] (KAFKA-4193) FetcherTest fails intermittently

[ https://issues.apache.org/jira/browse/KAFKA-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-4193: --- Resolution: Fixed Fix Version/s: 0.10.2.0 0.10.1.0

[GitHub] kafka pull request #1881: KAFKA-4193: Fix for Intermittent failure in Fetche...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1881 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4193) FetcherTest fails intermittently

[ https://issues.apache.org/jira/browse/KAFKA-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505734#comment-15505734 ] ASF GitHub Bot commented on KAFKA-4193: --- Github user asfgit closed the pull request at:

Build failed in Jenkins: kafka-trunk-jdk7 #1557

See Changes: [jason] KAFKA-4148; Support ListOffsetRequest v1 and search offsets by timestamp -- [...truncated 7383 lines...] kafka.coordinator.GroupCoordinatorResponseTest >

[jira] [Commented] (KAFKA-4187) Adding a flag to prefix topics with mirror maker

[ https://issues.apache.org/jira/browse/KAFKA-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505719#comment-15505719 ] Vincent Rischmann commented on KAFKA-4187: -- Thanks, somehow I completely missed this capability.