Build failed in Jenkins: kafka-0.10.1-jdk7 #127

See Changes: [me] MINOR: Fix missing wait_until import from bad cherry-pick -- [...truncated 585.60 KB...]

[GitHub] kafka pull request #3638: MINOR: Fix missing wait_until import from bad cher...

Github user ewencp closed the pull request at: https://github.com/apache/kafka/pull/3638 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [DISCUSS] KIP-180: Add a broker metric specifying the number of consumer group rebalances in progress

Hi Colin, The KIP looks good to me. In your latest proposal, the change of state would be captured as followed in the metrics for groups using Kafka for membership management: PreparingRebalance -> CompletingRebalance -> Stable -> Dead? If a group is just being used to store offsets, then it is

Re: [DISCUSS] KIP-180: Add a broker metric specifying the number of consumer group rebalances in progress

How about PreparingRebalance / CompletingRebalance? cheers, Colin On Fri, Aug 4, 2017, at 09:03, Ismael Juma wrote: > I agree that we should make them consistent. I think RebalanceJoin and > RebalanceAssignment are reasonable names. I think they are a bit more > descriptive than

Re: [DISCUSS] KIP-91 Provide Intuitive User Timeouts in The Producer

Responses inline: On Mon, Aug 7, 2017 at 9:37 AM, Sumant Tambe wrote: > > > > > However, one thing which has not come out of the JIRA discussion is the > > actual use cases for batch expiry. > > There are two usecases I can think of for batch expiry mechanism > irrespective

[GitHub] kafka pull request #3640: KAFKA-5701: fix flaky unit test

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3640 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [DISCUSS] KIP-113: Support replicas movement between log directories

Hey Tom, Yeah I agree with you that the total disk capacity can be useful particularly if it is different across brokers but it is probably of limited use in most cases. I also expect that most users would have their own customized tool across to determine the new partition reassignment after

[jira] [Resolved] (KAFKA-5681) jarAll does not build all scala versions anymore.

[ https://issues.apache.org/jira/browse/KAFKA-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved KAFKA-5681. - Resolution: Won't Fix Discussed in the PR. Closing the ticket as won't fix. > jarAll does not

[GitHub] kafka pull request #3628: KAFKA-5681; jarAll should build all scala versions...

Github user becketqin closed the pull request at: https://github.com/apache/kafka/pull/3628 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: Kafka Client for Swift 4

Thanks, Jason, It's kellan.burket - Kellan On Thu, Aug 3, 2017 at 6:39 PM, Jason Gustafson wrote: > Hi Kellan, > > Looks cool. If you tell me your user id, I can give you access to edit the > wiki directly. > > -Jason > > On Fri, Jul 28, 2017 at 1:41 PM, Kellan Burket

Re: [DISCUSS] KIP-184 Rename LogCleaner and related classes to LogCompactor

Thanks for the KIP proposal, I thought one suggestion before this discussion is to deprecate the " log.cleaner.enable" and always turn on compaction for those topics that have compact policies? Guozhang On Sat, Aug 5, 2017 at 9:36 AM, Pranav Maniar wrote: > Hi All, > >

[jira] [Created] (KAFKA-5709) Improve logging to include errors from state-change log in server log

Alla Tumarkin created KAFKA-5709: Summary: Improve logging to include errors from state-change log in server log Key: KAFKA-5709 URL: https://issues.apache.org/jira/browse/KAFKA-5709 Project: Kafka

Re: [DISCUSS] KIP-113: Support replicas movement between log directories

Hi Dong, The reason I thought this would be useful is it seems likely to me that people will want to write tools to help them generate allocations. If, as you say, all the brokers and all the disks are the same size, then it's not too difficult to tell the tool the size of the disk. But if

[GitHub] kafka pull request #3641: KAFKA-5704 Corrected Connect distributed startup b...

GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3641 KAFKA-5704 Corrected Connect distributed startup behavior to allow older brokers to auto-create topics When a Connect distributed worker starts up talking with broker versions 0.10.1.0 and later,

[GitHub] kafka pull request #3640: Kafka 5701 fix flaky unit test

GitHub user bbejeck opened a pull request: https://github.com/apache/kafka/pull/3640 Kafka 5701 fix flaky unit test 1. Remove separate thread from test failing periodically due to race condition. 2. Remove anonymous `AbstractNotifyingBatchingRestoreCallback` and set as package

[jira] [Resolved] (KAFKA-5705) Kafka Server start failed and reports "unsafe memory access operation"

[ https://issues.apache.org/jira/browse/KAFKA-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-5705. Resolution: Duplicate Marking this as a duplicate of KAFKA-5628 since the exception trace

Re: [DISCUSS] KIP-113: Support replicas movement between log directories

Hey Ismael, Thanks much for your comments. Please see my reply inline. On Mon, Aug 7, 2017 at 5:28 AM, Ismael Juma wrote: > Hi Dong, > > Thanks for the explanation. Comments inline. > > On Fri, Aug 4, 2017 at 6:47 PM, Dong Lin wrote: > > > 1. Yes it has

[GitHub] kafka pull request #3639: MINOR: Standardize logging of Worker-level message...

GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/3639 MINOR: Standardize logging of Worker-level messages from Tasks and Connectors This ensures all logs have the connector/task ID, whether tasks are source or sink, and formats them consistently. You

[GitHub] kafka pull request #3625: HOTFIX: fix for standby tasks using batching resto...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3625 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [DISCUSS] KIP-113: Support replicas movement between log directories

Hey Tom, Good question. We have actually considered having DescribeDirsResponse provide the capacity of each disk as well. This was not included because we believe Kafka cluster admin will always configure all brokers with same number of disks of the same size. This is because it is generally

Re: [DISCUSS] KIP-91 Provide Intuitive User Timeouts in The Producer

Please see the replies inline. If we are going to have a separate configuration for expiry, I prefer my > proposal of max.message.delivery.wait.ms and its semantics. > OK. I hope others will voice their preference too. > > However, one thing which has not come out of the JIRA discussion is the

[GitHub] kafka pull request #3638: MINOR: Fix missing wait_until import from bad cher...

GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/3638 MINOR: Fix missing wait_until import from bad cherry-pick You can merge this pull request into a Git repository by running: $ git pull https://github.com/ewencp/kafka missing-wait-import

Re: [DISCUSS] KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient

Hi, I've updated this KIP slightly, to clarify a couple of points. One thing in particular that I would like feedback on is what authorization should be required for triggering the election of the preferred leader? Another thing would be whether the request and responses should be grouped by

[GitHub] kafka pull request #3434: KAFKA-5516: Formatting verifiable producer/consume...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3434 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #3637: KAFKA-4879 KafkaConsumer.position may hang forever...

GitHub user baluchicken opened a pull request: https://github.com/apache/kafka/pull/3637 KAFKA-4879 KafkaConsumer.position may hang forever when deleting a topic @guozhangwang I created this PR but it lacks the test. I also has the test but I wanted to ask which Test file should

[GitHub] kafka pull request #3636: KAFKA-5684: KStreamPrintProcessor as customized KS...

GitHub user ppatierno opened a pull request: https://github.com/apache/kafka/pull/3636 KAFKA-5684: KStreamPrintProcessor as customized KStreamPeekProcessor This PR is intended for having KStreamPrint derived from KStreamPeek and avoiding the "instance of" check on byte[ ] every

Re: [DISCUSS] KIP-113: Support replicas movement between log directories

Hi Dong, Thanks for the explanation. Comments inline. On Fri, Aug 4, 2017 at 6:47 PM, Dong Lin wrote: > 1. Yes it has been considered. Here are the reasons why we don't do it > through controller. > > - There can be use-cases where we only want to rebalance the load of log

[GitHub] kafka pull request #3635: KAFKA-3417: Quote client-id and wrap reporter call...

GitHub user mimaison opened a pull request: https://github.com/apache/kafka/pull/3635 KAFKA-3417: Quote client-id and wrap reporter calls in try/catch blocks You can merge this pull request into a Git repository by running: $ git pull https://github.com/mimaison/kafka

[GitHub] kafka pull request #3634: MINOR: Deprecate LogConfig.Compact

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3634 MINOR: Deprecate LogConfig.Compact It actually refers to the `delete` cleanup policy. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka

Re: [DISCUSS] KIP-113: Support replicas movement between log directories

Hi Dong, Your comments on KIP-179 prompted me to look at KIP-113, and I have a question: AFAICS the DescribeDirsResponse (via ReplicaInfo) can be used to get the size of a partition on a disk, but I don't see a mechanism for knowing the total capacity of a disk (and/or the free capacity of a

[GitHub] kafka pull request #3633: MINOR: streams memory management docs

GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/3633 MINOR: streams memory management docs update streams memory management docs You can merge this pull request into a Git repository by running: $ git pull https://github.com/dguy/kafka mem-doc-011

[GitHub] kafka pull request #3604: MINOR: add memory management section to streams do...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3604 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (KAFKA-5707) Remove useless `--force` option for both TopicCommand and ConfigCommand

[ https://issues.apache.org/jira/browse/KAFKA-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxihx resolved KAFKA-5707. --- Resolution: Not A Bug For the sake of compatibility, just keep `--force` in both classes. Closed this jira

[GitHub] kafka pull request #3632: KAFKA-5707: TopicCommand and ConfigCommand should ...

Github user huxihx closed the pull request at: https://github.com/apache/kafka/pull/3632 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: kafka-0.11.0-jdk7 #261

See Changes: [becket.qin] KAFKA-5700; Producer should not drop header information when splitting -- [...truncated 972.91 KB...]

[jira] [Created] (KAFKA-5708) Update Jackson dependencies (from 2.8.5 to 2.9.x)

Dejan Stojadinović created KAFKA-5708: - Summary: Update Jackson dependencies (from 2.8.5 to 2.9.x) Key: KAFKA-5708 URL: https://issues.apache.org/jira/browse/KAFKA-5708 Project: Kafka