consistent consumption rate

2018-03-24 Thread Jamie Park
Hi, I am developing Kafka stream-application using low level processor API. I am consuming records from multiple topics, applying some joining logics, and then sending them off another topics. 1) How can I make sure my application consume records at consistent rate across different topics? If

Jenkins build is back to normal : kafka-1.0-jdk7 #179

2018-03-24 Thread Apache Jenkins Server
See

Jenkins build is back to normal : kafka-1.1-jdk7 #103

2018-03-24 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk7 #3287

2018-03-24 Thread Apache Jenkins Server
See Changes: [github] KAFKA-6710: Remove Thread.sleep from LogManager.deleteLogs (#4771) [jason] KAFKA-6052; Fix WriteTxnMarkers request retry issue in -- Started by an S

[jira] [Resolved] (KAFKA-6710) Streams integration tests hang during shutdown

2018-03-24 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-6710. --- Resolution: Fixed Reviewer: Jun Rao Fix Version/s: 1.2.0 > Streams integration

Build failed in Jenkins: kafka-trunk-jdk8 #2502

2018-03-24 Thread Apache Jenkins Server
See Changes: [github] KAFKA-6710: Remove Thread.sleep from LogManager.deleteLogs (#4771) [jason] KAFKA-6052; Fix WriteTxnMarkers request retry issue in -- Started by an S

Build failed in Jenkins: kafka-1.1-jdk7 #102

2018-03-24 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Fix potential resource leak in FileOffsetBackingStore (#4739) -- [...truncated 415.08 KB...] kafka.server.epoch.LeaderEpochFileCacheTest > shoul

Build failed in Jenkins: kafka-1.0-jdk7 #178

2018-03-24 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Fix potential resource leak in FileOffsetBackingStore (#4739) -- [...truncated 373.51 KB...] kafka.log.BrokerCompressionTest > testBrokerSideCompr

Build failed in Jenkins: kafka-trunk-jdk7 #3286

2018-03-24 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Remove redundant initialization of `Stats.index` (#4751) -- Started by an SCM change [EnvInject] - Loading node environment variables. Building

[jira] [Created] (KAFKA-6711) Checkpoint of InMemoryStore along with GlobalKTable

2018-03-24 Thread JIRA
Cemalettin KoƧ created KAFKA-6711: - Summary: Checkpoint of InMemoryStore along with GlobalKTable Key: KAFKA-6711 URL: https://issues.apache.org/jira/browse/KAFKA-6711 Project: Kafka Issue Ty

Build failed in Jenkins: kafka-trunk-jdk8 #2501

2018-03-24 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-6637; Avoid divide by zero error with segment.ms set to zero [jason] MINOR: Fix potential resource leak in FileOffsetBackingStore (#4739) [jason] MINOR: Remove redundant initializatio

Build failed in Jenkins: kafka-trunk-jdk7 #3285

2018-03-24 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-6637; Avoid divide by zero error with segment.ms set to zero [jason] MINOR: Fix potential resource leak in FileOffsetBackingStore (#4739) -- St

[jira] [Resolved] (KAFKA-6637) if set topic config segment.ms=0 Kafka broker won't be able to start

2018-03-24 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-6637. Resolution: Fixed Fix Version/s: 1.2.0 > if set topic config segment.ms=0 Kafka broke

Re: [VOTE] 1.1.0 RC4

2018-03-24 Thread Ted Yu
I wasn't able to reproduce the test failure when it is run alone. This seems to be flaky test. +1 from me. On Sat, Mar 24, 2018 at 11:49 AM, Rajini Sivaram wrote: > Hi Ted, > > Thank you for testing the RC. I haven't been able to recreate that failure > after running the test a 100 times. Was

Re: [VOTE] 1.1.0 RC4

2018-03-24 Thread Rajini Sivaram
Hi Ted, Thank you for testing the RC. I haven't been able to recreate that failure after running the test a 100 times. Was it a one-off transient failure or does it fail consistently for you? On Sat, Mar 24, 2018 at 2:51 AM, Ted Yu wrote: > When I ran test suite, I got one failure: > > kafka.a

[jira] [Created] (KAFKA-6710) Streams integration tests hang during shutdown

2018-03-24 Thread Rajini Sivaram (JIRA)
Rajini Sivaram created KAFKA-6710: - Summary: Streams integration tests hang during shutdown Key: KAFKA-6710 URL: https://issues.apache.org/jira/browse/KAFKA-6710 Project: Kafka Issue Type: Bu

Build failed in Jenkins: kafka-1.1-jdk7 #101

2018-03-24 Thread Apache Jenkins Server
See -- [...truncated 416.64 KB...] kafka.tools.ConsoleConsumerTest > shouldParseValidNewConsumerConfigWithAutoOffsetResetAndMatchingFromBeginning STARTED kafka.tools.ConsoleConsumerTest

[jira] [Created] (KAFKA-6709) broker failed to handle request due to OOM

2018-03-24 Thread Zou Tao (JIRA)
Zou Tao created KAFKA-6709: -- Summary: broker failed to handle request due to OOM Key: KAFKA-6709 URL: https://issues.apache.org/jira/browse/KAFKA-6709 Project: Kafka Issue Type: Bug Compon