[jira] [Updated] (KAFKA-3904) File descriptor leaking (Too many open files) for long running stream process

[ https://issues.apache.org/jira/browse/KAFKA-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Cai updated KAFKA-3904: - Description: I noticed when my application was running long (> 1 day), I will get 'Too many open files' e

[jira] [Created] (KAFKA-3904) File descriptor leaking (Too many open files) for long running stream process

Henry Cai created KAFKA-3904: Summary: File descriptor leaking (Too many open files) for long running stream process Key: KAFKA-3904 URL: https://issues.apache.org/jira/browse/KAFKA-3904 Project: Kafka

Re: KTable.filter usage, memory consumption and materialized view semantics

Thanks! You can follow this step-by-step guidance to contribute to Kafka via github. https://cwiki.apache.org/confluence/display/KAFKA/Contributing+Code+Changes#ContributingCodeChanges-PullRequest Guozhang On Sat, Jun 25, 2016 at 8:40 PM, Philippe Derome wrote: > I have a 1 liner solution fo

Re: KTable.filter usage, memory consumption and materialized view semantics

I have a 1 liner solution for this in KTableFilter.java and about 5-6 lines changes to existing unit test KTableFilterTest.testSendingOldValue. I included those lines with context in the JIRA. I am struggling a bit with github being new to it and how to do a proper pull request so hopefully that ca

[jira] [Commented] (KAFKA-3902) Optimize KTable.filter() to reduce unnecessary traffic

[ https://issues.apache.org/jira/browse/KAFKA-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15349932#comment-15349932 ] Phil Derome commented on KAFKA-3902: one liner fix, but am unfamiliar with github and

[jira] [Issue Comment Deleted] (KAFKA-3902) Optimize KTable.filter() to reduce unnecessary traffic

[ https://issues.apache.org/jira/browse/KAFKA-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Derome updated KAFKA-3902: --- Comment: was deleted (was: Can we remove in KTableFilterTest testSendingOldValue references to proc2

[GitHub] kafka pull request #1554: MINOR: Follow-up from KAFKA-3842 with suggested fi...

GitHub user bbejeck opened a pull request: https://github.com/apache/kafka/pull/1554 MINOR: Follow-up from KAFKA-3842 with suggested fixes to creating tem… …p directories, waitForCondition You can merge this pull request into a Git repository by running: $ git pull https://

[jira] [Commented] (KAFKA-3842) Add Helper Functions Into TestUtils

[ https://issues.apache.org/jira/browse/KAFKA-3842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15349914#comment-15349914 ] ASF GitHub Bot commented on KAFKA-3842: --- GitHub user bbejeck opened a pull request:

[jira] [Commented] (KAFKA-3902) Optimize KTable.filter() to reduce unnecessary traffic

[ https://issues.apache.org/jira/browse/KAFKA-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15349872#comment-15349872 ] Phil Derome commented on KAFKA-3902: Can we remove in KTableFilterTest testSendingOld

[jira] [Commented] (KAFKA-3740) Add configs for RocksDBStores

[ https://issues.apache.org/jira/browse/KAFKA-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15349772#comment-15349772 ] ASF GitHub Bot commented on KAFKA-3740: --- GitHub user HenryCaiHaiying opened a pull r

[GitHub] kafka pull request #1553: KAFKA-3740: Add configs for RocksDBStore

GitHub user HenryCaiHaiying opened a pull request: https://github.com/apache/kafka/pull/1553 KAFKA-3740: Add configs for RocksDBStore This is the part I of the work to add the StreamsConfig to ProcessorContext. We need to access StreamsConfig in the ProcessorContext so other

[jira] [Created] (KAFKA-3903) Convert tests to use static helper methods for Consumer/Producer/StreamsConfigs setup

Bill Bejeck created KAFKA-3903: -- Summary: Convert tests to use static helper methods for Consumer/Producer/StreamsConfigs setup Key: KAFKA-3903 URL: https://issues.apache.org/jira/browse/KAFKA-3903 Proje

Re: delay of producer and consumer in kafka 0.9 is too big to be accepted

Can you sanity check this with the end-to-end latency test that ships with Kafka in the tools package? https://apache.googlesource.com/kafka/+/1769642bb779921267bd57d3d338591dbdf33842/core/src/main/scala/kafka/tools/TestEndToEndLatency.scala On Saturday, June 25, 2016, Kafka wrote: > Hi all， >

delay of producer and consumer in kafka 0.9 is too big to be accepted

Hi all， my kafka cluster is composed of three brokers with each have 8core cpu and 8g memory and 1g network card. with java async client，I sent 100 messages with size of 1024 bytes per message ,the send gap between each sending is 20us，the consumer’s config is like this，fetch