[jira] [Created] (KAFKA-4449) Add Serializer/Deserializer for POJO

2016-11-26 Thread Jason Guo (JIRA)
Jason Guo created KAFKA-4449: Summary: Add Serializer/Deserializer for POJO Key: KAFKA-4449 URL: https://issues.apache.org/jira/browse/KAFKA-4449 Project: Kafka Issue Type: Improvement

[jira] [Updated] (KAFKA-4438) BACKPORT - Add scala 2.12 support

2016-11-26 Thread Bernard Leach (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bernard Leach updated KAFKA-4438: - Issue Type: Bug (was: Improvement) > BACKPORT - Add scala 2.12 support >

[GitHub] kafka pull request #2173: KAFKA-4449: Add Serializer/Deserializer for POJO

2016-11-26 Thread habren
GitHub user habren opened a pull request: https://github.com/apache/kafka/pull/2173 KAFKA-4449: Add Serializer/Deserializer for POJO Currently, there are only build-in serializer/deserializer for basic data type (String, Long, etc). It's better to have serializer/deserializer for PO

[jira] [Commented] (KAFKA-4449) Add Serializer/Deserializer for POJO

2016-11-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15698020#comment-15698020 ] ASF GitHub Bot commented on KAFKA-4449: --- GitHub user habren opened a pull request:

[jira] [Updated] (KAFKA-4449) Add Serializer/Deserializer for POJO

2016-11-26 Thread Jason Guo (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Guo updated KAFKA-4449: - Description: Currently, there are only build-in serializer/deserializer for basic data type (String, Long

Kafka - Roadmap - 2017

2016-11-26 Thread Costa Tsirbas
Hello, I was wondering if anyone from kafka (users/dev or commits) can send or direct me to the kafka software roadmap for 2017 and onwards. Let me know if I need to subscribe or if this is available somwhere on your website. Greatly appreciated! Costa Tsirbas 514.443.1439

Re: Kafka - Roadmap - 2017

2016-11-26 Thread Gwen Shapira
Our community does not have a roadmap as such. But there are few initiatives that are currently being worked on and are likely to be included in 2017 releases: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals If members of the community will have additional improvement

Re: [DISCUSS] 0.10.1.1 Plan

2016-11-26 Thread radai
"compatibility guarantees that are expected by people who subclass these classes" sorry if this is not the best thread for this discussion, but I just wanted to pop in and say that since any subclassing of these will obviously not be done within the kafka codebase - what guarantees are needed? On

[jira] [Commented] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

2016-11-26 Thread Brady Vidovic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15698670#comment-15698670 ] Brady Vidovic commented on KAFKA-1194: -- This is a big show-stopper on windows. Disks

[jira] [Updated] (KAFKA-4156) Not able to download tests jar of kafka and kafka-streams from maven repo.

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4156: - Fix Version/s: (was: 0.10.0.1) (was: 0.10.0.0) > Not ab

[jira] [Updated] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4316: - Fix Version/s: (was: 0.10.1.0) > Kafka Streams 0.10.0.1 does not run on Window

[jira] [Updated] (KAFKA-4449) Add Serializer/Deserializer for POJO

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4449: - Fix Version/s: (was: 0.10.1.0) > Add Serializer/Deserializer for POJO > --

[jira] [Updated] (KAFKA-4063) Add support for infinite endpoints for range queries in Kafka Streams KV stores

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4063: - Fix Version/s: (was: 0.10.1.0) > Add support for infinite endpoints for range

[jira] [Updated] (KAFKA-3775) Throttle maximum number of tasks assigned to a single KafkaStreams

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3775: - Fix Version/s: (was: 0.10.1.0) > Throttle maximum number of tasks assigned to

[jira] [Commented] (KAFKA-4449) Add Serializer/Deserializer for POJO

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15698784#comment-15698784 ] Ewen Cheslack-Postava commented on KAFKA-4449: -- [~habren] We actually try to

[jira] [Updated] (KAFKA-3400) Topic stop working / can't describe topic

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3400: - Fix Version/s: (was: 0.10.1.0) > Topic stop working / can't describe topic > -

[jira] [Updated] (KAFKA-3963) Missing messages from the controller to brokers

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3963: - Fix Version/s: (was: 0.10.1.0) > Missing messages from the controller to broke

[GitHub] kafka pull request #2174: MINOR: Make release notes script check resolutions...

2016-11-26 Thread ewencp
GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/2174 MINOR: Make release notes script check resolutions to avoid spurious inclusion of non-fix 'fixes' in release notes. You can merge this pull request into a Git repository by running: $ git pull

Re: Reg: DefaultParititioner in Kafka

2016-11-26 Thread Ewen Cheslack-Postava
When a key is available, you generally include it because you want all messages with the same key to always end up in the same partition. This allows all messages with the same key to be processed by the same consumer (e.g. allowing you to aggregate all data for a single user if you key on user ID)

Re: KafkaProducer.java topics() call?

2016-11-26 Thread Ewen Cheslack-Postava
Generally the producer knows the set of topics it wants to produce to because it is fixed by the application (even if dynamic, there isn't commonly much use in exposing this functionality). You're right it could be implemented, but the use cases seem limited. If you have a good use case, please fo

[jira] [Commented] (KAFKA-4449) Add Serializer/Deserializer for POJO

2016-11-26 Thread Jason Guo (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15698939#comment-15698939 ] Jason Guo commented on KAFKA-4449: -- Agree with you that we should lable it as POJOJSONSer

[jira] [Comment Edited] (KAFKA-4449) Add Serializer/Deserializer for POJO

2016-11-26 Thread Jason Guo (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15698939#comment-15698939 ] Jason Guo edited comment on KAFKA-4449 at 11/27/16 3:17 AM: Ew

[jira] [Comment Edited] (KAFKA-4449) Add Serializer/Deserializer for POJO

2016-11-26 Thread Jason Guo (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15698939#comment-15698939 ] Jason Guo edited comment on KAFKA-4449 at 11/27/16 3:19 AM: @E

[jira] [Commented] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

2016-11-26 Thread Abhi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15698974#comment-15698974 ] Abhi commented on KAFKA-1194: - I am also facing same the Kafka Log directory are keep on incre

[jira] [Commented] (KAFKA-3959) __consumer_offsets wrong number of replicas at startup

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15698985#comment-15698985 ] Ewen Cheslack-Postava commented on KAFKA-3959: -- [~toddpalino] That's fair, I

[GitHub] kafka pull request #2175: KAFKA-4229:Controller can't start after several zk...

2016-11-26 Thread pengwei-li
GitHub user pengwei-li opened a pull request: https://github.com/apache/kafka/pull/2175 KAFKA-4229:Controller can't start after several zk expired event Author: pengwei Reviewers: wangguoz.gmail.com You can merge this pull request into a Git repository by running:

[jira] [Commented] (KAFKA-4229) Controller can't start after several zk expired event

2016-11-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15698987#comment-15698987 ] ASF GitHub Bot commented on KAFKA-4229: --- GitHub user pengwei-li opened a pull reques

[jira] [Commented] (KAFKA-4229) Controller can't start after several zk expired event

2016-11-26 Thread Pengwei (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15698992#comment-15698992 ] Pengwei commented on KAFKA-4229: The PR is : https://github.com/apache/kafka/pull/2175 >

[jira] [Updated] (KAFKA-4229) Controller can't start after several zk expired event

2016-11-26 Thread Pengwei (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengwei updated KAFKA-4229: --- Reviewer: Guozhang Wang > Controller can't start after several zk expired event >

[jira] [Work started] (KAFKA-4229) Controller can't start after several zk expired event

2016-11-26 Thread Pengwei (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4229 started by Pengwei. -- > Controller can't start after several zk expired event > ---

[jira] [Updated] (KAFKA-4229) Controller can't start after several zk expired event

2016-11-26 Thread Pengwei (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengwei updated KAFKA-4229: --- Status: Patch Available (was: In Progress) PR : https://github.com/apache/kafka/pull/2175 > Controller can't

[jira] [Commented] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

2016-11-26 Thread Abhi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699052#comment-15699052 ] Abhi commented on KAFKA-1194: - Please do take some action.. > The kafka broker cannot delete

[jira] [Created] (KAFKA-4450) Add missing 0.10.1.x upgrade tests and ensure ongoing compatibility checks

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-4450: Summary: Add missing 0.10.1.x upgrade tests and ensure ongoing compatibility checks Key: KAFKA-4450 URL: https://issues.apache.org/jira/browse/KAFKA-4450

[jira] [Comment Edited] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

2016-11-26 Thread Abhi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15698974#comment-15698974 ] Abhi edited comment on KAFKA-1194 at 11/27/16 5:36 AM: --- I am also fa

[jira] [Commented] (KAFKA-4007) Improve fetch pipelining for low values of max.poll.records

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699134#comment-15699134 ] Ewen Cheslack-Postava commented on KAFKA-4007: -- [~enothereska] prefetching is