[jira] [Updated] (KAFKA-3029) Make class org.apache.kafka.common.TopicPartition Serializable
[ https://issues.apache.org/jira/browse/KAFKA-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3029: --- Reviewer: Ewen Cheslack-Postava Status: Patch Available (was: Open) > Make class org.apache.kafka.common.TopicPartition Serializable > -- > > Key: KAFKA-3029 > URL: https://issues.apache.org/jira/browse/KAFKA-3029 > Project: Kafka > Issue Type: Improvement > Components: clients >Affects Versions: 0.9.0.0 >Reporter: Praveen Devarao > Labels: easyfix, patch > Fix For: 0.9.0.1 > > > The client class TopicPartition is exposed and used by consumer applications > directly. In case where the application needs to checkpoint the state it is > difficult to serialize different app classes that use TopicPartition as > TopicParitition is not serializable. > For instance consider the Spark use case where RDDs have to be > checkpointedthe KafakaInputDstream (which we are currently modifying to > use the new Kafka API rather than the Highlevel apis in previous version) > cannot be serialized due to above limitation. > I have created a patch to serialize TopicPartition class by making it > implement serializable interface and have issued a pull request. > Can this be merged for the next release (0.9.0.1) > Thanks > Praveen -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KAFKA-3029) Make class org.apache.kafka.common.TopicPartition Serializable
[ https://issues.apache.org/jira/browse/KAFKA-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3029: - Resolution: Fixed Fix Version/s: (was: 0.9.0.1) 0.9.1.0 Status: Resolved (was: Patch Available) Issue resolved by pull request 711 [https://github.com/apache/kafka/pull/711] > Make class org.apache.kafka.common.TopicPartition Serializable > -- > > Key: KAFKA-3029 > URL: https://issues.apache.org/jira/browse/KAFKA-3029 > Project: Kafka > Issue Type: Improvement > Components: clients >Affects Versions: 0.9.0.0 >Reporter: Praveen Devarao > Labels: easyfix, patch > Fix For: 0.9.1.0 > > > The client class TopicPartition is exposed and used by consumer applications > directly. In case where the application needs to checkpoint the state it is > difficult to serialize different app classes that use TopicPartition as > TopicParitition is not serializable. > For instance consider the Spark use case where RDDs have to be > checkpointedthe KafakaInputDstream (which we are currently modifying to > use the new Kafka API rather than the Highlevel apis in previous version) > cannot be serialized due to above limitation. > I have created a patch to serialize TopicPartition class by making it > implement serializable interface and have issued a pull request. > Can this be merged for the next release (0.9.0.1) > Thanks > Praveen -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KAFKA-3029) Make class org.apache.kafka.common.TopicPartition Serializable
[ https://issues.apache.org/jira/browse/KAFKA-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3029: - Fix Version/s: 0.9.0.1 > Make class org.apache.kafka.common.TopicPartition Serializable > -- > > Key: KAFKA-3029 > URL: https://issues.apache.org/jira/browse/KAFKA-3029 > Project: Kafka > Issue Type: Improvement > Components: clients >Affects Versions: 0.9.0.0 >Reporter: Praveen Devarao > Labels: easyfix, patch > Fix For: 0.9.0.1, 0.9.1.0 > > > The client class TopicPartition is exposed and used by consumer applications > directly. In case where the application needs to checkpoint the state it is > difficult to serialize different app classes that use TopicPartition as > TopicParitition is not serializable. > For instance consider the Spark use case where RDDs have to be > checkpointedthe KafakaInputDstream (which we are currently modifying to > use the new Kafka API rather than the Highlevel apis in previous version) > cannot be serialized due to above limitation. > I have created a patch to serialize TopicPartition class by making it > implement serializable interface and have issued a pull request. > Can this be merged for the next release (0.9.0.1) > Thanks > Praveen -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KAFKA-3029) Make class org.apache.kafka.common.TopicPartition Serializable
[ https://issues.apache.org/jira/browse/KAFKA-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3029: - Assignee: Praveen Devarao > Make class org.apache.kafka.common.TopicPartition Serializable > -- > > Key: KAFKA-3029 > URL: https://issues.apache.org/jira/browse/KAFKA-3029 > Project: Kafka > Issue Type: Improvement > Components: clients >Affects Versions: 0.9.0.0 >Reporter: Praveen Devarao >Assignee: Praveen Devarao > Labels: easyfix, patch > Fix For: 0.9.0.1, 0.9.1.0 > > > The client class TopicPartition is exposed and used by consumer applications > directly. In case where the application needs to checkpoint the state it is > difficult to serialize different app classes that use TopicPartition as > TopicParitition is not serializable. > For instance consider the Spark use case where RDDs have to be > checkpointedthe KafakaInputDstream (which we are currently modifying to > use the new Kafka API rather than the Highlevel apis in previous version) > cannot be serialized due to above limitation. > I have created a patch to serialize TopicPartition class by making it > implement serializable interface and have issued a pull request. > Can this be merged for the next release (0.9.0.1) > Thanks > Praveen -- This message was sent by Atlassian JIRA (v6.3.4#6332)
