[jira] [Updated] (KAFKA-8326) Add List Serde
[
https://issues.apache.org/jira/browse/KAFKA-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax updated KAFKA-8326:
---
External issue URL: (was: https://github.com/apache/kafka/pull/6592)
> Add List Serde
> -
>
> Key: KAFKA-8326
> URL: https://issues.apache.org/jira/browse/KAFKA-8326
> Project: Kafka
> Issue Type: Improvement
> Components: clients, streams
>Reporter: Daniyar Yeralin
>Assignee: Daniyar Yeralin
>Priority: Minor
> Labels: kip
>
> _This ticket proposes adding new {color:#4c9aff}ListSerializer{color} and
> {color:#4c9aff}ListDeserializer{color} classes as well as support for the new
> classes into the Serdes class. This will allow using List Serde of type_
> {color:#4c9aff}_, T>_{color} _directly from Consumers,
> Producers and Streams._
> _{color:#4c9aff}List{color} serialization and deserialization will be done
> through repeatedly calling a serializer/deserializer for each entry provided
> by passed generic {color:#4c9aff}T{color}'s Serde. For example, if you want
> to create List of Strings serde, then serializer/deserializer of StringSerde
> will be used to serialize/deserialize each entry in
> {color:#4c9aff}List{color}._
> I believe there are many use cases where List Serde could be used. Ex.
> [https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows],
>
> [https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api]
> For instance, aggregate grouped (by key) values together in a list to do
> other subsequent operations on the collection.
> KIP Link:
> [https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (KAFKA-8326) Add List Serde
[
https://issues.apache.org/jira/browse/KAFKA-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniyar Yeralin updated KAFKA-8326:
---
Description:
_This ticket proposes adding new {color:#4c9aff}ListSerializer{color} and
{color:#4c9aff}ListDeserializer{color} classes as well as support for the new
classes into the Serdes class. This will allow using List Serde of type_
{color:#4c9aff}_, T>_{color} _directly from Consumers,
Producers and Streams._
_{color:#4c9aff}List{color} serialization and deserialization will be done
through repeatedly calling a serializer/deserializer for each entry provided by
passed generic {color:#4c9aff}T{color}'s Serde. For example, if you want to
create List of Strings serde, then serializer/deserializer of StringSerde will
be used to serialize/deserialize each entry in
{color:#4c9aff}List{color}._
I believe there are many use cases where List Serde could be used. Ex.
[https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows],
[https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api]
For instance, aggregate grouped (by key) values together in a list to do other
subsequent operations on the collection.
KIP Link:
[https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization]
was:
_This ticket proposes adding new ListSerializer and ListDeserializer classes as
well as support for the new classes into the Serdes class. This will allow
using List Serde of type T directly from Consumers, Producers and Streams._
_List serialization and deserialization will be done through repeatedly
calling a serializer/deserializer for each entry provided by passed generic T's
Serde. For example, if you want to create List of Strings serde, then
serializer/deserializer of StringSerde will be used to serialize/deserialize
each entry in `List`._
I believe there are many use cases where List Serde could be used. Ex.
[https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows],
[https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api]
For instance, aggregate grouped (by key) values together in a list to do other
subsequent operations on the collection.
KIP Link:
[https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization]
> Add List Serde
> -
>
> Key: KAFKA-8326
> URL: https://issues.apache.org/jira/browse/KAFKA-8326
> Project: Kafka
> Issue Type: Improvement
> Components: clients, streams
>Reporter: Daniyar Yeralin
>Assignee: Daniyar Yeralin
>Priority: Minor
> Labels: kip
>
> _This ticket proposes adding new {color:#4c9aff}ListSerializer{color} and
> {color:#4c9aff}ListDeserializer{color} classes as well as support for the new
> classes into the Serdes class. This will allow using List Serde of type_
> {color:#4c9aff}_, T>_{color} _directly from Consumers,
> Producers and Streams._
> _{color:#4c9aff}List{color} serialization and deserialization will be done
> through repeatedly calling a serializer/deserializer for each entry provided
> by passed generic {color:#4c9aff}T{color}'s Serde. For example, if you want
> to create List of Strings serde, then serializer/deserializer of StringSerde
> will be used to serialize/deserialize each entry in
> {color:#4c9aff}List{color}._
> I believe there are many use cases where List Serde could be used. Ex.
> [https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows],
>
> [https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api]
> For instance, aggregate grouped (by key) values together in a list to do
> other subsequent operations on the collection.
> KIP Link:
> [https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (KAFKA-8326) Add List Serde
[ https://issues.apache.org/jira/browse/KAFKA-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniyar Yeralin updated KAFKA-8326: --- Description: _This ticket proposes adding new ListSerializer and ListDeserializer classes as well as support for the new classes into the Serdes class. This will allow using List Serde of type T directly from Consumers, Producers and Streams._ _List serialization and deserialization will be done through repeatedly calling a serializer/deserializer for each entry provided by passed generic T's Serde. For example, if you want to create List of Strings serde, then serializer/deserializer of StringSerde will be used to serialize/deserialize each entry in `List`._ I believe there are many use cases where List Serde could be used. Ex. [https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows], [https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api] For instance, aggregate grouped (by key) values together in a list to do other subsequent operations on the collection. KIP Link: [https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization] was: I propose _adding new ListSerializer and ListDeserializer classes as well as support for the new classes into the Serdes class. This will allow using List Serde directly from Consumers, Producers and Streams._ _List serialization and deserialization will be done through repeatedly calling a serializer/deserializer for each entry provided by passed generic T's Serde._ _For example, if you want to create List of Strings serde, you will have to declare `new ListSerde<>(Serdes.String())`, in this case serializer/deserializer of String Serde will be used to serialize/deserialize each entry in `List`._ I believe there are many use cases where List Serde could be used. Ex. [https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows], [https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api] For instance, aggregate grouped (by key) values together in a list to do other subsequent operations on the collection. KIP Link: [https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization] > Add List Serde > - > > Key: KAFKA-8326 > URL: https://issues.apache.org/jira/browse/KAFKA-8326 > Project: Kafka > Issue Type: Improvement > Components: clients, streams >Reporter: Daniyar Yeralin >Assignee: Daniyar Yeralin >Priority: Minor > Labels: kip > > _This ticket proposes adding new ListSerializer and ListDeserializer classes > as well as support for the new classes into the Serdes class. This will allow > using List Serde of type T directly from Consumers, Producers and Streams._ > _List serialization and deserialization will be done through repeatedly > calling a serializer/deserializer for each entry provided by passed generic > T's Serde. For example, if you want to create List of Strings serde, then > serializer/deserializer of StringSerde will be used to serialize/deserialize > each entry in `List`._ > I believe there are many use cases where List Serde could be used. Ex. > [https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows], > > [https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api] > For instance, aggregate grouped (by key) values together in a list to do > other subsequent operations on the collection. > KIP Link: > [https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KAFKA-8326) Add List Serde
[ https://issues.apache.org/jira/browse/KAFKA-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniyar Yeralin updated KAFKA-8326: --- Description: I propose _adding new ListSerializer and ListDeserializer classes as well as support for the new classes into the Serdes class. This will allow using List Serde directly from Consumers, Producers and Streams._ _List serialization and deserialization will be done through repeatedly calling a serializer/deserializer for each entry provided by passed generic T's Serde._ _For example, if you want to create List of Strings serde, you will have to declare `new ListSerde<>(Serdes.String())`, in this case serializer/deserializer of String Serde will be used to serialize/deserialize each entry in `List`._ I believe there are many use cases where List Serde could be used. Ex. [https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows], [https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api] For instance, aggregate grouped (by key) values together in a list to do other subsequent operations on the collection. KIP Link: [https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization] was: I propose _adding new ListSerializer and ListDeserializer classes as well as support for the new classes into the Serdes class. This will allow using List Serde directly from Consumers, Producers and Streams._ _List serialization and deserialization will be done through repeatedly calling a serializer/deserializer for each entry provided by passed generic T's Serde._ _For example, if you want to create List of Strings serde, you will have to declare `new Serdes.ListSerde<>(Serdes.String(), Comparator.comparing(String::length))`, in this case serializer/deserializer of String Serde will be used to serialize/deserialize each entry in `List`._ I believe there are many use cases where List Serde could be used. Ex. [https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows], [https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api] For instance, aggregate grouped (by key) values together in a list to do other subsequent operations on the collection. KIP Link: [https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization] > Add List Serde > - > > Key: KAFKA-8326 > URL: https://issues.apache.org/jira/browse/KAFKA-8326 > Project: Kafka > Issue Type: Improvement > Components: clients, streams >Reporter: Daniyar Yeralin >Assignee: Daniyar Yeralin >Priority: Minor > Labels: kip > > I propose _adding new ListSerializer and ListDeserializer classes as well as > support for the new classes into the Serdes class. This will allow using > List Serde directly from Consumers, Producers and Streams._ > _List serialization and deserialization will be done through repeatedly > calling a serializer/deserializer for each entry provided by passed generic > T's Serde._ > _For example, if you want to create List of Strings serde, you will have to > declare `new ListSerde<>(Serdes.String())`, in this case > serializer/deserializer of String Serde will be used to serialize/deserialize > each entry in `List`._ > I believe there are many use cases where List Serde could be used. Ex. > [https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows], > > [https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api] > For instance, aggregate grouped (by key) values together in a list to do > other subsequent operations on the collection. > > KIP Link: > [https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KAFKA-8326) Add List Serde
[ https://issues.apache.org/jira/browse/KAFKA-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniyar Yeralin updated KAFKA-8326: --- Description: I propose _adding new ListSerializer and ListDeserializer classes as well as support for the new classes into the Serdes class. This will allow using List Serde directly from Consumers, Producers and Streams._ _List serialization and deserialization will be done through repeatedly calling a serializer/deserializer for each entry provided by passed generic T's Serde._ _For example, if you want to create List of Strings serde, you will have to declare `new Serdes.ListSerde<>(Serdes.String(), Comparator.comparing(String::length))`, in this case serializer/deserializer of String Serde will be used to serialize/deserialize each entry in `List`._ I believe there are many use cases where List Serde could be used. Ex. [https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows], [https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api] For instance, aggregate grouped (by key) values together in a list to do other subsequent operations on the collection. KIP Link: [https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization] was: I propose adding serializers and deserializers for the java.util.List class. I have many use cases where I want to set the key of a Kafka message to be a UUID. Currently, I need to turn UUIDs into strings or byte arrays and use their associated Serdes, but it would be more convenient to serialize and deserialize UUIDs directly. I believe there are many use cases where one would want to have a List serde. Ex. [https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows], [https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api] KIP Link: [https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization] > Add List Serde > - > > Key: KAFKA-8326 > URL: https://issues.apache.org/jira/browse/KAFKA-8326 > Project: Kafka > Issue Type: Improvement > Components: clients, streams >Reporter: Daniyar Yeralin >Assignee: Daniyar Yeralin >Priority: Minor > Labels: kip > > I propose _adding new ListSerializer and ListDeserializer classes as well as > support for the new classes into the Serdes class. This will allow using > List Serde directly from Consumers, Producers and Streams._ > _List serialization and deserialization will be done through repeatedly > calling a serializer/deserializer for each entry provided by passed generic > T's Serde._ > _For example, if you want to create List of Strings serde, you will have to > declare `new Serdes.ListSerde<>(Serdes.String(), > Comparator.comparing(String::length))`, in this case serializer/deserializer > of String Serde will be used to serialize/deserialize each entry in > `List`._ > I believe there are many use cases where List Serde could be used. Ex. > [https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows], > > [https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api] > For instance, aggregate grouped (by key) values together in a list to do > other subsequent operations on the collection. > > KIP Link: > [https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KAFKA-8326) Add List Serde
[ https://issues.apache.org/jira/browse/KAFKA-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-8326: --- Labels: kip (was: ) > Add List Serde > - > > Key: KAFKA-8326 > URL: https://issues.apache.org/jira/browse/KAFKA-8326 > Project: Kafka > Issue Type: Improvement > Components: clients, streams >Reporter: Daniyar Yeralin >Priority: Minor > Labels: kip > > I propose adding serializers and deserializers for the java.util.List class. > I have many use cases where I want to set the key of a Kafka message to be a > UUID. Currently, I need to turn UUIDs into strings or byte arrays and use > their associated Serdes, but it would be more convenient to serialize and > deserialize UUIDs directly. > I believe there are many use cases where one would want to have a List serde. > Ex. > [https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows], > > [https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api] > > KIP Link: > [https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
