[
https://issues.apache.org/jira/browse/BEAM-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17170356#comment-17170356
] Luke Cwik commented on BEAM-10529: ---------------------------------- It seems like one that might be worthwhile to make well known, alternatively we use RowCoder since it should support null fields. > Kafka XLang fails for ?empty? key/values > ---------------------------------------- > > Key: BEAM-10529 > URL: https://issues.apache.org/jira/browse/BEAM-10529 > Project: Beam > Issue Type: Bug > Components: io-java-kafka, sdk-py-core > Reporter: Luke Cwik > Priority: P2 > > It looks like the Javadoc for ByteArrayDeserializer and StringDeserializer > can return null[1, 2] and we aren't using > NullableCoder.of(ByteArrayCoder.of()) in the expansion[3]. Note that KafkaIO > does this correctly in its regular coder inference logic[4]. > 1: > https://kafka.apache.org/21/javadoc/org/apache/kafka/common/serialization/ByteArrayDeserializer.html#deserialize-java.lang.String-byte:A-2: > > https://kafka.apache.org/21/javadoc/org/apache/kafka/common/serialization/StringDeserializer.html#deserialize-java.lang.String-byte:A- > 3: > https://github.com/apache/beam/blob/af2d6b0379d64b522ecb769d88e9e7e7b8900208/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaIO.java#L478 > 4: > https://github.com/apache/beam/blob/af2d6b0379d64b522ecb769d88e9e7e7b8900208/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/LocalDeserializerProvider.java#L85 -- This message was sent by Atlassian Jira (v8.3.4#803005)
