gaoran10 edited a comment on issue #7407:
URL: https://github.com/apache/pulsar/issues/7407#issuecomment-698094497
@fmiguelez Sorry, late response.
1. `producer.newMessage().key("1").send()`
Currently, if we send messages as above the message payload is
`ByteBuffer.allocate(0)`, thus if the topic with Avro schema, the decoder can't
decode an empty byte array, this will cause java.io.EOFException as below.
```
org.apache.pulsar.client.api.SchemaSerializationException:
java.io.EOFException
at
org.apache.pulsar.client.impl.schema.reader.AvroReader.read(AvroReader.java:77)
at
org.apache.pulsar.client.api.schema.SchemaReader.read(SchemaReader.java:36)
at
org.apache.pulsar.client.impl.schema.StructSchema.decode(StructSchema.java:107)
at
org.apache.pulsar.client.impl.MessageImpl.getValue(MessageImpl.java:301)
at
org.apache.pulsar.broker.transaction.TransactionProduceTest.test(TransactionProduceTest.java:639)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)
at org.testng.internal.Invoker.invokeMethod(Invoker.java:583)
at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:719)
at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:989)
at
org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)
at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109)
at org.testng.TestRunner.privateRun(TestRunner.java:648)
at org.testng.TestRunner.run(TestRunner.java:505)
at org.testng.SuiteRunner.runTest(SuiteRunner.java:455)
at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:450)
at org.testng.SuiteRunner.privateRun(SuiteRunner.java:415)
at org.testng.SuiteRunner.run(SuiteRunner.java:364)
at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:84)
at org.testng.TestNG.runSuitesSequentially(TestNG.java:1208)
at org.testng.TestNG.runSuitesLocally(TestNG.java:1137)
at org.testng.TestNG.runSuites(TestNG.java:1049)
at org.testng.TestNG.run(TestNG.java:1017)
at com.intellij.rt.testng.IDEARemoteTestNG.run(IDEARemoteTestNG.java:66)
at
com.intellij.rt.testng.RemoteTestNGStarter.main(RemoteTestNGStarter.java:110)
Caused by: java.io.EOFException
at org.apache.avro.io.BinaryDecoder.ensureBounds(BinaryDecoder.java:509)
at org.apache.avro.io.BinaryDecoder.readInt(BinaryDecoder.java:149)
at org.apache.avro.io.BinaryDecoder.readIndex(BinaryDecoder.java:460)
at
org.apache.avro.io.ResolvingDecoder.readIndex(ResolvingDecoder.java:282)
at
org.apache.avro.generic.GenericDatumReader.readWithoutConversion(GenericDatumReader.java:178)
at
org.apache.avro.reflect.ReflectDatumReader.readField(ReflectDatumReader.java:290)
at
org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:237)
at
org.apache.avro.specific.SpecificDatumReader.readRecord(SpecificDatumReader.java:123)
at
org.apache.avro.generic.GenericDatumReader.readWithoutConversion(GenericDatumReader.java:170)
at
org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:151)
at
org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:144)
at
org.apache.pulsar.client.impl.schema.reader.AvroReader.read(AvroReader.java:75)
... 28 more
```
2. `producer.newMessage().key("1").value(null).send()`
If we specify the value is null, the messageMetaData will record the flag
`msgMetadataBuilder.setNullValue(true)`, the consumer client will check the
nullValue flag before schema decoder decode the payload, if the flag is true
will return null value directly.
3. Currently, the message value has three forms, normal value, empty byte
array, and null value, if topics use the Avro schema consumer couldn't handle
the empty byte array payload, maybe the consumer should return a null value for
the empty byte array.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
